Temperature controls how much an LLM is allowed to "improvise." Most agent templates ship with a default around 0.7 — tuned for natural-sounding conversation, not accuracy.
That's fine for a chatbot making small talk. It's a real problem for anything touching numbers, dates, or facts that need to be exactly right — an agent reading invoice data, quoting a price, or confirming an order total.
The fix:
for anything classification- or extraction-based (reading data, confirming facts, following a strict format), set temperature to 0.0–0.3. Save 0.7+ for genuinely creative tasks — writing a product description, brainstorming subject lines — where some variation is a feature, not a risk.
Comments
No comments yet — be the first.