Skip to content

.tip

· one of the small things

Temperature 0 for anything with a right answer

For classification, extraction, routing or a yes or no, sampling only adds variance, and your eval numbers wobble for no reason. At zero, the same input gives the same output, which is what a test needs.

Save temperature for generation, where variety is the point. Even there, going lower than the default is usually better for anything a customer reads.

ai-engineeringllm