Temperature 0 for anything with a right answer
For classification, extraction, routing or a yes or no, sampling only adds variance, and your eval numbers wobble for no reason. At zero, the same input gives the same output, which is what a test needs.
Save temperature for generation, where variety is the point. Even there, going lower than the default is usually better for anything a customer reads.
ai-engineeringllm