Temperature 0 for anything with a right answer
Classification, extraction, routing, yes or no. Sampling adds variance and the eval numbers wobble for no reason. Set it to zero and the same input gives the same output, which is what a test needs.
Leave temperature for generation where variety is the point, and even then, lower than the default is usually better for anything a customer reads.
ai-engineeringllm