LLM judges in production: sample them, don't trust them blindly
Using a model to grade your agent's output is useful and cheap to start. Here is how to keep it honest: sample, calibrate against people, keep it apart from hard outcomes, and watch what it costs.
Read post →