Hamel Husain
@hamelhusain
Q: Should I build automated evaluators for every failure mode I find?
A: No. Different types of evaluators have different costs (code vs. LLM judge), which you need to weigh before building an eval.
https://hamel.dev/blog/posts/evals-faq/should-i-build-automated-evaluators-for-every-failure-mode-i-find.html
