Hamel Husain
@hamelhusain
Q: What should you do when your "gold" eval dataset becomes stale?
A: Use regular error analysis to find new problems. Keep updating your evals as your product and users change.
https://hamel.dev/blog/posts/evals-faq/what-should-i-do-when-my-gold-eval-dataset-becomes-stale.html