Hamel Husain
@hamelhusain
Q: How can I do AI evals when traces contain sensitive data?
A: Four approaches: negotiate access to a defined scope, work with authorized experts, redaction and synthetic data.
https://hamel.dev/blog/posts/evals-faq/how-can-i-do-error-analysis-when-production-traces-contain-sensitive-data.html
