Agent Atlas

The Builders

Hamel Husain and Shreya Shankar

Teach evaluation of AI products.

Test your own product's failures, not leaderboard scores.

Steal this

  • Collect your product's real failures and test against those.

The lesson and the takeaways are our summary. Everything below is theirs, with where they said it.

How they work

Factual
  1. Their skills walk a coding agent through building evals for your product. (Hamel Husain and Shreya Shankar)

Where they talk and write

Interviews 53

47 older

Writing 47

41 older

Each link goes to the original page, newest first.