🚧 📱

Mobile experience coming soon

Mobile development is in progress. Until it is complete, please use your desktop or laptop.

Thanks!

← Back
AI Engineer June 27, 2025

Evals 101 — Doug Guthrie, Braintrust

Summary

This tech transcript introduces BrainTrust, an end-to-end developer platform for building AI products, focusing heavily on the concept of "evals" (evaluations). The speaker highlights the importance of rigorously testing AI applications, from local development through to production, using components like online scoring and human-in-the-loop feedback, to create a continuous improvement flywheel for GenAI applications. The core takeaway is that using BrainTrust's platform and SDK allows for seamless integration of these critical eval processes, enabling companies to ensure their AI products perform optimally in production.

View original episode ↗