🚧 📱

Mobile experience coming soon

Mobile development is in progress. Until it is complete, please use your desktop or laptop.

Thanks!

← Back
AI Engineer June 30, 2025

Turning Fails into Features: Zapier’s Hard-Won Eval Lessons — Rafal Willinski, Vitor Balocco, Zapier

Summary

The main theme is the challenges of building robust AI agents and platforms for non-technical users, especially when dealing with the nondeterministic nature of both AI and users. Key subjects discussed include Zapier, AI agents, and the "blankchain" library, highlighting the complexity beyond initial prototyping. The practical takeaway is that building AI agents requires focusing on a "data flywheel" by diligently collecting actionable feedback, tool calls, and errors from user interactions to drive continuous improvement and evolution.

View original episode ↗