🚧 📱

Mobile experience coming soon

Mobile development is in progress. Until it is complete, please use your desktop or laptop.

Thanks!

← Back
AI Engineer August 6, 2025

Evals Are Not Unit Tests — Ido Pesok, Vercel v0

Summary

Ido from Verscell discusses Vzero, a full-stack coding platform that enables rapid web prototyping and idea expression, while highlighting the inherent unreliability of large language models (LLMs) through a humorous example of a fruit letter counting app. The presentation explores the challenges of building AI applications, emphasizing that inconsistent AI responses can render products unusable and underscoring the critical need for robust evaluation at the application layer. The key takeaway is that while AI technologies offer tremendous potential, developers must rigorously test and validate AI-generated outputs to ensure practical, dependable user experiences.

View original episode ↗