🚧 📱

Mobile experience coming soon

Mobile development is in progress. Until it is complete, please use your desktop or laptop.

Thanks!

← Back
AI Engineer December 26, 2025

Shipping AI That Works: An Evaluation Framework for PMs – Aman Khan, Arize

Summary

The transcript discusses the role of AI product managers and frameworks for shipping effective AI applications, focusing on evaluation systems across different tech domains like self-driving cars, recommendation systems, and generative AI. The speaker, Aman, shares his professional journey from engineering to product management at companies like Cruz, Spotify, and Arise, working on AI evaluation technologies for major tech companies such as Uber, Instacart, and Reddit. The key takeaway is the critical importance of developing robust evaluation frameworks to ensure AI agents and applications perform as expected, highlighting the evolving landscape of AI product management.

View original episode ↗