🚧 📱

Mobile experience coming soon

Mobile development is in progress. Until it is complete, please use your desktop or laptop.

Thanks!

← Back
AI Engineer June 27, 2025

Foundry Local: Cutting-Edge AI experiences on device with ONNX Runtime/Olive — Emma Ning, Microsoft

Summary

This discussion centers on Microsoft's Foundry Local, a tool enabling cross-platform AI applications powered by local AI. Key reasons for local AI's importance include handling network limitations, ensuring data privacy and security, and achieving cost efficiency and real-time latency. The practical takeaway is that decades of hardware advancements and optimized models now make local AI a viable reality, with Microsoft providing robust assets like Azure AI Foundry and the ONNX Runtime to facilitate its implementation.

View original episode ↗