🚧 📱

Mobile experience coming soon

Mobile development is in progress. Until it is complete, please use your desktop or laptop.

Thanks!

← Back
Aaron Zisk September 24, 2025

LLMs on a budget

Summary

The transcript explores the capabilities of small language models, focusing on their efficiency and potential in agentic AI, specifically demonstrating performance on an M1 MacBook Air. The speaker references a recent Nvidia paper about small language models and shares a personal example of using an 8 billion parameter model for video processing tasks. The key takeaway is that small AI models are becoming increasingly powerful and can run effectively on budget laptops with limited memory, challenging the previous notion that smaller models are inherently less capable.

View original episode ↗