🚧 📱

Mobile experience coming soon

Mobile development is in progress. Until it is complete, please use your desktop or laptop.

Thanks!

← Back
Aaron Zisk November 7, 2024

Running LLM Clusters on ALL THIS 🚀

Summary

The transcript discusses setting up a network-attached storage (NAS) system for clustered machine learning model training across multiple MacBooks. The speaker uses a TerraMaster SSD-based NAS with a 10GB network interface to create a shared storage location for large AI models, utilizing an open-source tool called EXO to distribute computational tasks across four different Mac machines. By configuring environmental variables and mapping network folders, the setup allows efficient model storage and collaborative processing without consuming individual machine storage. The practical takeaway is demonstrating a cost-effective and flexible approach to distributed AI model training using consumer-grade hardware and network storage.

View original episode ↗