🚧 📱

Mobile experience coming soon

Mobile development is in progress. Until it is complete, please use your desktop or laptop.

Thanks!

← Back
Aaron Zisk March 14, 2025

DeepSeek 671B params on Mac Studio

Summary

The transcript discusses a technical experiment running a massive 671 billion parameter deep seek model quantized to reduce computational requirements, with the speaker noting RAM usage of around 14.89 gigabytes and using only 175 for processing. The model was tested by requesting a JavaScript function, which produced a result that appeared syntactically correct, suggesting potential effectiveness of the quantization technique. The key takeaway is the successful demonstration of running a large language model with significantly reduced computational resources while maintaining a basic level of functional output.

View original episode ↗