🚧 📱

Mobile experience coming soon

Mobile development is in progress. Until it is complete, please use your desktop or laptop.

Thanks!

← Back
AI Engineer July 26, 2025

Introduction to LLM serving with SGLang - Philip Kiely and Yineng Zhang, Baseten

Summary

The transcript introduces SG Lang, an open-source serving framework for large language and vision models, designed to provide high-performance model deployment across various GPUs. Key subjects include the framework's features such as production readiness, day-zero support for new model releases, and a strong community-driven approach that encourages user contributions and problem-solving. The workshop aims to help participants of all skill levels become comfortable with SG Lang, offering an introduction to its capabilities, history, and potential for optimizing model performance and deployment.

View original episode ↗