Can you prove AI ROI in Software Eng? (Stanford 120k Devs Study) – Yegor Denisov-Blanch, Stanford
Summary
The transcript explores the impact of AI tools on software engineering productivity through a comprehensive research study that developed a machine learning model to evaluate code commits across multiple dimensions. By comparing 46 AI-using teams with 46 non-AI teams, the research reveals a median productivity gain of 10% and highlights a growing performance disparity between top and bottom performers. The key takeaway is that companies must proactively measure and understand their AI adoption strategy to avoid falling behind, as early successful adopters are likely to compound their gains while struggling teams risk further decline.