AI-assisted Programming May Decrease the Productivity of Experienced Developers by Increasing Maintenance Burden
By: Feiyang , Xu , Poonacha K. Medappa and more
Potential Business Impact:
AI helps coders but makes experts fix more mistakes.
Generative AI solutions like GitHub Copilot have been shown to increase the productivity of software developers. Yet prior work remains unclear on the quality of code produced and the challenges of maintaining it in software projects. If quality declines as volume grows, experienced developers face increased workloads reviewing and reworking code from less-experienced contributors. We analyze developer activity in Open Source Software (OSS) projects following the introduction of GitHub Copilot. We find that productivity indeed increases. However, the increase in productivity is primarily driven by less-experienced (peripheral) developers. We also find that code written after the adoption of AI requires more rework. Importantly, the added rework burden falls on the more experienced (core) developers, who review 6.5% more code after Copilot's introduction, but show a 19% drop in their original code productivity. More broadly, this finding raises caution that productivity gains of AI may mask the growing burden of maintenance on a shrinking pool of experts.
Similar Papers
AI-assisted Programming May Decrease the Productivity of Experienced Developers by Increasing Maintenance Burden
General Economics
AI tools make coding faster, but experts fix more mistakes.
Echoes of AI: Investigating the Downstream Effects of AI Assistants on Software Maintainability
Software Engineering
AI helps programmers code faster, not worse.
How do Copilot Suggestions Impact Developers' Frustration and Productivity?
Software Engineering
Helps coders code faster, but can annoy experts.