The Role of AI in Application Development: A Comparative Study with Manual Coding
TL;DR
It is concluded that AI meaningfully augments developer productivity but does not yet demonstrably improve satisfaction or earnings, and that a hybrid human-AI model, supported by governance and training, remains the most defensible direction for application development.
Abstract
Application development has traditionally depended on manual coding, in which developers write every line of code themselves. This approach offers precision and control, but it is time-consuming, labour-intensive and prone to human error. The emergence of Artificial Intelligence (AI) has introduced tools that generate, test, debug and optimise code, raising the question of how AI-assisted development actually compares with manual practice. This paper presents a comparative study of the two approaches using secondary data from the Stack Overflow Annual Developer Survey 2024, comprising 65,437 responses from developers across 185 countries. Seven hypotheses were formulated covering productivity, job satisfaction, accuracy, compensation, challenges, sentiment and instrument reliability, and were tested using non-parametric methods (Mann-Whitney U, chi-square) at a 5% significance level. The job-satisfaction scale demonstrated excellent internal consistency (Cronbach's alpha = 0.931, 9 items, n = 29,095). The analysis found that 57.6% of respondents currently use AI tools, that 81.0% of adopters identify increased productivity as a benefit, and that 72.0% hold a favourable or very favourable view of AI. However, two widely assumed advantages did not survive testing. The difference in job satisfaction between AI users and manual coders was statistically significant but negligible in magnitude (means 6.97 vs 6.89; Cohen's d = 0.039). The apparent compensation advantage reversed direction once national context was controlled: pooled data showed manual coders earning more, yet within the United States alone the difference disappeared entirely (p = 0.203), indicating that the pooled gap is a confound arising from higher AI adoption in lower-income economies rather than an effect of AI itself. Trust remains the principal barrier, with 65.1% of respondents distrusting AI output and 61.9% reporting that AI tools lack context of their codebase. The study concludes that AI meaningfully augments developer productivity but does not yet demonstrably improve satisfaction or earnings, and that a hybrid human-AI model, supported by governance and training, remains the most defensible direction for application development