Unreliable in Practice? A Comprehensive Study of Errors in LLM-Generated Code
It is observed that generated code often omits basic input validation or memory-safety checks, which can lead to overflows, resource exhaustion, or other reliability/security issues, and even the largest models frequently make simple mistakes.