This paper introduces PR4Code, a dataset of 4,508 Java and 8,831 Python curated Pull Requests collected from GitHub, each enriched with metadata, commit histories, and detailed code changes, revealing substantial variability in PR structure, commit granularity, and textual content.
Abstract
AI-driven code generation is evolving from handling small, localized code-completion tasks toward supporting the implementation of full software features. To support this transition, this paper introduces PR4Code, a dataset of 4,508 Java and 8,831 Python curated Pull Requests (PRs) collected from GitHub, each enriched with metadata, commit histories, and detailed code changes. Unlike resources focused on isolated code fragments, PR4Code captures the feature implementation process, delivering a large and diverse collection of real-world development tasks that can be used to assess AI-driven solutions. Our analysis reveals substantial variability in PR structure, commit granularity, and textual content. In addition, we release scripts to regenerate and update the dataset, ensuring reproducibility and maintainability.
Large language models are paving the way towards innovation by understanding, analyzing, summarizing and generating content in the modern world. Currently there are thousands of LLM projects developed by engineers in open-source repositories. However, whether these LLM projects have underlying patterns or not remains a...
The Provable Representation Of Original Functionality (PROOF) is introduced, which manages codebases indirectly via structured specifications via structured specifications to enable full-lifecycle codebase management strictly through these specifications.
XinHao Zhang, Jing-Jie Lu, Kun-Peng Liu et al.· 0 citations
Public PRs and CVE advisories are valuable sources for Go concurrency-bug research, but rarely provide executable benchmark samples because historical projects are difficult to rebuild and many fixes lack reusable triggering tests. We present PR2Trigger, a semi-automated pipeline that reconstructs PR-localized triggeri...
Risheng Wei, Yu-Heng Shen, Yi-Ming Ye et al.· Proceedings of the 41st IEEE...· 0 citations
Legacy COBOL mainframes resist APIfication due to monolithic structure and scattered logic. We present a novel pipeline that takes code blocks selected and validated by the user, potentially with AI-assisted boundary suggestions, and generates compilable API modules with request/response copybooks. Key innovations incl...
Vini Kanvar, Ashwin Dhinesh Kumar, Keerthi Narayan Raghunath· Proceedings of the 2nd Inter...· 1 citation
Structured prompting routinely improves general LLM reasoning, but whether it transfers to code generation remains underexplored even as coding tools add template layers around user requests. We compare three levels of automatically imposed prompt structure, from free-form instructions over a static component template...
Yue-Tian Mao· Proceedings of the 41st IEEE...· 0 citations
Recent advances in large language models (LLMs) for code generation have given rise to vibe coding, a programming practice in which developers interact with LLMs through unstructured natural language and primarily validate implementations by inspecting overall execution outputs. However, the inherent ambiguity and inco...
Rui-Rui He, Han-Qing Lu, Le-Zhi Ma et al.· Proceedings of the 41st IEEE...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
