Adapting Code LLMs to Domain-specific Languages via Synthethic Instruction Generation and Reinforcement Learning with AI Feedback in Low-resource Settings
Large Language Models (LLMs) have significantly advanced automatic code generation in mainstream, high-resource, general-purpose programming languages. These models are trained on large instruction-code datasets with executable test environments, which can benchmark the performance of the outputs. However, they typical...