OctoPack: Instruction Tuning Code Large Language Models

Highlights: This paper demonstrates the instruct fine-tuning code for Language Model Models (LLMs) using public Github commit data. The proposed method achieves the highest HumanEval pass@1 accuracy among permissive licensed LLM models.