Code Repair Training Data Created and Evaluation Released
A new code repair dataset enables engineers to test accuracy, improving fix rates from 17% to 40%.
A new code repair dataset presents 924 examples dealing with faults split across two files. This dataset allows engineers to test the model's accuracy. Fix rates improve from 17% with a base model to 40% with a fine-tuned model.