Commit Message Edits

This is a dataset of expert-labeled edits to commit messages generated by GPT-4. Labelers were presented with GPT-4 generated messages for 15 commits from CMG benchmark from Long Code Arena and asked to manually edit them to be of good enough quality to submit to VCS. Data Paper Paper pre-print