Long Code Arena

Long Code Arena is a suite of benchmarks for code-related tasks with large contexts, up to a whole code repository. It currently spans six different tasks and contains six datasets: Library-based code generation, CI builds repair, Project-level code completion, Commit message generation, Bug localization, Module summarization Data Paper pre-print