BigCodeArena: Judging code generations end to end with code executions
•
21
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Articles
bigcode/autocodearena-v0
Viewer
•
Updated
•
600
•
21
•
2
bigcode/bigcodereward
Viewer
•
Updated
•
4.73k
•
64
•
2
bigcode/bigcodereward-experiment-results
Viewer
•
Updated
•
141k
•
87
bigcode/bigcodearena-preference-5k
Viewer
•
Updated
•
4.73k
•
62
•
1
bigcode/bigcodearena-raw-14k
Viewer
•
Updated
•
14.1k
•
33
•
2
bigcode/humanevalpack
Viewer
•
Updated
•
984
•
1.72k
•
91
bigcode/bigcodebench
Viewer
•
Updated
•
5.7k
•
17.5k
•
76
bigcode/governance-card
Updated
•
387
•
12
bigcode/bigcodebench-hard-results
Viewer
•
Updated
•
202
•
56
•
1
bigcode/bigcodebench-hard-solve-rate
Viewer
•
Updated
•
296
•
33
•
1
bigcode/bigcodebench-hard-domain
Viewer
•
Updated
•
372
•
27
•
1
bigcode/bigcodebench-hard-perf
Viewer
•
Updated
•
372
•
10
bigcode/bigcodebench-results
Viewer
•
Updated
•
202
•
58
•
2
bigcode/bigcodebench-solve-rate
Viewer
•
Updated
•
2.28k
•
54
bigcode/bigcodebench-domain
Viewer
•
Updated
•
279
•
14
bigcode/bigcodebench-perf
Viewer
•
Updated
•
279
•
10
bigcode/starcoder2data-extras
Viewer
•
Updated
•
51.6M
•
873
•
11
bigcode/bigcodebench-hard
Viewer
•
Updated
•
740
•
9k
•
3
bigcode/commitpack
Updated
•
15.5k
•
77
bigcode/bigcodebench-hard-elo
Viewer
•
Updated
•
268
•
20
bigcode/bigcodebench-elo
Viewer
•
Updated
•
222
•
65
bigcode/self-oss-instruct-sc2-exec-filter-50k
Viewer
•
Updated
•
50.7k
•
1.2k
•
105
bigcode/starcoder2-instruct-assets
Viewer
•
Updated
•
5
•
910
bigcode/MultiPL-E-completions
Viewer
•
Updated
•
20.3k
•
2.75k
•
8
bigcode/bigcodebench-tool
Viewer
•
Updated
•
148
•
5
•
1
bigcode/bcb_update
Viewer
•
Updated
•
4
•
11
•
1
bigcode/big-fc-script
Viewer
•
Updated
•
336
•
51
bigcode/bigcodebench-hard-test-elo
Viewer
•
Updated
•
160
•
9
bigcode/bigcodebench-instruct-perf
Updated
•
85
bigcode/bigcodebench-complete-perf
Updated
•
39