BigCodeArena: Judging code generations end to end with code executions
•
21
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Articles
Running
37
BigCodeArena
🚀
Compare two AI models by sending them code and seeing their responses
Running
BigCodeBench Evaluator
🥇
Evaluate code samples using specified parameters
Running
on
CPU Upgrade
18
BigCodeBench Evaluator
🥇
Evaluate code samples using specified parameters
Running
230
BigCodeBench Leaderboard
🥇
Explore code-generation model leaderboards and task details
Running
25
BigCode Model License Agreement
🤝
Display a PDF file in a web app
Runtime error
BigCodeBench Interaction
🥇
Running
1.49k
Big Code Models Leaderboard
📈
Explore and submit code model evaluations on a leaderboard
Runtime error
BigCodeBench Evaluator
🥇
Running
README
✨
Running
on
CPU Upgrade
Featured
91
Am I in The Stack?
📑
Check if your GitHub repo is in The Stack dataset
Running
14
StarCoder2 Search
🔎
Search for code snippets in a dataset
Sleeping
3
Data Inspection
🕵
Running
40
StarCoder Search
🔎
Search code snippets in the StarCoder dataset for matches
Runtime error
15
Near Deduplication
⚡
Runtime error
13
OctoCoder Demo
🐙
Runtime error
1
In The CommitPack
👁
Sleeping
Stack V2 Extensions
🏆
Runtime error
Featured
415
BigCode - Playground
🪐
Running
Featured
32
Reasoning With StarCoder
🧐
Generate and run Python code from natural language queries
Running
54
BigCode - Editor
💻
Deploy a web application server
Runtime error
10
Santa Explains Code
🎅
Runtime error
Featured
169
SantaCoder Demo
🎅
Generate code snippets in Python, Java, JavaScript
Build error
Tokenizer Testing
😻
Runtime error
Bot Issues Visualization
🐨