🏆 Reasoning Datasets Competition

TL;DR: Bespoke Labs, Hugging Face, and Together.ai are launching a competition to find the most innovative reasoning datasets. Create a great proof-of-concept reasoning dataset and win prizes to help you scale your work!

👀 Current Submissions

Check out all the submissions made so far here

📅 Important Dates

• Launch Date: April 9, 2025
• NEW Submission Deadline: May 9, 2025 (11:59 PM PT) (extended from May 1)
• Winners Announced: May 21, 2025 (10 AM PT)

🥇 Results Announced

• Twitter
• Linkedin

💡 What We're Looking For

We're seeking datasets that push the boundaries of AI reasoning across:

New Domains

• Legal reasoning
• Financial analysis
• Literary interpretation
• Ethics/philosophy

Novel Tasks

• Structured data extraction
• Zero-shot classification
• Search improvement
• Diagrammatic reasoning
• Constraint satisfaction problems
• Evidence evaluation
• Counterfactual reasoning

🚀 How to Participate

1. Create a dataset with at least 100 examples
2. Upload to the Hugging Face Hub
3. Tag it with reasoning-datasets-competition
4. Include a detailed dataset card

🏅 Prizes

• First Place: $1,500 API credits + $1,500 Amazon gift card + HF Pro subscription
• Runners-Up: $500 Amazon gift card + HF Pro subscription
• Spotlight Awards: 4 prizes of $250 each for innovative use of Curator
• All Participants: $50 in Together.ai API credits

📝 How to Sign Up

1. Register here to receive Together.ai credit and updates
2. Join the discussion thread
3. Join #reasoning-dataset-competition on Discord

🔍 Resources

• GPU-based distillation example
• API-only distillation example
• Claude 3.7 Sonnet traces

Learn more here or join the discussion here.

You can find all the submissions made so far here