|
--- |
|
title: README |
|
emoji: π |
|
colorFrom: indigo |
|
colorTo: red |
|
sdk: static |
|
pinned: false |
|
--- |
|
|
|
# π Reasoning Datasets Competition |
|
|
|
> **TL;DR**: Bespoke Labs, Hugging Face, and Together.ai are launching a competition to find the most innovative reasoning datasets. Create a great proof-of-concept reasoning dataset and win prizes to help you scale your work! |
|
|
|
## π Current Submissions |
|
**Check out all the submissions made so far [here](https://huggingface.co/datasets?other=reasoning-datasets-competition&sort=created)** |
|
|
|
## π
Important Dates |
|
- **Launch Date**: April 9, 2025 |
|
- **NEW Submission Deadline**: May 9, 2025 (11:59 PM PT) (extended from May 1) |
|
- **Winners Announced**: May 19, 2025 |
|
|
|
## π‘ What We're Looking For |
|
We're seeking datasets that push the boundaries of AI reasoning across: |
|
|
|
### New Domains |
|
- Legal reasoning |
|
- Financial analysis |
|
- Literary interpretation |
|
- Ethics/philosophy |
|
|
|
### Novel Tasks |
|
- Structured data extraction |
|
- Zero-shot classification |
|
- Search improvement |
|
- Diagrammatic reasoning |
|
- Constraint satisfaction problems |
|
- Evidence evaluation |
|
- Counterfactual reasoning |
|
|
|
## π How to Participate |
|
1. Create a dataset with at least **100 examples** |
|
2. Upload to the **Hugging Face Hub** |
|
3. Tag it with `reasoning-datasets-competition` |
|
4. Include a detailed dataset card |
|
|
|
## π
Prizes |
|
- **First Place**: $1,500 API credits + $1,500 Amazon gift card + HF Pro subscription |
|
- **Runners-Up**: $500 Amazon gift card + HF Pro subscription |
|
- **Spotlight Awards**: 4 prizes of $250 each for innovative use of Curator |
|
- **All Participants**: $50 in Together.ai API credits |
|
|
|
## π How to Sign Up |
|
1. [Register here](https://forms.gle/gwvvvCKfmNJxVZDR6) to receive Together.ai credit and updates |
|
2. Join the [discussion thread](https://huggingface.co/reasoning-datasets-competition) |
|
3. Join `#reasoning-dataset-competition` on [Discord](https://discord.com/invite/KqpXvpzVBS) |
|
|
|
## π Resources |
|
- [GPU-based distillation example](https://colab.research.google.com/drive/1YoA23-cBcWpaSErULzBI2bo2LPGo37GQ) |
|
- [API-only distillation example](https://colab.research.google.com/drive/1Zfl3g7POsqqYQqkzXdyhYRSAymLhZugn?usp=sharing) |
|
- [Claude 3.7 Sonnet traces](https://docs.bespokelabs.ai/bespoke-curator/how-to-guides/getting-claude-3.7-sonnets-reasoning-traces) |
|
|
|
--- |
|
|
|
Learn more [here](https://huggingface.co/blog/bespokelabs/reasoning-datasets-competition) or join the discussion [here](https://huggingface.co/spaces/reasoning-datasets-competition/README/discussions). |
|
|
|
You can find all the submissions made so far [here](https://huggingface.co/datasets?other=reasoning-datasets-competition) |