Common Crawl Foundation

Enterprise

non-profit

https://commoncrawl.org

commoncrawl

Activity Feed

AI & ML interests

Crawled data and metadata

Recent Activity

tvaughan updated a dataset 4 days ago

commoncrawl/statistics

greglindahl published a dataset 15 days ago

commoncrawl/host-index-testing-v2

tvaughan updated a dataset 2 months ago

commoncrawl/statistics

View all activity

commoncrawl's activity

tvaughan

updated a dataset 4 days ago

commoncrawl/statistics

Viewer • Updated 4 days ago • 563k • 481 • 22

greglindahl

published a dataset 15 days ago

commoncrawl/host-index-testing-v2

Updated 15 days ago • 64

greglindahl

authored a paper 4 months ago

Towards Best Practices for Open Datasets for LLM Training

Paper • 2501.08365 • Published Jan 14 • 63

greglindahl

updated a Space 6 months ago

README

🌍

Explore Common Crawl's metadata and experimental datasets

tvaughan

updated a Space 6 months ago

README

🌍

Explore Common Crawl's metadata and experimental datasets

greglindahl

updated a dataset 7 months ago

commoncrawl/eot2024_hostlevel_logs

Viewer • Updated Oct 9, 2024 • 271k • 19 • 1

greglindahl

updated a dataset 8 months ago

commoncrawl/citations

Viewer • Updated Sep 22, 2024 • 8.48k • 199

greglindahl

updated a dataset 9 months ago

commoncrawl/citations-annotated

Viewer • Updated Aug 6, 2024 • 424 • 193

jenglish-cc

updated a Space 10 months ago

README

🌍

Explore Common Crawl's metadata and experimental datasets

pjox

authored a paper 11 months ago

mOSCAR: A Large-scale Multilingual and Multimodal Document-level Corpus

Paper • 2406.08707 • Published Jun 13, 2024 • 16

pjox

authored a paper over 1 year ago

CamemBERT: a Tasty French Language Model

Paper • 1911.03894 • Published Nov 10, 2019 • 3

pjox

authored a paper about 2 years ago

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Paper • 2211.05100 • Published Nov 9, 2022 • 31

AI & ML interests

Recent Activity

Team members 8

commoncrawl's activity

README

README

README