LLMs and models

Common Crawl

Reference entryTraining and benchmark datasets

Reference entryCommon Crawl

Common Crawl is a nonprofit repository of web-page snapshots, widely used as raw training data for search, language, and web research.

Where it sits