HuggingFaceFW/fineweb-2

Permissive or share-alike

The declared licence (odc-by) is classified as permissive.

Licence facts reported by the dataset and its declared sources. Not legal advice, and not a grant of permission to use the dataset.

Evidence

Declared licence: odc-by (from the tag)
Licence files: no licence file at the top level of the repository
Access gated on Hugging Face: no

Declared sources

No source datasets listed in the card metadata.

Signal

See all datasets marked Permissive or share-alike.

Tasks

text-generation

Citation text from the card

@misc{penedo2025fineweb2pipelinescale,
  title={FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language}, 
  author={Guilherme Penedo and Hynek Kydlíček and Vinko Sabolčec and Bettina Messmer and Negar Foroutan and Amir Hossein Kargaran and Colin Raffel and Martin Jaggi and Leandro Von Werra and Thomas Wolf},
  year={2025},
  eprint={2506.20920},
  archivePrefix={arXiv},
  primaryClass={cs.CL},
  url={https://arxiv.org/abs/2506.20920}, 
}

Downloads (30 days): 133446. Likes: 919. Last modified: 2025-10-27T18:32:07.000Z.

View HuggingFaceFW/fineweb-2 on Hugging Face | JSON