All datasets / r-three-moto

r-three-moto/pre-training-data

6,692 downloads in 30 days0 likesLast modified 16 Oct 2026View on Hugging Face

Permissive or share-alike

The declared licence (odc-by) is classified as permissive.

Declared licence: odc-by, from the tagEvidence: README.md at 624dc75
Licence files: No licence file at the top level of the repositoryEvidence: file list at 624dc75
Declared sources: None listed in the card metadata
Access gated on Hugging Face: No

Each cell links to what was checked: a file, a file list or a Hub record.

Tasks

text-generation

Citation text from the card

@inproceedings{altintas2026moto,
  title={{MoTo}: Mixture of Tokenizers Towards Fair Multilingual Language Modeling},
  author={G{\"u}l Sena Alt{\i}nta{\c{s}} and Colin Raffel},
  booktitle={The Fortieth Annual Conference on Neural Information Processing Systems},
  year={2026},
  url={https://openreview.net/forum?id=avjeUhPuC6}
}

@article{messmer2025multilingdatacomp,
  title={Enhancing Multilingual LLM Pretraining with Model-Based Data Selection},
  author={Bettina Messmer and Vinko Sabolčec and Martin Jaggi},
  journal={arXiv},
  year={2025},
  url={https://arxiv.org/abs/2502.10361},
}

@misc{lozhkov2024fineweb-edu,
  author       = { Lozhkov, Anton and Ben Allal, Loubna and von Werra, Leandro and Wolf, Thomas },
  title        = { FineWeb-Edu: the Finest Collection of Educational Content },
  year         = 2024,
  url          = { https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu },
  doi          = { 10.57967/hf/2497 },
  publisher    = { Hugging Face }
}

@misc{penedo2024finewebdatasetsdecantingweb,
  title={The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale},
  author={Guilherme Penedo and Hynek Kydlíček and Loubna Ben allal and Anton Lozhkov and Margaret Mitchell and Colin Raffel and Leandro Von Werra and Thomas Wolf},
  year={2024},
  eprint={2406.17557},
  archivePrefix={arXiv},
  primaryClass={cs.CL},
  url={https://arxiv.org/abs/2406.17557},
}

All datasets marked Permissive or share-alike | JSON

The same facts for your agent

A free MCP server at mcp.datalicense.uk/mcp. Connect it from an MCP client such as Claude or Cursor.

dataset_licence({ "id": "r-three-moto/pre-training-data" })
signal: "permissive"
stated_licence: "odc-by"
sources: 0