mteb/sts12-sts
Unclear
The checks could not identify a recognised licence ID in the dataset's metadata.
Licence facts reported by the dataset and its declared sources. Not legal advice, and not a grant of permission to use the dataset.
Evidence
- Declared licence: unknown (from the tag)
- Licence files: no licence file at the top level of the repository
- Access gated on Hugging Face: no
Declared sources
No source datasets listed in the card metadata.
Signal
See all datasets marked Unclear.
Tasks
Citation text from the card
@inproceedings{10.5555/2387636.2387697,
abstract = {Semantic Textual Similarity (STS) measures the degree of semantic equivalence between two texts. This paper presents the results of the STS pilot task in Semeval. The training data contained 2000 sentence pairs from previously existing paraphrase datasets and machine translation evaluation resources. The test data also comprised 2000 sentences pairs for those datasets, plus two surprise datasets with 400 pairs from a different machine translation evaluation corpus and 750 pairs from a lexical resource mapping exercise. The similarity of pairs of sentences was rated on a 0-5 scale (low to high similarity) by human judges using Amazon Mechanical Turk, with high Pearson correlation scores, around 90\%. 35 teams participated in the task, submitting 88 runs. The best results scored a Pearson correlation >80\%, well above a simple lexical baseline that only scored a 31\% correlation. This pilot task opens an exciting way ahead, although there are still open issues, specially the evaluation metric.},
address = {USA},
author = {Agirre, Eneko and Diab, Mona and Cer, Daniel and Gonzalez-Agirre, Aitor},
booktitle = {Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the Main Conference and the Shared Task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation},
location = {Montr\'{e}al, Canada},
numpages = {9},
pages = {385–393},
pub
Downloads (30 days): 52260. Likes: 14. Last modified: 2026-02-24T21:19:36.000Z.