A standardized suite for evaluation and analysis of Swedish natural language understanding systems.
See the leaderboard here. See a detailed description of the collection here.
Standard reference
Aleksandrs Berdicevskis, Gerlof Bouma, Robin Kurtz, Felix Morger, Joey Öhman, Yvonne Adesam, Lars Borin, Dana Dannélls, Markus Forsberg, Tim Isbister, Anna Lindahl, Martin Malmsten, Faton Rekathati, Magnus Sahlgren, Elena Volodina, Love Börjeson, Simon Hengchen, and Nina Tahmasebi. 2023. Superlim: A Swedish Language Understanding Evaluation Benchmark. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 8137–8153, Singapore. Association for Computational Linguistics. Publication Bibtex
Citation
Språkbanken Text (2024). SuperLim 2 (updated: 2024-01-25). [Data set]. Språkbanken Text. https://doi.org/10.23695/kzyd-b925
Additional ways to cite the dataset.
| File | Size | Modified | Licence |
|---|---|---|---|
|
SuperLim-2-2.0.4.zip
an archive with the whole collection (datasets, documentation sheets, additional files)
(zip)
|
156.63 MB | 2024-01-25 |
CC BY 4.0
attribution
|
|
SuperLim_maintenance.odt
internal instructions on how (not) to update the Superlim 2.0
(odt)
|
16.96 KB | 2024-01-25 |