A standardized suite for evaluation and analysis of Swedish natural language understanding systems.
See the leaderboard here. See a detailed description of the collection here.
Aleksandrs Berdicevskis, Gerlof Bouma, Robin Kurtz, Felix Morger, Joey Öhman, Yvonne Adesam, Lars Borin, Dana Dannélls, Markus Forsberg, Tim Isbister, Anna Lindahl, Martin Malmsten, Faton Rekathati, Magnus Sahlgren, Elena Volodina, Love Börjeson, Simon Hengchen, and Nina Tahmasebi. 2023. Superlim: A Swedish Language Understanding Evaluation Benchmark. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 8137–8153, Singapore. Association for Computational Linguistics. Publication Bibtex
File | Size | Modified | Licence |
---|---|---|---|
SuperLim-2-2.0.4.zip
an archive with the whole collection (datasets, documentation sheets, additional files)
(zip)
|
156.63 MB | 2024-01-25 |
CC BY 4.0
attribution
|
SuperLim_maintenance.odt
internal instructions on how (not) to update the Superlim 2.0
(odt)
|
16.96 KB | 2024-01-25 |