A standardized suite for evaluation and analysis of Swedish natural language understanding systems.
See the leaderboard here. See a detailed description of the collection here.
Standardreferens
Aleksandrs Berdicevskis, Gerlof Bouma, Robin Kurtz, Felix Morger, Joey Öhman, Yvonne Adesam, Lars Borin, Dana Dannélls, Markus Forsberg, Tim Isbister, Anna Lindahl, Martin Malmsten, Faton Rekathati, Magnus Sahlgren, Elena Volodina, Love Börjeson, Simon Hengchen, and Nina Tahmasebi. 2023. Superlim: A Swedish Language Understanding Evaluation Benchmark. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 8137–8153, Singapore. Association for Computational Linguistics. Publication Bibtex
Citering
Språkbanken Text (2024). SuperLim 2 (uppdaterad: 2024-01-25). [Data set]. Språkbanken Text. https://doi.org/10.23695/kzyd-b925
Ytterligare sätt att citera datamängden.
| Fil | Storlek | Modifierad | Licens |
|---|---|---|---|
|
SuperLim-2-2.0.4.zip
an archive with the whole collection (datasets, documentation sheets, additional files)
(zip)
|
156.63 MB | 2024-01-25 |
CC BY 4.0
attribution
|
|
SuperLim_maintenance.odt
internal instructions on how (not) to update the Superlim 2.0
(odt)
|
16.96 KB | 2024-01-25 |