This utility exports corpus statistics as a word frequency list. The word frequency list contains the word forms and the annotations that have been selected in the configuration, as well as the number of occurrences of each row (word form and its annotations) in the corpus. The word frequency list can be used, among other things, to analyze language use in the corpus and to identify common words and expressions.
This exporter is used with Sparv. Check out Sparv's quick start guide to get started!
To use this exporter, run Sparv with the argument 'stats_export:freq_list':
sparv run stats_export:freq_list
For more info on how to use Sparv, check out the Sparv documentation.
Example output:
word lemma deprel pos count
. | IP MAD 84
en |en| DT DT 26
, | IK MID 25
är |vara| ROOT VB 21
ett |en| DT DT 16
som | SS HP 16
är |vara| MS VB 14
har |ha| ROOT VB 13
av |av| ET PP 10
att |att| OO SN 9
den |den| SS PN 9
i |i| ET PP 9
i |i| RA PP 9
du |du| SS PN 8
och |och| ROOT KN 8