paragraph-sparv-whitespace

The documentation for NLTK's RegexpTokenizer can be found here.

This analysis is used with Sparv. Check out Sparv's quick start guide to get started!

To use this analysis, add the following line under export.annotations in the Sparv corpus configuration file:

- segment.paragraph  # Paragraph segments

In order to use this paragraph segmenter you need to add the following setting to your Sparv corpus configuration file:

segment:
  paragraph_segmenter: whitespace

For more info on how to use Sparv, check out the Sparv documentation.

Example output:

<paragraph>
  <sentence>
    <token>Det</token>
    <token>här</token>
    <token>är</token>
    <token>en</token>
    <token>korpus</token>
    <token>.</token>
  </sentence>
</paragraph>
<paragraph>
  <sentence>
    <token>Den</token>
    <token>har</token>
    <token>flera</token>
    <token>stycken</token>
    <token>.</token>
  </sentence>
</paragraph>