NCTokenParser
trait NCTokenParser
A tokenizer that splits given text into the list of NCToken objects. This is one of the user-defined components of the processing pipeline. See NCPipeline for documentation on the token parser place in the overall processing pipeline.
- See also:
- Source:
- NCTokenParser.scala