Package gov.llnl.ontology.text.tokenize

Class Summary

OpenNlpMETokenizer	A wrapper around the TokenizerME Tokenizer so that it can be loaded with a no argument constructor using a predefined model.
OpenNlpWhiteSpaceTokenizer	A decorator for instantiating a WhitespaceTokenizer using the standard reflection framework.
StemmingTokenizer	A decorator for stemming each token returned by an existing Tokenizer, given a Stemmer.
TokenizerAdaptor	This Adaptor class simplifies extending functionality of an already existing Tokenizer.