Uses of Class
edu.ucla.sspace.text.TokenFilter

Packages that use TokenFilter

Package	Description
edu.ucla.sspace.dependency
edu.ucla.sspace.text

Uses of TokenFilter in edu.ucla.sspace.dependency

Constructors in edu.ucla.sspace.dependency with parameters of type TokenFilter

Constructor and Description
CoNLLDependencyExtractor(String configFile, TokenFilter filter, Stemmer stemmer) Creates a new CoNLLDependencyExtractor by parsing a Malt configuration file, which specifies the order in which the output is formatted and uses the given TokenFilter and Stemmer.
CoNLLDependencyExtractor(TokenFilter filter, Stemmer stemmer) Creates a new CoNLLDependencyExtractor that assumes the default ordering for Malt dependency parses and uses the given TokenFilter and Stemmer.
CoNLLDependencyExtractor(TokenFilter filter, Stemmer stemmer, int idIndex, int formIndex, int lemmaIndex, int posIndex, int parentIndex, int relationIndex) Creates a new CoNLLDependencyExtractor that assumes the default ordering for Malt dependency parses and uses the given TokenFilter and Stemmer and the given indices for each feature.
WaCKyDependencyExtractor(TokenFilter filter, Stemmer stemmer) Creates a new WaCKyDependencyExtractor that assumes the default ordering for Malt dependency parses and uses the given TokenFilter and Stemmer.

Uses of TokenFilter in edu.ucla.sspace.text

Methods in edu.ucla.sspace.text that return TokenFilter

Modifier and Type	Method and Description
TokenFilter	TokenFilter.combine(TokenFilter parent) Creates a chained filter by accepting the subset of whatever parent accepts less what tokens this filter rejects.
static TokenFilter	TokenFilter.loadFromSpecification(String configuration) Loads a series of chained TokenFilter instances from the specified configuration string.
static TokenFilter	TokenFilter.loadFromSpecification(String configuration, ResourceFinder finder) Loads a series of chained TokenFilter instances from the specified configuration string using the provided ResourceFinder to locate the resources.

Methods in edu.ucla.sspace.text with parameters of type TokenFilter

Modifier and Type	Method and Description
TokenFilter	TokenFilter.combine(TokenFilter parent) Creates a chained filter by accepting the subset of whatever parent accepts less what tokens this filter rejects.

Constructors in edu.ucla.sspace.text with parameters of type TokenFilter

Constructor and Description
FilteredIterator(BufferedReader reader, TokenFilter filter) Creates a filtered iterator using the reader as a source of tokens
FilteredIterator(Iterator<String> tokens, TokenFilter filter) Creates a filtered iterator using provided iterator as the source of tokens
FilteredIterator(String str, TokenFilter filter) Creates a filtered iterator using the string as a source of tokens
OrderPreservingFilteredIterator(BufferedReader reader, TokenFilter filter) Creates a filtered iterator using the reader as a source of tokens
OrderPreservingFilteredIterator(Iterator<String> tokens, TokenFilter filter) Creates a filtered iterator using provided iterator as the source of tokens
OrderPreservingFilteredIterator(String str, TokenFilter filter) Creates a filtered iterator using the string as a source of tokens
TokenFilter(Set<String> tokens, boolean excludeTokens, TokenFilter parent) Constructs a chained filter that accepts the subset of what the parent accepts after applying its own filter to any tokens that the parent accepts.