Package org.tribuo.util.tokens.options

OLCUT Options implementations which can construct Tokenizers of various types.

See: Description

Interface Summary

Interface	Description
TokenizerOptions	CLI Options for creating a tokenizer.

Class Summary

Class	Description
BreakIteratorTokenizerOptions	CLI options for a BreakIteratorTokenizer.
CoreTokenizerOptions	CLI Options for all the tokenizers in the core package.
SplitCharactersTokenizerOptions	CLI options for a SplitCharactersTokenizer.
SplitPatternTokenizerOptions	CLI options for a SplitPatternTokenizer.

Enum Summary

Enum	Description
CoreTokenizerOptions.CoreTokenizerType	Tokenizer type.

Package org.tribuo.util.tokens.options Description

OLCUT Options implementations which can construct Tokenizers of various types.