Package org.tribuo.util.tokens.universal

Class Summary

Class	Description
Range	A range currently being segmented.
UniversalTokenizer	This class was originally written for the purpose of document indexing in an information retrieval context (principally used in Sun Labs' Minion search engine).