Uses of Interface
org.tribuo.util.tokens.impl.SplitFunctionTokenizer.SplitFunction

Package
Description
Simple fixed rule tokenizers.
Provides an implementation of a Wordpiece tokenizer which implements to the Tribuo Tokenizer API.