Uses of Class
org.tribuo.util.tokens.impl.wordpiece.WordpieceTokenizer

Packages that use WordpieceTokenizer

Package	Description
org.tribuo.util.tokens.impl.wordpiece	Provides an implementation of a Wordpiece tokenizer which implements to the Tribuo Tokenizer API.

Uses of WordpieceTokenizer in org.tribuo.util.tokens.impl.wordpiece

Methods in org.tribuo.util.tokens.impl.wordpiece that return WordpieceTokenizer

Modifier and Type	Method	Description
WordpieceTokenizer	WordpieceTokenizer.clone()