Uses of Class
org.tribuo.util.tokens.impl.wordpiece.WordpieceBasicTokenizer

Packages that use WordpieceBasicTokenizer

Package	Description
org.tribuo.util.tokens.impl.wordpiece	Provides an implementation of a Wordpiece tokenizer which implements to the Tribuo Tokenizer API.

Uses of WordpieceBasicTokenizer in org.tribuo.util.tokens.impl.wordpiece

Methods in org.tribuo.util.tokens.impl.wordpiece that return WordpieceBasicTokenizer

Modifier and Type	Method	Description
WordpieceBasicTokenizer	WordpieceBasicTokenizer.clone()