An interface for things that tokenize text: breaking it into words according to some set of rules.
A single token extracted from a String.
Tokenizers may product multiple kinds of tokens, depending on the application to which they're being put.
Wraps exceptions thrown by tokenizers.
Copyright © 2015–2021 Oracle and/or its affiliates. All rights reserved.