Enum Token.TokenType
- All Implemented Interfaces:
Serializable
,Comparable<Token.TokenType>
,java.lang.constant.Constable
- Enclosing class:
Token
Tokenizers may product multiple kinds of tokens, depending on the
application to which they're being put. For example, when processing a
document for highlighting during querying, we need to send through
whitespace and punctuation so that the document looks as it did in it's
original form. For most tokenizer applications, they will only send word
tokens.
-
Nested Class Summary
Nested classes/interfaces inherited from class java.lang.Enum
Enum.EnumDesc<E extends Enum<E>>
-
Enum Constant Summary
Enum Constants -
Method Summary
Modifier and TypeMethodDescriptionstatic Token.TokenType
Returns the enum constant of this type with the specified name.static Token.TokenType[]
values()
Returns an array containing the constants of this enum type, in the order they are declared.
-
Enum Constant Details
-
WORD
-
NGRAM
-
PUNCTUATION
-
WHITESPACE
-
-
Method Details
-
values
Returns an array containing the constants of this enum type, in the order they are declared.- Returns:
- an array containing the constants of this enum type, in the order they are declared
-
valueOf
Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are not permitted.)- Parameters:
name
- the name of the enum constant to be returned.- Returns:
- the enum constant with the specified name
- Throws:
IllegalArgumentException
- if this enum type has no constant with the specified nameNullPointerException
- if the argument is null
-