org.tribuo.util.tokens.impl

Enum SplitFunctionTokenizer.SplitResult

java.lang.Object

java.lang.Enum<SplitFunctionTokenizer.SplitResult>

org.tribuo.util.tokens.impl.SplitFunctionTokenizer.SplitResult

All Implemented Interfaces:

Serializable, Comparable<SplitFunctionTokenizer.SplitResult>

Enclosing class:

SplitFunctionTokenizer

public static enum SplitFunctionTokenizer.SplitResult
extends Enum<SplitFunctionTokenizer.SplitResult>

A combination of a SplitFunctionTokenizer.SplitType and a Token.TokenType. The TokenType of some SplitResult values are ignored and so not every combination of SplitType and TokenType is provided. For example, SplitFunctionTokenizer.SplitType.SPLIT_AT and SplitFunctionTokenizer.SplitType.SPLIT_BEFORE (as described above) create tokens whose types have already been determined.

Enum Constant Summary

Enum Constants

Enum Constant and Description
NO_SPLIT_INFIX
NO_SPLIT_NGRAM
NO_SPLIT_PREFIX
NO_SPLIT_PUNCTUATION
NO_SPLIT_SUFFIX
NO_SPLIT_UNKNOWN
NO_SPLIT_WHITESPACE
NO_SPLIT_WORD
SPLIT_AFTER_INFIX
SPLIT_AFTER_NGRAM
SPLIT_AFTER_PREFIX
SPLIT_AFTER_PUNCTUATION
SPLIT_AFTER_SUFFIX
SPLIT_AFTER_UNKNOWN
SPLIT_AFTER_WHITESPACE
SPLIT_AFTER_WORD
SPLIT_AT
SPLIT_BEFORE
SPLIT_BEFORE_AND_AFTER_INFIX
SPLIT_BEFORE_AND_AFTER_NGRAM
SPLIT_BEFORE_AND_AFTER_PREFIX
SPLIT_BEFORE_AND_AFTER_PUNCTUATION
SPLIT_BEFORE_AND_AFTER_SUFFIX
SPLIT_BEFORE_AND_AFTER_UNKNOWN
SPLIT_BEFORE_AND_AFTER_WHITESPACE
SPLIT_BEFORE_AND_AFTER_WORD

Field Summary

Fields

Modifier and Type	Field and Description
SplitFunctionTokenizer.SplitType	splitType
Token.TokenType	tokenType

Method Summary

Modifier and Type	Method and Description
static SplitFunctionTokenizer.SplitResult	valueOf(String name) Returns the enum constant of this type with the specified name.
static SplitFunctionTokenizer.SplitResult[]	values() Returns an array containing the constants of this enum type, in the order they are declared.

Methods inherited from class java.lang.Enum

clone, compareTo, equals, finalize, getDeclaringClass, hashCode, name, ordinal, toString, valueOf

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, wait, wait, wait

Enum Constant Detail

NO_SPLIT_WORD

public static final SplitFunctionTokenizer.SplitResult NO_SPLIT_WORD

NO_SPLIT_NGRAM

public static final SplitFunctionTokenizer.SplitResult NO_SPLIT_NGRAM

NO_SPLIT_PUNCTUATION

public static final SplitFunctionTokenizer.SplitResult NO_SPLIT_PUNCTUATION

NO_SPLIT_WHITESPACE

public static final SplitFunctionTokenizer.SplitResult NO_SPLIT_WHITESPACE

NO_SPLIT_PREFIX

public static final SplitFunctionTokenizer.SplitResult NO_SPLIT_PREFIX

NO_SPLIT_SUFFIX

public static final SplitFunctionTokenizer.SplitResult NO_SPLIT_SUFFIX

NO_SPLIT_INFIX

public static final SplitFunctionTokenizer.SplitResult NO_SPLIT_INFIX

NO_SPLIT_UNKNOWN

public static final SplitFunctionTokenizer.SplitResult NO_SPLIT_UNKNOWN

SPLIT_AT

public static final SplitFunctionTokenizer.SplitResult SPLIT_AT

SPLIT_BEFORE

public static final SplitFunctionTokenizer.SplitResult SPLIT_BEFORE

SPLIT_AFTER_WORD

public static final SplitFunctionTokenizer.SplitResult SPLIT_AFTER_WORD

SPLIT_AFTER_NGRAM

public static final SplitFunctionTokenizer.SplitResult SPLIT_AFTER_NGRAM

SPLIT_AFTER_PUNCTUATION

public static final SplitFunctionTokenizer.SplitResult SPLIT_AFTER_PUNCTUATION

SPLIT_AFTER_WHITESPACE

public static final SplitFunctionTokenizer.SplitResult SPLIT_AFTER_WHITESPACE

SPLIT_AFTER_PREFIX

public static final SplitFunctionTokenizer.SplitResult SPLIT_AFTER_PREFIX

SPLIT_AFTER_SUFFIX

public static final SplitFunctionTokenizer.SplitResult SPLIT_AFTER_SUFFIX

SPLIT_AFTER_INFIX

public static final SplitFunctionTokenizer.SplitResult SPLIT_AFTER_INFIX

SPLIT_AFTER_UNKNOWN

public static final SplitFunctionTokenizer.SplitResult SPLIT_AFTER_UNKNOWN

SPLIT_BEFORE_AND_AFTER_WORD

public static final SplitFunctionTokenizer.SplitResult SPLIT_BEFORE_AND_AFTER_WORD

SPLIT_BEFORE_AND_AFTER_NGRAM

public static final SplitFunctionTokenizer.SplitResult SPLIT_BEFORE_AND_AFTER_NGRAM

SPLIT_BEFORE_AND_AFTER_PUNCTUATION

public static final SplitFunctionTokenizer.SplitResult SPLIT_BEFORE_AND_AFTER_PUNCTUATION

SPLIT_BEFORE_AND_AFTER_WHITESPACE

public static final SplitFunctionTokenizer.SplitResult SPLIT_BEFORE_AND_AFTER_WHITESPACE

SPLIT_BEFORE_AND_AFTER_PREFIX

public static final SplitFunctionTokenizer.SplitResult SPLIT_BEFORE_AND_AFTER_PREFIX

SPLIT_BEFORE_AND_AFTER_SUFFIX

public static final SplitFunctionTokenizer.SplitResult SPLIT_BEFORE_AND_AFTER_SUFFIX

SPLIT_BEFORE_AND_AFTER_INFIX

public static final SplitFunctionTokenizer.SplitResult SPLIT_BEFORE_AND_AFTER_INFIX

SPLIT_BEFORE_AND_AFTER_UNKNOWN

public static final SplitFunctionTokenizer.SplitResult SPLIT_BEFORE_AND_AFTER_UNKNOWN

Field Detail

splitType

public final SplitFunctionTokenizer.SplitType splitType

tokenType

public final Token.TokenType tokenType

Method Detail

values

public static SplitFunctionTokenizer.SplitResult[] values()

Returns an array containing the constants of this enum type, in the order they are declared. This method may be used to iterate over the constants as follows:

for (SplitFunctionTokenizer.SplitResult c : SplitFunctionTokenizer.SplitResult.values())
    System.out.println(c);

Returns:

an array containing the constants of this enum type, in the order they are declared

valueOf

public static SplitFunctionTokenizer.SplitResult valueOf(String name)

Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are not permitted.)

Parameters:

name - the name of the enum constant to be returned.

Returns:

the enum constant with the specified name

Throws:

IllegalArgumentException - if this enum type has no constant with the specified name

NullPointerException - if the argument is null