| Package | Description |
|---|---|
| org.tribuo.classification.explanations.lime |
Provides an implementation of LIME (Locally Interpretable Model Explanations).
|
| org.tribuo.data.text.impl |
Provides implementations of text data processors.
|
| org.tribuo.util.tokens |
Core definitions for tokenization.
|
| org.tribuo.util.tokens.impl |
Simple fixed rule tokenizers.
|
| org.tribuo.util.tokens.impl.wordpiece |
Provides an implementation of a Wordpiece tokenizer which implements
to the Tribuo
Tokenizer API. |
| org.tribuo.util.tokens.options |
OLCUT
Options implementations
which can construct Tokenizers of various types. |
| org.tribuo.util.tokens.universal |
An implementation of a "universal" tokenizer which will split
on word boundaries or character boundaries for languages where
word boundaries are contextual.
|
| Class and Description |
|---|
| Token
A single token extracted from a String.
|
| Tokenizer
An interface for things that tokenize text: breaking it into words according
to some set of rules.
|
| Class and Description |
|---|
| Tokenizer
An interface for things that tokenize text: breaking it into words according
to some set of rules.
|
| Class and Description |
|---|
| Token
A single token extracted from a String.
|
| Token.TokenType
Tokenizers may product multiple kinds of tokens, depending on the application
to which they're being put.
|
| Tokenizer
An interface for things that tokenize text: breaking it into words according
to some set of rules.
|
| Class and Description |
|---|
| Token.TokenType
Tokenizers may product multiple kinds of tokens, depending on the application
to which they're being put.
|
| Tokenizer
An interface for things that tokenize text: breaking it into words according
to some set of rules.
|
| Class and Description |
|---|
| Token
A single token extracted from a String.
|
| Token.TokenType
Tokenizers may product multiple kinds of tokens, depending on the application
to which they're being put.
|
| Tokenizer
An interface for things that tokenize text: breaking it into words according
to some set of rules.
|
| Class and Description |
|---|
| Tokenizer
An interface for things that tokenize text: breaking it into words according
to some set of rules.
|
| Class and Description |
|---|
| Token.TokenType
Tokenizers may product multiple kinds of tokens, depending on the application
to which they're being put.
|
| Tokenizer
An interface for things that tokenize text: breaking it into words according
to some set of rules.
|
Copyright © 2015–2021 Oracle and/or its affiliates. All rights reserved.