Package | Description |
---|---|
org.tribuo.util.tokens.impl |
Simple fixed rule tokenizers.
|
Modifier and Type | Method and Description |
---|---|
SplitCharactersTokenizer |
SplitCharactersTokenizer.clone() |
static SplitCharactersTokenizer |
SplitCharactersTokenizer.createWhitespaceTokenizer()
Creates a tokenizer that splits on whitespace.
|
Copyright © 2015–2021 Oracle and/or its affiliates. All rights reserved.