Package org.tribuo.data.text.impl

Class SimpleStringDataSource<T extends Output<T>>

java.lang.Object

org.tribuo.data.text.TextDataSource<T>

org.tribuo.data.text.impl.SimpleTextDataSource<T>

org.tribuo.data.text.impl.SimpleStringDataSource<T>

All Implemented Interfaces:

com.oracle.labs.mlrg.olcut.config.Configurable, com.oracle.labs.mlrg.olcut.provenance.Provenancable<DataSourceProvenance>, Iterable<Example<T>>, ConfigurableDataSource<T>, DataSource<T>

public class SimpleStringDataSource<T extends Output<T>>
extends SimpleTextDataSource<T>

A version of SimpleTextDataSource that accepts a List of Strings.

Uses the parsing logic from SimpleTextDataSource.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	SimpleStringDataSource.SimpleStringDataSourceProvenance	Provenance for SimpleStringDataSource.

Nested classes/interfaces inherited from class org.tribuo.data.text.impl.SimpleTextDataSource

SimpleTextDataSource.SimpleTextDataSourceProvenance

Field Summary

Fields

Modifier and Type	Field	Description
protected List<String>	rawLines	Used because OLCUT doesn't support generic Iterables.

Fields inherited from class org.tribuo.data.text.impl.SimpleTextDataSource

provenance

Fields inherited from class org.tribuo.data.text.TextDataSource

data, extractor, outputFactory, path, preprocessors

Constructor Summary

Constructors

Constructor	Description
SimpleStringDataSource(List<String> rawLines, OutputFactory<T> outputFactory, TextFeatureExtractor<T> extractor)	Constructs a simple string data source from the supplied lines.

Method Summary

Modifier and Type	Method	Description
protected ConfiguredDataSourceProvenance	cacheProvenance()	Computes the provenance.
void	postConfig()	Used by the OLCUT configuration system, and should not be called by external code.
protected void	read()	Reads the data from the Path.
String	toString()

Methods inherited from class org.tribuo.data.text.impl.SimpleTextDataSource

getProvenance, parseLine

Methods inherited from class org.tribuo.data.text.TextDataSource

getOutputFactory, handleDoc, iterator

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Field Details

rawLines

@Config(mandatory=true,
        description="The input data lines.")
protected List<String> rawLines

Used because OLCUT doesn't support generic Iterables.

Constructor Details

SimpleStringDataSource

public SimpleStringDataSource(List<String> rawLines,
 OutputFactory<T> outputFactory,
 TextFeatureExtractor<T> extractor)

Constructs a simple string data source from the supplied lines.

Parameters:

rawLines - The lines to parse.

outputFactory - The output factory.

extractor - The feature extractor.

Method Details

postConfig

public void postConfig()

Used by the OLCUT configuration system, and should not be called by external code.

Specified by:

postConfig in interface com.oracle.labs.mlrg.olcut.config.Configurable

Overrides:

postConfig in class SimpleTextDataSource<T extends Output<T>>

toString

public String toString()

Overrides:

toString in class TextDataSource<T extends Output<T>>

read

protected void read()

Description copied from class: TextDataSource

Reads the data from the Path.

Overrides:

read in class SimpleTextDataSource<T extends Output<T>>

cacheProvenance

protected ConfiguredDataSourceProvenance cacheProvenance()

Description copied from class: SimpleTextDataSource

Computes the provenance.

Overrides:

cacheProvenance in class SimpleTextDataSource<T extends Output<T>>

Returns:

The provenance.