org.tribuo.json

Class JsonDataSource<T extends Output<T>>

java.lang.Object

org.tribuo.data.columnar.ColumnarDataSource<T>

org.tribuo.json.JsonDataSource<T>

All Implemented Interfaces:

com.oracle.labs.mlrg.olcut.config.Configurable, com.oracle.labs.mlrg.olcut.provenance.Provenancable<DataSourceProvenance>, Iterable<Example<T>>, ConfigurableDataSource<T>, DataSource<T>

public class JsonDataSource<T extends Output<T>>
extends ColumnarDataSource<T>

A DataSource for loading data from a JSON text file and applying FieldProcessors to it.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	JsonDataSource.JsonDataSourceProvenance Provenance for JsonDataSource.

Field Summary

Fields inherited from class org.tribuo.data.columnar.ColumnarDataSource

outputRequired, rowProcessor

Constructor Summary

Constructors

Constructor and Description
JsonDataSource(Path dataPath, RowProcessor<T> rowProcessor, boolean outputRequired) Creates a JsonDataSource using the specified RowProcessor to process the data.
JsonDataSource(URI dataFile, RowProcessor<T> rowProcessor, boolean outputRequired) Creates a JsonDataSource using the specified RowProcessor to process the data.

Method Summary

Modifier and Type	Method and Description
ConfiguredDataSourceProvenance	getProvenance()
void	postConfig() Used by the OLCUT configuration system, and should not be called by external code.
ColumnarIterator	rowIterator() The iterator that emits ColumnarIterator.Row objects from the underlying data source.
String	toString()

Methods inherited from class org.tribuo.data.columnar.ColumnarDataSource

getMetadataTypes, getOutputFactory, iterator

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Constructor Detail

JsonDataSource

public JsonDataSource(Path dataPath,
                      RowProcessor<T> rowProcessor,
                      boolean outputRequired)

Creates a JsonDataSource using the specified RowProcessor to process the data.

Parameters:

dataPath - The Path to the data file.

rowProcessor - The row processor which converts a row into an Example.

outputRequired - Is the output required to exist in the data file.

JsonDataSource

public JsonDataSource(URI dataFile,
                      RowProcessor<T> rowProcessor,
                      boolean outputRequired)

Creates a JsonDataSource using the specified RowProcessor to process the data.

Parameters:

dataFile - A URI for the data file.

rowProcessor - The row processor which converts a row into an Example.

outputRequired - Is the output required to exist in the data file.

Method Detail

postConfig

public void postConfig()

Used by the OLCUT configuration system, and should not be called by external code.

toString

public String toString()

Overrides:

toString in class Object

rowIterator

public ColumnarIterator rowIterator()

Description copied from class: ColumnarDataSource

The iterator that emits ColumnarIterator.Row objects from the underlying data source.

Specified by:

rowIterator in class ColumnarDataSource<T extends Output<T>>

Returns:

The row level iterator.

getProvenance

public ConfiguredDataSourceProvenance getProvenance()