org.tribuo.data.csv

Class CSVLoader<T extends Output<T>>

java.lang.Object

org.tribuo.data.csv.CSVLoader<T>

Type Parameters:

T - The type of the output generated.

public class CSVLoader<T extends Output<T>>
extends Object

Load a DataSource/Dataset from a CSV file.

The delimiter and quote characters are user controlled, so this class can parse TSVs, CSVs, semi-colon separated data and other types of single character delimiter separated data.

This class is a simple loader *only* for numerical CSV files with a String response field. If you need more complex processing, the response field isn't present, or you don't wish to use all of the columns as features then you should use CSVDataSource and build a RowProcessor to cope with your specific input format.

CSVLoader is thread safe and immutable.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CSVLoader.CSVLoaderProvenance Provenance for CSVs loaded by CSVLoader.

Constructor Summary

Constructors

Constructor and Description
CSVLoader(char separator, char quote, OutputFactory<T> outputFactory) Creates a CSVLoader using the supplied separator, quote and output factory.
CSVLoader(char separator, OutputFactory<T> outputFactory) Creates a CSVLoader using the supplied separator and output factory.
CSVLoader(OutputFactory<T> outputFactory) Creates a CSVLoader using the supplied output factory.

Method Summary

Modifier and Type	Method and Description
MutableDataset<T>	load(Path csvPath, Set<String> responseNames) Loads a DataSource from the specified csv file then wraps it in a dataset.
MutableDataset<T>	load(Path csvPath, Set<String> responseNames, String[] header) Loads a DataSource from the specified csv file then wraps it in a dataset.
MutableDataset<T>	load(Path csvPath, String responseName) Loads a DataSource from the specified csv file then wraps it in a dataset.
MutableDataset<T>	load(Path csvPath, String responseName, String[] header) Loads a DataSource from the specified csv file then wraps it in a dataset.
ListDataSource<T>	loadDataSource(Path csvPath, Set<String> responseNames) Loads a DataSource from the specified csv path.
ListDataSource<T>	loadDataSource(Path csvPath, Set<String> responseNames, String[] header) Loads a DataSource from the specified csv path.
ListDataSource<T>	loadDataSource(Path csvPath, String responseName) Loads a DataSource from the specified csv path.
ListDataSource<T>	loadDataSource(Path csvPath, String responseName, String[] header) Loads a DataSource from the specified csv path.
ListDataSource<T>	loadDataSource(URL csvPath, Set<String> responseNames) Loads a DataSource from the specified csv path.
ListDataSource<T>	loadDataSource(URL csvPath, Set<String> responseNames, String[] header) Loads a DataSource from the specified csv path.
ListDataSource<T>	loadDataSource(URL csvPath, String responseName) Loads a DataSource from the specified csv path.
ListDataSource<T>	loadDataSource(URL csvPath, String responseName, String[] header) Loads a DataSource from the specified csv path.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CSVLoader

public CSVLoader(char separator,
                 char quote,
                 OutputFactory<T> outputFactory)

Creates a CSVLoader using the supplied separator, quote and output factory.

Parameters:

separator - The separator character.

quote - The quote character.

outputFactory - The output factory.

CSVLoader

public CSVLoader(char separator,
                 OutputFactory<T> outputFactory)

Creates a CSVLoader using the supplied separator and output factory. Sets the quote to CSVIterator.QUOTE.

Parameters:

separator - The separator character.

outputFactory - The output factory.

CSVLoader

public CSVLoader(OutputFactory<T> outputFactory)

Creates a CSVLoader using the supplied output factory. Sets the separator to CSVIterator.SEPARATOR and the quote to CSVIterator.QUOTE.

Parameters:

outputFactory - The output factory.

Method Detail

load

public MutableDataset<T> load(Path csvPath,
                              String responseName)
                       throws IOException

Loads a DataSource from the specified csv file then wraps it in a dataset.

Parameters:

csvPath - The path to load.

responseName - The name of the response variable.

Returns:

A dataset containing the csv data.

Throws:

IOException - If the read failed.

load

public MutableDataset<T> load(Path csvPath,
                              String responseName,
                              String[] header)
                       throws IOException

Loads a DataSource from the specified csv file then wraps it in a dataset.

Parameters:

csvPath - The path to load.

responseName - The name of the response variable.

header - The header of the CSV if it's not present in the file.

Returns:

A dataset containing the csv data.

Throws:

IOException - If the read failed.

load

public MutableDataset<T> load(Path csvPath,
                              Set<String> responseNames)
                       throws IOException

Loads a DataSource from the specified csv file then wraps it in a dataset.

Parameters:

csvPath - The path to load.

responseNames - The names of the response variables.

Returns:

A dataset containing the csv data.

Throws:

IOException - If the read failed.

load

public MutableDataset<T> load(Path csvPath,
                              Set<String> responseNames,
                              String[] header)
                       throws IOException

Loads a DataSource from the specified csv file then wraps it in a dataset.

Parameters:

csvPath - The path to load.

responseNames - The names of the response variables.

header - The header of the CSV if it's not present in the file.

Returns:

A dataset containing the csv data.

Throws:

IOException - If the read failed.

loadDataSource

public ListDataSource<T> loadDataSource(Path csvPath,
                                        String responseName)
                                 throws IOException

Loads a DataSource from the specified csv path.

Parameters:

csvPath - The csv to load from.

responseName - The name of the response variable.

Returns:

A datasource containing the csv data.

Throws:

IOException - If the disk read failed.

loadDataSource

public ListDataSource<T> loadDataSource(URL csvPath,
                                        String responseName)
                                 throws IOException

Loads a DataSource from the specified csv path.

Parameters:

csvPath - The csv to load from.

responseName - The name of the response variable.

Returns:

A datasource containing the csv data.

Throws:

IOException - If the disk read failed.

loadDataSource

public ListDataSource<T> loadDataSource(Path csvPath,
                                        String responseName,
                                        String[] header)
                                 throws IOException

Loads a DataSource from the specified csv path.

Parameters:

csvPath - The csv to load from.

responseName - The name of the response variable.

header - The header of the CSV if it's not present in the file.

Returns:

A datasource containing the csv data.

Throws:

IOException - If the disk read failed.

loadDataSource

public ListDataSource<T> loadDataSource(URL csvPath,
                                        String responseName,
                                        String[] header)
                                 throws IOException

Loads a DataSource from the specified csv path.

Parameters:

csvPath - The csv to load from.

responseName - The name of the response variable.

header - The header of the CSV if it's not present in the file.

Returns:

A datasource containing the csv data.

Throws:

IOException - If the disk read failed.

loadDataSource

public ListDataSource<T> loadDataSource(Path csvPath,
                                        Set<String> responseNames)
                                 throws IOException

Loads a DataSource from the specified csv path.

Parameters:

csvPath - The csv to load from.

responseNames - The names of the response variables.

Returns:

A datasource containing the csv data.

Throws:

IOException - If the disk read failed.

loadDataSource

public ListDataSource<T> loadDataSource(URL csvPath,
                                        Set<String> responseNames)
                                 throws IOException

Loads a DataSource from the specified csv path.

Parameters:

csvPath - The csv to load from.

responseNames - The names of the response variables.

Returns:

A datasource containing the csv data.

Throws:

IOException - If the disk read failed.

loadDataSource

public ListDataSource<T> loadDataSource(Path csvPath,
                                        Set<String> responseNames,
                                        String[] header)
                                 throws IOException

Loads a DataSource from the specified csv path.

Parameters:

csvPath - The csv to load from.

responseNames - The names of the response variables.

header - The header of the CSV if it's not present in the file.

Returns:

A datasource containing the csv data.

Throws:

IOException - If the disk read failed.

loadDataSource

public ListDataSource<T> loadDataSource(URL csvPath,
                                        Set<String> responseNames,
                                        String[] header)
                                 throws IOException

Loads a DataSource from the specified csv path.

Parameters:

csvPath - The csv to load from.

responseNames - The names of the response variables.

header - The header of the CSV if it's not present in the file.

Returns:

A datasource containing the csv data.

Throws:

IOException - If the disk read failed.