org.tribuo.interop.tensorflow.sequence

Class TensorflowSequenceTrainer<T extends Output<T>>

java.lang.Object

org.tribuo.interop.tensorflow.sequence.TensorflowSequenceTrainer<T>

All Implemented Interfaces:

com.oracle.labs.mlrg.olcut.config.Configurable, com.oracle.labs.mlrg.olcut.provenance.Provenancable<TrainerProvenance>, SequenceTrainer<T>

public class TensorflowSequenceTrainer<T extends Output<T>>
extends Object
implements SequenceTrainer<T>

A trainer for SequenceModels which use an underlying Tensorflow graph.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TensorflowSequenceTrainer.TensorflowSequenceTrainerProvenance

Field Summary

Fields

Modifier and Type	Field and Description
protected int	epochs
protected SequenceExampleTransformer<T>	exampleTransformer
protected String	getLossOp
protected Path	graphPath
protected String	initOp
protected int	loggingInterval
protected int	minibatchSize
protected SequenceOutputTransformer<T>	outputTransformer
protected String	predictOp
protected SplittableRandom	rng
protected long	seed
protected int	trainInvocationCounter
protected String	trainOp

Constructor Summary

Constructors

Constructor and Description
TensorflowSequenceTrainer(Path graphPath, SequenceExampleTransformer<T> exampleTransformer, SequenceOutputTransformer<T> outputTransformer, int minibatchSize, int epochs, int loggingInterval, long seed, String initOp, String trainOp, String getLossOp, String predictOp)

Method Summary

Modifier and Type	Method and Description
protected Map<String,org.tensorflow.Tensor<?>>	getHyperparameterFeed()
int	getInvocationCount() Returns the number of times the train method has been invoked.
TrainerProvenance	getProvenance()
void	postConfig()
protected void	preTrainingHook(org.tensorflow.Session session, SequenceDataset<T> examples)
String	toString()
SequenceModel<T>	train(SequenceDataset<T> examples, Map<String,com.oracle.labs.mlrg.olcut.provenance.Provenance> runProvenance) Trains a sequence prediction model using the examples in the given data set.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.tribuo.sequence.SequenceTrainer

train

Field Detail

graphPath

@Config(mandatory=true,
        description="Path to the protobuf containing the Tensorflow graph.")
protected Path graphPath

exampleTransformer

@Config(mandatory=true,
        description="Sequence feature extractor.")
protected SequenceExampleTransformer<T extends Output<T>> exampleTransformer

outputTransformer

@Config(mandatory=true,
        description="Sequence output extractor.")
protected SequenceOutputTransformer<T extends Output<T>> outputTransformer

minibatchSize

@Config(description="Minibatch size")
protected int minibatchSize

epochs

@Config(description="Number of SGD epochs to run.")
protected int epochs

loggingInterval

@Config(description="Logging interval to print the loss.")
protected int loggingInterval

seed

@Config(description="Seed for the RNG.")
protected long seed

initOp

@Config(mandatory=true,
        description="Name of the initialisation operation.")
protected String initOp

trainOp

@Config(mandatory=true,
        description="Name of the training operation.")
protected String trainOp

getLossOp

@Config(mandatory=true,
        description="Name of the loss operation (to inspect the loss).")
protected String getLossOp

predictOp

@Config(mandatory=true,
        description="Name of the prediction operation.")
protected String predictOp

rng

protected SplittableRandom rng

trainInvocationCounter

protected int trainInvocationCounter

Constructor Detail

TensorflowSequenceTrainer

public TensorflowSequenceTrainer(Path graphPath,
                                 SequenceExampleTransformer<T> exampleTransformer,
                                 SequenceOutputTransformer<T> outputTransformer,
                                 int minibatchSize,
                                 int epochs,
                                 int loggingInterval,
                                 long seed,
                                 String initOp,
                                 String trainOp,
                                 String getLossOp,
                                 String predictOp)
                          throws IOException

Throws:

IOException

Method Detail

postConfig

public void postConfig()
                throws IOException

Specified by:

postConfig in interface com.oracle.labs.mlrg.olcut.config.Configurable

Throws:

IOException

train

public SequenceModel<T> train(SequenceDataset<T> examples,
                              Map<String,com.oracle.labs.mlrg.olcut.provenance.Provenance> runProvenance)

Description copied from interface: SequenceTrainer

Trains a sequence prediction model using the examples in the given data set.

Specified by:

train in interface SequenceTrainer<T extends Output<T>>

Parameters:

examples - the data set containing the examples.

runProvenance - Training run specific provenance (e.g., fold number).

Returns:

a predictive model that can be used to generate predictions for new examples.

getInvocationCount

public int getInvocationCount()

Description copied from interface: SequenceTrainer

Returns the number of times the train method has been invoked.

Specified by:

getInvocationCount in interface SequenceTrainer<T extends Output<T>>

Returns:

The number of times train has been invoked.

toString

public String toString()

Overrides:

toString in class Object

preTrainingHook

protected void preTrainingHook(org.tensorflow.Session session,
                               SequenceDataset<T> examples)

getHyperparameterFeed

protected Map<String,org.tensorflow.Tensor<?>> getHyperparameterFeed()

getProvenance

public TrainerProvenance getProvenance()

Specified by:

getProvenance in interface com.oracle.labs.mlrg.olcut.provenance.Provenancable<TrainerProvenance>