org.tribuo.interop.tensorflow

Class DenseTransformer<T extends Output<T>>

java.lang.Object

org.tribuo.interop.tensorflow.DenseTransformer<T>

All Implemented Interfaces:

com.oracle.labs.mlrg.olcut.config.Configurable, com.oracle.labs.mlrg.olcut.provenance.Provenancable<com.oracle.labs.mlrg.olcut.provenance.ConfiguredObjectProvenance>, Serializable, ExampleTransformer<T>

public class DenseTransformer<T extends Output<T>>
extends Object
implements ExampleTransformer<T>

Converts a sparse example into a dense float vector, then wraps it in a Tensor.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static int	THRESHOLD Feature size beyond which a warning is generated (as ONNX requires dense features and large feature spaces are memory hungry).
static int	WARNING_THRESHOLD Number of times the feature size warning should be printed.

Constructor Summary

Constructors

Constructor and Description
DenseTransformer()

Method Summary

Modifier and Type	Method and Description
com.oracle.labs.mlrg.olcut.provenance.ConfiguredObjectProvenance	getProvenance()
String	toString()
org.tensorflow.Tensor<?>	transform(Example<T> example, ImmutableFeatureMap featureIDMap) Converts an Example into a Tensor suitable for supplying as an input to a graph.
org.tensorflow.Tensor<?>	transform(List<Example<T>> examples, ImmutableFeatureMap featureIDMap) Converts a batch of Examples into a single Tensor suitable for supplying as an input to a graph.
org.tensorflow.Tensor<?>	transform(List<SparseVector> vectors) Converts a list of SparseVectors representing a batch of features into a Tensor.
org.tensorflow.Tensor<?>	transform(SparseVector vector) Converts a SparseVector representing the features into a Tensor.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface com.oracle.labs.mlrg.olcut.config.Configurable

postConfig

Field Detail

THRESHOLD

public static final int THRESHOLD

Feature size beyond which a warning is generated (as ONNX requires dense features and large feature spaces are memory hungry).

See Also:

Constant Field Values

WARNING_THRESHOLD

public static final int WARNING_THRESHOLD

Number of times the feature size warning should be printed.

See Also:

Constant Field Values

Constructor Detail

DenseTransformer

public DenseTransformer()

Method Detail

transform

public org.tensorflow.Tensor<?> transform(Example<T> example,
                                          ImmutableFeatureMap featureIDMap)

Description copied from interface: ExampleTransformer

Converts an Example into a Tensor suitable for supplying as an input to a graph.

It generates it as a single example minibatch.

Specified by:

transform in interface ExampleTransformer<T extends Output<T>>

Parameters:

example - The example to convert.

featureIDMap - The id map to convert feature names into id numbers.

Returns:

A dense Tensor representing this example.

transform

public org.tensorflow.Tensor<?> transform(List<Example<T>> examples,
                                          ImmutableFeatureMap featureIDMap)

Description copied from interface: ExampleTransformer

Converts a batch of Examples into a single Tensor suitable for supplying as an input to a graph.

Specified by:

transform in interface ExampleTransformer<T extends Output<T>>

Parameters:

examples - The examples to convert.

featureIDMap - THe id map to convert feature names into id numbers.

Returns:

A dense Tensor representing this minibatch.

transform

public org.tensorflow.Tensor<?> transform(SparseVector vector)

Description copied from interface: ExampleTransformer

Converts a SparseVector representing the features into a Tensor.

It generates it as a single example minibatch.

Specified by:

transform in interface ExampleTransformer<T extends Output<T>>

Parameters:

vector - The features to convert.

Returns:

A dense Tensor representing this vector.

transform

public org.tensorflow.Tensor<?> transform(List<SparseVector> vectors)

Description copied from interface: ExampleTransformer

Converts a list of SparseVectors representing a batch of features into a Tensor.

Specified by:

transform in interface ExampleTransformer<T extends Output<T>>

Parameters:

vectors - The batch of features to convert.

Returns:

A dense Tensor representing this minibatch.

toString

public String toString()

Overrides:

toString in class Object

getProvenance

public com.oracle.labs.mlrg.olcut.provenance.ConfiguredObjectProvenance getProvenance()

Specified by:

getProvenance in interface com.oracle.labs.mlrg.olcut.provenance.Provenancable<com.oracle.labs.mlrg.olcut.provenance.ConfiguredObjectProvenance>