org.tribuo.classification.sequence

Class LabelSequenceEvaluator

java.lang.Object

org.tribuo.sequence.AbstractSequenceEvaluator<Label,LabelMetric.Context,LabelSequenceEvaluation,LabelMetric>

org.tribuo.classification.sequence.LabelSequenceEvaluator

All Implemented Interfaces:

SequenceEvaluator<Label,LabelSequenceEvaluation>

public class LabelSequenceEvaluator
extends AbstractSequenceEvaluator<Label,LabelMetric.Context,LabelSequenceEvaluation,LabelMetric>

A sequence evaluator for labels.

Constructor Summary

Constructors

Constructor and Description
LabelSequenceEvaluator()

Method Summary

Modifier and Type	Method and Description
protected LabelMetric.Context	createContext(SequenceModel<Label> model, List<List<Prediction<Label>>> predictions) Create the context needed for evaluation.
protected LabelSequenceEvaluation	createEvaluation(LabelMetric.Context ctx, Map<MetricID<Label>,Double> results, EvaluationProvenance provenance) Create an evaluation for the given results
protected Set<LabelMetric>	createMetrics(SequenceModel<Label> model) Creates the appropriate set of metrics for this model, by querying for it's OutputInfo.

Methods inherited from class org.tribuo.sequence.AbstractSequenceEvaluator

computeResults, evaluate, evaluate, evaluate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LabelSequenceEvaluator

public LabelSequenceEvaluator()

Method Detail

createMetrics

protected Set<LabelMetric> createMetrics(SequenceModel<Label> model)

Description copied from class: AbstractSequenceEvaluator

Creates the appropriate set of metrics for this model, by querying for it's OutputInfo.

Specified by:

createMetrics in class AbstractSequenceEvaluator<Label,LabelMetric.Context,LabelSequenceEvaluation,LabelMetric>

Parameters:

model - The model to inspect.

Returns:

The set of metrics.

createContext

protected LabelMetric.Context createContext(SequenceModel<Label> model,
                                            List<List<Prediction<Label>>> predictions)

Description copied from class: AbstractSequenceEvaluator

Create the context needed for evaluation. The context might store global properties or cache computation.

Specified by:

createContext in class AbstractSequenceEvaluator<Label,LabelMetric.Context,LabelSequenceEvaluation,LabelMetric>

Parameters:

model - the model that will be evaluated

predictions - the predictions that will be evaluated

Returns:

the context for this model and its predictions

createEvaluation

protected LabelSequenceEvaluation createEvaluation(LabelMetric.Context ctx,
                                                   Map<MetricID<Label>,Double> results,
                                                   EvaluationProvenance provenance)

Description copied from class: AbstractSequenceEvaluator

Create an evaluation for the given results

Specified by:

createEvaluation in class AbstractSequenceEvaluator<Label,LabelMetric.Context,LabelSequenceEvaluation,LabelMetric>

Parameters:

ctx - the context that was used to compute these results

results - the results

provenance - the provenance of the results (including information about the model and dataset)

Returns:

the evaluation