Uses of Interface
org.tribuo.evaluation.Evaluation
Package
Description
Provides the core interfaces and classes for using Tribuo.
Evaluation classes for anomaly detection.
Evaluation classes for multi-class classification.
Evaluation classes for clustering.
Evaluation base classes, along with code for train/test splits and cross validation.
ModelCard feature to allow more transparent model reporting.
Evaluation classes for multi-label classification using
MultiLabel
.Evaluation classes for single or multi-dimensional regression.
-
Uses of Evaluation in org.tribuo
Modifier and TypeMethodDescriptionEvaluator<T,
? extends Evaluation<T>> OutputFactory.getEvaluator()
Gets anEvaluator
suitable for measuring performance of predictions for the Output subclass. -
Uses of Evaluation in org.tribuo.anomaly.evaluation
-
Uses of Evaluation in org.tribuo.classification.evaluation
Modifier and TypeInterfaceDescriptioninterface
ClassifierEvaluation<T extends Classifiable<T>>
Defines methods that calculate classification performance, used for both multi-class and multi-label classification.interface
Adds multi-class classification specific metrics toClassifierEvaluation
. -
Uses of Evaluation in org.tribuo.clustering.evaluation
-
Uses of Evaluation in org.tribuo.evaluation
Modifier and TypeClassDescriptionclass
AbstractEvaluator<T extends Output<T>,
C extends MetricContext<T>, E extends Evaluation<T>, M extends EvaluationMetric<T, C>> Base class for evaluators.class
CrossValidation<T extends Output<T>,
E extends Evaluation<T>> A class that does k-fold cross-validation.interface
EvaluationRenderer<T extends Output<T>,
E extends Evaluation<T>> Renders anEvaluation
into a String.interface
Evaluator<T extends Output<T>,
E extends Evaluation<T>> An evaluation factory which produces immutableEvaluation
s of a givenDataset
using the givenModel
.final class
OnlineEvaluator<T extends Output<T>,
E extends Evaluation<T>> An evaluator which aggregates predictions and producesEvaluation
s covering all thePrediction
s it has seen or created.Modifier and TypeMethodDescriptionstatic <T extends Output<T>,
R extends Evaluation<T>>
com.oracle.labs.mlrg.olcut.util.Pair<Integer,Double> Calculates the argmax of a metric across the supplied evaluations.static <T extends Output<T>,
R extends Evaluation<T>>
Map<MetricID<T>,DescriptiveStats> Summarize all fields of a list of evaluations.static <T extends Output<T>,
R extends Evaluation<T>>
DescriptiveStatsEvaluationAggregator.summarize
(List<R> evaluations, ToDoubleFunction<R> fieldGetter) Summarize a single field of an evaluation across several evaluations.static <T extends Output<T>,
R extends Evaluation<T>>
Map<MetricID<T>,DescriptiveStats> EvaluationAggregator.summarize
(Evaluator<T, R> evaluator, List<? extends Model<T>> models, Dataset<T> dataset) Summarize performance using the supplied evaluator across several models on one dataset.static <T extends Output<T>,
R extends Evaluation<T>>
Map<MetricID<T>,DescriptiveStats> EvaluationAggregator.summarize
(Evaluator<T, R> evaluator, Model<T> model, List<? extends Dataset<T>> datasets) Summarize performance according to evaluator for a single model across several datasets.static <T extends Output<T>,
R extends Evaluation<T>>
Map<MetricID<T>,DescriptiveStats> EvaluationAggregator.summarizeCrossValidation
(List<com.oracle.labs.mlrg.olcut.util.Pair<R, Model<T>>> evaluations) Summarize all fields of a list of evaluations produced byCrossValidation
. -
Uses of Evaluation in org.tribuo.interop.modelcard
ModifierConstructorDescriptionModelCard
(Model<?> model, Evaluation<?> evaluation) Creates an instance of ModelCard that does not include any extracted metrics and has itsUsageDetails
set to null.Creates an instance of ModelCard that has itsUsageDetails
set to null.ModelCard
(Model<?> model, Evaluation<?> evaluation, Map<String, Double> testingMetrics, UsageDetails usage) Creates an instance of ModelCard.ModelCard
(Model<?> model, Evaluation<?> evaluation, UsageDetails usage) Creates an instance of ModelCard that does not include any extracted metrics.TestingDetails
(Evaluation<?> evaluation) Creates an instance of TestingDetails.TestingDetails
(Evaluation<?> evaluation, Map<String, Double> testingMetrics) Creates an instance of TestingDetails. -
Uses of Evaluation in org.tribuo.multilabel.evaluation
Modifier and TypeClassDescriptionfinal class
The implementation of aMultiLabelEvaluation
using the default metrics. -
Uses of Evaluation in org.tribuo.regression.evaluation
Modifier and TypeInterfaceDescriptioninterface
Defines methods that calculate regression performance.