nucleus.validate.scenario_test_metric

ScenarioTestMetric

A Scenario Test Metric is an evaluation function combined with a comparator and associated with a Scenario Test.

class nucleus.validate.scenario_test_metric.ScenarioTestMetric

A Scenario Test Metric is an evaluation function combined with a comparator and associated with a Scenario Test. Scenario Test Metrics serve as the basis when evaluating a Model on a Scenario Test.

set_threshold(threshold=None)

Sets the threshold of the metric to the new value passed in as a parameters. .. attribute:: threshold

The ID of the scenario test.

type:

str

Parameters:

threshold (Optional[float]) –

Return type:

None