opendataval.experiment.exper_methods#

Experiments to test DataEvaluator.

Experiments pass into evaluate() and plot() evaluate performance of one DataEvaluator at a time.

Functions

discover_corrupted_sample(evaluator[, ...])

Evaluate discovery of noisy indices in low data value points.

increasing_bin_removal(evaluator[, fetcher, ...])

Evaluate accuracy after removing data points with data values above threshold.

noisy_detection(evaluator[, fetcher, indices])

Evaluate ability to identify noisy indices.

remove_high_low(evaluator[, fetcher, model, ...])

Evaluate performance after removing high/low points determined by data valuator.

save_dataval(evaluator[, fetcher, indices, ...])

Save the indices and the respective data values of the DataEvaluator.