reliability-diagram

Measures what your Jev classifier's confidence is really worth, and sets the human hand-off line from what a mistake costs.

khalib is a classifier calibration algorithm based on Khiops

Calibration and uncertainty quantification for ranking systems.

Study and Implementation of various neural network pruning techniques. Extending the lottery ticket hypothesis to structured pruning for accelerated training while maintaining uncertainty and accuracy. The focus is on simplifying the model's complexity without sacrificing its overall performance or leading to overfitting.

Compare classifier confidence with accuracy using your own predictions. Browser-based calibration analysis and reports.

TypeScript binary forecast metrics: Brier score, log loss, ROC AUC, reliability diagrams, ECE and seeded day-block bootstrap intervals.

Is your model's confidence honest? ECE, Brier decomposition, reliability diagrams and temperature scaling. Zero dependencies.

Calibration auditing for probabilistic predictions: reliability diagrams, ECE, Brier decomposition, temperature scaling. Zero dependencies.