Post-hoc calibration corrects reported confidence, yet a multiclass calibrator can also change the associated top-1 prediction. Accuracy captures only the net effect of these changes on correctness, not how often predictions change; the Top-1 Prediction Change Rate (TPCR) instead measures this frequency. We propose Calibrator-Output Repair for Top-1 Decision Preservation (CORD), the first post-fit adapter to impose exact prediction preservation by repairing the full calibrated probability vector. From the original and calibrated outputs alone, CORD determines the mass assigned to the original top-1. The calibrated conditional distribution allocates the remaining mass over the other classes, yielding a repaired vector whose own argmax recovers the original prediction. On the calibration split, CORD coordinates the repaired masses to retain the calibrated outputs' mean mass on original predictions whenever attainable. The adapter alters neither the fitted calibrator nor its direct output, fits no additional supervised map, and requires no user- or validation-tuned hyperparameter. Across CIFAR-10/100 and ImageNet-1K, CORD attains zero TPCR by construction and lowers mean ECE, NLL, and Brier relative to the corresponding direct outputs in every dataset; paired gains persist under distribution shift and across calibration-set sizes. CORD thus removes the preservation constraint from calibrator fitting and assigns exact recovery of the original decision to subsequent output repair. Our code is available at https://github.com/labhai/CORD.
Alex: Welcome to another episode of ResearchPod.
Sam: Today we're looking at a paper called "Let Confidence Change, Not the Prediction." It targets a failure mode that's easy to overlook in post-hoc calibration. Standard methods — temperature scaling, isotonic regression, Platt scaling — optimize for confidence accuracy, but they have no formal obligation to preserve the model's original top-1 decision. So you can end up in a situation where calibration actually flips the predicted class. The model said "benign," the calibrator says "malignant," and downstream, a clinician acts on the calibrated output.
Alex: That's a meaningful failure mode. So the authors' argument is that the preservation constraint is being applied in the wrong place — instead of constraining the calibrator during fitting, you fix the output afterward?
Sam: Exactly. They introduce CORD — Calibrator-Output Repair for Top-1 Decision Preservation. The core idea is to treat the calibrated probability vector as a starting point, then solve for the minimal adjustment that restores the original argmax. Think of it as projecting back onto the feasible region of the simplex where the original prediction wins, while disturbing the rest of the distribution as little as possible.
Alex: Walk me through the mechanism. If the calibrator shifts enough probability mass that "malignant" overtakes "benign," CORD intervenes — but how does it decide how much mass to move?
Sam: It works over the conditional distribution on the non-predicted classes. The repair finds the minimum scalar adjustment to the top-1 class probability that satisfies the argmax constraint, optimized over the calibration set using KL divergence as the objective. So it's not arbitrary — it's the smallest intervention that recovers the original decision, and the relative ordering among the non-top classes is preserved.
Alex: Here's where I'd push back. If the calibrator is trying to flip the prediction, maybe it has a point. You're overriding what could be a genuine correction.
Sam: That's the right tension to name. CORD takes a firm stance: the base classifier's decision is authoritative, and calibration is only in the business of improving confidence reliability, not revising predictions. The justification is empirical — across their experiments, applying CORD on top of unconstrained calibrators actually improves Expected Calibration Error and Negative Log-Likelihood compared to calibrators trained with explicit decision-preservation constraints. The intuition is that constrained calibrators are less expressive during fitting, so they find worse optima. Freeing the calibrator and repairing afterward gives you the best of both.
Alex: So the repair isn't just neutral — it's actively improving calibration quality.
Sam: Right, and that's the load-bearing finding. It holds across multiple base calibrators and datasets, which matters — if it only worked with one calibrator family, you'd worry it was an artifact of that specific interaction. The consistency across methods is what makes the modularity claim credible.
Alex: How sensitive is the repair to the quality of the underlying calibrator? If the calibrator is badly misaligned to begin with, can CORD recover?
Sam: That's the primary constraint on the method. CORD is bounded by what the base calibrator provides. If the calibration set is too small, or the calibrator is systematically off, the repair is optimizing within a feasible interval that's already poorly positioned. It's a filter, not a reconstruction — you still need a reasonable calibrator underneath.
Alex: So the modularity cuts both ways. Clean to apply, but it inherits the upstream problems.
Sam: Precisely. And that points to where the paper is deliberately quiet. The current framework handles top-1 preservation in standard multiclass classification. The authors acknowledge that extending to hierarchical or multi-label settings is an open problem — the optimization becomes substantially more complex when "preserving the decision" isn't a single argmax condition.
Alex: That feels like a natural place for a referee to push. Has the repair been tested under severe class imbalance, or where the base model is already poorly calibrated by construction?
Sam: The paper doesn't systematically address those cases, which is a fair gap. The experiments are on reasonably well-trained classifiers with standard calibration splits. Whether the method degrades gracefully under distribution shift, or when the calibration set is small relative to the number of classes, isn't fully characterized. Those are the conditions where you'd want robustness checks before deploying this in a high-stakes pipeline.
Alex: So the practical takeaway is: CORD is a clean, modular post-processing step that decouples the calibration objective from decision preservation — and that decoupling appears to help both. But it's not a substitute for a well-functioning calibrator, and the extension to more complex prediction structures is still open.
Sam: That's the right read. The contribution is architectural as much as empirical — it reframes where the preservation constraint belongs. Rather than baking it into the calibration loss and paying an expressiveness penalty, you handle it as a deterministic repair step. For practitioners, that means you can swap in any calibrator you like and apply CORD as a wrapper. No retraining, no additional hyperparameters, no modification to the base model.
Alex: It's a pragmatic piece of work. Solves an operational conflict cleanly, with a mechanism that's transparent enough to reason about. Thanks for walking through it — and thanks to everyone listening to ResearchPod.