Uncertainty

UAT-LITE: Inference-Time Uncertainty-Aware Attention for Pretrained Transformers

Making pretrained transformer attention sensitive to uncertainty during inference.

Beyond the Loss Curve: Scaling Laws, Active Learning, and the Limits of Learning from Exact Posteriors

Using exact posterior probabilities to separate reducible model error from uncertainty in the data.

The Illusion of AI Expertise Under Uncertainty: Navigating Elusive Ground Truth via a Probabilistic Paradigm

Accounting for ambiguous ground truth when comparing AI systems with experts.

Fine-Tuning with Uncertainty-Aware Priors Makes Vision and Language Foundation Models More Reliable

Improving the reliability of fine-tuned foundation models with priors that account for uncertainty.

Rate-In: Information-Driven Adaptive Dropout Rates for Improved Inference-Time Uncertainty Estimation

Adjusting dropout during inference to estimate uncertainty without additional labels or training.