AI calibration: why language models often lie about their confidence

AI models often lie about how confident they are — they say '99% certain' when they're really just guessing. This matters because decisions about jobs, medical treatments, and even immigration are increasingly automated by LMs. New calibration techniques like Platt scaling and isotonic regression help fix this — they make LMs' confidence scores more accurate. Why this matters for us: Brown communities are more likely to rely on these automated decisions, and calibration ensures they're not just random guesses.