Probing vs Zero-Shot Language Model Introspection
AI-generated summary Georgia Tech researchers evaluated language model introspection by comparing linear probes against zero-shot self-reporting using the OLMo 3 family from the Allen Institute for AI. The study found that internal activation perturbations become decodable early in pretraining long before models learn to report them behaviorally.