Investigating What Open Models Knew When They Answered Questions Incorrectly
AI-generated summary Patronus.ai says it tested open models on software tasks to investigate whether incorrect answers mean the model failed to compute the answer or computed it internally and said something else. Patronus.ai says probes on activations beat model answers on rate of change tasks across five models, while service topology tasks showed no sign the answer was ever computed.