StateBench: Testing how language models track state changes over long documents
AI-generated summary Hugging introduced StateBench, a benchmark designed to evaluate how language models track entity state changes across long documents. The publisher says tests showed recurrent and hybrid models generalize much farther than transformers when trained directly on these tasks.