Stanford Memorilla: Latent Memory for Frozen LLMs
AI-generated summary Researchers from Stanford University and partner institutions open-sourced Memorilla, an architecture designed to provide frozen large language models with persistent access to extensive document collections. Evaluations on hardware including NVIDIA H100 and B200 GPUs demonstrated that the system compresses context while maintaining stable latency across expanded corpora.