Sketching Speeds Up LLM Context Attribution
AI-generated summary Researchers from Google Research and Yale University released a preprint introducing a randomized sketching algorithm for language model context attribution. The team validated their algorithm using the Llama-3.2-1B-Instruct model on an NVIDIA H100 GPU to estimate leave-one-out prompt attribution without evaluating each token individually.