Token Pooling-Aware Training for Multi-Vector Embedding Models
AI-generated summary Token pooling-aware training teaches the encoder to preserve important information when document vectors are merged for retrieval models. Using Sentence Transformers, token pooling-aware training raises retention to 97.8% at a pool factor of four compared to 94.6% for normally trained models.