Attention Is Not What You Need, Tested: Taking Grassmann Flows from Language Models to Speech Recognition
AI-generated summary Dhruv Vakharwala tested an attention-free layer called Grassmann flows from a paper by Zhang Chong to see if it can replace self-attention in speech recognition. The author wrote a speech experiment using a 15-block Conformer-CTC on LibriSpeech-100 with four arms on two independent code paths.