Lip-reading AI fills gaps in sentences by recognizing most certain words first
AI-generated summary Researchers at the Korea Advanced Institute of Science and Technology have developed a visual speech recognition technology using a diffusion large language model. The model identifies certain words first and uses surrounding context to decode remaining positions, achieving a word error rate of 19.4% on LRS3.