braindetox.kr · Sat 7 Nov

Saturday 7 November

ERNIE 5.5 Flash Base Release: 280B-A14B Weights and License Territory Terms

AI-generated summary Baidu says it is releasing ERNIE-5.5-Flash-Base, a sparse Mixture-of-Experts language model with 280 billion total parameters and 14 billion activated parameters per token. Baidu states that the model was pre-trained from scratch on 33.5 trillion tokens and supports a context of up to 128K during pre-training.