The inventor of the bitter lesson has a bitter lesson for LLM scaling enthusiasts
AI-generated summary Turing Award winner Richard Sutton says raw compute alone is not enough for artificial intelligence and that artificial intelligence science needs clever new methods. OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei disagree, stating that large language model scaling is far from exhausted and that the data favor further scaling.