Welcome to the era of embodied AI: Introducing AA-Robotics v0.1
AI-generated summary artificialanalysis.ai previews AA-Robotics v0.1 to measure frontier language model performance on understanding, planning, and acting in the physical world using a 6-axis robot arm. artificialanalysis.ai states that today's language models are currently far too slow and expensive for any kind of production usage on these tasks.