The AI Data Problem Moved Downstream

Last year I wrote that robotics had a data problem language models were lucky enough to avoid. Text, images, and code had accumulated for decades before anyone decided to train models on them. Robots had no comparable internet of physical experience. That distinction is starting to look less clean. Recent systems have trained on enormous…