On data
- Mobile ALOHA cooks shrimp for $32,000
Stanford's two-armed robot on a wheeled base learned to cook, wipe spills and call an elevator from about fifty demonstrations per task. Cheap hardware plus teleoperation is changing robot data.
2 min reads likes comments - We've been undertraining
DeepMind's Chinchilla paper says large language models have far too many parameters for the data they see. The fix is more data, and that raises a question about where it comes from.
2 min reads likes comments - Why our models train on forty different lobbies
A year of live events taught us that benchmark accuracy barely predicts real-world accuracy. What we changed in how we collect data and evaluate.
2 min reads likes comments