On curiosity
- Learning like a baby: a plan for an embodied world model
Google DeepMind's Gemini Robotics ER 2 gives robots a better high-level brain. The part I still think nobody has built is the body-first learning underneath. Here's the research plan I'd run.
3 min reads likes comments - The noisy TV problem
A curious agent gets hypnotized by random static. OpenAI's Random Network Distillation fixes it and beats humans at Montezuma's Revenge. What curiosity should actually reward.
2 min reads likes comments - Curiosity is a prediction error
A Berkeley paper gives agents an internal reward for being surprised by their own predictions. It learns Mario with no score at all, and it answers a question I asked two years ago.
2 min reads likes comments