Learning to capture the world one memory at a time