I learn that babies born in the 1880s have better cognitive skills than modern babies, and are able to remember things that happened in the first year of your life (long term memory in real life doesn't start to develop until around age 3 or 4).
I assumed the Robinsons passed the story on to the kid after he was old enough to understand it. It was actually one of the few things in the film that did make sense.