I don't believe the mice actually knew the question, (pertaining to Life the Universe and Everything) since they were unable to disect Arther Dent's brain. They came up with something along the lines of "How many roads must a man walk?" and ran with that.