We like the bot indexing. Helps the sites come up higher in the search lists when searching for "Hobie" terms.

I think the robots.txt files are used to "protect" information from bots.