The Best Kept Secrets About data integration

http://shaneyuar698.trexgame.net/12-do-s-and-don-ts-for-a-successful-synthetic-data

This will allow Goggle (user-agent name GoogleBot) to go to every web site and directory, although at the same time banning Inquire Jeeves with the site absolutely