Attached is a generic robots.txt file for drupal
http://drupal.org/node/22265
http://www.searchengineworld.com/robots/robots_tutorial.htm
