# robots.txt file for http://www.reentry.org # Re-Entry Prison and Jail Ministry # # The robots.txt file is intended to prohibit search engines/robots # from indexing certain areas of our web site. # # The * given for User-agent means that the following set of # "Disallows" apply to each and every search engine/robot that # comes here. User-agent: * # Stay away from/Disallow access to the following directories Disallow: /_cfm/ Disallow: /_ Disallow: /cfm/ Disallow: /cgi-bin/ Disallow: /dev/ # The above "disallow" prohibits spiders/robots/ search engines # indexing anything in the site.