############################################################################ ## This file controls the accessibility of this server to web crawlers ## ## robots, and indexing engines. ## ## ## ## The format is as follows: ## ## ## ## A line beginning with a # is a comment. ## ## ## ## A control directive begins with a user agent list (* means all). ## ## User-agent: ## ## ex. User-agent: AltaVista Intranet Webreq Google ## ## ## ## The control directive is completed with one or more disallow lines ## ## Disallow: /index.html ## ## Disallow: /Help/ ## ## Disallow: /Help ## ## ## ## The second entry will protect the Help directory and all ## ## subdirectories. ## ## The third entry will protect the Help directory and all ## ## subdirectories as well as Help.html and HelpingHands.html ## ## ## ## *** Everything that is not explicitly disallowed is allowed *** ## ## ## ############################################################################ # This will protect the entire site from all agents. User-agent: * #Disallow: / Allow: /Public/