#===============================================================================
#
#   Copyright (c) 2000 Software Productivity Center Inc.  All rights reserved.
#
# File:         robots.txt
#
# Summary:      Web Robot Exclusion File
#
# Project:      SPC WEB
#
# Author(s):    Bill Dagg
#
# Description:  This file specifies areas of the Web site that are not to be 
#				accessed by Web robots, or spiders.
#
# Notes:		1. This file must be named "robots.txt" and must reside at the
#					Web site document root.
#
#				2. Even if no areas of the Web site are to be excluded, DON'T
#					REMOVE THIS FILE from the document root.  Its presence
#					prevents 404 "Not found" errors from occurring (for 
#					"robots.txt") in Web site error logs.
#
#				3.	Refer to the following URL for full "robots.txt" details:
#
#					http://info.webcrawler.com/mak/projects/robots/robots.html
#
#===============================================================================
#
#
#  17-nov-2007 D.Muir addedecommends to block off downloads etc to indexing robots
#
#
#
#
#
User-agent: *  
Disallow: /logs
Disallow: /logs/
Disallow: /webstats
Disallow: /webstats/
Disallow: /downloads
Disallow: /downloads/