[GRASSweb-list]markus: web robots.txt,NONE,1.1
    grass at intevation.de 
    grass at intevation.de
       
    Tue Aug  2 17:00:29 EDT 2005
    
    
  
Author: markus
Update of /grassrepository/web
In directory doto:/tmp/cvs-serv20538
Added Files:
	robots.txt 
Log Message:
added to CVS
--- NEW FILE: robots.txt ---
# mail to 'weblist AT grass.itc.it' for constructive criticism!
#
# the Wget agent is disabled due to abuse:
User-agent: Wget
Disallow: /
User-agent: *
Disallow: /cgi-bin
Disallow: /tmp
Disallow: /spearfish
Disallow: /grassbook
Disallow: /webalizer
    
    
More information about the grass-web
mailing list