[GRASSweb-list]markus: web robots.txt,NONE,1.1
grass at intevation.de
grass at intevation.de
Tue Aug 2 17:00:29 EDT 2005
Author: markus
Update of /grassrepository/web
In directory doto:/tmp/cvs-serv20538
Added Files:
robots.txt
Log Message:
added to CVS
--- NEW FILE: robots.txt ---
# mail to 'weblist AT grass.itc.it' for constructive criticism!
#
# the Wget agent is disabled due to abuse:
User-agent: Wget
Disallow: /
User-agent: *
Disallow: /cgi-bin
Disallow: /tmp
Disallow: /spearfish
Disallow: /grassbook
Disallow: /webalizer
More information about the grass-web
mailing list