[GRASS-web] markus: web robots.txt,1.3,1.4
grass at intevation.de
grass at intevation.de
Tue Nov 20 04:15:34 EST 2007
Author: markus
Update of /grassrepository/web
In directory doto:/tmp/cvs-serv6980
Modified Files:
robots.txt
Log Message:
enable wget again
Index: robots.txt
===================================================================
RCS file: /grassrepository/web/robots.txt,v
retrieving revision 1.3
retrieving revision 1.4
diff -u -d -r1.3 -r1.4
--- robots.txt 4 Jul 2007 14:28:55 -0000 1.3
+++ robots.txt 20 Nov 2007 09:15:32 -0000 1.4
@@ -1,8 +1,8 @@
# mail to 'weblist AT grass.itc.it' for constructive criticism!
#
# the Wget agent is disabled due to abuse:
-User-agent: Wget
-Disallow: /
+#User-agent: Wget
+#Disallow: /
User-agent: *
Disallow: /cgi-bin
Disallow: /tmp
More information about the grass-web
mailing list