[GRASS-dev] [GRASS GIS] #3983: robots.txt unmaintained and lacks sitemaps

[GRASS GIS]

#3983: robots.txt unmaintained and lacks sitemaps
-------------------------+-------------------------
 Reporter:  jidanni      |      Owner:  grass-dev@…
     Type:  defect       |     Status:  new
 Priority:  trivial      |  Milestone:
Component:  Website      |    Version:  unspecified
 Keywords:               |        CPU:  Unspecified
 Platform:  Unspecified  |
-------------------------+-------------------------
 Google is returning older versions of man pages instead of the current
 (v78) ones.

 This is due to robots.txt not having been updated since 2015,


 {{{
 $ HEAD https://grass.osgeo.org/robots.txt
 Last-Modified: Tue, 20 Jan 2015 11:14:30 GMT

 $ GET https://grass.osgeo.org/robots.txt
 Disallow: /grass61/manuals/
 Disallow: /grass62/manuals/
 Disallow: /grass63/manuals/
 Disallow: /grass65/manuals/
 }}}


 And most importantly, the lack of sitemap entries.
  https://support.google.com/webmasters/answer/156184

-- 
Ticket URL: <https://trac.osgeo.org/grass/ticket/3983>
GRASS GIS <https://grass.osgeo.org>