[gdal-dev] Building GDAL documentation with ReadTheDocs

[Daniel Baston]

> From what I see, robots.txt is automatically configured for the default version:
> https://docs.readthedocs.io/en/stable/reference/robots.html

I read this as saying that the robots.txt published by the default
branch will be served from the top level of the domain
(https://proj.org/robots.txt) and that a robots.txt associated with
any other branch will be ignored.

If no robots.txt is provided, ReadTheDocs uses a default which allows
indexing of all non-hidden branches. PROJ does not appear to have any
branches that are hidden with RTD, so all versions >= 5.0 would be
indexed.

User-agent: *

Disallow: # Allow everything

Sitemap: https://proj.org/sitemap.xml

Dan