[mapserver-users] Gallery: running mapserver in docker on kubernetes

[Jan Hartmann]

Hi Pete, could you explain what you mean by "cloud-optimized geotiffs?

Regards,
Jan

On 8/29/2019 5:42 PM, Peter Schmitt wrote:
> > If anyone is interested by our docker image, you can find it here: 
> https://github.com/camptocamp/docker-mapserver
>
> Thanks for sharing this, Yves!
>
> Regarding /vsicurl/ performance you mentioned:
>
> > We saw some drawback when displaying maps on low scale as too much 
> files should be read. Visicurl seems copy the files in the container. 
> We need to check this to confirm, but probably someone have a better 
> understanding of how visicurl and visis3 work.
>
> There might be two things at play:  First, using cloud-optimized 
> geotiffs greatly reduces the number of curl requests required.  
> Secondly, a few GDAL config options dramatically improved performance 
> for me.  Here's what I've had the best luck with (although your 
> specific use case probably requires different settings)
>
> CONFIG "CPL_VSIL_CURL_ALLOWED_EXTENSIONS"      "vrt tif geojson zip gpkg"
> CONFIG "GDAL_DISABLE_READDIR_ON_OPEN"       "YES"
> CONFIG "GDAL_INGESTED_BYTES_AT_OPEN"      "262144" # Bytes. This is 
> the value required to have 1 CURL request when opening one of our COGs 
> that has many levels deep of overviews
> CONFIG "VSI_CACHE"      "FALSE"
> CONFIG "GDAL_CACHEMAX"      "80"       # MB
> CONFIG "OGR_SQLITE_CACHE"                      "10"       # MB
>
>
> I'm curious about this comment in your config: "mapserver has memory 
> leaks, this limit should improve long term memory usage" 
> https://github.com/camptocamp/docker-mapserver/blob/ba86f87b0ec1357ad5a8ae6159a005e24db64e3f/server/runtime/etc/apache2/conf-enabled/mapserver.conf#L1-L2
>
> I've got a MapServer instance configured with > 100 million 
> requests/year.  I also see some behavior suggesting a memory leak 
> somewhere, but I have not tracked it down. Here's my Dockerized 
> MapServer, which uses NGINX to proxy to MapServer via FCGI: 
> https://github.com/pedros007/debian-mapserver
>
> Here's my memory use for a Docker container running 8 mapserv 
> processes. 300% in the scale corresponds to 3 GB of memory usage.
> https://i.imgur.com/CXBDsuw.png
>
> Cheers,
> Pete
>