[mapserver-users] Gallery: running mapserver in docker on kubernetes
Jan Hartmann
j.l.h.hartmann at uva.nl
Fri Aug 30 05:20:28 PDT 2019
Hi Pete, could you explain what you mean by "cloud-optimized geotiffs?
Regards,
Jan
On 8/29/2019 5:42 PM, Peter Schmitt wrote:
> > If anyone is interested by our docker image, you can find it here:
> https://github.com/camptocamp/docker-mapserver
>
> Thanks for sharing this, Yves!
>
> Regarding /vsicurl/ performance you mentioned:
>
> > We saw some drawback when displaying maps on low scale as too much
> files should be read. Visicurl seems copy the files in the container.
> We need to check this to confirm, but probably someone have a better
> understanding of how visicurl and visis3 work.
>
> There might be two things at play: First, using cloud-optimized
> geotiffs greatly reduces the number of curl requests required.
> Secondly, a few GDAL config options dramatically improved performance
> for me. Here's what I've had the best luck with (although your
> specific use case probably requires different settings)
>
> CONFIG "CPL_VSIL_CURL_ALLOWED_EXTENSIONS" "vrt tif geojson zip gpkg"
> CONFIG "GDAL_DISABLE_READDIR_ON_OPEN" "YES"
> CONFIG "GDAL_INGESTED_BYTES_AT_OPEN" "262144" # Bytes. This is
> the value required to have 1 CURL request when opening one of our COGs
> that has many levels deep of overviews
> CONFIG "VSI_CACHE" "FALSE"
> CONFIG "GDAL_CACHEMAX" "80" # MB
> CONFIG "OGR_SQLITE_CACHE" "10" # MB
>
>
> I'm curious about this comment in your config: "mapserver has memory
> leaks, this limit should improve long term memory usage"
> https://github.com/camptocamp/docker-mapserver/blob/ba86f87b0ec1357ad5a8ae6159a005e24db64e3f/server/runtime/etc/apache2/conf-enabled/mapserver.conf#L1-L2
>
> I've got a MapServer instance configured with > 100 million
> requests/year. I also see some behavior suggesting a memory leak
> somewhere, but I have not tracked it down. Here's my Dockerized
> MapServer, which uses NGINX to proxy to MapServer via FCGI:
> https://github.com/pedros007/debian-mapserver
>
> Here's my memory use for a Docker container running 8 mapserv
> processes. 300% in the scale corresponds to 3 GB of memory usage.
> https://i.imgur.com/CXBDsuw.png
>
> Cheers,
> Pete
>
More information about the MapServer-users
mailing list