[gdal-dev] GDAL VRT with Cloud Optimized GeoTIFFs and AWS

[Jeremy Palmer]

I've now found this useful Mapserver wiki page
https://github.com/mapserver/mapserver/wiki/Render-images-straight-out-of-S3-with-the-vsicurl-driver.
It seems to imply that it's better to merge a collection of dataset tiles
into a single big Geotiff rather than create a VRT due to the repeated HTTP
calls. I'm still interested in people's experiences using imagery direct
from S3 and it's performance.

Note some of my largest datasets have a total size of 1.5TBs uncompressed
Geotiff with about 8000 tiles @ 175mb per tile. I'll likely compress the
uncompressed Geotiffs and use JPEG compression, which I estimate can bring
the size down to about 200GB total.

Cheers
Jeremy

On Sat, Mar 2, 2019 at 9:15 AM Jeremy Palmer <palmerjnz at gmail.com> wrote:

> Hi All,
>
> Does anyone have any tips or experience in trying to serve RGB large
> imagery multi file datasets hosted on S3 to application servers/containers
> for bulk tile rendering? Is this possible using VRTs and is the performance
> manageable when compared to other mounted storage options?
>
> Thanks,
> Jeremy
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20190303/e1e2bc31/attachment.html>