[gdal-dev] GDAL VRT with Cloud Optimized GeoTIFFs and AWS

[Richard Greenwood]

What are the advantages of storing the imagery in S3 as opposed to EBS? I'm
using the throughput optimized magnetic EBS which I is a little less
expensive than S3. I did some testing a couple years ago and didn't see
enough performance gain to justify SSD. Have you tested S3 against any of
the EBS options?

Rich


On Sat, Mar 2, 2019 at 7:58 AM Jeremy Palmer <palmerjnz at gmail.com> wrote:

> I've now found this useful Mapserver wiki page
> https://github.com/mapserver/mapserver/wiki/Render-images-straight-out-of-S3-with-the-vsicurl-driver.
> It seems to imply that it's better to merge a collection of dataset tiles
> into a single big Geotiff rather than create a VRT due to the repeated HTTP
> calls. I'm still interested in people's experiences using imagery direct
> from S3 and it's performance.
>
> Note some of my largest datasets have a total size of 1.5TBs uncompressed
> Geotiff with about 8000 tiles @ 175mb per tile. I'll likely compress the
> uncompressed Geotiffs and use JPEG compression, which I estimate can bring
> the size down to about 200GB total.
>
> Cheers
> Jeremy
>
> On Sat, Mar 2, 2019 at 9:15 AM Jeremy Palmer <palmerjnz at gmail.com> wrote:
>
>> Hi All,
>>
>> Does anyone have any tips or experience in trying to serve RGB large
>> imagery multi file datasets hosted on S3 to application servers/containers
>> for bulk tile rendering? Is this possible using VRTs and is the performance
>> manageable when compared to other mounted storage options?
>>
>> Thanks,
>> Jeremy
>>
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/gdal-dev



-- 
Richard W. Greenwood, PLS
www.greenwoodmap.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20190304/e61f9fe3/attachment.html>