<div dir="ltr">You may want to look at Google's store of Sentinel-2 as Google faithfully follows the SAFE format, which looks to be what's expected in the Sentinel2 driver.<div><br></div><div>The data stored in AWS has been post-processed for SentinelHub so is not SAFE format.</div><div><br></div><div>-bborie</div></div><br><div class="gmail_quote"><div dir="ltr">On Fri, Dec 7, 2018 at 12:43 PM Trochim, Edward <<a href="mailto:Edward.Trochim@radiantsolutions.com">Edward.Trochim@radiantsolutions.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="m_-956372206880382284WordSection1">
<p class="MsoNormal">Hi Everyone,<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I am using gdal 2.3.2 to access Sentinel-2 data on the AWS Open Data Registry (<a href="https://registry.opendata.aws/sentinel-2/" target="_blank">https://registry.opendata.aws/sentinel-2/</a>). I am using a version of GDAL I built myself in an Amazon
Linux docker image with the intention of eventually running it on AWS Lambda.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I am trying to use gdal’s built-in support for Sentinel-2 (<a href="https://www.gdal.org/frmt_sentinel2.html" target="_blank">https://www.gdal.org/frmt_sentinel2.html</a>) to easily read all the band data with vsis3 (<a href="https://www.gdal.org/gdal_virtual_file_systems.html#gdal_virtual_file_systems_vsis3" target="_blank">https://www.gdal.org/gdal_virtual_file_systems.html#gdal_virtual_file_systems_vsis3</a>).
However, when I do so I get this error:<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"># gdalinfo /vsis3/sentinel-s2-l2a/tiles/23/L/MD/2016/10/27/0/metadata.xml --config AWS_REQUEST_PAYER requester<u></u><u></u></p>
<p class="MsoNormal">ERROR 4: `/vsis3/sentinel-s2-l2a/tiles/23/L/MD/2016/10/27/0/metadata.xml' not recognized as a supported file format.<u></u><u></u></p>
<p class="MsoNormal">gdalinfo failed - unable to open '/vsis3/sentinel-s2-l2a/tiles/23/L/MD/2016/10/27/0/metadata.xml'.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">After taking a look at the Sentinel2 driver source code I saw that I needed to prepend SENTINEL2_L2A: to the path. With that I got a different error:<u></u><u></u></p>
<p class="MsoNormal"># gdalinfo SENTINEL2_L2A:/vsis3/sentinel-s2-l2a/tiles/23/L/MD/2016/10/27/0/metadata.xml --config AWS_REQUEST_PAYER requester<u></u><u></u></p>
<p class="MsoNormal">ERROR 1: Invalid syntax for SENTINEL2_L2A:<u></u><u></u></p>
<p class="MsoNormal">gdalinfo failed - unable to open 'SENTINEL2_L2A:/vsis3/sentinel-s2-l2a/tiles/23/L/MD/2016/10/27/0/metadata.xml'.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">After some investigation I found this pull request (<a href="https://github.com/OSGeo/gdal/pull/1069" target="_blank">https://github.com/OSGeo/gdal/pull/1069</a>) which seems to add support for the data that I’m trying to access. However, after rebuilding
off the master branch in github I’m still getting the same errors.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Accessing the band files individually seems to work correctly:<u></u><u></u></p>
<p class="MsoNormal"># gdalinfo /vsis3/sentinel-s2-l2a/tiles/23/L/MD/2016/10/27/0/R10m/B02.jp2 --config AWS_REQUEST_PAYER requester<u></u><u></u></p>
<p class="MsoNormal">Driver: JP2OpenJPEG/JPEG-2000 driver based on OpenJPEG library<u></u><u></u></p>
<p class="MsoNormal">Files: /vsis3/sentinel-s2-l2a/tiles/23/L/MD/2016/10/27/0/R10m/B02.jp2<u></u><u></u></p>
<p class="MsoNormal">Size is 10980, 10980<u></u><u></u></p>
<p class="MsoNormal">Coordinate System is:<u></u><u></u></p>
<p class="MsoNormal">PROJCS["WGS 84 / UTM zone 23S",<u></u><u></u></p>
<p class="MsoNormal">…<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Does anyone know what I’m doing wrong?<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">In case it is helpful here is the output of gdalinfo –formats<u></u><u></u></p>
<p class="MsoNormal">Supported Formats:<u></u><u></u></p>
<p class="MsoNormal"> VRT -raster- (rw+v): Virtual Raster<u></u><u></u></p>
<p class="MsoNormal"> DERIVED -raster- (ro): Derived datasets using VRT pixel functions<u></u><u></u></p>
<p class="MsoNormal"> GTiff -raster- (rw+vs): GeoTIFF<u></u><u></u></p>
<p class="MsoNormal"> NITF -raster- (rw+vs): National Imagery Transmission Format<u></u><u></u></p>
<p class="MsoNormal"> RPFTOC -raster- (rovs): Raster Product Format TOC format<u></u><u></u></p>
<p class="MsoNormal"> ECRGTOC -raster- (rovs): ECRG TOC format<u></u><u></u></p>
<p class="MsoNormal"> HFA -raster- (rw+v): Erdas Imagine Images (.img)<u></u><u></u></p>
<p class="MsoNormal"> SAR_CEOS -raster- (rov): CEOS SAR Image<u></u><u></u></p>
<p class="MsoNormal"> CEOS -raster- (rov): CEOS Image<u></u><u></u></p>
<p class="MsoNormal"> JAXAPALSAR -raster- (rov): JAXA PALSAR Product Reader (Level 1.1/1.5)<u></u><u></u></p>
<p class="MsoNormal"> GFF -raster- (rov): Ground-based SAR Applications Testbed File Format (.gff)<u></u><u></u></p>
<p class="MsoNormal"> ELAS -raster- (rw+v): ELAS<u></u><u></u></p>
<p class="MsoNormal"> AIG -raster- (rov): Arc/Info Binary Grid<u></u><u></u></p>
<p class="MsoNormal"> AAIGrid -raster- (rwv): Arc/Info ASCII Grid<u></u><u></u></p>
<p class="MsoNormal"> GRASSASCIIGrid -raster- (rov): GRASS ASCII Grid<u></u><u></u></p>
<p class="MsoNormal"> SDTS -raster- (rov): SDTS Raster<u></u><u></u></p>
<p class="MsoNormal"> DTED -raster- (rwv): DTED Elevation Raster<u></u><u></u></p>
<p class="MsoNormal"> PNG -raster- (rwv): Portable Network Graphics<u></u><u></u></p>
<p class="MsoNormal"> JPEG -raster- (rwv): JPEG JFIF<u></u><u></u></p>
<p class="MsoNormal"> MEM -raster- (rw+): In Memory Raster<u></u><u></u></p>
<p class="MsoNormal"> JDEM -raster- (rov): Japanese DEM (.mem)<u></u><u></u></p>
<p class="MsoNormal"> GIF -raster- (rwv): Graphics Interchange Format (.gif)<u></u><u></u></p>
<p class="MsoNormal"> BIGGIF -raster- (rov): Graphics Interchange Format (.gif)<u></u><u></u></p>
<p class="MsoNormal"> ESAT -raster- (rov): Envisat Image Format<u></u><u></u></p>
<p class="MsoNormal"> BSB -raster- (rov): Maptech BSB Nautical Charts<u></u><u></u></p>
<p class="MsoNormal"> XPM -raster- (rwv): X11 PixMap Format<u></u><u></u></p>
<p class="MsoNormal"> BMP -raster- (rw+v): MS Windows Device Independent Bitmap<u></u><u></u></p>
<p class="MsoNormal"> DIMAP -raster- (rov): SPOT DIMAP<u></u><u></u></p>
<p class="MsoNormal"> AirSAR -raster- (rov): AirSAR Polarimetric Image<u></u><u></u></p>
<p class="MsoNormal"> RS2 -raster- (rovs): RadarSat 2 XML Product<u></u><u></u></p>
<p class="MsoNormal"> SAFE -raster- (rov): Sentinel-1 SAR SAFE Product<u></u><u></u></p>
<p class="MsoNormal"> PCIDSK -raster,vector- (rw+v): PCIDSK Database File<u></u><u></u></p>
<p class="MsoNormal"> PCRaster -raster- (rw+): PCRaster Raster File<u></u><u></u></p>
<p class="MsoNormal"> ILWIS -raster- (rw+v): ILWIS Raster Map<u></u><u></u></p>
<p class="MsoNormal"> SGI -raster- (rw+v): SGI Image File Format 1.0<u></u><u></u></p>
<p class="MsoNormal"> SRTMHGT -raster- (rwv): SRTMHGT File Format<u></u><u></u></p>
<p class="MsoNormal"> Leveller -raster- (rw+v): Leveller heightfield<u></u><u></u></p>
<p class="MsoNormal"> Terragen -raster- (rw+v): Terragen heightfield<u></u><u></u></p>
<p class="MsoNormal"> ISIS3 -raster- (rw+v): USGS Astrogeology ISIS cube (Version 3)<u></u><u></u></p>
<p class="MsoNormal"> ISIS2 -raster- (rw+v): USGS Astrogeology ISIS cube (Version 2)<u></u><u></u></p>
<p class="MsoNormal"> PDS -raster- (rov): NASA Planetary Data System<u></u><u></u></p>
<p class="MsoNormal"> PDS4 -raster- (rw+vs): NASA Planetary Data System 4<u></u><u></u></p>
<p class="MsoNormal"> VICAR -raster- (rov): MIPL VICAR file<u></u><u></u></p>
<p class="MsoNormal"> TIL -raster- (rov): EarthWatch .TIL<u></u><u></u></p>
<p class="MsoNormal"> ERS -raster- (rw+v): ERMapper .ers Labelled<u></u><u></u></p>
<p class="MsoNormal"> JP2OpenJPEG -raster,vector- (rwv): JPEG-2000 driver based on OpenJPEG library<u></u><u></u></p>
<p class="MsoNormal"> L1B -raster- (rovs): NOAA Polar Orbiter Level 1b Data Set<u></u><u></u></p>
<p class="MsoNormal"> FIT -raster- (rwv): FIT Image<u></u><u></u></p>
<p class="MsoNormal"> GRIB -raster- (rwv): GRIdded Binary (.grb, .grb2)<u></u><u></u></p>
<p class="MsoNormal"> RMF -raster- (rw+v): Raster Matrix Format<u></u><u></u></p>
<p class="MsoNormal"> WCS -raster- (rovs): OGC Web Coverage Service<u></u><u></u></p>
<p class="MsoNormal"> WMS -raster- (rwvs): OGC Web Map Service<u></u><u></u></p>
<p class="MsoNormal"> MSGN -raster- (rov): EUMETSAT Archive native (.nat)<u></u><u></u></p>
<p class="MsoNormal"> RST -raster- (rw+v): Idrisi Raster A.1<u></u><u></u></p>
<p class="MsoNormal"> INGR -raster- (rw+v): Intergraph Raster<u></u><u></u></p>
<p class="MsoNormal"> GSAG -raster- (rwv): Golden Software ASCII Grid (.grd)<u></u><u></u></p>
<p class="MsoNormal"> GSBG -raster- (rw+v): Golden Software Binary Grid (.grd)<u></u><u></u></p>
<p class="MsoNormal"> GS7BG -raster- (rw+v): Golden Software 7 Binary Grid (.grd)<u></u><u></u></p>
<p class="MsoNormal"> COSAR -raster- (rov): COSAR Annotated Binary Matrix (TerraSAR-X)<u></u><u></u></p>
<p class="MsoNormal"> TSX -raster- (rov): TerraSAR-X Product<u></u><u></u></p>
<p class="MsoNormal"> COASP -raster- (ro): DRDC COASP SAR Processor Raster<u></u><u></u></p>
<p class="MsoNormal"> R -raster- (rwv): R Object Data Store<u></u><u></u></p>
<p class="MsoNormal"> MAP -raster- (rov): OziExplorer .MAP<u></u><u></u></p>
<p class="MsoNormal"> KMLSUPEROVERLAY -raster- (rwv): Kml Super Overlay<u></u><u></u></p>
<p class="MsoNormal"> PDF -raster,vector- (w+): Geospatial PDF<u></u><u></u></p>
<p class="MsoNormal"> PLMOSAIC -raster- (ro): Planet Labs Mosaics API<u></u><u></u></p>
<p class="MsoNormal"> CALS -raster- (rwv): CALS (Type 1)<u></u><u></u></p>
<p class="MsoNormal"> WMTS -raster- (rwv): OGC Web Map Tile Service<u></u><u></u></p>
<p class="MsoNormal"> SENTINEL2 -raster- (rovs): Sentinel 2<u></u><u></u></p>
<p class="MsoNormal"> MRF -raster- (rw+v): Meta Raster Format<u></u><u></u></p>
<p class="MsoNormal"> PNM -raster- (rw+v): Portable Pixmap Format (netpbm)<u></u><u></u></p>
<p class="MsoNormal"> DOQ1 -raster- (rov): USGS DOQ (Old Style)<u></u><u></u></p>
<p class="MsoNormal"> DOQ2 -raster- (rov): USGS DOQ (New Style)<u></u><u></u></p>
<p class="MsoNormal"> PAux -raster- (rw+v): PCI .aux Labelled<u></u><u></u></p>
<p class="MsoNormal"> MFF -raster- (rw+v): Vexcel MFF Raster<u></u><u></u></p>
<p class="MsoNormal"> MFF2 -raster- (rw+): Vexcel MFF2 (HKV) Raster<u></u><u></u></p>
<p class="MsoNormal"> FujiBAS -raster- (rov): Fuji BAS Scanner Image<u></u><u></u></p>
<p class="MsoNormal"> GSC -raster- (rov): GSC Geogrid<u></u><u></u></p>
<p class="MsoNormal"> FAST -raster- (rov): EOSAT FAST Format<u></u><u></u></p>
<p class="MsoNormal"> BT -raster- (rw+v): VTP .bt (Binary Terrain) 1.3 Format<u></u><u></u></p>
<p class="MsoNormal"> LAN -raster- (rw+v): Erdas .LAN/.GIS<u></u><u></u></p>
<p class="MsoNormal"> CPG -raster- (rov): Convair PolGASP<u></u><u></u></p>
<p class="MsoNormal"> IDA -raster- (rw+v): Image Data and Analysis<u></u><u></u></p>
<p class="MsoNormal"> NDF -raster- (rov): NLAPS Data Format<u></u><u></u></p>
<p class="MsoNormal"> EIR -raster- (rov): Erdas Imagine Raw<u></u><u></u></p>
<p class="MsoNormal"> DIPEx -raster- (rov): DIPEx<u></u><u></u></p>
<p class="MsoNormal"> LCP -raster- (rwv): FARSITE v.4 Landscape File (.lcp)<u></u><u></u></p>
<p class="MsoNormal"> GTX -raster- (rw+v): NOAA Vertical Datum .GTX<u></u><u></u></p>
<p class="MsoNormal"> LOSLAS -raster- (rov): NADCON .los/.las Datum Grid Shift<u></u><u></u></p>
<p class="MsoNormal"> NTv1 -raster- (rov): NTv1 Datum Grid Shift<u></u><u></u></p>
<p class="MsoNormal"> NTv2 -raster- (rw+vs): NTv2 Datum Grid Shift<u></u><u></u></p>
<p class="MsoNormal"> CTable2 -raster- (rw+v): CTable2 Datum Grid Shift<u></u><u></u></p>
<p class="MsoNormal"> ACE2 -raster- (rov): ACE2<u></u><u></u></p>
<p class="MsoNormal"> SNODAS -raster- (rov): Snow Data Assimilation System<u></u><u></u></p>
<p class="MsoNormal"> KRO -raster- (rw+v): KOLOR Raw<u></u><u></u></p>
<p class="MsoNormal"> ROI_PAC -raster- (rw+v): ROI_PAC raster<u></u><u></u></p>
<p class="MsoNormal"> RRASTER -raster- (rw+v): R Raster<u></u><u></u></p>
<p class="MsoNormal"> BYN -raster- (rw+v): Natural Resources Canada's Geoid<u></u><u></u></p>
<p class="MsoNormal"> ARG -raster- (rwv): Azavea Raster Grid format<u></u><u></u></p>
<p class="MsoNormal"> RIK -raster- (rov): Swedish Grid RIK (.rik)<u></u><u></u></p>
<p class="MsoNormal"> USGSDEM -raster- (rwv): USGS Optional ASCII DEM (and CDED)<u></u><u></u></p>
<p class="MsoNormal"> GXF -raster- (rov): GeoSoft Grid Exchange Format<u></u><u></u></p>
<p class="MsoNormal"> NWT_GRD -raster- (rw+v): Northwood Numeric Grid Format .grd/.tab<u></u><u></u></p>
<p class="MsoNormal"> NWT_GRC -raster- (rov): Northwood Classified Grid Format .grc/.tab<u></u><u></u></p>
<p class="MsoNormal"> ADRG -raster- (rw+vs): ARC Digitized Raster Graphics<u></u><u></u></p>
<p class="MsoNormal"> SRP -raster- (rovs): Standard Raster Product (ASRP/USRP)<u></u><u></u></p>
<p class="MsoNormal"> BLX -raster- (rwv): Magellan topo (.blx)<u></u><u></u></p>
<p class="MsoNormal"> SAGA -raster- (rw+v): SAGA GIS Binary Grid (.sdat, .sg-grd-z)<u></u><u></u></p>
<p class="MsoNormal"> XYZ -raster- (rwv): ASCII Gridded XYZ<u></u><u></u></p>
<p class="MsoNormal"> HF2 -raster- (rwv): HF2/HFZ heightfield raster<u></u><u></u></p>
<p class="MsoNormal"> OZI -raster- (rov): OziExplorer Image File<u></u><u></u></p>
<p class="MsoNormal"> CTG -raster- (rov): USGS LULC Composite Theme Grid<u></u><u></u></p>
<p class="MsoNormal"> E00GRID -raster- (rov): Arc/Info Export E00 GRID<u></u><u></u></p>
<p class="MsoNormal"> ZMap -raster- (rwv): ZMap Plus Grid<u></u><u></u></p>
<p class="MsoNormal"> NGSGEOID -raster- (rov): NOAA NGS Geoid Height Grids<u></u><u></u></p>
<p class="MsoNormal"> IRIS -raster- (rov): IRIS data (.PPI, .CAPPi etc)<u></u><u></u></p>
<p class="MsoNormal"> PRF -raster- (rov): Racurs PHOTOMOD PRF<u></u><u></u></p>
<p class="MsoNormal"> RDA -raster- (ro): DigitalGlobe Raster Data Access driver<u></u><u></u></p>
<p class="MsoNormal"> EEDAI -raster- (ros): Earth Engine Data API Image<u></u><u></u></p>
<p class="MsoNormal"> SIGDEM -raster- (rwv): Scaled Integer Gridded DEM .sigdem<u></u><u></u></p>
<p class="MsoNormal"> IGNFHeightASCIIGrid -raster- (rov): IGN France height correction ASCII Grid<u></u><u></u></p>
<p class="MsoNormal"> CAD -raster,vector- (rovs): AutoCAD Driver<u></u><u></u></p>
<p class="MsoNormal"> PLSCENES -raster,vector- (ro): Planet Labs Scenes API<u></u><u></u></p>
<p class="MsoNormal"> GenBin -raster- (rov): Generic Binary (.hdr Labelled)<u></u><u></u></p>
<p class="MsoNormal"> ENVI -raster- (rw+v): ENVI .hdr Labelled<u></u><u></u></p>
<p class="MsoNormal"> EHdr -raster- (rw+v): ESRI .hdr Labelled<u></u><u></u></p>
<p class="MsoNormal"> ISCE -raster- (rw+v): ISCE raster<u></u><u></u></p>
<p class="MsoNormal"> HTTP -raster,vector- (ro): HTTP Fetching Wrapper<u></u><u></u></p>
</div>
<br>
This electronic communication and any attachments may contain confidential and proprietary information of Radiant Solutions, Inc. If you are not the intended recipient, or an agent or employee responsible for delivering this communication to the intended recipient,
or if you have received this communication in error, please do not print, copy, retransmit, disseminate or otherwise use the information. Please indicate to the sender that you have received this communication in error, and delete the copy you received.
<br>
<br>
Radiant Solutions reserves the right to monitor any electronic communication sent or received by its employees, agents or representatives.
</div>
_______________________________________________<br>
gdal-dev mailing list<br>
<a href="mailto:gdal-dev@lists.osgeo.org" target="_blank">gdal-dev@lists.osgeo.org</a><br>
<a href="https://lists.osgeo.org/mailman/listinfo/gdal-dev" rel="noreferrer" target="_blank">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a></blockquote></div>