<div dir="ltr">Hello GDAL Developers,<div><br></div><div><br></div><div>I am having trouble using the /vsis3 or /vsicurl driver with S3 signed links and can't find any details in the archive of this list. I have a signed S3 link that is a zip file containing a variety of other files, including a geotiff, which is what I'm really after.   I would like to be able to access the geotiff file only using a combination of /vsizip and /vsicurl.   I am using GDAL version 2.2.1 on MacOS.  An example link is below:</div><div><br></div><div>







<p class="gmail-p1"><a href="https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D">https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D</a></p><p class="gmail-p1">If I do a gdalinfo on this file using vsizip and vsicurl it seems to recognize the file and gives me links to use to access the individual elements.  </p><font face="monospace, monospace">gdalinfo /vsizip//vsicurl/"<a href="https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D">https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D</a>"<br><br>ERROR 6: Support only 1 file in archive file /vsicurl/<a href="https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D">https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D</a> when no explicit in-archive filename is specified<br><br>You could try one of the following :<br><br>  /vsizip//vsicurl/<a href="https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.tif">https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.tif</a><br><br>  /vsizip//vsicurl/<a href="https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.jpg">https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.jpg</a><br><br>  /vsizip//vsicurl/<a href="https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.jpg.aux.xml">https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.jpg.aux.xml</a><br><br>  /vsizip//vsicurl/<a href="https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/ESA_citation.txt">https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/ESA_citation.txt</a><br><br>  /vsizip//vsicurl/<a href="https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.wld">https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.wld</a></font><p class="gmail-p1"><br></p><p class="gmail-p1">Apologies for the funky formatting on this result.  However, if I try to run gdalinfo on one of the recommended links (the geotiff), I get the following (with --debug ON)</p><p class="gmail-p1"><font face="monospace, monospace">gdalinfo --debug ON /vsizip//vsicurl/"<a href="https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.tif">https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.tif</a>"</font></p><p class="gmail-p1"><font face="monospace, monospace">GDAL: Auto register /opt/local/lib/gdalplugins/gdal_KEA.dylib using GDALRegister_KEA.</font></p><p class="gmail-p1"><font face="monospace, monospace">GDAL: Assuming DCAP_RASTER for driver KEA. Please fix it.</font></p><p class="gmail-p1"><font face="monospace, monospace">GNM: GNMRegisterAllInternal</font></p><p class="gmail-p1"><font face="monospace, monospace">GNM: RegisterGNMFile</font></p><p class="gmail-p1"><font face="monospace, monospace">GNM: RegisterGNMdatabase</font></p><p class="gmail-p1"><font face="monospace, monospace">VSICURL: GetFileSize(<a href="https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.tif)=0">https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.tif)=0</a><span class="gmail-Apple-converted-space">  </span>response_code=403</font></p><p class="gmail-p1"><font face="monospace, monospace">VSICURL: GetFileSize(<a href="https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.tif.xml)=0">https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.tif.xml)=0</a><span class="gmail-Apple-converted-space">  </span>response_code=403</font></p><p class="gmail-p1"><font face="monospace, monospace">ERROR 4: `/vsizip//vsicurl/<a href="https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.tif">https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.tif</a>' does not exist in the file system, and is not recognized as a supported dataset name.</font></p><p class="gmail-p1"><font face="monospace, monospace">
















</font></p><p class="gmail-p1"><font face="monospace, monospace">gdalinfo failed - unable to open '/vsizip//vsicurl/<a href="https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.tif">https://gsfc-ngap-hyp3-product-prod.s3.amazonaws.com/547/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.zip?AWSAccessKeyId=AKIAIYGQSCGFDA6WYRIQ&Expires=1824498425&Signature=WkQJbs%2FE6vLttvAAYt2fXlKOeKk%3D/S1B_IW_GRDH_1SDV_20170903T223511_20170903T223539_007233_00CC06_E9A8-POEORB-24-RGB.tif</a>'.</font></p><div><br></div><div>I'm wondering if there is something I am doing wrong, something in the way gdal handles S3 signed links, or perhaps the functionality I'm looking for just doesn't exist yet.  Thank you very much for any thoughts you might have.  </div><div><br></div><div>Kindest Regards,</div><div>Scott Arko</div><div><br></div><div><br></div><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><div>Scott Arko<br>Alaska Satellite Facility Deputy Director<div>University of Alaska Fairbanks<br><br>903 Koyukuk Drive<br>Fairbanks, AK 99775<br>Phone: (907) 474 - 5570<br>email:  <a href="mailto:saarko@alaska.edu" target="_blank">saarko@alaska.edu</a><br><a href="http://www.asf.alaska.edu" target="_blank">http://www.asf.alaska.edu</a></div></div></div></div>
</div></div>