<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Lato;
panose-1:2 15 5 2 2 2 4 3 2 3;}
@font-face
{font-family:"Source Code Pro";
panose-1:2 11 5 9 3 4 3 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style></head><body lang=EN-US link=blue vlink=purple style='word-wrap:break-word'><div class=WordSection1><p class=MsoNormal>Clive,<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>A solution to this is to use a GDAL configuration file that will allow you to set per path options for your authentication, allowing you to use one set of credentials for read and one for write. See <a href="https://gdal.org/user/configoptions.html#gdal-configuration-file">https://gdal.org/user/configoptions.html#gdal-configuration-file</a><o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal style='margin-bottom:.25in;line-height:18.0pt;background:#FCFCFC'><span style='font-size:12.0pt;font-family:"Lato",sans-serif;color:#404040'>Starting with GDAL 3.5, a configuration file can also contain credentials (or more generally options related to a virtual file system) for a given path prefix, that can also be set with <a href="https://gdal.org/api/cpl.html#_CPPv424VSISetPathSpecificOptionPKcPKcPKc" title=VSISetPathSpecificOption><b><span style='font-size:11.0pt;font-family:"Source Code Pro";color:black;border:solid #E1E4E5 1.0pt;padding:2.0pt;background:white;text-decoration:none'>VSISetPathSpecificOption()</span></b></a>. Credentials should be put under a </span><span style='font-family:"Source Code Pro";color:black;border:solid #E1E4E5 1.0pt;padding:2.0pt;background:white'>[credentials]</span><span style='font-size:12.0pt;font-family:"Lato",sans-serif;color:#404040'> section, and for each path prefix, under a relative subsection whose name starts with “[.” (e.g. “[.some_arbitrary_name]”), and whose first key is “path”.<o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Mike<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>-- <o:p></o:p></p><div><p class=MsoNormal>Michael Smith<o:p></o:p></p><p class=MsoNormal>US Army Corps of Engineers<o:p></o:p></p><p class=MsoNormal>Remote Sensing/GIS Center<o:p></o:p></p></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><o:p> </o:p></p><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:12.0pt;color:black'>From: </span></b><span style='font-size:12.0pt;color:black'>gdal-dev <gdal-dev-bounces@lists.osgeo.org> on behalf of Clive Swan <cliveswan@gmail.com><br><b>Date: </b>Monday, December 12, 2022 at 9:24 AM<br><b>To: </b>Andrew C Aitchison <andrew@aitchison.me.uk>, <gdal-dev@lists.osgeo.org><br><b>Subject: </b>Re: [gdal-dev] ERROR 13: The specified key does not exist<o:p></o:p></span></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><div><div><div><div><p class=MsoNormal style='margin-bottom:12.0pt'>Greetings,<o:p></o:p></p></div><p class=MsoNormal>The problem was writing directly from one AWS instance to another.<o:p></o:p></p></div><p class=MsoNormal style='margin-bottom:12.0pt'>I have to write to the local instance, than copy to the other instance.<o:p></o:p></p></div><p class=MsoNormal>Thanks<o:p></o:p></p></div><p class=MsoNormal>Clive<o:p></o:p></p></div><p class=MsoNormal><o:p> </o:p></p><div><div><p class=MsoNormal>On Mon, 12 Dec 2022 at 09:57, Andrew C Aitchison <<a href="mailto:andrew@aitchison.me.uk">andrew@aitchison.me.uk</a>> wrote:<o:p></o:p></p></div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in'><p class=MsoNormal>On Mon, 12 Dec 2022, Clive Swan wrote:<br><br>> Greetings,<br>><br>> I have been using the security details for weeks, now getting an odd error.<br>> AWS_ACCESS_KEY_ID<br>> AWS_SECRET_ACCESS_KEY<br>> *ERROR 4:* Attempt to create new tiff file `/vsis3/summer-outputs/3/coastal-<br>> -2020.tif' failed: Permission denied<br>> Input file size is 450000, 225000*ERROR 13*: The specified key does<br>> not exist *<< ??*<br><br>Does it really say coastal--2020.tif with two dashes ?<br><br>> *### Script below*<br>> #!/bin/bash<br>><br>> LOG_FILE=/home/ubuntu/run_translate.log<br>><br>> exec 1>>${LOG_FILE}<br>> exec 2>>${LOG_FILE}<br>><br>> ## 5_UK_rasters >> 3_data_ready<br>><br>> gdal_translate /vsis3/summer-outputs/5/coastal-2020.vrt /vsis3/<br>> summer-outputs/3/coastal-2020.tif -co BIGTIFF=YES -co<br>> NUM_THREADS=ALL_CPUS --config GDAL_CACHEMAX 100000 --config CPL_TMPDIR<br>> /data/tmp --config CPL_VSIL_USE_TEMP_FILE_FOR_RANDOM_WRITE YES<br>> --config AWS_ACCESS_KEY_ID KEY_ID --config AWS_SECRET_ACCESS_KEY<br>> ACCESS_KEY<br>> echo end script<br><br>-- <br>Andrew C. Aitchison Kendal, UK<br> <a href="mailto:andrew@aitchison.me.uk" target="_blank">andrew@aitchison.me.uk</a><o:p></o:p></p></blockquote></div><p class=MsoNormal><br clear=all><br>-- <o:p></o:p></p><div><div><div><div><div><div><p style='margin:0in'><span style='font-size:8.0pt'> Regards,</span><o:p></o:p></p><p style='margin:0in'><o:p> </o:p></p><p style='margin:0in'><span style='font-size:8.0pt'>Clive Swan</span><o:p></o:p></p><p style='margin:0in'><span style='font-size:12.0pt'>--</span><o:p></o:p></p><p style='margin:0in'><o:p> </o:p></p><p style='margin:0in'><span style='font-size:12.0pt;color:gray'>M: +44 7766 452665</span><o:p></o:p></p></div></div></div></div></div></div><p class=MsoNormal>_______________________________________________ gdal-dev mailing list gdal-dev@lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/gdal-dev <o:p></o:p></p></div></body></html>