<div dir="ltr">Your original message described an attempt to use /vsis3/ , which is a GDAL feature that lets it read datasets from S3. Mapserver uses those GDAL hooks to read datasets and rasters, but it does not use GDAL to read mapfiles. To my knowledge, Mapserver itself doesn't speak s3 natively. Mapserver has no way of getting its mapfile from an s3 URL... or any URL, for that matter.<br><br><div>The only way I can think of to get mapfiles from s3 is to use something like s3fs-fuse. That would mount the s3 bucket as a filesystem on the VM. Then mapserver would read it like a normal local file.<br><br>But you said you didn't want to do it that way. I think you're chasing something that isn't possible.<br><br>Even if it were possible, I wouldn't necessarily advise it. It seems like it would be a security nightmare. Also, mapfiles aren't usually that big. When you spin up a new VM, why not just download a copy of the mapfiles locally? Huge rasters can live on S3, and that's fine. The DATA line can use /vsis3/ to get the raster. But mapfiles? I'd question how much would be gained at the cost of latency and security risks.<br><br></div><div>-Tim</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Oct 24, 2022 at 6:33 AM Marcin Niemyjski via MapServer-users <<a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="msg6952589377941015662">
<div dir="ltr">
<span style="color:black;font-size:12pt;font-family:Calibri,Arial,Helvetica,sans-serif;background-color:white">Jukka, Lars</span>
<div style="color:black;font-size:12pt;font-family:Calibri,Arial,Helvetica,sans-serif;background-color:white">
<br>
</div>
<div style="color:black;font-size:12pt;font-family:Calibri,Arial,Helvetica,sans-serif;background-color:white">
thanks for quick response.</div>
<div style="color:black;font-size:12pt;font-family:Calibri,Arial,Helvetica,sans-serif;background-color:white">
<br>
</div>
<div style="color:black;font-size:12pt;font-family:Calibri,Arial,Helvetica,sans-serif;background-color:white">
Sorry for making a mistake and replying to you directly.<br>
</div>
<div style="color:black;font-size:12pt;font-family:Calibri,Arial,Helvetica,sans-serif;background-color:white">
<br>
</div>
<div style="color:black;font-size:12pt;font-family:Calibri,Arial,Helvetica,sans-serif;background-color:white">
Lars</div>
<div style="color:black;font-size:12pt;font-family:Calibri,Arial,Helvetica,sans-serif;background-color:white">
Yes, my apache has all required modules active and the bucket I'm using is a public bucket. To be honest I'm not fully understand the mechanism of Apache, I'll go back and try using structure from docs. I do not understand the reasoning behind using Environment
variable in this case. From my experience environmental variable for example, can be used to point file in which erros would be written. Could you please tell me more precisely how to use it in my case?</div>
<div style="color:black;font-size:12pt;font-family:Calibri,Arial,Helvetica,sans-serif;background-color:white">
<br>
</div>
<div style="color:black;font-size:12pt;font-family:Calibri,Arial,Helvetica,sans-serif;background-color:white">
Using env. variable for me wouldn't work because I'm using more than one mapfile (I'm displaying everyday S-2 scenes for Poland and Ukraine). The goal is to use mapserver hosted from docker, to which would be connected (apache redirect?) s3 bucket with mapfiles,
so serving wms would be fully independent process without need to mount bucket.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
I think I'll try this way:<br>
<a href="https://stackoverflow.com/questions/9929487/using-apache-mod-alias-in-vhost-to-link-assets-from-external-server" id="m_6952589377941015662LPlnk561286" target="_blank">https://stackoverflow.com/questions/9929487/using-apache-mod-alias-in-vhost-to-link-assets-from-external-server</a></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<br>
</div>
<div style="color:black;font-size:12pt;font-family:Calibri,Arial,Helvetica,sans-serif;background-color:white">
Thank you both,</div>
<span style="color:black;font-size:12pt;font-family:Calibri,Arial,Helvetica,sans-serif;background-color:white">Marcin</span><br>
<div id="m_6952589377941015662appendonsend"></div>
<hr style="display:inline-block;width:98%">
<div id="m_6952589377941015662divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> MapServer-users <<a href="mailto:mapserver-users-bounces@lists.osgeo.org" target="_blank">mapserver-users-bounces@lists.osgeo.org</a>> on behalf of Lars Fricke <<a href="mailto:lars.fricke@skendata.de" target="_blank">lars.fricke@skendata.de</a>><br>
<b>Sent:</b> Monday, October 24, 2022 11:37 AM<br>
<b>To:</b> <a href="mailto:mapserver-users@lists.osgeo.org" target="_blank">mapserver-users@lists.osgeo.org</a> <<a href="mailto:mapserver-users@lists.osgeo.org" target="_blank">mapserver-users@lists.osgeo.org</a>><br>
<b>Subject:</b> Re: [MapServer-users] Redirecting to s3 via apache2 redirect/alias/proxy</font>
<div> </div>
</div>
<div>
<div style="color:rgb(0,0,0);font-weight:200;font-size:15px;font-style:normal;font-family:source-sans-pro,Arial,Freesans;line-height:140%">
Three things come to my mind:<br>
1) Did you check if your Apache or NGINX respectively has the module installed and active?<br>
2) You do not have credentials in your second S3 URL example. This may be an issue.<br>
3) The structure in the doc's is different: <br>
```<br>
RewriteEngine on<br>
RewriteRule wmsmap?(.*) /cgi-bin/mapserv?map=/home/www/mapserverstuff/mymapfile.map&$1<br>
```<br>
I don't use this method myself but you may want to try using exactly the same replacement structure?<br>
<div>As said before, you could als use an Environment variable.<br>
Cheers Lars<br>
</div>
<div><br>
</div>
</div>
<div>Am 24.10.22 um 11:12 schrieb Marcin Niemyjski via MapServer-users:<br>
</div>
<blockquote type="cite">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
Hello,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
coming back to you with one more question about s3, namely:</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
As I wrote before - I want to keep my mapfiles on buckets but I also want to access them without need to mount buckets to VMs, so I've came up with this:</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<a href="https://httpd.apache.org/docs/2.4/rewrite/flags.html#flag_p" id="m_6952589377941015662LPlnk949755" target="_blank">https://httpd.apache.org/docs/2.4/rewrite/flags.html#flag_p</a></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<a href="https://mapserver.org/ogc/wms_server.html#changing-the-online-resource-url" id="m_6952589377941015662LPlnk317784" target="_blank">https://mapserver.org/ogc/wms_server.html#changing-the-online-resource-url</a><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
generaly I want to do this:</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
ProxyPass /martest/ <a href="https://s3.amazon.com/Bucket/Key" target="_blank">
https://s3.amazon.com/Bucket/Key</a><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
ProxyPassReverse /martest/ <a href="https://s3.amazon.com/Bucket/Key" id="m_6952589377941015662LPlnk802299" target="_blank">
https://s3.amazon.com/Bucket/Key</a></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
or</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<span style="font-family:Arial,Helvetica,sans-serif">RewriteEngine on</span><span style="font-family:Arial,Helvetica,sans-serif"><br>
</span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<span style="font-family:Arial,Helvetica,sans-serif">RewriteRule /martest/ </span>
<a href="https://s3.amazon.com/Bucket/" id="m_6952589377941015662LPlnk154435" target="_blank"><span style="font-family:Arial,Helvetica,sans-serif">https://s3.amazon.com/Bucket/</span></a><br>
</div>
<pre style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">so, while using WMS online resource url <a href="https://www.lpis.pl/cgi-bin/mapserv?map=/martest/jrc.map" id="m_6952589377941015662LPlnk633910" target="_blank">https://www.lpis.pl/cgi-bin/mapserv?map=/martest/jrc.map</a> i would connect to mapfile on s3.
</pre>
<pre style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">But it doesn't seem to be working. Is this even possible to connect mapserver and s3 this way?
As always thank you for your help and time,
Marcin
</pre>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
<br>
</div>
<br>
<fieldset></fieldset>
<pre>_______________________________________________
MapServer-users mailing list
<a href="mailto:MapServer-users@lists.osgeo.org" target="_blank">MapServer-users@lists.osgeo.org</a>
<a href="https://lists.osgeo.org/mailman/listinfo/mapserver-users" target="_blank">https://lists.osgeo.org/mailman/listinfo/mapserver-users</a>
</pre>
</blockquote>
<br>
</div>
</div>
_______________________________________________<br>
MapServer-users mailing list<br>
<a href="mailto:MapServer-users@lists.osgeo.org" target="_blank">MapServer-users@lists.osgeo.org</a><br>
<a href="https://lists.osgeo.org/mailman/listinfo/mapserver-users" rel="noreferrer" target="_blank">https://lists.osgeo.org/mailman/listinfo/mapserver-users</a><br>
</div></blockquote></div>