From karsten at terragis.net Mon Feb 4 14:33:09 2019 From: karsten at terragis.net (karsten) Date: Mon, 4 Feb 2019 23:33:09 +0100 Subject: [mapserver-users] styling based on attribute for MapServer derived MVTiles Message-ID: Dear All, I was working on the configuration of MapServer generated MVT tiles for a demo country world map and had success with MS v 7.2 outputting tiles in MVT format ( all thanks to https://github.com/sdlime/mvt-demo ). I am trying to work on the client side style for my demo map (using mapbox-gl.js) and defined them in a similar way as JSON as in Steve's mvt-demo above. The whole thing is later intended to be used in a benchmark for MapServer MVT rendering speed versus T-Rex ( see http://blog.sourcepole.ch/2018/09/06/the-tale-of-a-vector-tile-benchmark/ ) . For now I am struggling with specifying the correct style syntax for the client side and it seem that I missing something as I was not yet able to successfully use attribute properties to render Countries as different colors based on an attribute field of my PostGIS source. Below is the configuration of my 'allcountries' layer. The mapcolor7 filed is an integer field (in the input PostGIS source) but my set-up fails to output multiple colors , instead I am getting all default black for the country fill color. A second layer where I specified only Italy as one Country 'country-italy' to show up renders fine - see https://github.com/karstenv/mvt-benchmark/blob/master/MapServer/countries_mv t.png My complete style JSON is at https://github.com/karstenv/mvt-benchmark/blob/master/MapServer/ms_ne_simple .json and the corresponding map file is here https://github.com/karstenv/mvt-benchmark/blob/master/MapServer/ne.map Would anyone know what I need to change in order to render the countries with different colors according to the 'mapcolor7' attribute ? To me it seems that somehow the attribute is not available to the renderer even though in the MapServer map file I am selecting all fields in the sub-query ... Thanks Karsten -------------------------------------------- { "id": "country-fill", "type": "fill", "source": "compass", "source-layer": "allcountries", "paint": { "fill-color": { "property": "mapcolor7", "stops": [ [1, "#fdaf6b"], [2, "#fdc663"], [3, "#fae364"], [4, "#d3e46f"], [5, "#aadb78"], [6, "#a3cec5"], [7, "#ceb5cf"] ] } } },{ "id": "country-italy", "type": "fill", "source": "compass", "source-layer": "italy", "paint": { "fill-color": "#fdc663" } } Karsten Vennemann Terra GIS -------------- next part -------------- An HTML attachment was scrubbed... URL: From jmckenna at gatewaygeomatics.com Mon Feb 4 16:46:49 2019 From: jmckenna at gatewaygeomatics.com (Jeff McKenna) Date: Mon, 4 Feb 2019 20:46:49 -0400 Subject: [mapserver-users] MS4W version 4.0.0-beta1 available In-Reply-To: References: Message-ID: <062010da-fe14-ff9f-0fb8-9d6fd8dd2ef9@gatewaygeomatics.com> Hello everyone, Many Windows users will be very interested that MS4W-4.0.0-beta1 is available now, which will be a huge release of changes, as every library (over 200 now) has been upgraded and built with a new compiler (Visual Studio 2017), and contains many great additions overall. You can test the beta at: - installer: https://ms4w.com/release/experimental/ms4w-4.0.0-beta1-setup.exe (recommended) - archive: https://ms4w.com/release/experimental/ms4w_4.0.0_beta1.zip Please see MS4W's HISTORY.txt for all of the changes, but here are some of the highlights: - Mapbox Vector Tile output through MapServer (demo included) - PHP7 mapscript support (using the SWIG API) - usual mapscripts available (Java, Python, CSharp) - embedded Python 3.7.0 - running pycsw Catalogue Server - expanded ZOO-Project WPS support (all GDAL/OGR services, Python, PHP, CSharp, Java) - new Matomo Analytics package - simple map viewer on the localhost page - GDAL 2.4.0 - MapServer 7.4.0-dev - mod_wsgi for Apache - and many more... You can see that MS4W-4.0.0 will be a full SDI for Windows environments, with ~40+ working mapfiles and over 1.7GB of files, empowering DevOps and organizations worldwide. Also note that this is a major release for MS4W, meaning that some things have changed dramatically (PHPmapscript will now use the SWIG API for example), so please follow MS4W's README for specific instructions for the many plugins and mapscripts. When installing, it is very important that (if you are using the .zip) your server must have the C++ Redistributable installed on it beforehand: execute the local file /ms4w/tmp/vcredist_x86.exe (alternatively if you use MS4W's setup.exe installer this is done automatically) Please provide your 4.0.0 testing feedback through the MS4W tracker (so the feedback is not lost or forgotten): http://www.ms4w.com/trac/ Thank you all for sharing your spatial information with MS4W. -jeff -- Jeff McKenna MapServer Consulting and Training Services https://gatewaygeomatics.com/ From jmckenna at gatewaygeomatics.com Mon Feb 4 16:59:09 2019 From: jmckenna at gatewaygeomatics.com (Jeff McKenna) Date: Mon, 4 Feb 2019 20:59:09 -0400 Subject: [mapserver-users] MS4W version 4.0.0-beta1 available In-Reply-To: <062010da-fe14-ff9f-0fb8-9d6fd8dd2ef9@gatewaygeomatics.com> References: <062010da-fe14-ff9f-0fb8-9d6fd8dd2ef9@gatewaygeomatics.com> Message-ID: <560c49b3-5b9f-f676-b5f0-057433950ccc@gatewaygeomatics.com> I forgot to highlight one of the most important parts: MS4W-4.0.0 contains PHP 7.2.14 and the performance improvements are very noticeable. -jeff On 2019-02-04 8:46 PM, Jeff McKenna wrote: > Hello everyone, > > Many Windows users will be very interested that MS4W-4.0.0-beta1 is > available now, which will be a huge release of changes, as every library > (over 200 now) has been upgraded and built with a new compiler (Visual > Studio 2017), and contains many great additions overall.? You can test > the beta at: > > ?- installer: > https://ms4w.com/release/experimental/ms4w-4.0.0-beta1-setup.exe > (recommended) > ?- archive: https://ms4w.com/release/experimental/ms4w_4.0.0_beta1.zip > > Please see MS4W's HISTORY.txt for all of the changes, but here are some > of the highlights: > > ?- Mapbox Vector Tile output through MapServer (demo included) > ?- PHP7 mapscript support (using the SWIG API) > ?- usual mapscripts available (Java, Python, CSharp) > ?- embedded Python 3.7.0 > ?- running pycsw Catalogue Server > ?- expanded ZOO-Project WPS support (all GDAL/OGR services, Python, > PHP, CSharp, Java) > ?- new Matomo Analytics package > ?- simple map viewer on the localhost page > ?- GDAL 2.4.0 > ?- MapServer 7.4.0-dev > ?- mod_wsgi for Apache > ?- and many more... > > You can see that MS4W-4.0.0 will be a full SDI for Windows environments, > with ~40+ working mapfiles and over 1.7GB of files, empowering DevOps > and organizations worldwide.? Also note that this is a major release for > MS4W, meaning that some things have changed dramatically (PHPmapscript > will now use the SWIG API for example), so please follow MS4W's README > for specific instructions for the many plugins and mapscripts. > > When installing, it is very important that (if you are using the .zip) > your server must have the C++ Redistributable installed on it > beforehand: execute the local file /ms4w/tmp/vcredist_x86.exe > (alternatively if you use MS4W's setup.exe installer this is done > automatically) > > Please provide your 4.0.0 testing feedback through the MS4W tracker (so > the feedback is not lost or forgotten): http://www.ms4w.com/trac/ > > Thank you all for sharing your spatial information with MS4W. > > > -jeff > > -- Jeff McKenna MapServer Consulting and Training Services https://gatewaygeomatics.com/ From bob.basques at ci.stpaul.mn.us Tue Feb 5 10:44:12 2019 From: bob.basques at ci.stpaul.mn.us (Basques, Bob (CI-StPaul)) Date: Tue, 5 Feb 2019 18:44:12 +0000 Subject: [mapserver-users] OSGeo Local Chapter (aka TCMUG) Meeting Message-ID: <2D5875F9-47EC-47EC-A53D-78B8FC408027@ci.stpaul.mn.us> All, Next Meeting. Location : http://www.flatearthbrewing.com/ Date : Feb. 13th. Time : 4:30 PM TCMUG Meeting Scheduled: Feb 13, 2019 at 4:30 PM to 6:00 PM Location: http://www.flatearthbrewing.com/ http://www.flatearthbrewing.com/ https://goo.gl/maps/4sXKnj1nn9J2 "C makes it easy to shoot yourself in the foot; C++ makes it harder, but when you do, it blows away your whole leg." - Bjarne Stroustrup -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: iCal-20190205-124120.ics Type: text/calendar Size: 958 bytes Desc: iCal-20190205-124120.ics URL: From steve.lime at state.mn.us Tue Feb 5 12:15:23 2019 From: steve.lime at state.mn.us (Lime, Steve D (MNIT)) Date: Tue, 5 Feb 2019 20:15:23 +0000 Subject: [mapserver-users] styling based on attribute for MapServer derived MVTiles In-Reply-To: References: Message-ID: I believe the default WxS behavior is to expose no attributes. You need to be explicit and I don't see the gml_include_items metadata property in the mapfile for the layer allcountries. You'd need something like: "gml_include_items" "mapcolor7" Added to the allcountries layer. The mvt-demo does this for most layers... --Steve From: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of karsten Sent: Monday, February 04, 2019 4:33 PM To: mapserver-users at lists.osgeo.org Subject: [mapserver-users] styling based on attribute for MapServer derived MVTiles Dear All, I was working on the configuration of MapServer generated MVT tiles for a demo country world map and had success with MS v 7.2 outputting tiles in MVT format ( all thanks to https://github.com/sdlime/mvt-demo ). I am trying to work on the client side style for my demo map (using mapbox-gl.js) and defined them in a similar way as JSON as in Steve's mvt-demo above. The whole thing is later intended to be used in a benchmark for MapServer MVT rendering speed versus T-Rex ( see http://blog.sourcepole.ch/2018/09/06/the-tale-of-a-vector-tile-benchmark/ ) . For now I am struggling with specifying the correct style syntax for the client side and it seem that I missing something as I was not yet able to successfully use attribute properties to render Countries as different colors based on an attribute field of my PostGIS source. Below is the configuration of my 'allcountries' layer. The mapcolor7 filed is an integer field (in the input PostGIS source) but my set-up fails to output multiple colors , instead I am getting all default black for the country fill color. A second layer where I specified only Italy as one Country 'country-italy' to show up renders fine - see https://github.com/karstenv/mvt-benchmark/blob/master/MapServer/countries_mvt.png My complete style JSON is at https://github.com/karstenv/mvt-benchmark/blob/master/MapServer/ms_ne_simple.json and the corresponding map file is here https://github.com/karstenv/mvt-benchmark/blob/master/MapServer/ne.map Would anyone know what I need to change in order to render the countries with different colors according to the 'mapcolor7' attribute ? To me it seems that somehow the attribute is not available to the renderer even though in the MapServer map file I am selecting all fields in the sub-query ... Thanks Karsten -------------------------------------------- { "id": "country-fill", "type": "fill", "source": "compass", "source-layer": "allcountries", "paint": { "fill-color": { "property": "mapcolor7", "stops": [ [1, "#fdaf6b"], [2, "#fdc663"], [3, "#fae364"], [4, "#d3e46f"], [5, "#aadb78"], [6, "#a3cec5"], [7, "#ceb5cf"] ] } } },{ "id": "country-italy", "type": "fill", "source": "compass", "source-layer": "italy", "paint": { "fill-color": "#fdc663" } } Karsten Vennemann Terra GIS -------------- next part -------------- An HTML attachment was scrubbed... URL: From karsten at terragis.net Tue Feb 5 13:01:51 2019 From: karsten at terragis.net (karsten) Date: Tue, 5 Feb 2019 22:01:51 +0100 Subject: [mapserver-users] styling based on attribute for MapServer derived MVTiles In-Reply-To: References: Message-ID: <2150C84090324F8FB1BAA40EDCA30835@terragispc> Great, Thanks Steve I added "gml_include_items" "mapcolor7" to the Metadata block and got it working. One quirk seems to be that when I am trying to the values as integer (from the mapcolor7 column) specifying the style as in 1.) below did not work. However it I treat them as characters instead, quoted them and used "type": "categorical" in the json file for the style as in 2.) below it is working. Cheers Karsten 1.) ---------------------------- { "id": "country-fill", "type": "fill", "source": "compass", "source-layer": "allcountries", "paint": { "fill-color": { "property": "mapcolor7", "stops": [ [1, "#fdaf6b"], [2, "#fdc663"], [3, "#fae364"], [4, "#d3e46f"], [5, "#aadb78"], [6, "#a3cec5"], [7, "#ceb5cf"] ] } } } 2.) ---------------------------- { "id": "country-fill", "type": "fill", "source": "compass", "source-layer": "allcountries", "paint": { "fill-color": { "property": "mapcolor7", "type": "categorical", "stops": [ ["1", "#fdaf6b"], ["2", "#fdc663"], ["3", "#fae364"], ["4", "#d3e46f"], ["5", "#aadb78"], ["6", "#a3cec5"], ["7", "#ceb5cf"] ] } } } _____ From: Lime, Steve D (MNIT) [mailto:steve.lime at state.mn.us] Sent: Tuesday, February 05, 2019 21:15 To: karsten; mapserver-users at lists.osgeo.org Subject: RE: [mapserver-users] styling based on attribute for MapServer derived MVTiles I believe the default WxS behavior is to expose no attributes. You need to be explicit and I don't see the gml_include_items metadata property in the mapfile for the layer allcountries. You'd need something like: "gml_include_items" "mapcolor7" Added to the allcountries layer. The mvt-demo does this for most layers. --Steve From: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of karsten Sent: Monday, February 04, 2019 4:33 PM To: mapserver-users at lists.osgeo.org Subject: [mapserver-users] styling based on attribute for MapServer derived MVTiles Dear All, I was working on the configuration of MapServer generated MVT tiles for a demo country world map and had success with MS v 7.2 outputting tiles in MVT format ( all thanks to https://github.com/sdlime/mvt-demo ). I am trying to work on the client side style for my demo map (using mapbox-gl.js) and defined them in a similar way as JSON as in Steve's mvt-demo above. The whole thing is later intended to be used in a benchmark for MapServer MVT rendering speed versus T-Rex ( see http://blog.sourcepole.ch/2018/09/06/the-tale-of-a-vector-tile-benchmark/ ) . For now I am struggling with specifying the correct style syntax for the client side and it seem that I missing something as I was not yet able to successfully use attribute properties to render Countries as different colors based on an attribute field of my PostGIS source. Below is the configuration of my 'allcountries' layer. The mapcolor7 filed is an integer field (in the input PostGIS source) but my set-up fails to output multiple colors , instead I am getting all default black for the country fill color. A second layer where I specified only Italy as one Country 'country-italy' to show up renders fine - see https://github.com/karstenv/mvt-benchmark/blob/master/MapServer/countries_mv t.png My complete style JSON is at https://github.com/karstenv/mvt-benchmark/blob/master/MapServer/ms_ne_simple .json and the corresponding map file is here https://github.com/karstenv/mvt-benchmark/blob/master/MapServer/ne.map Would anyone know what I need to change in order to render the countries with different colors according to the 'mapcolor7' attribute ? To me it seems that somehow the attribute is not available to the renderer even though in the MapServer map file I am selecting all fields in the sub-query ... Thanks Karsten -------------------------------------------- { "id": "country-fill", "type": "fill", "source": "compass", "source-layer": "allcountries", "paint": { "fill-color": { "property": "mapcolor7", "stops": [ [1, "#fdaf6b"], [2, "#fdc663"], [3, "#fae364"], [4, "#d3e46f"], [5, "#aadb78"], [6, "#a3cec5"], [7, "#ceb5cf"] ] } } },{ "id": "country-italy", "type": "fill", "source": "compass", "source-layer": "italy", "paint": { "fill-color": "#fdc663" } } Karsten Vennemann Terra GIS -------------- next part -------------- An HTML attachment was scrubbed... URL: From stephenwoodbridge37 at gmail.com Tue Feb 5 15:38:05 2019 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Tue, 5 Feb 2019 18:38:05 -0500 Subject: [mapserver-users] mamcache vertical assembly In-Reply-To: References: <3e8273e8-9ef3-79f5-d089-2a3edef3a77e@gmail.com> Message-ID: <6D878686-995D-4E63-B60F-E6E13262D7EE@gmail.com> I found response to question by Thomas on this subject that suggested it might cause a deadlock if you ran out of connections. Anyway I decided to build a new map file to do the vertical assembly and then cache that through mapcache. -Steve Sent from my iPhone > On Jan 27, 2019, at 11:35 PM, Lime, Steve D (MNIT) wrote: > > I?ll try to derive something from the source and report back. > From: mapserver-users on behalf of Stephen Woodbridge > Sent: Sunday, January 27, 2019 7:08:38 PM > To: mapserver-users > Subject: [mapserver-users] mamcache vertical assembly > > Hi, > > The mapcache docs has a page for vertical assembly but it is blank :( > > I have 7 layers in mapcache and I would like to vertically assemble > these into a composite layer. In the past I have been loading all 7 in > openlayers but it makes more sense to just composite them into a new > layer. There are some scale limits that apply to the various layers. > > Does anyone have some info on how to do this in mapcache directly rather > than create a mapfile and compositing them in mapserver and then making > that a new layer in mapcache. > > Thanks, > -Steve W > > --- > This email has been checked for viruses by Avast antivirus software. > https://www.avast.com/antivirus > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From stephenwoodbridge37 at gmail.com Tue Feb 5 15:43:42 2019 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Tue, 5 Feb 2019 18:43:42 -0500 Subject: [mapserver-users] MVT Tiles status? Message-ID: <55BD6CA9-A67B-4CE9-AE38-D57428502CF4@gmail.com> Is the MVT vector tiles stuff released yet? If not what?s the plan for that? I saw some posts in the archives that Steve L had stuff on github but would prefer to get it from Ubuntu packages. Thanks, -Steve W Sent from my iPhone From steve.lime at state.mn.us Tue Feb 5 15:57:39 2019 From: steve.lime at state.mn.us (Lime, Steve D (MNIT)) Date: Tue, 5 Feb 2019 23:57:39 +0000 Subject: [mapserver-users] MVT Tiles status? In-Reply-To: <55BD6CA9-A67B-4CE9-AE38-D57428502CF4@gmail.com> References: <55BD6CA9-A67B-4CE9-AE38-D57428502CF4@gmail.com> Message-ID: It's in 7.2 although there are a couple of useful bug fixes set for 7.2.2... -----Original Message----- From: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Stephen Woodbridge Sent: Tuesday, February 05, 2019 5:44 PM To: mapserver-users at lists.osgeo.org Subject: [mapserver-users] MVT Tiles status? Is the MVT vector tiles stuff released yet? If not what?s the plan for that? I saw some posts in the archives that Steve L had stuff on github but would prefer to get it from Ubuntu packages. Thanks, -Steve W Sent from my iPhone _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-users&data=02%7C01%7Csteve.lime%40state.mn.us%7Ce7118d8fe1684447cf1b08d68bc3c6cf%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636850070304631443&sdata=%2BLnYvAsWuU7%2F7oKP55JKHsHW7fFIjVlPokyM3M0YAhQ%3D&reserved=0 From richard.greenwood at gmail.com Tue Feb 5 17:52:49 2019 From: richard.greenwood at gmail.com (Richard Greenwood) Date: Tue, 5 Feb 2019 18:52:49 -0700 Subject: [mapserver-users] mamcache vertical assembly In-Reply-To: <6D878686-995D-4E63-B60F-E6E13262D7EE@gmail.com> References: <3e8273e8-9ef3-79f5-d089-2a3edef3a77e@gmail.com> <6D878686-995D-4E63-B60F-E6E13262D7EE@gmail.com> Message-ID: Stephen, I was watching this thread hoping for a reply to your original question because it's an interesting problem. If you have time to provide a more detailed explanation of your solution I'd be interested. Best regards, Rich On Tue, Feb 5, 2019 at 4:38 PM Stephen Woodbridge < stephenwoodbridge37 at gmail.com> wrote: > I found response to question by Thomas on this subject that suggested it > might cause a deadlock if you ran out of connections. > > Anyway I decided to build a new map file to do the vertical assembly and > then cache that through mapcache. > > -Steve > > Sent from my iPhone > > On Jan 27, 2019, at 11:35 PM, Lime, Steve D (MNIT) > wrote: > > I?ll try to derive something from the source and report back. > ------------------------------ > *From:* mapserver-users on > behalf of Stephen Woodbridge > *Sent:* Sunday, January 27, 2019 7:08:38 PM > *To:* mapserver-users > *Subject:* [mapserver-users] mamcache vertical assembly > > Hi, > > The mapcache docs has a page for vertical assembly but it is blank :( > > I have 7 layers in mapcache and I would like to vertically assemble > these into a composite layer. In the past I have been loading all 7 in > openlayers but it makes more sense to just composite them into a new > layer. There are some scale limits that apply to the various layers. > > Does anyone have some info on how to do this in mapcache directly rather > than create a mapfile and compositing them in mapserver and then making > that a new layer in mapcache. > > Thanks, > -Steve W > > --- > This email has been checked for viruses by Avast antivirus software. > https://www.avast.com/antivirus > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -- Richard W. Greenwood, PLS www.greenwoodmap.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From stephenwoodbridge37 at gmail.com Tue Feb 5 19:49:58 2019 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Tue, 5 Feb 2019 22:49:58 -0500 Subject: [mapserver-users] mamcache vertical assembly In-Reply-To: References: <3e8273e8-9ef3-79f5-d089-2a3edef3a77e@gmail.com> <6D878686-995D-4E63-B60F-E6E13262D7EE@gmail.com> Message-ID: <70d343b0-2a16-146c-8f04-7b950a4c5237@gmail.com> On 2/5/2019 8:52 PM, Richard Greenwood wrote: > Stephen, > > I was watching this thread hoping for a reply to your original > question because it's an interesting problem. If you have time to > provide a more detailed explanation of your solution I'd be interested. So what I had originally were 7 layers of NOAA ENC (Electronic Nautical Charts) being pulled from the NOAA WMS service and these were getting cached locally in mapcache. Since my app was always turning on/off all seven layers as a set, I wanted to build a new layer that merged all seven into a single layer. Part of the reason for this was to reduce the number of layer in openlayers for performance improvements. This would be just a vertical stacking of the the seven layers into one. Because of the way NOAA service is structured each layer has a different end point so it was not possible to have their server do the stacking. I eventually found this post: https://lists.osgeo.org/pipermail/mapserver-users/2012-April/072045.html which suggests, this might no be the best approach. In addition, while looking at this issue I realized the NOAA service changed it layer definitions for some of the data and my mapcache stuff was broken as a result. In the end, I decided to create a mapserver mapfile that did WMS client requests to the NOAA server and broke up the seven layers into 21 (7 each area, line and point) smaller layers that allowed for more correct stacking of the data and setting appropriate MIN/MAX scaledenom? values as recommended by the getCapabilities for the NOAA services. Now I have one mapcache layer that uses the new mosaic mapfile and this does the vertical stacking which is slow given that mapserver has to make about 21 WMS requests to serve each metatile request from mapcache. But the end result is good and tiles are fast once they are populated. Also, I will note that the NOAA ENC service updates the chart data on a regular basis, so I expire my tiles in the cache after 7 days so they get regenerated possible using new data. I think because of this, the strategy of using mapserver to do the stacking and mapcache to handle the caching is a better division of labor and once the app is converted to use the new mosaic layer, I'll remove the 7 old layers to free up disk space. Hope this helps someone with a similar issue. Best regards, ? -Steve W > > Best regards, > Rich > > > On Tue, Feb 5, 2019 at 4:38 PM Stephen Woodbridge > > > wrote: > > I found response to question by Thomas on this subject that > suggested it might cause a deadlock if you ran out of connections. > > Anyway I decided to build a new map file to do the vertical > assembly and then cache that through mapcache. > > -Steve > > Sent from my iPhone > > On Jan 27, 2019, at 11:35 PM, Lime, Steve D (MNIT) > > wrote: > >> I?ll try to derive something from the source and report back. >> ------------------------------------------------------------------------ >> *From:* mapserver-users > > on behalf of >> Stephen Woodbridge > > >> *Sent:* Sunday, January 27, 2019 7:08:38 PM >> *To:* mapserver-users >> *Subject:* [mapserver-users] mamcache vertical assembly >> Hi, >> >> The mapcache docs has a page for vertical assembly but it is blank :( >> >> I have 7 layers in mapcache and I would like to vertically assemble >> these into a composite layer. In the past I have been loading all >> 7 in >> openlayers but it makes more sense to just composite them into a new >> layer. There are some scale limits that apply to the various layers. >> >> Does anyone have some info on how to do this in mapcache directly >> rather >> than create a mapfile and compositing them in mapserver and then >> making >> that a new layer in mapcache. >> >> Thanks, >> ?? -Steve W >> >> --- >> This email has been checked for viruses by Avast antivirus software. >> https://www.avast.com/antivirus >> >> _______________________________________________ >> mapserver-users mailing list >> mapserver-users at lists.osgeo.org >> >> https://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > > https://lists.osgeo.org/mailman/listinfo/mapserver-users > > > > -- > Richard W. Greenwood, PLS > www.greenwoodmap.com From jmckenna at gatewaygeomatics.com Wed Feb 6 05:00:58 2019 From: jmckenna at gatewaygeomatics.com (Jeff McKenna) Date: Wed, 6 Feb 2019 09:00:58 -0400 Subject: [mapserver-users] MVT Tiles status? In-Reply-To: References: <55BD6CA9-A67B-4CE9-AE38-D57428502CF4@gmail.com> Message-ID: SteveL: I can help push out a 7.2.2 release, let me know (I feel that it is needed). -jeff On 2019-02-05 7:57 PM, Lime, Steve D (MNIT) wrote: > It's in 7.2 although there are a couple of useful bug fixes set for 7.2.2... > > -----Original Message----- > From: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Stephen Woodbridge > Sent: Tuesday, February 05, 2019 5:44 PM > To: mapserver-users at lists.osgeo.org > Subject: [mapserver-users] MVT Tiles status? > > Is the MVT vector tiles stuff released yet? If not what?s the plan for that? I saw some posts in the archives that Steve L had stuff on github but would prefer to get it from Ubuntu packages. > > Thanks, > -Steve W > From richard.greenwood at gmail.com Wed Feb 6 06:03:48 2019 From: richard.greenwood at gmail.com (Richard Greenwood) Date: Wed, 6 Feb 2019 07:03:48 -0700 Subject: [mapserver-users] mamcache vertical assembly In-Reply-To: <70d343b0-2a16-146c-8f04-7b950a4c5237@gmail.com> References: <3e8273e8-9ef3-79f5-d089-2a3edef3a77e@gmail.com> <6D878686-995D-4E63-B60F-E6E13262D7EE@gmail.com> <70d343b0-2a16-146c-8f04-7b950a4c5237@gmail.com> Message-ID: Steve, Thanks for the detailed explanation. Sounds like a very logical solution. MapServer is so powerful in its ability to both consume and serv WMS. The thread caught my eye because my apps typically have a few dozen layers that users can turn on/off in any combination, which makes caching less practical. Best regards, Rich On Tue, Feb 5, 2019 at 8:49 PM Stephen Woodbridge < stephenwoodbridge37 at gmail.com> wrote: > On 2/5/2019 8:52 PM, Richard Greenwood wrote: > > Stephen, > > > > I was watching this thread hoping for a reply to your original > > question because it's an interesting problem. If you have time to > > provide a more detailed explanation of your solution I'd be interested. > > So what I had originally were 7 layers of NOAA ENC (Electronic Nautical > Charts) being pulled from the NOAA WMS service and these were getting > cached locally in mapcache. Since my app was always turning on/off all > seven layers as a set, I wanted to build a new layer that merged all > seven into a single layer. Part of the reason for this was to reduce the > number of layer in openlayers for performance improvements. This would > be just a vertical stacking of the the seven layers into one. Because of > the way NOAA service is structured each layer has a different end point > so it was not possible to have their server do the stacking. > > I eventually found this post: > https://lists.osgeo.org/pipermail/mapserver-users/2012-April/072045.html > which suggests, this might no be the best approach. > > In addition, while looking at this issue I realized the NOAA service > changed it layer definitions for some of the data and my mapcache stuff > was broken as a result. In the end, I decided to create a mapserver > mapfile that did WMS client requests to the NOAA server and broke up the > seven layers into 21 (7 each area, line and point) smaller layers that > allowed for more correct stacking of the data and setting appropriate > MIN/MAX scaledenom values as recommended by the getCapabilities for the > NOAA services. Now I have one mapcache layer that uses the new mosaic > mapfile and this does the vertical stacking which is slow given that > mapserver has to make about 21 WMS requests to serve each metatile > request from mapcache. But the end result is good and tiles are fast > once they are populated. > > Also, I will note that the NOAA ENC service updates the chart data on a > regular basis, so I expire my tiles in the cache after 7 days so they > get regenerated possible using new data. I think because of this, the > strategy of using mapserver to do the stacking and mapcache to handle > the caching is a better division of labor and once the app is converted > to use the new mosaic layer, I'll remove the 7 old layers to free up > disk space. > > Hope this helps someone with a similar issue. > > Best regards, > -Steve W > > > > > Best regards, > > Rich > > > > > > On Tue, Feb 5, 2019 at 4:38 PM Stephen Woodbridge > > > > > wrote: > > > > I found response to question by Thomas on this subject that > > suggested it might cause a deadlock if you ran out of connections. > > > > Anyway I decided to build a new map file to do the vertical > > assembly and then cache that through mapcache. > > > > -Steve > > > > Sent from my iPhone > > > > On Jan 27, 2019, at 11:35 PM, Lime, Steve D (MNIT) > > > wrote: > > > >> I?ll try to derive something from the source and report back. > >> > ------------------------------------------------------------------------ > >> *From:* mapserver-users >> > on behalf of > >> Stephen Woodbridge >> > > >> *Sent:* Sunday, January 27, 2019 7:08:38 PM > >> *To:* mapserver-users > >> *Subject:* [mapserver-users] mamcache vertical assembly > >> Hi, > >> > >> The mapcache docs has a page for vertical assembly but it is blank > :( > >> > >> I have 7 layers in mapcache and I would like to vertically assemble > >> these into a composite layer. In the past I have been loading all > >> 7 in > >> openlayers but it makes more sense to just composite them into a new > >> layer. There are some scale limits that apply to the various layers. > >> > >> Does anyone have some info on how to do this in mapcache directly > >> rather > >> than create a mapfile and compositing them in mapserver and then > >> making > >> that a new layer in mapcache. > >> > >> Thanks, > >> -Steve W > >> > >> --- > >> This email has been checked for viruses by Avast antivirus software. > >> https://www.avast.com/antivirus > >> > >> _______________________________________________ > >> mapserver-users mailing list > >> mapserver-users at lists.osgeo.org > >> > >> https://lists.osgeo.org/mailman/listinfo/mapserver-users > > _______________________________________________ > > mapserver-users mailing list > > mapserver-users at lists.osgeo.org > > > > https://lists.osgeo.org/mailman/listinfo/mapserver-users > > > > > > > > -- > > Richard W. Greenwood, PLS > > www.greenwoodmap.com > > -- Richard W. Greenwood, PLS www.greenwoodmap.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From emperor_stef at yahoo.gr Fri Feb 8 01:26:59 2019 From: emperor_stef at yahoo.gr (Stefanos Anastasiou) Date: Fri, 8 Feb 2019 09:26:59 +0000 (UTC) Subject: [mapserver-users] MS4W version 4.0.0-beta1 available In-Reply-To: <560c49b3-5b9f-f676-b5f0-057433950ccc@gatewaygeomatics.com> References: <062010da-fe14-ff9f-0fb8-9d6fd8dd2ef9@gatewaygeomatics.com> <560c49b3-5b9f-f676-b5f0-057433950ccc@gatewaygeomatics.com> Message-ID: <814239987.248274.1549618019042@mail.yahoo.com> Hello Jeff,? ? does php mapsrcipt now belong to SWIG family ? Regarding Linux distribution what changes does this bring in the installation process ?? Thank you -Stefanos ???? ?????, 5 ??????????? 2019, 2:59:24 ?.?. EET, ? ??????? Jeff McKenna ??????: I forgot to highlight one of the most important parts: MS4W-4.0.0 contains PHP 7.2.14 and the performance improvements are very noticeable.? -jeff On 2019-02-04 8:46 PM, Jeff McKenna wrote: > Hello everyone, > > Many Windows users will be very interested that MS4W-4.0.0-beta1 is > available now, which will be a huge release of changes, as every library > (over 200 now) has been upgraded and built with a new compiler (Visual > Studio 2017), and contains many great additions overall.? You can test > the beta at: > >? ?- installer: > https://ms4w.com/release/experimental/ms4w-4.0.0-beta1-setup.exe > (recommended) >? ?- archive: https://ms4w.com/release/experimental/ms4w_4.0.0_beta1.zip > > Please see MS4W's HISTORY.txt for all of the changes, but here are some > of the highlights: > >? ?- Mapbox Vector Tile output through MapServer (demo included) >? ?- PHP7 mapscript support (using the SWIG API) >? ?- usual mapscripts available (Java, Python, CSharp) >? ?- embedded Python 3.7.0 >? ?- running pycsw Catalogue Server >? ?- expanded ZOO-Project WPS support (all GDAL/OGR services, Python, > PHP, CSharp, Java) >? ?- new Matomo Analytics package >? ?- simple map viewer on the localhost page >? ?- GDAL 2.4.0 >? ?- MapServer 7.4.0-dev >? ?- mod_wsgi for Apache >? ?- and many more... > > You can see that MS4W-4.0.0 will be a full SDI for Windows environments, > with ~40+ working mapfiles and over 1.7GB of files, empowering DevOps > and organizations worldwide.? Also note that this is a major release for > MS4W, meaning that some things have changed dramatically (PHPmapscript > will now use the SWIG API for example), so please follow MS4W's README > for specific instructions for the many plugins and mapscripts. > > When installing, it is very important that (if you are using the .zip) > your server must have the C++ Redistributable installed on it > beforehand: execute the local file /ms4w/tmp/vcredist_x86.exe > (alternatively if you use MS4W's setup.exe installer this is done > automatically) > > Please provide your 4.0.0 testing feedback through the MS4W tracker (so > the feedback is not lost or forgotten): http://www.ms4w.com/trac/ > > Thank you all for sharing your spatial information with MS4W. > > > -jeff > > -- Jeff McKenna MapServer Consulting and Training Services https://gatewaygeomatics.com/ _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From jmckenna at gatewaygeomatics.com Fri Feb 8 07:02:24 2019 From: jmckenna at gatewaygeomatics.com (Jeff McKenna) Date: Fri, 8 Feb 2019 11:02:24 -0400 Subject: [mapserver-users] MS4W version 4.0.0-beta1 available In-Reply-To: <814239987.248274.1549618019042@mail.yahoo.com> References: <062010da-fe14-ff9f-0fb8-9d6fd8dd2ef9@gatewaygeomatics.com> <560c49b3-5b9f-f676-b5f0-057433950ccc@gatewaygeomatics.com> <814239987.248274.1549618019042@mail.yahoo.com> Message-ID: <0b09a498-d3f1-fc68-1d54-68c2f42879ca@gatewaygeomatics.com> Hi Stefanos, MS4W 4, and moving forward, will leverage the SWIG API for PHPmapscript use. Believe it or not, there was an alpha release of MS4W way back in 2016 with that SWIG support for PHP7mapscript (and some have used that alpha in deployment since). The purpose of the 4.0.0 beta process is to give all MS4W users, devs, organizations, projects, lots of time to get their hands on it, trying, testing, giving feedback, and modifying their code for this PHPmapscript change. I've also informed several other software communities directly of this (GeoMoose, Mapbender, p.mapper, ZOO-Project, etc). It is a dramatic change, but the timing is right as MS4W 4.0 will give the reason to adapt to the SWIG API, for PHP users. This change for MS4W was made for the long-term maintenance of PHPmapscript in MS4W (to avoid such a show-stopping PHP version, like a PHP8, coming along and affecting MS4W deployments again). In terms of your question for PHPmapscript support in other environments other than MS4W, many have been leveraging this code: https://github.com/bjoernboldt/mapscript-php7 which has been imported into MapServer 7.4dev source also. So you should be fine for Linux as well (but it may take time for all packaged distributions to catch up to all of these changes). I hope I helped answer your questions. Thanks for your interest in MS4W. -jeff On 2019-02-08 5:26 AM, Stefanos Anastasiou wrote: > Hello Jeff, > ? ? does php mapsrcipt now belong to SWIG family ? Regarding Linux > distribution what changes does this bring in the installation process ? > > Thank you > > -Stefanos > > ???? ?????, 5 ??????????? 2019, 2:59:24 ?.?. EET, ? ??????? Jeff McKenna > ??????: > > > I forgot to highlight one of the most important parts: MS4W-4.0.0 > contains PHP 7.2.14 and the performance improvements are very > noticeable.? -jeff > > > > On 2019-02-04 8:46 PM, Jeff McKenna wrote: > > Hello everyone, > > > > Many Windows users will be very interested that MS4W-4.0.0-beta1 is > > available now, which will be a huge release of changes, as every library > > (over 200 now) has been upgraded and built with a new compiler (Visual > > Studio 2017), and contains many great additions overall.? You can test > > the beta at: > > > >? ?- installer: > > https://ms4w.com/release/experimental/ms4w-4.0.0-beta1-setup.exe > > (recommended) > >? ?- archive: https://ms4w.com/release/experimental/ms4w_4.0.0_beta1.zip > > > > Please see MS4W's HISTORY.txt for all of the changes, but here are some > > of the highlights: > > > >? ?- Mapbox Vector Tile output through MapServer (demo included) > >? ?- PHP7 mapscript support (using the SWIG API) > >? ?- usual mapscripts available (Java, Python, CSharp) > >? ?- embedded Python 3.7.0 > >? ?- running pycsw Catalogue Server > >? ?- expanded ZOO-Project WPS support (all GDAL/OGR services, Python, > > PHP, CSharp, Java) > >? ?- new Matomo Analytics package > >? ?- simple map viewer on the localhost page > >? ?- GDAL 2.4.0 > >? ?- MapServer 7.4.0-dev > >? ?- mod_wsgi for Apache > >? ?- and many more... > > > > You can see that MS4W-4.0.0 will be a full SDI for Windows environments, > > with ~40+ working mapfiles and over 1.7GB of files, empowering DevOps > > and organizations worldwide.? Also note that this is a major release for > > MS4W, meaning that some things have changed dramatically (PHPmapscript > > will now use the SWIG API for example), so please follow MS4W's README > > for specific instructions for the many plugins and mapscripts. > > > > When installing, it is very important that (if you are using the .zip) > > your server must have the C++ Redistributable installed on it > > beforehand: execute the local file /ms4w/tmp/vcredist_x86.exe > > (alternatively if you use MS4W's setup.exe installer this is done > > automatically) > > > > Please provide your 4.0.0 testing feedback through the MS4W tracker (so > > the feedback is not lost or forgotten): http://www.ms4w.com/trac/ > > > > Thank you all for sharing your spatial information with MS4W. > > > > > > -jeff > > > > > > -- Jeff McKenna MapServer Consulting and Training Services https://gatewaygeomatics.com/ From steve.lime at state.mn.us Sat Feb 9 06:55:08 2019 From: steve.lime at state.mn.us (Lime, Steve D (MNIT)) Date: Sat, 9 Feb 2019 14:55:08 +0000 Subject: [mapserver-users] styling based on attribute for MapServer derived MVTiles In-Reply-To: <2150C84090324F8FB1BAA40EDCA30835@terragispc> References: , <2150C84090324F8FB1BAA40EDCA30835@terragispc> Message-ID: You can specify a type in the gml metadata and that will impact how the conversion is done in the mvt encoding. Something like: gml_mapcolor7_type integer Otherwise things are treated as strings... ?Steve ________________________________ From: karsten Sent: Tuesday, February 5, 2019 3:01:51 PM To: mapserver-users at lists.osgeo.org Cc: Lime, Steve D (MNIT) Subject: RE: [mapserver-users] styling based on attribute for MapServer derived MVTiles Great, Thanks Steve I added "gml_include_items" "mapcolor7" to the Metadata block and got it working. One quirk seems to be that when I am trying to the values as integer (from the mapcolor7 column) specifying the style as in 1.) below did not work. However it I treat them as characters instead, quoted them and used "type": "categorical" in the json file for the style as in 2.) below it is working. Cheers Karsten 1.) ---------------------------- { "id": "country-fill", "type": "fill", "source": "compass", "source-layer": "allcountries", "paint": { "fill-color": { "property": "mapcolor7", "stops": [ [1, "#fdaf6b"], [2, "#fdc663"], [3, "#fae364"], [4, "#d3e46f"], [5, "#aadb78"], [6, "#a3cec5"], [7, "#ceb5cf"] ] } } } 2.) ---------------------------- { "id": "country-fill", "type": "fill", "source": "compass", "source-layer": "allcountries", "paint": { "fill-color": { "property": "mapcolor7", "type": "categorical", "stops": [ ["1", "#fdaf6b"], ["2", "#fdc663"], ["3", "#fae364"], ["4", "#d3e46f"], ["5", "#aadb78"], ["6", "#a3cec5"], ["7", "#ceb5cf"] ] } } } ________________________________ From: Lime, Steve D (MNIT) [mailto:steve.lime at state.mn.us] Sent: Tuesday, February 05, 2019 21:15 To: karsten; mapserver-users at lists.osgeo.org Subject: RE: [mapserver-users] styling based on attribute for MapServer derived MVTiles I believe the default WxS behavior is to expose no attributes. You need to be explicit and I don?t see the gml_include_items metadata property in the mapfile for the layer allcountries. You?d need something like: ?gml_include_items? ?mapcolor7? Added to the allcountries layer. The mvt-demo does this for most layers? --Steve From: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of karsten Sent: Monday, February 04, 2019 4:33 PM To: mapserver-users at lists.osgeo.org Subject: [mapserver-users] styling based on attribute for MapServer derived MVTiles Dear All, I was working on the configuration of MapServer generated MVT tiles for a demo country world map and had success with MS v 7.2 outputting tiles in MVT format ( all thanks to https://github.com/sdlime/mvt-demo ). I am trying to work on the client side style for my demo map (using mapbox-gl.js) and defined them in a similar way as JSON as in Steve's mvt-demo above. The whole thing is later intended to be used in a benchmark for MapServer MVT rendering speed versus T-Rex ( see http://blog.sourcepole.ch/2018/09/06/the-tale-of-a-vector-tile-benchmark/ ) . For now I am struggling with specifying the correct style syntax for the client side and it seem that I missing something as I was not yet able to successfully use attribute properties to render Countries as different colors based on an attribute field of my PostGIS source. Below is the configuration of my 'allcountries' layer. The mapcolor7 filed is an integer field (in the input PostGIS source) but my set-up fails to output multiple colors , instead I am getting all default black for the country fill color. A second layer where I specified only Italy as one Country 'country-italy' to show up renders fine - see https://github.com/karstenv/mvt-benchmark/blob/master/MapServer/countries_mvt.png My complete style JSON is at https://github.com/karstenv/mvt-benchmark/blob/master/MapServer/ms_ne_simple.json and the corresponding map file is here https://github.com/karstenv/mvt-benchmark/blob/master/MapServer/ne.map Would anyone know what I need to change in order to render the countries with different colors according to the 'mapcolor7' attribute ? To me it seems that somehow the attribute is not available to the renderer even though in the MapServer map file I am selecting all fields in the sub-query ... Thanks Karsten -------------------------------------------- { "id": "country-fill", "type": "fill", "source": "compass", "source-layer": "allcountries", "paint": { "fill-color": { "property": "mapcolor7", "stops": [ [1, "#fdaf6b"], [2, "#fdc663"], [3, "#fae364"], [4, "#d3e46f"], [5, "#aadb78"], [6, "#a3cec5"], [7, "#ceb5cf"] ] } } },{ "id": "country-italy", "type": "fill", "source": "compass", "source-layer": "italy", "paint": { "fill-color": "#fdc663" } } Karsten Vennemann Terra GIS -------------- next part -------------- An HTML attachment was scrubbed... URL: From Brent.Wood at niwa.co.nz Sun Feb 10 16:51:28 2019 From: Brent.Wood at niwa.co.nz (Brent Wood) Date: Mon, 11 Feb 2019 00:51:28 +0000 Subject: [mapserver-users] Help with failing Postgis query... In-Reply-To: References: , <2150C84090324F8FB1BAA40EDCA30835@terragispc>, Message-ID: <1549846288336.24742@niwa.co.nz> Hi, I'm getting an error with an SQL in a mapfile. The query works from from the command line: select ROW_NUMBER() OVER (order by code) as id, code, sci_name, com_name, lower(family_com)||' ('|| family_sci||')' as Family, point from rdb.species_master s, maps.null_point p where code in (select distinct species from trawl.t_catch) limit 10 ; id,code,sci_name,com_name,family,locn 1,AAT,Alainopasiphaea australis,Alainopasiphaea australis,,0101000020E610000000000000000000000000000000000000 ... When embedded in a mapfile & invoked from a browser or QGIS I get an error: WFS server error. ms_error->code not found msPostGISLayerWhichShapes(): Query error. Error executing query. Any suggestions? Brent Wood Programme leader: Environmental Information Delivery NIWA DDI: +64 (4) 3860529 [cid:image0b988e.PNG at bcbaef9b.478419bf] Brent Wood Principal Technician - GIS and Spatial Data Management Programme Leader - Environmental Information Delivery T +64-4-386-0529 National Institute of Water & Atmospheric Research Ltd (NIWA) 301 Evans Bay Parade, Greta Point, Wellington Connect with NIWA: niwa.co.nz Facebook Twitter LinkedIn Instagram To ensure compliance with legal requirements and to maintain cyber security standards, NIWA's IT systems are subject to ongoing monitoring, activity logging and auditing. This monitoring and auditing service may be provided by third parties. Such third parties can access information transmitted to, processed by and stored on NIWA's IT systems. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image0b988e.PNG Type: image/png Size: 12288 bytes Desc: image0b988e.PNG URL: From stephenwoodbridge37 at gmail.com Sun Feb 10 21:04:07 2019 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Mon, 11 Feb 2019 00:04:07 -0500 Subject: [mapserver-users] Help with failing Postgis query... In-Reply-To: <1549846288336.24742@niwa.co.nz> References: <2150C84090324F8FB1BAA40EDCA30835@terragispc> <1549846288336.24742@niwa.co.nz> Message-ID: <6400bf95-bfee-ee18-8ff7-0ca57b5003d9@gmail.com> Brent, Are you wrapping your query like: DATA "select * from (select ROW_NUMBER() OVER (order by code) as id, code, sci_name, com_name, lower(family_com)||' ('|| family_sci||')' as Family, point from rdb.species_master s, maps.null_point p where code in (select distinct species from trawl.t_catch) limit 10) as foo using unique id using srid=4326" where srid is appropriate for your data? -Steve W On 2/10/2019 7:51 PM, Brent Wood wrote: > > Hi, > > > I'm getting an error with an SQL in a mapfile. > > > The query works from from the command line: > > > select ROW_NUMBER() OVER (order by code) as id, code, sci_name, > com_name, lower(family_com)||' ('|| family_sci||')' as Family, point > from rdb.species_master s, maps.null_point p where code in (select > distinct species from trawl.t_catch) limit 10 ; > > > id,code,sci_name,com_name,family,locn > 1,AAT,Alainopasiphaea australis,Alainopasiphaea > australis,,0101000020E610000000000000000000000000000000000000 > > ... > > > When embedded in a mapfile & invoked from a browser or QGIS I get an > error: > > > WFS server error. ms_error->code not found > msPostGISLayerWhichShapes(): Query error. Error executing query. > > > > Any suggestions? > > > Brent Wood > > Programme leader: Environmental Information Delivery > NIWA > DDI:? +64 (4) 3860529 > > > > > > Brent Wood > Principal Technician - GIS and Spatial Data Management > Programme Leader - Environmental Information Delivery > T +64-4-386-0529 > > National Institute of Water & Atmospheric Research Ltd (NIWA) > 301 Evans Bay Parade, Greta Point, Wellington > Connect with NIWA: niwa.co.nz Facebook > Twitter > LinkedIn > Instagram > > > To ensure compliance with legal requirements and to maintain cyber > security standards, NIWA's IT systems are subject to ongoing > monitoring, activity logging and auditing. This monitoring and > auditing service may be provided by third parties. Such third parties > can access information transmitted to, processed by and stored on > NIWA's IT systems. > > > > > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users --- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus From klassen.js at gmail.com Mon Feb 11 11:10:17 2019 From: klassen.js at gmail.com (Jim Klassen) Date: Mon, 11 Feb 2019 13:10:17 -0600 Subject: [mapserver-users] MS4W version 4.0.0-beta1 available In-Reply-To: <0b09a498-d3f1-fc68-1d54-68c2f42879ca@gatewaygeomatics.com> References: <062010da-fe14-ff9f-0fb8-9d6fd8dd2ef9@gatewaygeomatics.com> <560c49b3-5b9f-f676-b5f0-057433950ccc@gatewaygeomatics.com> <814239987.248274.1549618019042@mail.yahoo.com> <0b09a498-d3f1-fc68-1d54-68c2f42879ca@gatewaygeomatics.com> Message-ID: BTW: I tested GeoMoose 3.2.1 and 3.3.0 on MS4W 4.0.0-beta1 and it looks good. On 2/8/19 9:02 AM, Jeff McKenna wrote: > Hi Stefanos, > > MS4W 4, and moving forward, will leverage the SWIG API for PHPmapscript use.? Believe it or not, there was an alpha release of MS4W way back in 2016 with that SWIG support for PHP7mapscript (and some have used that alpha in deployment since).? The purpose of the 4.0.0 beta process is to give all MS4W users, devs, organizations, projects, lots of time to get their hands on it, trying, testing, giving feedback, and modifying their code for this PHPmapscript change.? I've also informed several other software communities directly of this (GeoMoose, Mapbender, p.mapper, ZOO-Project, etc). > > It is a dramatic change, but the timing is right as MS4W 4.0 will give the reason to adapt to the SWIG API, for PHP users.? This change for MS4W was made for the long-term maintenance of PHPmapscript in MS4W (to avoid such a show-stopping PHP version, like a PHP8, coming along and affecting MS4W deployments again). > > In terms of your question for PHPmapscript support in other environments other than MS4W, many have been leveraging this code: https://github.com/bjoernboldt/mapscript-php7 which has been imported into MapServer 7.4dev source also.? So you should be fine for Linux as well (but it may take time for all packaged distributions to catch up to all of these changes). > > I hope I helped answer your questions. > > Thanks for your interest in MS4W. > > -jeff > > > > On 2019-02-08 5:26 AM, Stefanos Anastasiou wrote: >> Hello Jeff, >> ?? ? does php mapsrcipt now belong to SWIG family ? Regarding Linux distribution what changes does this bring in the installation process ? >> >> Thank you >> >> -Stefanos >> >> ???? ?????, 5 ??????????? 2019, 2:59:24 ?.?. EET, ? ??????? Jeff McKenna ??????: >> >> >> I forgot to highlight one of the most important parts: MS4W-4.0.0 >> contains PHP 7.2.14 and the performance improvements are very >> noticeable.? -jeff >> >> >> >> On 2019-02-04 8:46 PM, Jeff McKenna wrote: >> ?> Hello everyone, >> ?> >> ?> Many Windows users will be very interested that MS4W-4.0.0-beta1 is >> ?> available now, which will be a huge release of changes, as every library >> ?> (over 200 now) has been upgraded and built with a new compiler (Visual >> ?> Studio 2017), and contains many great additions overall. You can test >> ?> the beta at: >> ?> >> ?>? ?- installer: >> ?> https://ms4w.com/release/experimental/ms4w-4.0.0-beta1-setup.exe >> ?> (recommended) >> ?>? ?- archive: https://ms4w.com/release/experimental/ms4w_4.0.0_beta1.zip >> ?> >> ?> Please see MS4W's HISTORY.txt for all of the changes, but here are some >> ?> of the highlights: >> ?> >> ?>? ?- Mapbox Vector Tile output through MapServer (demo included) >> ?>? ?- PHP7 mapscript support (using the SWIG API) >> ?>? ?- usual mapscripts available (Java, Python, CSharp) >> ?>? ?- embedded Python 3.7.0 >> ?>? ?- running pycsw Catalogue Server >> ?>? ?- expanded ZOO-Project WPS support (all GDAL/OGR services, Python, >> ?> PHP, CSharp, Java) >> ?>? ?- new Matomo Analytics package >> ?>? ?- simple map viewer on the localhost page >> ?>? ?- GDAL 2.4.0 >> ?>? ?- MapServer 7.4.0-dev >> ?>? ?- mod_wsgi for Apache >> ?>? ?- and many more... >> ?> >> ?> You can see that MS4W-4.0.0 will be a full SDI for Windows environments, >> ?> with ~40+ working mapfiles and over 1.7GB of files, empowering DevOps >> ?> and organizations worldwide.? Also note that this is a major release for >> ?> MS4W, meaning that some things have changed dramatically (PHPmapscript >> ?> will now use the SWIG API for example), so please follow MS4W's README >> ?> for specific instructions for the many plugins and mapscripts. >> ?> >> ?> When installing, it is very important that (if you are using the .zip) >> ?> your server must have the C++ Redistributable installed on it >> ?> beforehand: execute the local file /ms4w/tmp/vcredist_x86.exe >> ?> (alternatively if you use MS4W's setup.exe installer this is done >> ?> automatically) >> ?> >> ?> Please provide your 4.0.0 testing feedback through the MS4W tracker (so >> ?> the feedback is not lost or forgotten): http://www.ms4w.com/trac/ >> ?> >> ?> Thank you all for sharing your spatial information with MS4W. >> ?> >> ?> >> ?> -jeff >> ?> >> ?> >> >> From emperor_stef at yahoo.gr Tue Feb 12 03:59:48 2019 From: emperor_stef at yahoo.gr (Stefanos Anastasiou) Date: Tue, 12 Feb 2019 11:59:48 +0000 (UTC) Subject: [mapserver-users] MS4W version 4.0.0-beta1 available In-Reply-To: <0b09a498-d3f1-fc68-1d54-68c2f42879ca@gatewaygeomatics.com> References: <062010da-fe14-ff9f-0fb8-9d6fd8dd2ef9@gatewaygeomatics.com> <560c49b3-5b9f-f676-b5f0-057433950ccc@gatewaygeomatics.com> <814239987.248274.1549618019042@mail.yahoo.com> <0b09a498-d3f1-fc68-1d54-68c2f42879ca@gatewaygeomatics.com> Message-ID: <678447976.3683419.1549972788832@mail.yahoo.com> Hi Jeff,?thank you for your reply and the link. So regarding Linux there is no official SWIG integration for php mapscript yet,right? Only attempts and tests Thank you for your reply -Stefanos ???? ?????????, 8 ??????????? 2019, 5:02:41 ?.?. EET, ? ??????? Jeff McKenna ??????: Hi Stefanos, MS4W 4, and moving forward, will leverage the SWIG API for PHPmapscript use.? Believe it or not, there was an alpha release of MS4W way back in 2016 with that SWIG support for PHP7mapscript (and some have used that alpha in deployment since).? The purpose of the 4.0.0 beta process is to give all MS4W users, devs, organizations, projects, lots of time to get their hands on it, trying, testing, giving feedback, and modifying their code for this PHPmapscript change.? I've also informed several other software communities directly of this (GeoMoose, Mapbender, p.mapper, ZOO-Project, etc). It is a dramatic change, but the timing is right as MS4W 4.0 will give the reason to adapt to the SWIG API, for PHP users.? This change for MS4W was made for the long-term maintenance of PHPmapscript in MS4W (to avoid such a show-stopping PHP version, like a PHP8, coming along and affecting MS4W deployments again). In terms of your question for PHPmapscript support in other environments other than MS4W, many have been leveraging this code: https://github.com/bjoernboldt/mapscript-php7 which has been imported into MapServer 7.4dev source also.? So you should be fine for Linux as well (but it may take time for all packaged distributions to catch up to all of these changes). I hope I helped answer your questions. Thanks for your interest in MS4W. -jeff On 2019-02-08 5:26 AM, Stefanos Anastasiou wrote: > Hello Jeff, >? ? ? does php mapsrcipt now belong to SWIG family ? Regarding Linux > distribution what changes does this bring in the installation process ? > > Thank you > > -Stefanos > > ???? ?????, 5 ??????????? 2019, 2:59:24 ?.?. EET, ? ??????? Jeff McKenna > ??????: > > > I forgot to highlight one of the most important parts: MS4W-4.0.0 > contains PHP 7.2.14 and the performance improvements are very > noticeable.? -jeff > > > > On 2019-02-04 8:46 PM, Jeff McKenna wrote: >? > Hello everyone, >? > >? > Many Windows users will be very interested that MS4W-4.0.0-beta1 is >? > available now, which will be a huge release of changes, as every library >? > (over 200 now) has been upgraded and built with a new compiler (Visual >? > Studio 2017), and contains many great additions overall.? You can test >? > the beta at: >? > >? >? ?- installer: >? > https://ms4w.com/release/experimental/ms4w-4.0.0-beta1-setup.exe >? > (recommended) >? >? ?- archive: https://ms4w.com/release/experimental/ms4w_4.0.0_beta1.zip >? > >? > Please see MS4W's HISTORY.txt for all of the changes, but here are some >? > of the highlights: >? > >? >? ?- Mapbox Vector Tile output through MapServer (demo included) >? >? ?- PHP7 mapscript support (using the SWIG API) >? >? ?- usual mapscripts available (Java, Python, CSharp) >? >? ?- embedded Python 3.7.0 >? >? ?- running pycsw Catalogue Server >? >? ?- expanded ZOO-Project WPS support (all GDAL/OGR services, Python, >? > PHP, CSharp, Java) >? >? ?- new Matomo Analytics package >? >? ?- simple map viewer on the localhost page >? >? ?- GDAL 2.4.0 >? >? ?- MapServer 7.4.0-dev >? >? ?- mod_wsgi for Apache >? >? ?- and many more... >? > >? > You can see that MS4W-4.0.0 will be a full SDI for Windows environments, >? > with ~40+ working mapfiles and over 1.7GB of files, empowering DevOps >? > and organizations worldwide.? Also note that this is a major release for >? > MS4W, meaning that some things have changed dramatically (PHPmapscript >? > will now use the SWIG API for example), so please follow MS4W's README >? > for specific instructions for the many plugins and mapscripts. >? > >? > When installing, it is very important that (if you are using the .zip) >? > your server must have the C++ Redistributable installed on it >? > beforehand: execute the local file /ms4w/tmp/vcredist_x86.exe >? > (alternatively if you use MS4W's setup.exe installer this is done >? > automatically) >? > >? > Please provide your 4.0.0 testing feedback through the MS4W tracker (so >? > the feedback is not lost or forgotten): http://www.ms4w.com/trac/ >? > >? > Thank you all for sharing your spatial information with MS4W. >? > >? > >? > -jeff >? > >? > > > -- Jeff McKenna MapServer Consulting and Training Services https://gatewaygeomatics.com/ _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From jmckenna at gatewaygeomatics.com Tue Feb 12 04:41:23 2019 From: jmckenna at gatewaygeomatics.com (Jeff McKenna) Date: Tue, 12 Feb 2019 08:41:23 -0400 Subject: [mapserver-users] Fwd: version 4.0.0-beta2 available In-Reply-To: References: Message-ID: Forwarding to MapServer-users. The beta2 installer also leverages GeoMoose 3.3.0, Mapbender 3.0.7.7, ... -------- Forwarded Message -------- Hello everyone, Another beta of MS4W 4.0.0 is available: - installer: https://ms4w.com/release/experimental/ms4w-4.0.0-beta2-setup.exe (recommended) - archive: https://ms4w.com/release/experimental/ms4w_4.0.0_beta2.zip Please see MS4W's HISTORY.txt for all of the changes, but here are some of the recent changes: - upgraded PHP to 7.2.15 (trac ticket 184) - upgraded APCu to 5.1.17 - upgraded MapServer and MapScript (CSharp, Java, Python, PHP) to today's 7.4.0-dev - moved mapscript plugins into /ms4w/msplugins - moved test-cgi-mapscript.py into /ms4w/msplugins/mapscript/python - use relative paths for MapCache and mod_wsgi Apache modules (trac ticket 185) - use relative paths for ZOO-Project's main.cfg You can see that MS4W-4.0.0 will be a full SDI for Windows environments, with ~40+ working mapfiles and over 1.7GB of files, empowering DevOps and organizations worldwide. Also note that this is a major release for MS4W, meaning that some things have changed dramatically (PHPmapscript will now use the SWIG API for example), so please follow MS4W's README for specific instructions for the many plugins and mapscripts. When installing, it is very important that (if you are using the .zip) your server must have the C++ Redistributable installed on it beforehand: execute the local file /ms4w/tmp/vcredist_x86.exe (alternatively if you use MS4W's setup.exe installer this is done automatically) Please provide your 4.0.0 testing feedback through the MS4W tracker (so the feedback is not lost or forgotten): https://ms4w.com/trac/ Thank you all for sharing your spatial information with MS4W. -jeff -- Jeff McKenna MapServer Consulting and Training Services https://gatewaygeomatics.com/ From stephenwoodbridge37 at gmail.com Tue Feb 12 10:44:42 2019 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Tue, 12 Feb 2019 13:44:42 -0500 Subject: [mapserver-users] [mapserver-dev] Setup for MVT (was: Time for a 7.2.2 release?) In-Reply-To: References: <3137dee7-0a2d-edf2-aa9f-151b90e0d4ad@gmail.com> <7fab5a58-4a7b-7eae-8d0c-460b00ac48a3@gmail.com> Message-ID: <8da8e82b-0791-f74b-8dd5-fc93c3b367ec@gmail.com> Hi Steve, Thanks!, I put this back on the list so other can benefit from your thoughts. Tiles at various scales is not intuitive to me either. If you don't simplify the geometries, then all you are getting it more features in each tile as you zoom out. But your point about degenerate geometries play right into this and you can't really simplify them except via clustering which makes more sense on the client side. I was thinking of using this for serving point features to an OL5 application. Since my case was so simple, I ended up writing a trivial PHP handler to do this using a bbox strategy, but I want to revisit that using mapcache and MVT because I think it would be good to learn and I think it would be more efficient on both the client and server, not that I need to worry that much about that. -Steve On 2/12/2019 11:56 AM, Lime, Steve D (MNIT) wrote: > I like the OL example as well. Years ago I created an initial run at that format using the CGI-based options against a common MapFile. It worked ok for that use case because all the differences between examples were configured completely on the client. > > 1) You actually don't need to define an output format - there's one set by default if the support is compiled in. You can override of course. > 2) Configuration for MVT mirrors that of WMS (strangely) and WFS at least in terms of determining which feature attributes are exposed, so OWS_INCLUDE_ITEMS and OWS_[item name]_TYPE are about all you care about. This applies to either MapCache or mode=tile requests. GeoJSON and KML drivers behave similarly. > 3) If using MapCache the requests are made using WMS so that protocol needs to be enabled in the MapFIle. > 4) The other option is using the CGI and mode=tile. You can set the format either in the mapfile via IMAGETYPE or via URL using map_imagetype=mvt > 5) The MVT format is layer-based so it maps nicely to MapServer. You can certainly mix geometry types across layers. I don't know that the format supports mixed geometry types within layers - MapServer doesn't so it's a moot point anyway. > 6) MapServer is generating binary protobuf files so there isn't really a way to show sample outout. > 7) The rendering process does respect MIN/MAXSCALEDENOM values > 8) Features are converted from map coordinates to tile coordinates much the same way as you would for drawing in an images. Features are clipped and then sampled based on the tile extent and resolution. I think it's helpful to think of MVT features as almost pre-processed features suitable for drawing-only. > 9) One difference from the vector->raster conversion and the vector->mvt conversion is that I was finding that the Mapbox GL client was pretty sensitive to degenerate geometries - specifically triangles that trend towards a point (area < 1) or a line (triangle height along the longest size < 1 pixel). The geometries are valid according to a few MVT utilities out there but Mapbox GL stops rendering the geometry as soon as it reaches a part like this. I've got a feeling this is related to Web GL itself. Anyway, MapServer 7.2.2 has some additional filtering in place to remove this portions of a geometry. I suspect we'll run into other issues like this as we gain experience. > > One thing I don't have good handle on is strategies to optimize tiles based on scale. For example, it's certainly possible to send full-resolution features at a certain zoom level and it would seem to me that you wouldn't want to keep sending them since the client already has as good a data as it can get. This is all probably heavily dependent on the behavior of the client and until folks get a chance to use this functionality we won't be able to provide much guidance. > > --Steve > > -----Original Message----- > From: Stephen Woodbridge [mailto:stephenwoodbridge37 at gmail.com] > Sent: Thursday, February 07, 2019 9:06 PM > To: Lime, Steve D (MNIT) ; mapserver-dev at lists.osgeo.org > Subject: Re: [mapserver-dev] Time for a 7.2.2 release? > > Steve L, > > I like what Openlayers has in the way of examples but that would be a > major undertaking so I think it is beyond the scope of things. I have > found the? Mapserver OGC pages to be very help as an example. For this > specific case of MVT tiles, a simple mapfile with the appropriate bits > commented. And for mapcache, and a sample mapcache.xml referencing the > sample mapfile should do it. I would think this could all be done on a > single page and added to the documentation. > > For the mapfile, I presume you need to setup an output format, and then > there is probably some metadata that needs to be defined to tell what > properties should be included with the data. Is this on each layer? What > happens if multiple layers are requested with different geometry types? > you get back a FeatureCollection?? What does a request look like, is > this a standard WMS or WFS request? I'm guessing a WMS because that is > what mapcache expects.? A sample geojson output might be helpful. I'm > just tossing out ideas here that I think might be helpful to someone not > familiar with it and trying to make use of it. > > If you want to send me some info on/off list, I will try to organize it > and put together markdown page and send that back to you. > > -Steve W > > On 2/6/2019 5:45 PM, Lime, Steve D (MNIT) wrote: >> I'll update the RFC. At a minimum it's missing the voting history. >> >> As for other documentation we?d need to create a new page I guess that would be more task-based (e.g. I want to serve vector tiles using MapServer and MapCache). We don't do much of that and perhaps we should. There really aren't any new configuration options, heck the MVT output format is built in so as long as the support is compiled in there isn't much to it. Steve, maybe you could put together an outline of what your ideal "how to" might contain? >> >> --Steve >> >> -----Original Message----- >> From: mapserver-dev [mailto:mapserver-dev-bounces at lists.osgeo.org] On Behalf Of Stephen Woodbridge >> Sent: Wednesday, February 06, 2019 9:31 AM >> To: mapserver-dev at lists.osgeo.org >> Subject: Re: [mapserver-dev] Time for a 7.2.2 release? >> >> It would be nice if RFC 119 on MVT Tiles was updated to indicate it is >> release. I'm not sure if there is any docs, I did go looking and the >> only thing I found was references to SteveL's github stuff, but it would >> be nice is there was an example showing how to setup mapserver and >> mapcache serving MVT Tiles. >> >> Thanks, >> ? -Steve W >> >> On 2/6/2019 9:47 AM, Lime, Steve D (MNIT) wrote: >>> I had mentioned a mid-January release a while back so we?re a tad >>> late. There a couple of MVT-related bug fixes, among other things, >>> that would be nice to release. Anything folks were hoping to see included? >>> >>> Otherwise I?ll offer a +1 for a 7.2.2 release in the next week. Jeff >>> has graciously offered to help... >>> >>> ?Steve >>> >>> _______________________________________________ >>> mapserver-dev mailing list >>> mapserver-dev at lists.osgeo.org >>> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-dev&data=02%7C01%7Csteve.lime%40state.mn.us%7C4ca35e428b4f4cec48f508d68d726b23%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636851919895381801&sdata=6lxUMFyaaSsKLLnZ04va4qDWPivuujJHb8C5FU23nxE%3D&reserved=0 >> --- >> This email has been checked for viruses by Avast antivirus software. >> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.avast.com%2Fantivirus&data=02%7C01%7Csteve.lime%40state.mn.us%7C4ca35e428b4f4cec48f508d68d726b23%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636851919895381801&sdata=UeY1nsMpRFRbqrCgxpHNIA6k%2FMkt8CUb6DOoLECKzhg%3D&reserved=0 >> >> _______________________________________________ >> mapserver-dev mailing list >> mapserver-dev at lists.osgeo.org >> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-dev&data=02%7C01%7Csteve.lime%40state.mn.us%7C4ca35e428b4f4cec48f508d68d726b23%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636851919895381801&sdata=6lxUMFyaaSsKLLnZ04va4qDWPivuujJHb8C5FU23nxE%3D&reserved=0 > > --- > This email has been checked for viruses by Avast antivirus software. > https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.avast.com%2Fantivirus&data=02%7C01%7Csteve.lime%40state.mn.us%7C4ca35e428b4f4cec48f508d68d726b23%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636851919895381801&sdata=UeY1nsMpRFRbqrCgxpHNIA6k%2FMkt8CUb6DOoLECKzhg%3D&reserved=0 > --- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus From bob.basques at ci.stpaul.mn.us Tue Feb 12 11:14:05 2019 From: bob.basques at ci.stpaul.mn.us (Basques, Bob (CI-StPaul)) Date: Tue, 12 Feb 2019 19:14:05 +0000 Subject: [mapserver-users] OSGeo Local Chapter (aka TCMUG) Meeting Message-ID: Reminder for tomorrows meeting. bobb OSGeo Local Chapter (aka TCMUG) Meeting Scheduled: Feb 13, 2019 at 4:30 PM to 6:00 PM Location: http://www.flatearthbrewing.com/ http://www.flatearthbrewing.com/ https://goo.gl/maps/4sXKnj1nn9J2 ?There is nothing quite so useless as doing with great efficiency something that should not be done at all.? - Peter Drucker -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: iCal-20190212-131315.ics Type: text/calendar Size: 1010 bytes Desc: iCal-20190212-131315.ics URL: From steve.lime at state.mn.us Tue Feb 12 11:34:51 2019 From: steve.lime at state.mn.us (Lime, Steve D (MNIT)) Date: Tue, 12 Feb 2019 19:34:51 +0000 Subject: [mapserver-users] [mapserver-dev] Setup for MVT (was: Time for a 7.2.2 release?) In-Reply-To: <8da8e82b-0791-f74b-8dd5-fc93c3b367ec@gmail.com> References: <3137dee7-0a2d-edf2-aa9f-151b90e0d4ad@gmail.com> <7fab5a58-4a7b-7eae-8d0c-460b00ac48a3@gmail.com> <8da8e82b-0791-f74b-8dd5-fc93c3b367ec@gmail.com> Message-ID: BTW my MVT demo does have a sample mapache config included now. Note that the MVT creation does do simplification so for example you'll see islands in lakes disappear as they become degenerate and points removed from lines, etc.... That's the fun part and hat you need for scanline conversion is a little different from what Open/Web GL needs. -----Original Message----- From: Stephen Woodbridge [mailto:stephenwoodbridge37 at gmail.com] Sent: Tuesday, February 12, 2019 12:45 PM To: Lime, Steve D (MNIT) ; mapserver-users Subject: Re: [mapserver-dev] Setup for MVT (was: Time for a 7.2.2 release?) Hi Steve, Thanks!, I put this back on the list so other can benefit from your thoughts. Tiles at various scales is not intuitive to me either. If you don't simplify the geometries, then all you are getting it more features in each tile as you zoom out. But your point about degenerate geometries play right into this and you can't really simplify them except via clustering which makes more sense on the client side. I was thinking of using this for serving point features to an OL5 application. Since my case was so simple, I ended up writing a trivial PHP handler to do this using a bbox strategy, but I want to revisit that using mapcache and MVT because I think it would be good to learn and I think it would be more efficient on both the client and server, not that I need to worry that much about that. -Steve On 2/12/2019 11:56 AM, Lime, Steve D (MNIT) wrote: > I like the OL example as well. Years ago I created an initial run at that format using the CGI-based options against a common MapFile. It worked ok for that use case because all the differences between examples were configured completely on the client. > > 1) You actually don't need to define an output format - there's one set by default if the support is compiled in. You can override of course. > 2) Configuration for MVT mirrors that of WMS (strangely) and WFS at least in terms of determining which feature attributes are exposed, so OWS_INCLUDE_ITEMS and OWS_[item name]_TYPE are about all you care about. This applies to either MapCache or mode=tile requests. GeoJSON and KML drivers behave similarly. > 3) If using MapCache the requests are made using WMS so that protocol needs to be enabled in the MapFIle. > 4) The other option is using the CGI and mode=tile. You can set the format either in the mapfile via IMAGETYPE or via URL using map_imagetype=mvt > 5) The MVT format is layer-based so it maps nicely to MapServer. You can certainly mix geometry types across layers. I don't know that the format supports mixed geometry types within layers - MapServer doesn't so it's a moot point anyway. > 6) MapServer is generating binary protobuf files so there isn't really a way to show sample outout. > 7) The rendering process does respect MIN/MAXSCALEDENOM values > 8) Features are converted from map coordinates to tile coordinates much the same way as you would for drawing in an images. Features are clipped and then sampled based on the tile extent and resolution. I think it's helpful to think of MVT features as almost pre-processed features suitable for drawing-only. > 9) One difference from the vector->raster conversion and the vector->mvt conversion is that I was finding that the Mapbox GL client was pretty sensitive to degenerate geometries - specifically triangles that trend towards a point (area < 1) or a line (triangle height along the longest size < 1 pixel). The geometries are valid according to a few MVT utilities out there but Mapbox GL stops rendering the geometry as soon as it reaches a part like this. I've got a feeling this is related to Web GL itself. Anyway, MapServer 7.2.2 has some additional filtering in place to remove this portions of a geometry. I suspect we'll run into other issues like this as we gain experience. > > One thing I don't have good handle on is strategies to optimize tiles based on scale. For example, it's certainly possible to send full-resolution features at a certain zoom level and it would seem to me that you wouldn't want to keep sending them since the client already has as good a data as it can get. This is all probably heavily dependent on the behavior of the client and until folks get a chance to use this functionality we won't be able to provide much guidance. > > --Steve > > -----Original Message----- > From: Stephen Woodbridge [mailto:stephenwoodbridge37 at gmail.com] > Sent: Thursday, February 07, 2019 9:06 PM > To: Lime, Steve D (MNIT) ; mapserver-dev at lists.osgeo.org > Subject: Re: [mapserver-dev] Time for a 7.2.2 release? > > Steve L, > > I like what Openlayers has in the way of examples but that would be a > major undertaking so I think it is beyond the scope of things. I have > found the? Mapserver OGC pages to be very help as an example. For this > specific case of MVT tiles, a simple mapfile with the appropriate bits > commented. And for mapcache, and a sample mapcache.xml referencing the > sample mapfile should do it. I would think this could all be done on a > single page and added to the documentation. > > For the mapfile, I presume you need to setup an output format, and then > there is probably some metadata that needs to be defined to tell what > properties should be included with the data. Is this on each layer? What > happens if multiple layers are requested with different geometry types? > you get back a FeatureCollection?? What does a request look like, is > this a standard WMS or WFS request? I'm guessing a WMS because that is > what mapcache expects.? A sample geojson output might be helpful. I'm > just tossing out ideas here that I think might be helpful to someone not > familiar with it and trying to make use of it. > > If you want to send me some info on/off list, I will try to organize it > and put together markdown page and send that back to you. > > -Steve W > > On 2/6/2019 5:45 PM, Lime, Steve D (MNIT) wrote: >> I'll update the RFC. At a minimum it's missing the voting history. >> >> As for other documentation we?d need to create a new page I guess that would be more task-based (e.g. I want to serve vector tiles using MapServer and MapCache). We don't do much of that and perhaps we should. There really aren't any new configuration options, heck the MVT output format is built in so as long as the support is compiled in there isn't much to it. Steve, maybe you could put together an outline of what your ideal "how to" might contain? >> >> --Steve >> >> -----Original Message----- >> From: mapserver-dev [mailto:mapserver-dev-bounces at lists.osgeo.org] On Behalf Of Stephen Woodbridge >> Sent: Wednesday, February 06, 2019 9:31 AM >> To: mapserver-dev at lists.osgeo.org >> Subject: Re: [mapserver-dev] Time for a 7.2.2 release? >> >> It would be nice if RFC 119 on MVT Tiles was updated to indicate it is >> release. I'm not sure if there is any docs, I did go looking and the >> only thing I found was references to SteveL's github stuff, but it would >> be nice is there was an example showing how to setup mapserver and >> mapcache serving MVT Tiles. >> >> Thanks, >> ? -Steve W >> >> On 2/6/2019 9:47 AM, Lime, Steve D (MNIT) wrote: >>> I had mentioned a mid-January release a while back so we?re a tad >>> late. There a couple of MVT-related bug fixes, among other things, >>> that would be nice to release. Anything folks were hoping to see included? >>> >>> Otherwise I?ll offer a +1 for a 7.2.2 release in the next week. Jeff >>> has graciously offered to help... >>> >>> ?Steve >>> >>> _______________________________________________ >>> mapserver-dev mailing list >>> mapserver-dev at lists.osgeo.org >>> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-dev&data=02%7C01%7Csteve.lime%40state.mn.us%7C496918c1609c48fb50c308d6911a2738%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636855938851058102&sdata=3mhmfn%2Fz%2B9gDWoJ%2Brm8Ln8a8lAvavC549FCS6K421lg%3D&reserved=0 >> --- >> This email has been checked for viruses by Avast antivirus software. >> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.avast.com%2Fantivirus&data=02%7C01%7Csteve.lime%40state.mn.us%7C496918c1609c48fb50c308d6911a2738%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636855938851058102&sdata=k4r%2BcFoBqk11Y%2B20foTd3fbGoNX68sKCTRFXrQ5ufx0%3D&reserved=0 >> >> _______________________________________________ >> mapserver-dev mailing list >> mapserver-dev at lists.osgeo.org >> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-dev&data=02%7C01%7Csteve.lime%40state.mn.us%7C496918c1609c48fb50c308d6911a2738%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636855938851068104&sdata=nFdif%2FmbfivEu9E%2B29W6kPQsJaQ0EZ%2BAL4ebI1OvpLc%3D&reserved=0 > > --- > This email has been checked for viruses by Avast antivirus software. > https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.avast.com%2Fantivirus&data=02%7C01%7Csteve.lime%40state.mn.us%7C496918c1609c48fb50c308d6911a2738%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636855938851068104&sdata=dbwm5xtyBZm2D4MRBTM2fI2zBA9JIFKjWaKdX2pYhYs%3D&reserved=0 > --- This email has been checked for viruses by Avast antivirus software. https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.avast.com%2Fantivirus&data=02%7C01%7Csteve.lime%40state.mn.us%7C496918c1609c48fb50c308d6911a2738%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636855938851068104&sdata=dbwm5xtyBZm2D4MRBTM2fI2zBA9JIFKjWaKdX2pYhYs%3D&reserved=0 From steve.lime at state.mn.us Tue Feb 12 11:39:08 2019 From: steve.lime at state.mn.us (Lime, Steve D (MNIT)) Date: Tue, 12 Feb 2019 19:39:08 +0000 Subject: [mapserver-users] Help with failing Postgis query... In-Reply-To: <6400bf95-bfee-ee18-8ff7-0ca57b5003d9@gmail.com> References: <2150C84090324F8FB1BAA40EDCA30835@terragispc> <1549846288336.24742@niwa.co.nz> <6400bf95-bfee-ee18-8ff7-0ca57b5003d9@gmail.com> Message-ID: Also, I'd turn on debugging. The PostGIS code is very good about writing meaningful debugging information to that log file. -----Original Message----- From: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Stephen Woodbridge Sent: Sunday, February 10, 2019 11:04 PM To: mapserver-users at lists.osgeo.org Subject: Re: [mapserver-users] Help with failing Postgis query... Brent, Are you wrapping your query like: DATA "select * from (select ROW_NUMBER() OVER (order by code) as id, code, sci_name, com_name, lower(family_com)||' ('|| family_sci||')' as Family, point from rdb.species_master s, maps.null_point p where code in (select distinct species from trawl.t_catch) limit 10) as foo using unique id using srid=4326" where srid is appropriate for your data? -Steve W On 2/10/2019 7:51 PM, Brent Wood wrote: > > Hi, > > > I'm getting an error with an SQL in a mapfile. > > > The query works from from the command line: > > > select ROW_NUMBER() OVER (order by code) as id, code, sci_name, > com_name, lower(family_com)||' ('|| family_sci||')' as Family, point > from rdb.species_master s, maps.null_point p where code in (select > distinct species from trawl.t_catch) limit 10 ; > > > id,code,sci_name,com_name,family,locn > 1,AAT,Alainopasiphaea australis,Alainopasiphaea > australis,,0101000020E610000000000000000000000000000000000000 > > ... > > > When embedded in a mapfile & invoked from a browser or QGIS I get an > error: > > > WFS server error. ms_error->code not found > msPostGISLayerWhichShapes(): Query error. Error executing query. > > > > Any suggestions? > > > Brent Wood > > Programme leader: Environmental Information Delivery > NIWA > DDI:? +64 (4) 3860529 > > > > > > Brent Wood > Principal Technician - GIS and Spatial Data Management > Programme Leader - Environmental Information Delivery > T +64-4-386-0529 > > National Institute of Water & Atmospheric Research Ltd (NIWA) > 301 Evans Bay Parade, Greta Point, Wellington > Connect with NIWA: niwa.co.nz Facebook > Twitter > LinkedIn > Instagram > > > To ensure compliance with legal requirements and to maintain cyber > security standards, NIWA's IT systems are subject to ongoing > monitoring, activity logging and auditing. This monitoring and > auditing service may be provided by third parties. Such third parties > can access information transmitted to, processed by and stored on > NIWA's IT systems. > > > > > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-users&data=02%7C01%7Csteve.lime%40state.mn.us%7Ccd30802415dd452ec1eb08d68fde5c89%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636854582543106672&sdata=Or5QlT2y7YnEoea9XqkSlgoyC1OAm0Q0BiklpHtZkZc%3D&reserved=0 --- This email has been checked for viruses by Avast antivirus software. https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.avast.com%2Fantivirus&data=02%7C01%7Csteve.lime%40state.mn.us%7Ccd30802415dd452ec1eb08d68fde5c89%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636854582543106672&sdata=ENQHGV2XiSeAnJaQv8ReCiQ45Z%2B4BtZIdNqI9zbokB0%3D&reserved=0 _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-users&data=02%7C01%7Csteve.lime%40state.mn.us%7Ccd30802415dd452ec1eb08d68fde5c89%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636854582543106672&sdata=Or5QlT2y7YnEoea9XqkSlgoyC1OAm0Q0BiklpHtZkZc%3D&reserved=0 From Brent.Wood at niwa.co.nz Tue Feb 12 16:19:38 2019 From: Brent.Wood at niwa.co.nz (Brent Wood) Date: Wed, 13 Feb 2019 00:19:38 +0000 Subject: [mapserver-users] Help with failing Postgis query... In-Reply-To: References: <2150C84090324F8FB1BAA40EDCA30835@terragispc> <1549846288336.24742@niwa.co.nz> <6400bf95-bfee-ee18-8ff7-0ca57b5003d9@gmail.com>, Message-ID: <1550017178159.736@niwa.co.nz> Thanks guys, I have solved this problem (but am working through another :-) The logged SQL with the error says: "... find_srid('','rdb.species_master','point'))"... and it can't find the srid. This is because my query gets the point from the maps.null_point table, not the rdb.species_master one, so there is no geometry_columns entry for the column in the rdb table. It seems mapserver uses the first table in the SQL from clause to find the SRID for the geometry column (even if that column in not in the first table), and my query had it as the second table listed... if I change the order of the tables in the from clause so the first one listed contains the geometry it seems to work... Not sure if this is a bug? I can't find it mentioned anywhere on Google... Cheers Brent Wood Programme leader: Environmental Information Delivery NIWA DDI: +64 (4) 3860529 [cid:imagec1f72c.PNG at 56107fed.4c9e4abf] Brent Wood Principal Technician - GIS and Spatial Data Management Programme Leader - Environmental Information Delivery T +64-4-386-0529 National Institute of Water & Atmospheric Research Ltd (NIWA) 301 Evans Bay Parade, Greta Point, Wellington Connect with NIWA: niwa.co.nz Facebook Twitter LinkedIn Instagram To ensure compliance with legal requirements and to maintain cyber security standards, NIWA's IT systems are subject to ongoing monitoring, activity logging and auditing. This monitoring and auditing service may be provided by third parties. Such third parties can access information transmitted to, processed by and stored on NIWA's IT systems. ________________________________________ From: mapserver-users on behalf of Lime, Steve D (MNIT) Sent: Wednesday, February 13, 2019 08:39 To: Stephen Woodbridge; mapserver-users at lists.osgeo.org Subject: Re: [mapserver-users] Help with failing Postgis query... Also, I'd turn on debugging. The PostGIS code is very good about writing meaningful debugging information to that log file. -----Original Message----- From: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Stephen Woodbridge Sent: Sunday, February 10, 2019 11:04 PM To: mapserver-users at lists.osgeo.org Subject: Re: [mapserver-users] Help with failing Postgis query... Brent, Are you wrapping your query like: DATA "select * from (select ROW_NUMBER() OVER (order by code) as id, code, sci_name, com_name, lower(family_com)||' ('|| family_sci||')' as Family, point from rdb.species_master s, maps.null_point p where code in (select distinct species from trawl.t_catch) limit 10) as foo using unique id using srid=4326" where srid is appropriate for your data? -Steve W On 2/10/2019 7:51 PM, Brent Wood wrote: > > Hi, > > > I'm getting an error with an SQL in a mapfile. > > > The query works from from the command line: > > > select ROW_NUMBER() OVER (order by code) as id, code, sci_name, > com_name, lower(family_com)||' ('|| family_sci||')' as Family, point > from rdb.species_master s, maps.null_point p where code in (select > distinct species from trawl.t_catch) limit 10 ; > > > id,code,sci_name,com_name,family,locn > 1,AAT,Alainopasiphaea australis,Alainopasiphaea > australis,,0101000020E610000000000000000000000000000000000000 > > ... > > > When embedded in a mapfile & invoked from a browser or QGIS I get an > error: > > > WFS server error. ms_error->code not found > msPostGISLayerWhichShapes(): Query error. Error executing query. > > > > Any suggestions? > > > Brent Wood > > Programme leader: Environmental Information Delivery > NIWA > DDI: +64 (4) 3860529 > > > > > > Brent Wood > Principal Technician - GIS and Spatial Data Management > Programme Leader - Environmental Information Delivery > T +64-4-386-0529 > > National Institute of Water & Atmospheric Research Ltd (NIWA) > 301 Evans Bay Parade, Greta Point, Wellington > Connect with NIWA: niwa.co.nz Facebook > Twitter > LinkedIn > Instagram > > > To ensure compliance with legal requirements and to maintain cyber > security standards, NIWA's IT systems are subject to ongoing > monitoring, activity logging and auditing. This monitoring and > auditing service may be provided by third parties. Such third parties > can access information transmitted to, processed by and stored on > NIWA's IT systems. > > > > > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-users&data=02%7C01%7Csteve.lime%40state.mn.us%7Ccd30802415dd452ec1eb08d68fde5c89%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636854582543106672&sdata=Or5QlT2y7YnEoea9XqkSlgoyC1OAm0Q0BiklpHtZkZc%3D&reserved=0 --- This email has been checked for viruses by Avast antivirus software. https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.avast.com%2Fantivirus&data=02%7C01%7Csteve.lime%40state.mn.us%7Ccd30802415dd452ec1eb08d68fde5c89%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636854582543106672&sdata=ENQHGV2XiSeAnJaQv8ReCiQ45Z%2B4BtZIdNqI9zbokB0%3D&reserved=0 _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-users&data=02%7C01%7Csteve.lime%40state.mn.us%7Ccd30802415dd452ec1eb08d68fde5c89%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636854582543106672&sdata=Or5QlT2y7YnEoea9XqkSlgoyC1OAm0Q0BiklpHtZkZc%3D&reserved=0 _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: imagec1f72c.PNG Type: image/png Size: 12288 bytes Desc: imagec1f72c.PNG URL: From bob.basques at ci.stpaul.mn.us Thu Feb 14 11:33:34 2019 From: bob.basques at ci.stpaul.mn.us (Basques, Bob (CI-StPaul)) Date: Thu, 14 Feb 2019 19:33:34 +0000 Subject: [mapserver-users] OSGeo Local Chaptr (aka TCMUG) Meeting Message-ID: <015FCE7A-8096-4B81-9EF4-7D434A4F1EEA@ci.stpaul.mn.us> OSGeo Local Chaptr (aka TCMUG) Meeting Scheduled: Mar 13, 2019 at 4:30 PM to 6:00 PM Location: DNR 500 Lafayette Rd St Paul MN 55155-4025 All, Had a nice meet up at Flat Earth last evening, new and old faces showed up. https://www.dropbox.com/s/lghzs0qydt3swrw/20190213_180210.flatearth.jpg?dl=0 Next meeting . . . at the DNR offices . . . https://www.google.com/maps/d/u/0/viewer?mid=1mqasu9xzmjyQ7E9xhrJ_aaZqUBw&ll=44.955733543794466%2C-93.08540166931152&z=19 for a LIDAR presentation by Howard Bulter . . . then over to the Bulldog at 5:30 in Lowertown afterwards. https://goo.gl/maps/v9PPjqjYL2U2 https://www.thebulldogmn.com/ "Only two things are infinite, the universe and human stupidity, and I'm not sure about the former." - Albert Einstein -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: iCal-20190214-132831.ics Type: text/calendar Size: 1650 bytes Desc: iCal-20190214-132831.ics URL: From pcreso at yahoo.com Thu Feb 14 20:19:45 2019 From: pcreso at yahoo.com (Brent Wood) Date: Fri, 15 Feb 2019 04:19:45 +0000 (UTC) Subject: [mapserver-users] help passing runtime variables through cgi obfuscation script References: <1365888662.1314427.1550204385879.ref@mail.yahoo.com> Message-ID: <1365888662.1314427.1550204385879@mail.yahoo.com> Hi, I hope this makes sense... I'm using simple shell CGI scripts to avoid passing the mapfile name in the service URL, eg: http://..../cgi-bin/species?????? with the species CGI script containing: #!/bin/bash export MS_MAPFILE=/usr/lib/cgi-bin/mapfiles/species_enhancedsearch.map /usr/lib/cgi-bin/mapserv I can use this approach to get the value of the variable passed in the URL:species_code=`echo "$QUERY_STRING" | sed -n 's/^.*species_code=\([^&]*\).*$/\1/p' | sed "s/%20/ /g"` If I have a mapfile which uses runtime substitution to set a value in an SQL in the DATA statement: ... where c.species='%species_code%' ... How do I pass this value to mapserver from the obfuscating script? Thanks, ?? Brent Wood -------------- next part -------------- An HTML attachment was scrubbed... URL: From stephenwoodbridge37 at gmail.com Thu Feb 14 21:37:24 2019 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Fri, 15 Feb 2019 00:37:24 -0500 Subject: [mapserver-users] help passing runtime variables through cgi obfuscation script In-Reply-To: <1365888662.1314427.1550204385879@mail.yahoo.com> References: <1365888662.1314427.1550204385879.ref@mail.yahoo.com> <1365888662.1314427.1550204385879@mail.yahoo.com> Message-ID: <720C81E2-02FB-4FC0-AAB4-39B227C2B319@gmail.com> Have your script add the parameters to QUERY_STRING. Sent from my iPhone > On Feb 14, 2019, at 11:19 PM, Brent Wood wrote: > > Hi, > > I hope this makes sense... > > I'm using simple shell CGI scripts to avoid passing the mapfile name in the service URL, eg: > > http://..../cgi-bin/species with the species CGI script containing: > > #!/bin/bash > export MS_MAPFILE=/usr/lib/cgi-bin/mapfiles/species_enhancedsearch.map > /usr/lib/cgi-bin/mapserv > > I can use this approach to get the value of the variable passed in the URL: > species_code=`echo "$QUERY_STRING" | sed -n 's/^.*species_code=\([^&]*\).*$/\1/p' | sed "s/%20/ /g"` > > If I have a mapfile which uses runtime substitution to set a value in an SQL in the DATA statement: > > ... where c.species='%species_code%' ... > > How do I pass this value to mapserver from the obfuscating script? > > > Thanks, > > Brent Wood > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From pe_lord at protonmail.com Fri Feb 15 08:01:37 2019 From: pe_lord at protonmail.com (pe_lord) Date: Fri, 15 Feb 2019 09:01:37 -0700 (MST) Subject: [mapserver-users] WFS outputformat zipped geojson(s)? Message-ID: <1550246497611-0.post@n6.nabble.com> Hi I try to output many wfs layers (typenames) to a single zipped output. This is working properly for zipped shapefiles. ...?service=wfs&version=2.0.0&request=getfeature&typename=A,B&outputformat=SHP OUTPUTFORMAT NAME "SHP" DRIVER "OGR/ESRI Shapefile" FORMATOPTION "STORAGE=filesystem" FORMATOPTION "FORM=zip" FORMATOPTION "FILENAME=result.zip" END OUTPUTFORMAT NAME "geojson" DRIVER "OGR/GEOJSON" FORMATOPTION "LCO:COORDINATE_PRECISION=15" FORMATOPTION "LCO:WRITE_BBOX=YES" FORMATOPTION "STORAGE=filesystem" FORMATOPTION "FORM=zip" FORMATOPTION "FILENAME=result.geojson.zip" END For "Zipped" geojson ...?service=wfs&version=2.0.0&request=getfeature&typename=A,B&outputformat=geojson I get : General error message. OGR OGR_DS_CreateLayer failed for layer 'B' with driver 'GEOJSON'. Does somebody already create zipped geojson? -- Sent from: http://osgeo-org.1560.x6.nabble.com/Mapserver-User-f4226646.html From herbertscbr at gmail.com Sun Feb 17 18:21:40 2019 From: herbertscbr at gmail.com (Herbert) Date: Sun, 17 Feb 2019 23:21:40 -0300 Subject: [mapserver-users] Configure a images pyramid in mapserver - gdal_retile command Message-ID: I have already created a pyramid of images with GDAL using the command gdal_retile. I currently use the geoserver, but I want to test the performance with the mapserver. (The geoserver has already created the .shp and .proj files inside each directory of the pyramid) --------------------------- I already see it: https://lists.osgeo.org/pipermail/mapserver-users/2010-August/066444.html but i used gdal_retile and I want check for this possibility.. thanks Herbert -------------- next part -------------- An HTML attachment was scrubbed... URL: From pcreso at yahoo.com Sun Feb 17 19:41:00 2019 From: pcreso at yahoo.com (Brent Wood) Date: Mon, 18 Feb 2019 03:41:00 +0000 (UTC) Subject: [mapserver-users] help passing runtime variables through cgi obfuscation script In-Reply-To: <1365888662.1314427.1550204385879@mail.yahoo.com> References: <1365888662.1314427.1550204385879.ref@mail.yahoo.com> <1365888662.1314427.1550204385879@mail.yahoo.com> Message-ID: <597964109.750474.1550461260474@mail.yahoo.com> Thanks (again!! :-) I'm trying to get runtime variable substitution working, without success. I'm not getting an error message, but no data comes back... so the query is working OK, but the parameter substitution is nor happening... The URL I'm using to test the service:localhost/cgi-bin/mapserv?map=trawl.map&species_code=RCO&version=2.0.0&srsname=EPSG:4326&typename=Selected_Species&service=wfs&request=getfeature The layer DATA statement:?DATA "startp from (select ROW_NUMBER() OVER (order by (t.trip_code, t.station_no)) as id, t.trip_code, t.station_no, species as code, sci_name, com_name, initcap(family_sci)||' ('|| initcap(family_com)||')' as Family, c.weight, ST_Shift_longitude(t.startp) as startp from trawl.t_station t, rdb.species_master s, trawl.t_catch c where c.species='%species_code%' and s.code = c.species and t.trip_code = c.trip_code and t.station_no=c.station_no ) as myquery using unique id using srid 4326" The layer VALIDATION statement:??? VALIDATION? ?????? #? spp code value is a 3 char upper case string ?????? 'spp_code' '[A-Z][A-Z][A-Z]' ??? END The XML returned says: ... numberMatched="0" numberReturned="0" ... If I edit the data statement to: where c.species='RCO' (ie: hard code the value to RCO rather than pass it in - no other change) I get the desired response... ... numberMatched="7505" numberReturned="7505" ... The mapserver log (when trying substitution):msPostGISLayerGetExtent(): General error message. msPostGISLayerGetExtent: Null result returned. msQueryByRect(): Search returned no results. No matching record(s) found. Can anyone suggest why my substitution is failing? Thanks, Brent Wood -------------- next part -------------- An HTML attachment was scrubbed... URL: From jukka.rahkonen at maanmittauslaitos.fi Mon Feb 18 00:54:47 2019 From: jukka.rahkonen at maanmittauslaitos.fi (Rahkonen Jukka (MML)) Date: Mon, 18 Feb 2019 08:54:47 +0000 Subject: [mapserver-users] help passing runtime variables through cgi obfuscation script Message-ID: <208f3268bf0744d7abfb3eb8f58b6580@C119S212VM042.msvyvi.vaha.local> Hi, I guess that you do not really test with &species_code=RCO if you have defined variable as spp_code, but I have to ask anyway. -Jukka Rahkonen- L?hett?j?: mapserver-users Puolesta Brent Wood L?hetetty: maanantai 18. helmikuuta 2019 5.41 Vastaanottaja: mapserver-users at lists.osgeo.org Aihe: Re: [mapserver-users] help passing runtime variables through cgi obfuscation script Thanks (again!! :-) I'm trying to get runtime variable substitution working, without success. I'm not getting an error message, but no data comes back... so the query is working OK, but the parameter substitution is nor happening... The URL I'm using to test the service: localhost/cgi-bin/mapserv?map=trawl.map&species_code=RCO&version=2.0.0&srsname=EPSG:4326&typename=Selected_Species&service=wfs&request=getfeature The layer DATA statement: DATA "startp from (select ROW_NUMBER() OVER (order by (t.trip_code, t.station_no)) as id, t.trip_code, t.station_no, species as code, sci_name, com_name, initcap(family_sci)||' ('|| initcap(family_com)||')' as Family, c.weight, ST_Shift_longitude(t.startp) as startp from trawl.t_station t, rdb.species_master s, trawl.t_catch c where c.species='%species_code%' and s.code = c.species and t.trip_code = c.trip_code and t.station_no=c.station_no ) as myquery using unique id using srid 4326" The layer VALIDATION statement: VALIDATION # spp code value is a 3 char upper case string 'spp_code' '[A-Z][A-Z][A-Z]' END The XML returned says: ... numberMatched="0" numberReturned="0" ... If I edit the data statement to: where c.species='RCO' (ie: hard code the value to RCO rather than pass it in - no other change) I get the desired response... ... numberMatched="7505" numberReturned="7505" ... The mapserver log (when trying substitution): msPostGISLayerGetExtent(): General error message. msPostGISLayerGetExtent: Null result returned. msQueryByRect(): Search returned no results. No matching record(s) found. Can anyone suggest why my substitution is failing? Thanks, Brent Wood -------------- next part -------------- An HTML attachment was scrubbed... URL: From mh at innovative.dk Tue Feb 19 01:08:36 2019 From: mh at innovative.dk (Martin Svend Hagerup) Date: Tue, 19 Feb 2019 09:08:36 +0000 Subject: [mapserver-users] Upside Down labelling - Rotate Line text 180 degrees Message-ID: Hi all Using Mapserver to produce maps for navigation applications we need to be able to rotate the road labels 180 degrees on the map so when the driver is driving south he/she will see the map upside down In an ideal world the line segments labels should follow any curvature but still be readable when the map is shown upside down. Points labels are just rotated 180 - this should is easy - but I want to use the many benefits of Angle Auto if possible Cheers Martin Hagerup, Copenhagen -------------- next part -------------- An HTML attachment was scrubbed... URL: From stephenwoodbridge37 at gmail.com Tue Feb 19 06:55:16 2019 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Tue, 19 Feb 2019 09:55:16 -0500 Subject: [mapserver-users] Upside Down labelling - Rotate Line text 180 degrees In-Reply-To: References: Message-ID: On 2/19/2019 4:08 AM, Martin Svend Hagerup wrote: > Hi all > Using Mapserver to produce maps for navigation applications we need to > be able to rotate the road labels 180 degrees on the map so when the > driver is driving south he/she will see the map upside down > In an ideal world the line segments labels should follow any curvature > but still be readable when the map is shown upside down. > Points labels are just rotated 180 - this should is easy ? but I want > to use the many benefits of Angle Auto if possible > Cheers > Martin Hagerup, Copenhagen Steve Lime, When we worked this out years ago it was before you could rotate the map and I think the algorithm used assume map up was north. we probably need to make an adjustment if the map is rotated. -Steve W --- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus From steve.lime at state.mn.us Tue Feb 19 12:29:52 2019 From: steve.lime at state.mn.us (Lime, Steve D (MNIT)) Date: Tue, 19 Feb 2019 20:29:52 +0000 Subject: [mapserver-users] MapServer 7.2.2 Released Message-ID: Hi all: The maintenance release of MapServer 7.2.2 is now available for download: http://mapserver.org/download.html For a list of changes please see the changelog at https://mapserver.org/development/changelog/changelog-7-2.html Thank you to all of the users, developers, documenters, and packagers for sharing the passion for such a great OSGeo project. --The MapServer Team -------------- next part -------------- An HTML attachment was scrubbed... URL: From MarkVolz at co.lyon.mn.us Tue Feb 19 13:28:49 2019 From: MarkVolz at co.lyon.mn.us (Mark Volz) Date: Tue, 19 Feb 2019 21:28:49 +0000 Subject: [mapserver-users] Mapcache - best way to find broken or white tiles in a service? Message-ID: <5c62060ac21642fda1cd9f6c03c370d9@co.lyon.mn.us> Hello, On my webmap I noticed a few broken (white) tiles in a single area from my mapcache server. I would like to know the best way to find broken tiles in my mapcache service. * Initially I was concerned that I would need to the tile number and folder location by using the BBOX, WIDTH, and TILE RESOLUTION from the request. However, I figured out using the mapcache demo is easier to work with /mapcache/demo/ * Would it be better just to delete any tile that is 1K or smaller? These problibly are tiles that are broken, or intended to be blank in the first place. * What do others do to validate that the mapcache tiles have been built appropriately? Thanks! Sincerely, Mark Volz, GISP Lyon County GIS Coordinator -------------- next part -------------- An HTML attachment was scrubbed... URL: From traviskirstine at gmail.com Wed Feb 20 10:45:14 2019 From: traviskirstine at gmail.com (Travis Kirstine) Date: Wed, 20 Feb 2019 13:45:14 -0500 Subject: [mapserver-users] Mapcache - best way to find broken or white tiles in a service? In-Reply-To: <5c62060ac21642fda1cd9f6c03c370d9@co.lyon.mn.us> References: <5c62060ac21642fda1cd9f6c03c370d9@co.lyon.mn.us> Message-ID: You shouldn't have any cached "broken" tiles unless your source WMS is generating the white images (metatiles). I believe MapCache will generate a 404 and return a empty tile if configured. This may be the white tiles you are seeing. report It can be very difficult to locate and clean up tiles from a cache, the easiest method and in some cases the fastest is simply to create a new cache and delete the old one. One alternative is to use the mapcache_seed command line tool to either -f force the creation of new tiles or use the -mode delete option to delete the tiles from the cache. BTW you can use a polygon (shapefile) with mapcache_seed to only update / delete the desired area using the -d flag. Also if you are using a disk cache you might be using symlinks which will allow mapcache to "reuse" blank tiles. If this is the case you might need to find / delete the symlinks rather than a "file" /tmp On Tue, 19 Feb 2019 at 16:47, Mark Volz wrote: > Hello, > > > > On my webmap I noticed a few broken (white) tiles in a single area from my > mapcache server. I would like to know the best way to find broken tiles in > my mapcache service. > > ? Initially I was concerned that I would need to the tile number > and folder location by using the BBOX, WIDTH, and TILE RESOLUTION from the > request. However, I figured out using the mapcache demo is easier to work > with /mapcache/demo/ > > ? Would it be better just to delete any tile that is 1K or > smaller? These problibly are tiles that are broken, or intended to be > blank in the first place. > > ? What do others do to validate that the mapcache tiles have been > built appropriately? > > Thanks! > > > > Sincerely, > > *Mark Volz, GISP* > > *Lyon County GIS Coordinator* > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From MarkVolz at co.lyon.mn.us Wed Feb 20 11:57:11 2019 From: MarkVolz at co.lyon.mn.us (Mark Volz) Date: Wed, 20 Feb 2019 19:57:11 +0000 Subject: [mapserver-users] Mapcache - best way to find broken or white tiles in a service? In-Reply-To: References: <5c62060ac21642fda1cd9f6c03c370d9@co.lyon.mn.us> Message-ID: <6b0eeb97ece84f8ab3b055d346975a99@co.lyon.mn.us> Travis, Thank you for your ideas. The tiles themselves existed in Mapcache as white images so Mapcache returned a ?valid? image instead of a 404. I was able to find the white tiles by just deleting all the <1K files in the area. However, if I ever notice the issue again I will definitely consider using the mapcache_seed command line with a shapefile to force the tiles to rebuild... That would have been quicker than searching for small files! Thank You! Sincerely, Mark Volz, GISP Lyon County GIS Coordinator From: Travis Kirstine Sent: Wednesday, February 20, 2019 12:45 PM To: Mark Volz Cc: mapserver-users at lists.osgeo.org Subject: Re: [mapserver-users] Mapcache - best way to find broken or white tiles in a service? SWHHS/LYON/LINCOLN COUNTY SECURITY NOTICE: This email originated from an external sender. Exercise caution before clicking on any links or attachments and consider whether you know the sender. For more information please contact IT support. ________________________________ You shouldn't have any cached "broken" tiles unless your source WMS is generating the white images (metatiles). I believe MapCache will generate a 404 and return a empty tile if configured. This may be the white tiles you are seeing. report It can be very difficult to locate and clean up tiles from a cache, the easiest method and in some cases the fastest is simply to create a new cache and delete the old one. One alternative is to use the mapcache_seed command line tool to either -f force the creation of new tiles or use the -mode delete option to delete the tiles from the cache. BTW you can use a polygon (shapefile) with mapcache_seed to only update / delete the desired area using the -d flag. Also if you are using a disk cache you might be using symlinks which will allow mapcache to "reuse" blank tiles. If this is the case you might need to find / delete the symlinks rather than a "file" /tmp On Tue, 19 Feb 2019 at 16:47, Mark Volz > wrote: Hello, On my webmap I noticed a few broken (white) tiles in a single area from my mapcache server. I would like to know the best way to find broken tiles in my mapcache service. ? Initially I was concerned that I would need to the tile number and folder location by using the BBOX, WIDTH, and TILE RESOLUTION from the request. However, I figured out using the mapcache demo is easier to work with /mapcache/demo/ ? Would it be better just to delete any tile that is 1K or smaller? These problibly are tiles that are broken, or intended to be blank in the first place. ? What do others do to validate that the mapcache tiles have been built appropriately? Thanks! Sincerely, Mark Volz, GISP Lyon County GIS Coordinator _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From gustafson.erik at gmail.com Fri Feb 22 01:22:45 2019 From: gustafson.erik at gmail.com (Erik Gustafson) Date: Fri, 22 Feb 2019 10:22:45 +0100 Subject: [mapserver-users] Configure a images pyramid in mapserver - gdal_retile command In-Reply-To: References: Message-ID: Hi, have you found the documentation, https://mapserver.org/input/raster.html, specifically chapter "Raster and Tile indexing" I can try to help if you have a more precise question. /Erik On Mon, Feb 18, 2019 at 3:21 AM Herbert wrote: > > I have already created a pyramid of images with GDAL using the command > gdal_retile. > I currently use the geoserver, but I want to test the performance with the > mapserver. (The geoserver has already created the .shp and .proj files > inside each directory of the pyramid) > > --------------------------- > I already see it: > https://lists.osgeo.org/pipermail/mapserver-users/2010-August/066444.html > but i used gdal_retile and I want check for this possibility.. > > thanks > Herbert > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From traviskirstine at gmail.com Fri Feb 22 05:57:29 2019 From: traviskirstine at gmail.com (Travis Kirstine) Date: Fri, 22 Feb 2019 08:57:29 -0500 Subject: [mapserver-users] mapcache seed slow In-Reply-To: References: Message-ID: The time you have indicated seems excessive to seed the UK. My guess is that the current process it seeding the extents of your grid (world?) but default. I've seeded the province of ontario 1 million km2 z0-17 in about 2 weeks using a sqlite cache Ramping up the -n will only bottle neck the process more (same with the -p flag) the limiting factor is SQLite and it limitation on concurrent writes (I use -n 4). I've noticed that if you try to use other sqlite3 journal modes you can degrade performance ( http://osgeo-org.1560.x6.nabble.com/mapcache-sqlite-cache-large-wal-files-and-blocked-checkpoints-when-seeding-td5377571.html). I would just use most basic cache config as a starting point. BTW using SSD should increase the SQLite writes as well (if you are lucky enough to have them) ./{tileset}.sqlite3 There are a few things that you could do when seeding to speed up the process: Use the "restricted_extent" parameter in the tileset grid to limit the number of tiles Example ontario_2018_wms sqlite gmaps mixed 5 5 Use a polygon shapefile (or other ogr datasource) to limit the seeding using the -d flag in mapcache_seed command (note the projection of the datasource should be the same as the grid) Use a larger metatile when seeding (-M flag override in command line). Mapcache will "bulk" insert the resultant tiles based on the metatile - if 5 5 mapcache will insert 25 tiles at a time if 8 8 it will do 64 (I think this is the way it works). The limiting factor here is trying to balance this with your source WMS performance. I use 8,8 when seeding Regards On Fri, 22 Feb 2019 at 06:35, Sebastiano Laini < Sebastiano.Laini at buchanancomputing.co.uk> wrote: > Hi all, > > > > I?m trying to seed the whole UK at all zoom lv with these resolutions > > > > 280 140 70 28 14 7 6.16 2.8 1.4 0.7 > > > > But after 13 days it arrives at the 5th level where before I kill the > process it seed just 900MB on that level. > > > > This is my script > > > > su -s /bin/sh apache -c "/usr/local/bin/mapcache_seed -c > /usr/local/src/mapcache-1.6.1/build/mapcache.xml -t bccache -g bcgrid -z > 5,6 ?n 400" 2>&1> /var/www/vhosts/$SITE/scripts/cache_log.txt > > > > I know that in the documentation say that ?n should be less or max the > number of cpu in the server but is really slow if I put 2, so I tried with > 100 and after 13 days that was the result so now I?m trying 400 > > > > Is there something else I can use to speed up the seed? I?m using the > SQlite cache method > > > > Should I use the -p (| ?nprocesses: number of parallel processes that > should be used to request tiles from the WMS source) Instead of the ?n > parameter? > > > > Sebastiano Laini > > Web Developer > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From jukka.rahkonen at maanmittauslaitos.fi Fri Feb 22 07:03:20 2019 From: jukka.rahkonen at maanmittauslaitos.fi (Rahkonen Jukka (MML)) Date: Fri, 22 Feb 2019 15:03:20 +0000 Subject: [mapserver-users] mapcache seed slow Message-ID: Hi, Stupid question, but do you know how fast your WMS service is? How many GetMap requests/sec it can serve with the metatile size that you are seeding with? Have you some evidence that WMS is running idle while MapCache is busy with cutting the tiles and filling the cache? -Jukka Rahkonen- L?hett?j?: mapserver-users Puolesta Sebastiano Laini L?hetetty: perjantai 22. helmikuuta 2019 13.35 Vastaanottaja: 'mapserver-users at lists.osgeo.org' Aihe: [mapserver-users] mapcache seed slow Hi all, I'm trying to seed the whole UK at all zoom lv with these resolutions 280 140 70 28 14 7 6.16 2.8 1.4 0.7 But after 13 days it arrives at the 5th level where before I kill the process it seed just 900MB on that level. This is my script su -s /bin/sh apache -c "/usr/local/bin/mapcache_seed -c /usr/local/src/mapcache-1.6.1/build/mapcache.xml -t bccache -g bcgrid -z 5,6 -n 400" 2>&1> /var/www/vhosts/$SITE/scripts/cache_log.txt I know that in the documentation say that -n should be less or max the number of cpu in the server but is really slow if I put 2, so I tried with 100 and after 13 days that was the result so now I'm trying 400 Is there something else I can use to speed up the seed? I'm using the SQlite cache method Should I use the -p (| -nprocesses: number of parallel processes that should be used to request tiles from the WMS source) Instead of the -n parameter? Sebastiano Laini Web Developer -------------- next part -------------- An HTML attachment was scrubbed... URL: From dogneyannick at yahoo.fr Mon Feb 25 08:01:36 2019 From: dogneyannick at yahoo.fr (Bogui Yannick Dogne) Date: Mon, 25 Feb 2019 16:01:36 +0000 (UTC) Subject: [mapserver-users] probleme mapserver 5.x tutorial References: <1989477817.7914704.1551110496673.ref@mail.yahoo.com> Message-ID: <1989477817.7914704.1551110496673@mail.yahoo.com> hello I am really new on mapserver. I started learning through the tutorial but I am stuck on section 1 example 1-9 which does not appear in my browser: Annotation Layers have been removed. To obtain same functionality, use a layer with label->styles and no class->styles.this also applies to section 2I did some research but I still do not understand how to do it. should you change the annotation block or just add a style in label, if you have some examples and also anything that could help me learn better mapserver. thank you so much -------------- next part -------------- An HTML attachment was scrubbed... URL: From rainy3 at poczta.onet.pl Mon Feb 25 10:13:21 2019 From: rainy3 at poczta.onet.pl (=?UTF-8?Q?Marek_B=c4=85k?=) Date: Mon, 25 Feb 2019 19:13:21 +0100 Subject: [mapserver-users] Order of layers Message-ID: <25f5fde9-ee97-1b19-6e08-f307130ef200@poczta.onet.pl> Dear All, I'm working on project? for which maps in different scales are delivered by customer. Higher scale means more details but less coverage. Output can have glitches but it cannot have any gaps (it should works in similar way like in opencpn - high detailed maps shadow less detailed but at the same moment you can enable and disable groups of layers). So having layers like that: LAYER (GROUP "WATER", NAME "WATERBIG", COMPOP src-over) LAYER (GROUP "LAND", NAME "LANDBIG", COMPOP src-over) LAYER (GROUP "TREES", NAME "TREESBIG", COMPOP src-over) LAYER (GROUP "WATER", NAME "WATERMID", COMPOP src-over) LAYER (GROUP "LAND", NAME "LANDMID", COMPOP src-over) LAYER (GROUP "TREES", NAME "TREESMID", COMPOP src-over) LAYER (GROUP "WATER", NAME "WATERSMALL", COMPOP src-over) LAYER (GROUP "LAND", NAME "LANDSMALL", COMPOP src-over) LAYER (GROUP "TREES", NAME "TREESSMALL", COMPOP src-over) I'd have output in which: MID replaces BIG within its EXTENT (completely both transparent and non-transparent pixels) SMALL replaces BIG and MID within its EXTENT (completely both transparent and non-transparent pixels) But I'm having problem to force reset some EXTENT to transparent color. Someting like: LAYER (GROUP "WATER", NAME "WATERBIG", COMPOP src-over) LAYER (GROUP "LAND", NAME "LANDBIG", COMPOP src-over) LAYER (GROUP "TREES", NAME "TREESBIG", COMPOP src-over) LAYER (GROUP "RESET", NAME "RESETMID", COMPOP ??? - what to put here to have precalcuated EXTENT (not whole buffer) of render buffer to reset to transparent LAYER (GROUP "WATER", NAME "WATERMID", COMPOP src-over) LAYER (GROUP "LAND", NAME "LANDMID", COMPOP src-over) LAYER (GROUP "TREES", NAME "TREESMID", COMPOP src-over) Is it possible to achieve with MapServer using GROUP attribute and some kind reset extent layer? Regards, Marek From steve.lime at state.mn.us Mon Feb 25 16:00:33 2019 From: steve.lime at state.mn.us (Lime, Steve D (MNIT)) Date: Tue, 26 Feb 2019 00:00:33 +0000 Subject: [mapserver-users] probleme mapserver 5.x tutorial In-Reply-To: <1989477817.7914704.1551110496673@mail.yahoo.com> References: <1989477817.7914704.1551110496673.ref@mail.yahoo.com> <1989477817.7914704.1551110496673@mail.yahoo.com> Message-ID: Hi: In that particular example the states label layer should become: LAYER # States label layer begins here NAME states DATA states_ugl STATUS OFF TYPE POLYGON PROJECTION "init=epsg:4326" END CLASSITEM "CLASS" LABELITEM "STATE" CLASS EXPRESSION 'land' LABEL COLOR 132 31 31 OUTLINECOLOR 128 128 128 SHADOWCOLOR 218 218 218 SHADOWSIZE 1 1 TYPE TRUETYPE FONT arial-bold SIZE 12 ANTIALIAS TRUE POSITION CL PARTIALS FALSE MINDISTANCE 200 BUFFER 4 END # end of label END # end of class END # States label layer ends here The reason you might want to use a label style is for something like drawing a road shield paired with a road number but that?s not necessary in this particular case. We really do need to update the demo and tutorials for 7.0 and newer versions. The changes are minor but can be frustrating for a new user. Please feel free to reach out as often as you need and I?ll do my best to help! --Steve From: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Bogui Yannick Dogne Sent: Monday, February 25, 2019 10:02 AM To: mapserver-users at lists.osgeo.org Subject: [mapserver-users] probleme mapserver 5.x tutorial hello I am really new on mapserver. I started learning through the tutorial but I am stuck on section 1 example 1-9 which does not appear in my browser: Annotation Layers have been removed. To obtain same functionality, use a layer with label->styles and no class->styles. this also applies to section 2 I did some research but I still do not understand how to do it. should you change the annotation block or just add a style in label, if you have some examples and also anything that could help me learn better mapserver. thank you so much -------------- next part -------------- An HTML attachment was scrubbed... URL: From sethg at geographika.co.uk Tue Feb 26 16:22:12 2019 From: sethg at geographika.co.uk (Seth G) Date: Tue, 26 Feb 2019 19:22:12 -0500 Subject: [mapserver-users] mappyfile and mappyfile-colors Released Message-ID: Hi list, A couple of MapServer related updates that may be of interest. There is a new 0.8.x release of mappyfile - a Python library to parse, validate, and format Mapfiles: https://pypi.org/project/mappyfile/ Release notes are available at https://mappyfile.readthedocs.io/en/latest/#releases The main new feature is adding Mapfile class names to their associated END blocks, e.g. LAYER NAME "Polygon" TYPE POLYGON FEATURE POINTS 30 10 40 40 20 40 10 20 30 10 END # POINTS END # FEATURE END # LAYER You can see this in action in the online demo at http://mappyfile.geographika.net/ by going to Settings > Add Closing Block Comments There is also a new mappyfile plugin available - https://github.com/geographika/mappyfile-colors This allows you to add colour names as comments to your Mapfile, and convert and harmonise colour formats (RGB or HEX), e.g. COLOR 75 0 130 Can be converted to: COLOR "#4B0082" # indigo Again this can be seen in the online demo at http://mappyfile.geographika.net/ - go to Settings > mappyfile-colors Plugin Settings it is also available on PyPI at https://pypi.org/project/mappyfile-colors/ and can be installed using pip. Feedback and thoughts welcome, Seth -- web:http://geographika.co.uk twitter: @geographika From A.Dahinden at alpgis.ch Wed Feb 27 02:50:50 2019 From: A.Dahinden at alpgis.ch (Adrian Dahinden) Date: Wed, 27 Feb 2019 10:50:50 +0000 Subject: [mapserver-users] SVG OUTPUTFORMAT TEXT LABEL Message-ID: <1417b2977c2945c4b651d06d3da6f373@alpgis.ch> Hello mapserver users Does anyone have experience with the SVG OUTPUTFORMAT of MapServer when rendering text labels? For a GetMap request with the format the mapserver returns on text labels the labels as instead of svg elements. According to the documentation, this should not be the case with TRUETYPE fonts: https://mapserver.org/output/svg.html#text-features I assume there the docs isn't true yet, since it is over 10 years old. Or is this simply not implemented in the CAIRO/SVG render engine? My MapFile configuration looks like this: MAP ... IMAGETYPE svg ... OUTPUTFORMAT NAME svg MIMETYPE "image/svg+xml" DRIVER CAIRO/SVG FORMATOPTION "COMPRESSED_OUTPUT=FALSE" FORMATOPTION "FULL_RESOLUTION=TRUE" IMAGEMODE RGB EXTENSION "svg" END ... WEB IMAGEPATH 'geotmp/log/mapserver/' IMAGEURL 'geotmp/log/mapserver/' END ... LAYER NAME "Nr" TYPE POINT PROJECTION "init=epsg:2056" END CONNECTIONTYPE postgis PROCESSING "CLOSE_CONNECTION=DEFER" CONNECTION "user=www-data password=www-data dbname=... host=..." DATA "pos from (SELECT ... FROM ...) AS foo using unique gid using epsg:2056" LABELITEM "nummer" CLASS LABEL TYPE TRUETYPE FONT arial SIZE 5 COLOR 0 0 0 END END END ... END We use MapServer version 7.0.4. Kind regards Adrian Dahinden ALPGIS AG Raumentwicklung und Geoinformation Fliederweg 11 3600 Thun Telefon 033 224 04 30 / direkt 033 224 04 34 Fax 033 224 40 60 www.alpgis.ch mailto:a.dahinden at alpgis.ch -------------- next part -------------- An HTML attachment was scrubbed... URL: From stephenwoodbridge37 at gmail.com Wed Feb 27 07:33:25 2019 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Wed, 27 Feb 2019 10:33:25 -0500 Subject: [mapserver-users] SVG OUTPUTFORMAT TEXT LABEL In-Reply-To: <1417b2977c2945c4b651d06d3da6f373@alpgis.ch> References: <1417b2977c2945c4b651d06d3da6f373@alpgis.ch> Message-ID: I'm guessing that this is a CAIRO issue because mapserver hands off the rendering to CAIRO and at a low level CAIRO is sending the vectors to the SVG file rather than rasterizing them. That said, I haven't looked at the code and I'll defer to any of the dev's. -Steve W On 2/27/2019 5:50 AM, Adrian Dahinden wrote: > > Hello mapserver users > > Does anyone have experience with the SVG OUTPUTFORMAT of MapServer > when rendering text labels? > > For a GetMap request with the format ?FORMAT = image / svg + xml? the > mapserver returns on text labels the labels as instead of > svg elements. > > According to the documentation, this should not be the case with > TRUETYPE fonts: https://mapserver.org/output/svg.html#text-features > > I assume there the docs isn?t true yet, since it is over 10 years old. > Or is this simply not implemented in the CAIRO/SVG render engine? > > My MapFile configuration looks like this: > > MAP > > ? > > ? IMAGETYPE svg > > ? > > ? OUTPUTFORMAT > > ??? NAME svg > > ??? MIMETYPE "image/svg+xml" > > ??? DRIVER CAIRO/SVG > > ??? FORMATOPTION "COMPRESSED_OUTPUT=FALSE" > > ??? FORMATOPTION "FULL_RESOLUTION=TRUE" > > ??? IMAGEMODE RGB > > ??? EXTENSION "svg" > > ? END > > ? > > ?WEB > > ? ??IMAGEPATH 'geotmp/log/mapserver/' > > ? ??IMAGEURL 'geotmp/log/mapserver/' > > ? END > > ... > > ? LAYER > > ??? NAME "Nr" > > ??? TYPE POINT > > ??? PROJECTION > > ????? "init=epsg:2056" > > ??? END > > ??? CONNECTIONTYPE postgis > > ??? PROCESSING "CLOSE_CONNECTION=DEFER" > > ??? CONNECTION "user=www-data password=www-data dbname=? host=?" > > ??? DATA? "pos from (SELECT ? FROM ?) AS foo using unique gid using > epsg:2056" > > ??? LABELITEM "nummer" > > ????CLASS > > ????? LABEL > > ??????? TYPE TRUETYPE > > ??????? FONT arial > > ??????? SIZE 5 > > ??????? COLOR 0 0 0 > > ????? END > > ??? END > > ??END > > ? > > END > > We use MapServer version 7.0.4. > > Kind regards > > Adrian Dahinden > > ALPGIS AG > Raumentwicklung und Geoinformation > Fliederweg 11 > 3600 Thun > > > Telefon 033 224 04 30 / direkt 033 224 04 34 > Fax 033 224 40 60 > www.alpgis.ch > mailto:a.dahinden at alpgis.ch > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users --- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus From rainy3 at poczta.onet.pl Wed Feb 27 08:00:59 2019 From: rainy3 at poczta.onet.pl (=?UTF-8?Q?Marek_B=c4=85k?=) Date: Wed, 27 Feb 2019 17:00:59 +0100 Subject: [mapserver-users] Rendering TrueType labels. Message-ID: <625f330b-2ebd-744a-ccc3-54a8d0c5f561@poczta.onet.pl> Hello All, Can anyone explain how the rendering engine works? For example I have four layers: case1. Polygon case2. Point which is presented as symbol (circle) with truetype label case3. Polygon which is more detailed version of layers case1 case4. Point which is presented as symbol (circle) with truetype label which is more detailed version of layers case2 The problem is that composition (shadownig) during rendering (default src-over compop) works only for Polygon and Symbol. The label is preserved and final tile has one Symbol but with two labels. Is there any way to disable that behaviour? Regards, Marek From steve.lime at state.mn.us Wed Feb 27 12:14:42 2019 From: steve.lime at state.mn.us (Lime, Steve D (MNIT)) Date: Wed, 27 Feb 2019 20:14:42 +0000 Subject: [mapserver-users] Rendering TrueType labels. In-Reply-To: <625f330b-2ebd-744a-ccc3-54a8d0c5f561@poczta.onet.pl> References: <625f330b-2ebd-744a-ccc3-54a8d0c5f561@poczta.onet.pl> Message-ID: Can you post some visuals (and/or layer snippets) that demonstrate each case? That would help... It's not clear if this a result of layer compositing or strictly related to label matching/caching. -----Original Message----- From: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Marek Bak Sent: Wednesday, February 27, 2019 10:01 AM To: mapserver-users at lists.osgeo.org Subject: [mapserver-users] Rendering TrueType labels. Hello All, Can anyone explain how the rendering engine works? For example I have four layers: case1. Polygon case2. Point which is presented as symbol (circle) with truetype label case3. Polygon which is more detailed version of layers case1 case4. Point which is presented as symbol (circle) with truetype label which is more detailed version of layers case2 The problem is that composition (shadownig) during rendering (default src-over compop) works only for Polygon and Symbol. The label is preserved and final tile has one Symbol but with two labels. Is there any way to disable that behaviour? Regards, Marek _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-users&data=02%7C01%7Csteve.lime%40state.mn.us%7C72f1427468e142a36f7c08d69cce0cee%7Ceb14b04624c445198f26b89c2159828c%7C0%7C1%7C636868806132112515&sdata=7k2h8mhQApfceAbqTKs5eCf7XS8Ms3GbBj7Jc0wrX68%3D&reserved=0 From rainy3 at poczta.onet.pl Thu Feb 28 08:26:24 2019 From: rainy3 at poczta.onet.pl (=?UTF-8?Q?Marek_B=c4=85k?=) Date: Thu, 28 Feb 2019 17:26:24 +0100 Subject: [mapserver-users] Rendering TrueType labels. In-Reply-To: References: <625f330b-2ebd-744a-ccc3-54a8d0c5f561@poczta.onet.pl> Message-ID: <6ec7ee10-2184-2820-0496-b1d883c111cc@poczta.onet.pl> W dniu 2019-02-27 o?21:14, Lime, Steve D (MNIT) pisze: > Can you post some visuals (and/or layer snippets) that demonstrate each case? That would help... It's not clear if this a result of layer compositing or strictly related to label matching/caching. > > -----Original Message----- > From: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Marek Bak > Sent: Wednesday, February 27, 2019 10:01 AM > To: mapserver-users at lists.osgeo.org > Subject: [mapserver-users] Rendering TrueType labels. > > Hello All, > > Can anyone explain how the rendering engine works? For example I have > four layers: > > case1. Polygon > > case2. Point which is presented as symbol (circle) with truetype label > > case3. Polygon which is more detailed version of layers case1 > > case4. Point which is presented as symbol (circle) with truetype label > which is more detailed version of layers case2 > > The problem is that composition (shadownig) during rendering (default > src-over compop) works only for Polygon and Symbol. The label is > preserved and final tile has one Symbol but with two labels. Is there > any way to disable that behaviour? > > > Regards, > > Marek > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-users&data=02%7C01%7Csteve.lime%40state.mn.us%7C72f1427468e142a36f7c08d69cce0cee%7Ceb14b04624c445198f26b89c2159828c%7C0%7C1%7C636868806132112515&sdata=7k2h8mhQApfceAbqTKs5eCf7XS8Ms3GbBj7Jc0wrX68%3D&reserved=0 Hello All, The parametr I've missed was: LAYER ? LABELCACHE off Default value is 'on' and that causes the labels are always rendered once at the very end of rendering process. With label cache disabled everything looks perfect. Regards, Marek From sethg at geographika.co.uk Thu Feb 28 22:02:22 2019 From: sethg at geographika.co.uk (Seth G) Date: Fri, 01 Mar 2019 01:02:22 -0500 Subject: [mapserver-users] Python MapScript 7.2.2 available on PyPI Message-ID: Hi all, Python MapScript bindings are now available at https://pypi.org/project/mapscript/ for the MapServer 7.2.2 release. Wheels have been created for 64-bit versions of Python 2.7 and Python 3.7 for Windows. They have been tested against the release-1911-x64-gdal-2-4-0-mapserver-7-2-2 binaries available at https://www.gisinternals.com/release.php Seth -- web:http://geographika.co.uk twitter: @geographika