From jbo-ads at laposte.net Mon Feb 3 08:27:19 2020 From: jbo-ads at laposte.net (jbo-ads) Date: Mon, 3 Feb 2020 17:27:19 +0100 Subject: [mapserver-users] MapCache Wiki Update: "MapCache Performance Analysis A Case Study" Message-ID: Hi all, I've added an article to the young MapCache Wiki. This is called "MapCache Performance Analysis: A Case Study". Here is the context of that study: "A satellite imagery provider wants a browser to display its product catalog. Each product is an image of a small area on Earth (about 100km wide) and there are hundreds of products. The solution is built around MapCache serving selected products through its WMS/WMTS map services. Products are preprocessed to take the form of single SQLite caches or Geopackages directly accessible by MapCache. Product selection takes place using dimension feature of those services. This is implemented with second level dimensions in MapCache, so that new products can be added without interrupting MapCache service." Regards, J?rome Bou?. -------------- next part -------------- An HTML attachment was scrubbed... URL: From johannespaul92 at gmail.com Wed Feb 5 02:02:46 2020 From: johannespaul92 at gmail.com (Johannes Paul) Date: Wed, 5 Feb 2020 11:02:46 +0100 Subject: [mapserver-users] OUTPUTFORMAT png 16-bits Message-ID: Hello, I'm using Mapserver to output PNG 16-bits DEM raster from .HGT elevation data. I'm using the below output format definition : OUTPUTFORMAT NAME PNG16 DRIVER GDAL/PNG MIMETYPE image/png IMAGEMODE INT16 EXTENSION "png" END However I keep on getting the standard PNG 8-bits out of mapserver. The strange thing being that when I use a similar config to get GeoTiff 16-bits, I do get what I'm asking for : OUTPUTFORMAT NAME GEOTIFF16 DRIVER GDAL/GTiff MIMETYPE image/tiff IMAGEMODE INT16 EXTENSION "tiff" END Could that be an issue with the GDAL/PNG driver ? It seems that the GDAL/PNG driver supports only CreateCopy() and not Create(), where the GDAL/GTiff driver supports both ... Could that be it ? I suspect the GDAL/PNG driver so I also sent my issue to the GDAL mailing list. I can see from the mailing list that other users already had a similar issue, but there is no obvious reason or solution provided. https://lists.osgeo.org/pipermail/mapserver-users/2011-April/068428.html https://lists.osgeo.org/pipermail/mapserver-users/2012-January/071310.html For information, I'm using GDAL v2.1.3 and Mapserver v7.0.1 Thanks, Johannes -------------- next part -------------- An HTML attachment was scrubbed... URL: From jukka.rahkonen at maanmittauslaitos.fi Wed Feb 5 02:09:56 2020 From: jukka.rahkonen at maanmittauslaitos.fi (Rahkonen Jukka (MML)) Date: Wed, 5 Feb 2020 10:09:56 +0000 Subject: [mapserver-users] OUTPUTFORMAT png 16-bits Message-ID: <112068c7b8d14abd8d6c92712f6c2880@C119S212VM042.msvyvi.vaha.local> Hi, I would make a test by using some other mimetype, like image/png16, for eliminating the possibility that some internal png configuration drives over your own outputformat. I don?t know if it helps but it is cheap to test. -Jukka Rahkonen- L?hett?j?: mapserver-users Puolesta Johannes Paul L?hetetty: keskiviikko 5. helmikuuta 2020 12.03 Vastaanottaja: mapserver-users at lists.osgeo.org Aihe: [mapserver-users] OUTPUTFORMAT png 16-bits Hello, I'm using Mapserver to output PNG 16-bits DEM raster from .HGT elevation data. I'm using the below output format definition : OUTPUTFORMAT NAME PNG16 DRIVER GDAL/PNG MIMETYPE image/png IMAGEMODE INT16 EXTENSION "png" END However I keep on getting the standard PNG 8-bits out of mapserver. The strange thing being that when I use a similar config to get GeoTiff 16-bits, I do get what I'm asking for : OUTPUTFORMAT NAME GEOTIFF16 DRIVER GDAL/GTiff MIMETYPE image/tiff IMAGEMODE INT16 EXTENSION "tiff" END Could that be an issue with the GDAL/PNG driver ? It seems that the GDAL/PNG driver supports only CreateCopy() and not Create(), where the GDAL/GTiff driver supports both ... Could that be it ? I suspect the GDAL/PNG driver so I also sent my issue to the GDAL mailing list. I can see from the mailing list that other users already had a similar issue, but there is no obvious reason or solution provided. https://lists.osgeo.org/pipermail/mapserver-users/2011-April/068428.html https://lists.osgeo.org/pipermail/mapserver-users/2012-January/071310.html For information, I'm using GDAL v2.1.3 and Mapserver v7.0.1 Thanks, Johannes -------------- next part -------------- An HTML attachment was scrubbed... URL: From johannespaul92 at gmail.com Wed Feb 5 02:32:35 2020 From: johannespaul92 at gmail.com (Johannes Paul) Date: Wed, 5 Feb 2020 11:32:35 +0100 Subject: [mapserver-users] OUTPUTFORMAT png 16-bits In-Reply-To: <112068c7b8d14abd8d6c92712f6c2880@C119S212VM042.msvyvi.vaha.local> References: <112068c7b8d14abd8d6c92712f6c2880@C119S212VM042.msvyvi.vaha.local> Message-ID: Hello Jukka, Thanks for your reply, i've changed mimetype but i still get the 8-bits png... Johannes Le mer. 5 f?vr. 2020 ? 11:09, Rahkonen Jukka (MML) < jukka.rahkonen at maanmittauslaitos.fi> a ?crit : > Hi, > > > > I would make a test by using some other mimetype, like image/png16, for > eliminating the possibility that some internal png configuration drives > over your own outputformat. > > > > I don?t know if it helps but it is cheap to test. > > > > -Jukka Rahkonen- > > > > *L?hett?j?:* mapserver-users *Puolesta > *Johannes Paul > *L?hetetty:* keskiviikko 5. helmikuuta 2020 12.03 > *Vastaanottaja:* mapserver-users at lists.osgeo.org > *Aihe:* [mapserver-users] OUTPUTFORMAT png 16-bits > > > > Hello, > > I'm using Mapserver to output PNG 16-bits DEM raster from .HGT elevation > data. > > I'm using the below output format definition : > > OUTPUTFORMAT > > NAME PNG16 > > DRIVER GDAL/PNG > > MIMETYPE image/png > > IMAGEMODE INT16 > > EXTENSION "png" > > END > > However I keep on getting the standard PNG 8-bits out of mapserver. > > > > The strange thing being that when I use a similar config to get GeoTiff > 16-bits, I do get what I'm asking for : > > > > OUTPUTFORMAT > NAME GEOTIFF16 > DRIVER GDAL/GTiff > MIMETYPE image/tiff > IMAGEMODE INT16 > EXTENSION "tiff" > END > > > > Could that be an issue with the GDAL/PNG driver ? It seems that the > GDAL/PNG driver supports only CreateCopy() and not Create(), where the > GDAL/GTiff driver supports both ... Could that be it ? I suspect the > GDAL/PNG driver so I also sent my issue to the GDAL mailing list. > > > > I can see from the mailing list that other users already had a similar > issue, but there is no obvious reason or solution provided. > > https://lists.osgeo.org/pipermail/mapserver-users/2011-April/068428.html > > https://lists.osgeo.org/pipermail/mapserver-users/2012-January/071310.html > > > > For information, I'm using GDAL v2.1.3 and Mapserver v7.0.1 > > Thanks, > > Johannes > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From Andreas.Eichner at sid.sachsen.de Wed Feb 5 03:05:03 2020 From: Andreas.Eichner at sid.sachsen.de (Eichner, Andreas - SID) Date: Wed, 5 Feb 2020 11:05:03 +0000 Subject: [mapserver-users] OUTPUTFORMAT png 16-bits In-Reply-To: References: <112068c7b8d14abd8d6c92712f6c2880@C119S212VM042.msvyvi.vaha.local> Message-ID: <6F331135492B944D90731CE93743D5684E925A97@FS-EX-DB102.fs.sachsen.de> Hello Johannes, 16bit-PNGs are IMHO not supported by MapServer. Although libPNG supports 16bit depth (see http://www.libpng.org/pub/png/libpng-1.2.5-manual.html#section-4.3) MapServer only supports 1, 2, 4 and 8bit palettes (see https://github.com/mapserver/mapserver/blob/master/mapimageio.c#L355). HTH -----Urspr?ngliche Nachricht----- Von: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] Im Auftrag von Johannes Paul Gesendet: Mittwoch, 5. Februar 2020 11:33 An: Rahkonen Jukka (MML) Cc: mapserver-users at lists.osgeo.org Betreff: Re: [mapserver-users] OUTPUTFORMAT png 16-bits Hello Jukka, Thanks for your reply, i've changed mimetype but i still get the 8-bits png... Johannes Le mer. 5 f?vr. 2020 ? 11:09, Rahkonen Jukka (MML) a ?crit : Hi, I would make a test by using some other mimetype, like image/png16, for eliminating the possibility that some internal png configuration drives over your own outputformat. I don?t know if it helps but it is cheap to test. -Jukka Rahkonen- L?hett?j?: mapserver-users Puolesta Johannes Paul L?hetetty: keskiviikko 5. helmikuuta 2020 12.03 Vastaanottaja: mapserver-users at lists.osgeo.org Aihe: [mapserver-users] OUTPUTFORMAT png 16-bits Hello, I'm using Mapserver to output PNG 16-bits DEM raster from .HGT elevation data. I'm using the below output format definition : OUTPUTFORMAT NAME PNG16 DRIVER GDAL/PNG MIMETYPE image/png IMAGEMODE INT16 EXTENSION "png" END However I keep on getting the standard PNG 8-bits out of mapserver. The strange thing being that when I use a similar config to get GeoTiff 16-bits, I do get what I'm asking for : OUTPUTFORMAT NAME GEOTIFF16 DRIVER GDAL/GTiff MIMETYPE image/tiff IMAGEMODE INT16 EXTENSION "tiff" END Could that be an issue with the GDAL/PNG driver ? It seems that the GDAL/PNG driver supports only CreateCopy() and not Create(), where the GDAL/GTiff driver supports both ... Could that be it ? I suspect the GDAL/PNG driver so I also sent my issue to the GDAL mailing list. I can see from the mailing list that other users already had a similar issue, but there is no obvious reason or solution provided. https://lists.osgeo.org/pipermail/mapserver-users/2011-April/068428.html https://lists.osgeo.org/pipermail/mapserver-users/2012-January/071310.html For information, I'm using GDAL v2.1.3 and Mapserver v7.0.1 Thanks, Johannes From jukka.rahkonen at maanmittauslaitos.fi Wed Feb 5 05:57:26 2020 From: jukka.rahkonen at maanmittauslaitos.fi (Rahkonen Jukka (MML)) Date: Wed, 5 Feb 2020 13:57:26 +0000 Subject: [mapserver-users] OUTPUTFORMAT png 16-bits Message-ID: <226a0c3278094fb1a9898a2da8184145@C119S212VM042.msvyvi.vaha.local> Hi, But it is GDAL that is supposed to write the png because of DRIVER GDAL/PNG GDAL does support UInt16 fot png but it does not support int16. Perhaps this has something to do with the problem. -Jukka Rahkonen- -----Alkuper?inen viesti----- L?hett?j?: Eichner, Andreas - SID L?hetetty: keskiviikko 5. helmikuuta 2020 13.05 Vastaanottaja: Johannes Paul ; Rahkonen Jukka (MML) Kopio: mapserver-users at lists.osgeo.org Aihe: AW: [mapserver-users] OUTPUTFORMAT png 16-bits Hello Johannes, 16bit-PNGs are IMHO not supported by MapServer. Although libPNG supports 16bit depth (see http://www.libpng.org/pub/png/libpng-1.2.5-manual.html#section-4.3) MapServer only supports 1, 2, 4 and 8bit palettes (see https://github.com/mapserver/mapserver/blob/master/mapimageio.c#L355). HTH -----Urspr?ngliche Nachricht----- Von: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] Im Auftrag von Johannes Paul Gesendet: Mittwoch, 5. Februar 2020 11:33 An: Rahkonen Jukka (MML) Cc: mapserver-users at lists.osgeo.org Betreff: Re: [mapserver-users] OUTPUTFORMAT png 16-bits Hello Jukka, Thanks for your reply, i've changed mimetype but i still get the 8-bits png... Johannes Le mer. 5 f?vr. 2020 ? 11:09, Rahkonen Jukka (MML) a ?crit : Hi, I would make a test by using some other mimetype, like image/png16, for eliminating the possibility that some internal png configuration drives over your own outputformat. I don?t know if it helps but it is cheap to test. -Jukka Rahkonen- L?hett?j?: mapserver-users Puolesta Johannes Paul L?hetetty: keskiviikko 5. helmikuuta 2020 12.03 Vastaanottaja: mapserver-users at lists.osgeo.org Aihe: [mapserver-users] OUTPUTFORMAT png 16-bits Hello, I'm using Mapserver to output PNG 16-bits DEM raster from .HGT elevation data. I'm using the below output format definition : OUTPUTFORMAT NAME PNG16 DRIVER GDAL/PNG MIMETYPE image/png IMAGEMODE INT16 EXTENSION "png" END However I keep on getting the standard PNG 8-bits out of mapserver. The strange thing being that when I use a similar config to get GeoTiff 16-bits, I do get what I'm asking for : OUTPUTFORMAT NAME GEOTIFF16 DRIVER GDAL/GTiff MIMETYPE image/tiff IMAGEMODE INT16 EXTENSION "tiff" END Could that be an issue with the GDAL/PNG driver ? It seems that the GDAL/PNG driver supports only CreateCopy() and not Create(), where the GDAL/GTiff driver supports both ... Could that be it ? I suspect the GDAL/PNG driver so I also sent my issue to the GDAL mailing list. I can see from the mailing list that other users already had a similar issue, but there is no obvious reason or solution provided. https://lists.osgeo.org/pipermail/mapserver-users/2011-April/068428.html https://lists.osgeo.org/pipermail/mapserver-users/2012-January/071310.html For information, I'm using GDAL v2.1.3 and Mapserver v7.0.1 Thanks, Johannes From Andreas.Eichner at sid.sachsen.de Wed Feb 5 06:50:06 2020 From: Andreas.Eichner at sid.sachsen.de (Eichner, Andreas - SID) Date: Wed, 5 Feb 2020 14:50:06 +0000 Subject: [mapserver-users] OUTPUTFORMAT png 16-bits In-Reply-To: <226a0c3278094fb1a9898a2da8184145@C119S212VM042.msvyvi.vaha.local> References: <226a0c3278094fb1a9898a2da8184145@C119S212VM042.msvyvi.vaha.local> Message-ID: <6F331135492B944D90731CE93743D5684E925AC9@FS-EX-DB102.fs.sachsen.de> Hi Jukka, you're damn right. Missed that he uses the GDAL-driver. Seems to be exactly as you say. For IMAGEMODE INT16 MapServer maps it to GDT_Int16 (https://github.com/mapserver/mapserver/blob/master/mapgdal.c#L234). But GDAL's PNG-driver checks for GDT_UInt16 (https://github.com/OSGeo/gdal/blob/master/gdal/frmts/png/pngdataset.cpp#L1477) and maps everything else to bitdepth=8 -----Urspr?ngliche Nachricht----- Von: Rahkonen Jukka (MML) [mailto:jukka.rahkonen at maanmittauslaitos.fi] Gesendet: Mittwoch, 5. Februar 2020 14:57 An: Eichner, Andreas - SID; Johannes Paul Cc: mapserver-users at lists.osgeo.org Betreff: Re: [mapserver-users] OUTPUTFORMAT png 16-bits Hi, But it is GDAL that is supposed to write the png because of DRIVER GDAL/PNG GDAL does support UInt16 fot png but it does not support int16. Perhaps this has something to do with the problem. -Jukka Rahkonen- -----Alkuper?inen viesti----- L?hett?j?: Eichner, Andreas - SID L?hetetty: keskiviikko 5. helmikuuta 2020 13.05 Vastaanottaja: Johannes Paul ; Rahkonen Jukka (MML) Kopio: mapserver-users at lists.osgeo.org Aihe: AW: [mapserver-users] OUTPUTFORMAT png 16-bits Hello Johannes, 16bit-PNGs are IMHO not supported by MapServer. Although libPNG supports 16bit depth (see http://www.libpng.org/pub/png/libpng-1.2.5-manual.html#section-4.3) MapServer only supports 1, 2, 4 and 8bit palettes (see https://github.com/mapserver/mapserver/blob/master/mapimageio.c#L355). HTH -----Urspr?ngliche Nachricht----- Von: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] Im Auftrag von Johannes Paul Gesendet: Mittwoch, 5. Februar 2020 11:33 An: Rahkonen Jukka (MML) Cc: mapserver-users at lists.osgeo.org Betreff: Re: [mapserver-users] OUTPUTFORMAT png 16-bits Hello Jukka, Thanks for your reply, i've changed mimetype but i still get the 8-bits png... Johannes Le mer. 5 f?vr. 2020 ? 11:09, Rahkonen Jukka (MML) a ?crit : Hi, I would make a test by using some other mimetype, like image/png16, for eliminating the possibility that some internal png configuration drives over your own outputformat. I don?t know if it helps but it is cheap to test. -Jukka Rahkonen- L?hett?j?: mapserver-users Puolesta Johannes Paul L?hetetty: keskiviikko 5. helmikuuta 2020 12.03 Vastaanottaja: mapserver-users at lists.osgeo.org Aihe: [mapserver-users] OUTPUTFORMAT png 16-bits Hello, I'm using Mapserver to output PNG 16-bits DEM raster from .HGT elevation data. I'm using the below output format definition : OUTPUTFORMAT NAME PNG16 DRIVER GDAL/PNG MIMETYPE image/png IMAGEMODE INT16 EXTENSION "png" END However I keep on getting the standard PNG 8-bits out of mapserver. The strange thing being that when I use a similar config to get GeoTiff 16-bits, I do get what I'm asking for : OUTPUTFORMAT NAME GEOTIFF16 DRIVER GDAL/GTiff MIMETYPE image/tiff IMAGEMODE INT16 EXTENSION "tiff" END Could that be an issue with the GDAL/PNG driver ? It seems that the GDAL/PNG driver supports only CreateCopy() and not Create(), where the GDAL/GTiff driver supports both ... Could that be it ? I suspect the GDAL/PNG driver so I also sent my issue to the GDAL mailing list. I can see from the mailing list that other users already had a similar issue, but there is no obvious reason or solution provided. https://lists.osgeo.org/pipermail/mapserver-users/2011-April/068428.html https://lists.osgeo.org/pipermail/mapserver-users/2012-January/071310.html For information, I'm using GDAL v2.1.3 and Mapserver v7.0.1 Thanks, Johannes From jmckenna at gatewaygeomatics.com Wed Feb 5 07:52:10 2020 From: jmckenna at gatewaygeomatics.com (Jeff McKenna) Date: Wed, 5 Feb 2020 11:52:10 -0400 Subject: [mapserver-users] OUTPUTFORMAT png 16-bits In-Reply-To: References: Message-ID: <49514a28-ebf8-9517-0328-5f68e3467748@gatewaygeomatics.com> Hi Johannes, I just wanted to mention that what I always test OUTPUTFORMAT with is through the shp2img commandline utility, with the "-i" switch, such as: shp2img -m test.map -o ttt.png -i PNG16 -all_debug 5 PS. in the future MapServer v8.0 I hope to help change that utility name to "map2img", so it makes more sense. -jeff -- Jeff McKenna MapServer Consulting and Training Services https://gatewaygeomatics.com/ On 2020-02-05 6:02 a.m., Johannes Paul wrote: > Hello, > I'm using Mapserver to output PNG 16-bits DEM raster from .HGT elevation > data. > I'm using the below output format definition : > > |OUTPUTFORMAT NAME PNG16 DRIVER GDAL/PNG MIMETYPE image/png IMAGEMODE > INT16 EXTENSION "png" END| > > However I keep on getting the standard PNG 8-bits out of mapserver. > > The strange thing being that when I use a similar config to get GeoTiff > 16-bits, I do get what I'm asking for : > > OUTPUTFORMAT > ? NAME GEOTIFF16 > ? DRIVER GDAL/GTiff > ? MIMETYPE image/tiff > ? IMAGEMODE INT16 > ? EXTENSION "tiff" > END > > > Could that be an issue with the GDAL/PNG driver ? It seems that the > GDAL/PNG driver supports only CreateCopy() and not Create(), where the > GDAL/GTiff driver supports both ... Could that be it ? I suspect the > GDAL/PNG driver so I also sent my issue to the GDAL mailing list. > > I can see from the mailing list that other users already had a similar > issue, but there is no obvious reason or solution provided. > https://lists.osgeo.org/pipermail/mapserver-users/2011-April/068428.html > https://lists.osgeo.org/pipermail/mapserver-users/2012-January/071310.html > > For information, I'm using GDAL v2.1.3 and Mapserver v7.0.1 > Thanks, > Johannes > > From johannespaul92 at gmail.com Wed Feb 5 08:35:29 2020 From: johannespaul92 at gmail.com (Johannes Paul) Date: Wed, 5 Feb 2020 17:35:29 +0100 Subject: [mapserver-users] OUTPUTFORMAT png 16-bits In-Reply-To: <49514a28-ebf8-9517-0328-5f68e3467748@gatewaygeomatics.com> References: <49514a28-ebf8-9517-0328-5f68e3467748@gatewaygeomatics.com> Message-ID: Thanks for the trick Jeff, unfortunatelly i still get a 8-bits png and obviously uint16 is not a valid mapserver imagemode... Johannes Le mer. 5 f?vr. 2020 ? 16:52, Jeff McKenna a ?crit : > Hi Johannes, > > I just wanted to mention that what I always test OUTPUTFORMAT with is > through the shp2img commandline utility, with the "-i" switch, such as: > > shp2img -m test.map -o ttt.png -i PNG16 -all_debug 5 > > PS. in the future MapServer v8.0 I hope to help change that utility name > to "map2img", so it makes more sense. > > > -jeff > > > > -- > Jeff McKenna > MapServer Consulting and Training Services > https://gatewaygeomatics.com/ > > > > > On 2020-02-05 6:02 a.m., Johannes Paul wrote: > > Hello, > > I'm using Mapserver to output PNG 16-bits DEM raster from .HGT elevation > > data. > > I'm using the below output format definition : > > > > |OUTPUTFORMAT NAME PNG16 DRIVER GDAL/PNG MIMETYPE image/png IMAGEMODE > > INT16 EXTENSION "png" END| > > > > However I keep on getting the standard PNG 8-bits out of mapserver. > > > > The strange thing being that when I use a similar config to get GeoTiff > > 16-bits, I do get what I'm asking for : > > > > OUTPUTFORMAT > > NAME GEOTIFF16 > > DRIVER GDAL/GTiff > > MIMETYPE image/tiff > > IMAGEMODE INT16 > > EXTENSION "tiff" > > END > > > > > > Could that be an issue with the GDAL/PNG driver ? It seems that the > > GDAL/PNG driver supports only CreateCopy() and not Create(), where the > > GDAL/GTiff driver supports both ... Could that be it ? I suspect the > > GDAL/PNG driver so I also sent my issue to the GDAL mailing list. > > > > I can see from the mailing list that other users already had a similar > > issue, but there is no obvious reason or solution provided. > > https://lists.osgeo.org/pipermail/mapserver-users/2011-April/068428.html > > > https://lists.osgeo.org/pipermail/mapserver-users/2012-January/071310.html > > > > For information, I'm using GDAL v2.1.3 and Mapserver v7.0.1 > > Thanks, > > Johannes > > > > > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From akrherz at iastate.edu Wed Feb 5 11:12:19 2020 From: akrherz at iastate.edu (Herzmann, Daryl E [AGRON]) Date: Wed, 5 Feb 2020 19:12:19 +0000 Subject: [mapserver-users] Is Mapserver known to play nice with Proj 6.3 ? Message-ID: Greetings, I'm attempting to use Mapserver with Proj 6.3 and am wondering if this combination is known to work? I've been experiencing some issues. 1) For my deployment of FastCGI mapserver (master or 7.4.x build) and based on my monitoring, CPU usage is about double vs my previous setup of mapserver 7.3.x and Proj 5.2.0. My comment here is lame I know as I have yet to produce a test case showing that actual difference. All the other support libraries that went into the new build are updated too, so it is unfair to perhaps blame proj here :) I had lots of previous fun[1] with a newer proj and postgis when an old sqlite3 library is at play, but I'm using the most recent version of that here. [1] https://lists.osgeo.org/pipermail/postgis-users/2019-November/043727.html 2) I could not get master branch to build with proj 6.3, I get the error: [ 0%] Building C object CMakeFiles/mapserver.dir/fontcache.c.o In file included from /home/akrherz/projects/mapserver/mapproject.h:46, from /home/akrherz/projects/mapserver/mapshape.h:35, from /home/akrherz/projects/mapserver/mapserver.h:126, from /home/akrherz/projects/mapserver/fontcache.c:30: /opt/miniconda3/envs/prod/include/proj_api.h:37:2: error: #error 'To use the proj_api.h you must define the macro ACCEPT_USE_OF_DEPRECATED_PROJ_API_H' #error 'To use the proj_api.h you must define the macro ACCEPT_USE_OF_DEPRECATED_PROJ_API_H' Which is described in this closed issue: https://github.com/mapserver/mapserver/issues/5766 Strangely, this builds just fine on the branch-7-4 branch without any code workarounds. 3) I've been seeing lots of segfaulting and coredumps Process 2803 (mapserv.fcgi) of user 48 dumped core.#012#012Stack trace of thread 2803:#012#0 0x00007f348d2a28df raise (libc.so.6)#012#1 0x00007f348d28ccf5 abort (libc.so.6)#012#2 0x00007f348d2e5c17 __libc_message (libc.so.6)#012#3 0x00007f348d2ec53c malloc_printerr (libc.so.6)#012#4 0x00007f348d2edf2c _int_free (libc.so.6)#012#5 0x00007f348f9ecdcb msGEOSCleanup (libmapserver.so.2)#012#6 0x00007f348fad2a66 msCleanup (libmapserver.so.2)#012#7 0x0000000000401213 msCleanupOnSignal (mapserv.fcgi)#012#8 0x00007f348d2a2960 __restore_rt (libc.so.6)#012#9 0x00007f348730c0c9 _gfortrani_free_format_hash_table (libgfortran.so.4)#012#10 0x00007f3487318d72 close_unit_1 (libgfortran.so.4)#012#11 0x00007f3487318e02 _gfortrani_close_units (libgfortran.so.4)#012#12 0x00007f348fee80e6 _dl_fini (ld-linux-x86-64.so.2)#012#13 0x00007f348d2a506c __run_exit_handlers (libc.so.6)#012#14 0x00007f348d2a51a0 exit (libc.so.6)#012#15 0x0000000000401782 main (mapserv.fcgi)#012#16 0x00007f348d28e873 __libc_start_main (libc.so.6)#012#17 0x000000000040111e _start (mapserv.fcgi) 4) It appears like Travis CI testing is all against proj 6.1.1, maybe I should revert to that? :) thanks daryl -- /** * daryl herzmann * Systems Analyst III -- Iowa Environmental Mesonet * https://mesonet.agron.iastate.edu */ From even.rouault at spatialys.com Wed Feb 5 13:22:25 2020 From: even.rouault at spatialys.com (Even Rouault) Date: Wed, 05 Feb 2020 22:22:25 +0100 Subject: [mapserver-users] Is Mapserver known to play nice with Proj 6.3 ? In-Reply-To: References: Message-ID: <4477689.SsqIGWH1Jc@even-i700> Hi, > 1) For my deployment of FastCGI mapserver (master or 7.4.x build) and based > on my monitoring, CPU usage is about double vs my previous setup of > mapserver 7.3.x and Proj 5.2.0. My comment here is lame I know as I have > yet to produce a test case showing that actual difference. All the other > support libraries that went into the new build are updated too, so it is > unfair to perhaps blame proj here :) I had lots of previous fun[1] with a > newer proj and postgis when an old sqlite3 library is at play, but I'm > using the most recent version of that here. There's certainly a performance hit with PROJ >= 6. How much it is depends on a lot of things. I'm not sure there are so many low hanging fruits remaining, but precise reproducer to investigate could be useful. Normally in FastCGI, the initial overhead should be amortized in following requests reusing the same process. However with branch 7.4 you will use PROJ.4 API of PROJ 6, so a x2 performance hit is not expected in that situation. It should exhibit performance similar to PROJ 5. > 2) I could not get master branch to build with proj 6.3, I get the error: > > [ 0%] Building C object CMakeFiles/mapserver.dir/fontcache.c.o > In file included from /home/akrherz/projects/mapserver/mapproject.h:46, > from /home/akrherz/projects/mapserver/mapshape.h:35, > from /home/akrherz/projects/mapserver/mapserver.h:126, > from /home/akrherz/projects/mapserver/fontcache.c:30: > /opt/miniconda3/envs/prod/include/proj_api.h:37:2: error: #error 'To use the > proj_api.h you must define the macro ACCEPT_USE_OF_DEPRECATED_PROJ_API_H' > #error 'To use the proj_api.h you must define the macro > ACCEPT_USE_OF_DEPRECATED_PROJ_API_H' That's not expected. Is there a /opt/miniconda3/envs/prod/include/proj.h file as there should normally be one for PROJ >= 6 ? > 3) I've been seeing lots of segfaulting and coredumps You should make sure that all MapServer direct or indirect dependencies use the same PROJ version. (or you can use the -DPROJ_RENAME_SYMBOLS trick as in https://github.com/mapserver/mapserver/blob/master/ci/travis/script.sh#L16 and https://github.com/mapserver/mapserver/blob/master/ci/travis/script.sh#L30) That said... > 4) It appears like Travis CI testing is all against proj 6.1.1, maybe I > should revert to that? :) I've just tested with PROJ 6.3.0 and I indeed see number of crashes/wrong results when running msautotest. Those disappear when using the HEAD of the 6.3 git branch. I've raised the opportunity to issue a PROJ 6.3.1 release in https://lists.osgeo.org/pipermail/proj/2020-February/009339.html Even -- Spatialys - Geospatial professional services http://www.spatialys.com From akrherz at iastate.edu Wed Feb 5 13:45:00 2020 From: akrherz at iastate.edu (Herzmann, Daryl E [AGRON]) Date: Wed, 5 Feb 2020 21:45:00 +0000 Subject: [mapserver-users] Is Mapserver known to play nice with Proj 6.3 ? In-Reply-To: <4477689.SsqIGWH1Jc@even-i700> References: , <4477689.SsqIGWH1Jc@even-i700> Message-ID: Hi Even, You are the best! Thank you for the response. My email client does not like inline quoting, sigh. With regards to: 1) Performance hit. Yeah, I haven't got a test case yet. Too many moving parts on my end currently :( 2) building with proj 6.3.0 Did you try building the master branch? That's what fails for me without adding that macro. branch-7-4 works without code modifications. 3) segfaults I will look into your suggestion, but initially I found some core files with this backtrace: #0 0x00007f9b4abc38df in raise () from /lib64/libc.so.6 #1 0x00007f9b4abadcf5 in abort () from /lib64/libc.so.6 #2 0x00007f9b4ac06c17 in __libc_message () from /lib64/libc.so.6 #3 0x00007f9b4ac0d53c in malloc_printerr () from /lib64/libc.so.6 #4 0x00007f9b4ac0ef2c in _int_free () from /lib64/libc.so.6 #5 0x00007f9b4d30ddcb in msGEOSCleanup () from /opt/miniconda3/envs/prod/lib/libmapserver.so.2 #6 0x00007f9b4d3f3a66 in msCleanup () from /opt/miniconda3/envs/prod/lib/libmapserver.so.2 #7 0x000000000040116a in ?? () #8 0x00007f9b4d861560 in ?? () #9 0x0000000f0000026f in ?? () #10 0x00007f9b44b18290 in feholdexcept at got.plt () from /opt/miniconda3/envs/prod/lib/./././libquadmath.so.0 #11 #12 0x00007f9b4abc6520 in __cxa_finalize () from /lib64/libc.so.6 #13 0x00007f9b44ae2740 in __do_global_dtors_aux () from /opt/miniconda3/envs/prod/lib/./././libquadmath.so.0 #14 0x00007f9b4da22000 in ?? () from /lib64/ld-linux-x86-64.so.2 #15 0x0000000000000000 in ?? () I am still efforting getting a full debug environment setup :( 4) new proj 6.3.1 release Thank you for prioritizing that! I will certainly give it a spin and report back my findings. daryl -- /** * daryl herzmann * Systems Analyst III -- Iowa Environmental Mesonet * https://mesonet.agron.iastate.edu */ ________________________________________ From: Even Rouault Sent: Wednesday, February 5, 2020 3:22 PM To: mapserver-users at lists.osgeo.org Cc: Herzmann, Daryl E [AGRON] Subject: Re: [mapserver-users] Is Mapserver known to play nice with Proj 6.3 ? Hi, > 1) For my deployment of FastCGI mapserver (master or 7.4.x build) and based > on my monitoring, CPU usage is about double vs my previous setup of > mapserver 7.3.x and Proj 5.2.0. My comment here is lame I know as I have > yet to produce a test case showing that actual difference. All the other > support libraries that went into the new build are updated too, so it is > unfair to perhaps blame proj here :) I had lots of previous fun[1] with a > newer proj and postgis when an old sqlite3 library is at play, but I'm > using the most recent version of that here. There's certainly a performance hit with PROJ >= 6. How much it is depends on a lot of things. I'm not sure there are so many low hanging fruits remaining, but precise reproducer to investigate could be useful. Normally in FastCGI, the initial overhead should be amortized in following requests reusing the same process. However with branch 7.4 you will use PROJ.4 API of PROJ 6, so a x2 performance hit is not expected in that situation. It should exhibit performance similar to PROJ 5. > 2) I could not get master branch to build with proj 6.3, I get the error: > > [ 0%] Building C object CMakeFiles/mapserver.dir/fontcache.c.o > In file included from /home/akrherz/projects/mapserver/mapproject.h:46, > from /home/akrherz/projects/mapserver/mapshape.h:35, > from /home/akrherz/projects/mapserver/mapserver.h:126, > from /home/akrherz/projects/mapserver/fontcache.c:30: > /opt/miniconda3/envs/prod/include/proj_api.h:37:2: error: #error 'To use the > proj_api.h you must define the macro ACCEPT_USE_OF_DEPRECATED_PROJ_API_H' > #error 'To use the proj_api.h you must define the macro > ACCEPT_USE_OF_DEPRECATED_PROJ_API_H' That's not expected. Is there a /opt/miniconda3/envs/prod/include/proj.h file as there should normally be one for PROJ >= 6 ? > 3) I've been seeing lots of segfaulting and coredumps You should make sure that all MapServer direct or indirect dependencies use the same PROJ version. (or you can use the -DPROJ_RENAME_SYMBOLS trick as in https://github.com/mapserver/mapserver/blob/master/ci/travis/script.sh#L16 and https://github.com/mapserver/mapserver/blob/master/ci/travis/script.sh#L30) That said... > 4) It appears like Travis CI testing is all against proj 6.1.1, maybe I > should revert to that? :) I've just tested with PROJ 6.3.0 and I indeed see number of crashes/wrong results when running msautotest. Those disappear when using the HEAD of the 6.3 git branch. I've raised the opportunity to issue a PROJ 6.3.1 release in https://lists.osgeo.org/pipermail/proj/2020-February/009339.html Even -- Spatialys - Geospatial professional services http://www.spatialys.com From even.rouault at spatialys.com Wed Feb 5 13:58:06 2020 From: even.rouault at spatialys.com (Even Rouault) Date: Wed, 05 Feb 2020 22:58:06 +0100 Subject: [mapserver-users] Is Mapserver known to play nice with Proj 6.3 ? In-Reply-To: References: <4477689.SsqIGWH1Jc@even-i700> Message-ID: <27281928.qBEvWAkxum@even-i700> > Did you try building the master branch? Yes MapServer master branch + PROJ 6.3.0 or 6.3 git HEAD. -- Spatialys - Geospatial professional services http://www.spatialys.com From even.rouault at spatialys.com Mon Feb 10 02:27:22 2020 From: even.rouault at spatialys.com (Even Rouault) Date: Mon, 10 Feb 2020 11:27:22 +0100 Subject: [mapserver-users] Is Mapserver known to play nice with Proj 6.3 ? In-Reply-To: References: <4477689.SsqIGWH1Jc@even-i700> Message-ID: <4875050.2tuTgyzy4T@even-i700> > 4) new proj 6.3.1 release > > Thank you for prioritizing that! I will certainly give it a spin and report > back my findings. PROJ 6.3.1 release candidate announced: https://lists.osgeo.org/pipermail/proj/2020-February/009360.html Even -- Spatialys - Geospatial professional services http://www.spatialys.com From bob.basques at ci.stpaul.mn.us Mon Feb 10 06:49:29 2020 From: bob.basques at ci.stpaul.mn.us (Basques, Bob (CI-StPaul)) Date: Mon, 10 Feb 2020 14:49:29 +0000 Subject: [mapserver-users] REMINDER: OSGeo Local Chapter (aka TCMUG) Meeting Message-ID: Just a reminder about the TCMUG meeting this Wednesday at Wabasha Brewing. https://www.google.com/maps/place/Wabasha+Brewing+Company/@44.9329664,-93.0847012,15z/data=!4m5!3m4!1s0x0:0xa017f9c78c8e29ba!8m2!3d44.9329664!4d-93.0847012 https://www.pwgeo.org/apps/compass/#xy=151823,577301,17.768690395435254&on=L167/all;L207/all;L353/20190924;L117/all;L116/all;L201/all;L11/all bobb OSGeo Local Chapter (aka TCMUG) Meeting Scheduled: Feb 12, 2020 at 4:30 PM to 6:00 PM Location: 429 Wabasha Street South, Saint Paul, MN 55107, United States -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: iCal-20200210-084209.ics Type: text/calendar Size: 1564 bytes Desc: iCal-20200210-084209.ics URL: From jbo-ads at laposte.net Tue Feb 11 07:02:21 2020 From: jbo-ads at laposte.net (jbo-ads) Date: Tue, 11 Feb 2020 16:02:21 +0100 Subject: [mapserver-users] MapCache 1.10.0-rc1 ready for testing Message-ID: <54781b22-3637-4a9f-79fd-5aaf2778cccf@laposte.net> Today the project team has packaged the first release candidate of MapCache 1.10.0, which includes a long list of changes. Changelog: https://mapserver.org/development/changelog/mapcache/changelog-1-10.html#changelog-mapcache-1-10-0-rc1 Download: http://download.osgeo.org/mapserver/mapcache-1.10.0-rc1.tar.gz Thanks, MapServer / MapCache team From stephenwoodbridge37 at gmail.com Thu Feb 13 08:24:54 2020 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Thu, 13 Feb 2020 11:24:54 -0500 Subject: [mapserver-users] How to assemble mapcache tilesets into a new layer? Message-ID: <38c45c9b-8d1e-2dc5-5534-3bcc0964e5b8@gmail.com> Hi all, I have three existing layers in my mapcache.xml and I need to create a new layer that assembles this three layers into a single layer. There is a section in the mapcache documentation https://mapserver.org/mapcache/tile_assembling.html but it is not very helpful ;) Can anyone help with with this problem? Say I have existing tilesets "A", "B", "C" how would I create a tileset "D" where it stacks A, B, and C like: C B A Thanks, ? -Steve W From jbo-ads at laposte.net Thu Feb 13 09:36:11 2020 From: jbo-ads at laposte.net (jbo-ads) Date: Thu, 13 Feb 2020 18:36:11 +0100 Subject: [mapserver-users] How to assemble mapcache tilesets into a new layer? In-Reply-To: <38c45c9b-8d1e-2dc5-5534-3bcc0964e5b8@gmail.com> References: <38c45c9b-8d1e-2dc5-5534-3bcc0964e5b8@gmail.com> Message-ID: <2d4d72e8-2998-e1b0-ff45-987b3de0e59b@laposte.net> Hi Steve, Yes, this part of the doc should be improved... A more helpful one is but it is relative only to second level dimensions. Assembling several layers can be performed with a WMS request using "...&LAYERS=A,B,C&...". Then to create a new layer, you just need to define a WMS source using that WMS pattern. J?rome. Le 13/02/2020 ? 17:24, Stephen Woodbridge a ?crit?: > Hi all, > > I have three existing layers in my mapcache.xml and I need to create a > new layer that assembles this three layers into a single layer. There > is a section in the mapcache documentation > https://mapserver.org/mapcache/tile_assembling.html but it is not very > helpful ;) > > Can anyone help with with this problem? > > Say I have existing tilesets "A", "B", "C" how would I create a > tileset "D" where it stacks A, B, and C like: > > C > B > A > > Thanks, > ? -Steve W > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users From stephenwoodbridge37 at gmail.com Thu Feb 13 10:46:51 2020 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Thu, 13 Feb 2020 13:46:51 -0500 Subject: [mapserver-users] How to assemble mapcache tilesets into a new layer? In-Reply-To: <2d4d72e8-2998-e1b0-ff45-987b3de0e59b@laposte.net> References: <38c45c9b-8d1e-2dc5-5534-3bcc0964e5b8@gmail.com> <2d4d72e8-2998-e1b0-ff45-987b3de0e59b@laposte.net> Message-ID: <0b0a0c46-23b5-f032-1bd3-19c75e57af44@gmail.com> On 2/13/2020 12:36 PM, jbo-ads wrote: > Hi Steve, > > Yes, this part of the doc should be improved... A more helpful one is > > but it is relative only to second level dimensions. > > Assembling several layers can be performed with a WMS request using > "...&LAYERS=A,B,C&...". Then to create a new layer, you just need to > define a WMS source using that WMS pattern. J?rome, Thanks that seems simple enough. A couple of questions: ? ??? ????? image/png> ????? A,B,C ??? ? ? ??? ????? ? ? D ? ... Does this look right? Should I have an section and what should be in that if anything for assembly of existing tilesets? Thanks, ? -Steve > > J?rome. > > > > Le 13/02/2020 ? 17:24, Stephen Woodbridge a ?crit?: >> Hi all, >> >> I have three existing layers in my mapcache.xml and I need to create >> a new layer that assembles this three layers into a single layer. >> There is a section in the mapcache documentation >> https://mapserver.org/mapcache/tile_assembling.html but it is not >> very helpful ;) >> >> Can anyone help with with this problem? >> >> Say I have existing tilesets "A", "B", "C" how would I create a >> tileset "D" where it stacks A, B, and C like: >> >> C >> B >> A >> >> Thanks, >> ? -Steve W >> _______________________________________________ >> mapserver-users mailing list >> mapserver-users at lists.osgeo.org >> https://lists.osgeo.org/mailman/listinfo/mapserver-users > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users From stephenwoodbridge37 at gmail.com Thu Feb 13 11:33:02 2020 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Thu, 13 Feb 2020 14:33:02 -0500 Subject: [mapserver-users] How to assemble mapcache tilesets into a new layer? In-Reply-To: <0b0a0c46-23b5-f032-1bd3-19c75e57af44@gmail.com> References: <38c45c9b-8d1e-2dc5-5534-3bcc0964e5b8@gmail.com> <2d4d72e8-2998-e1b0-ff45-987b3de0e59b@laposte.net> <0b0a0c46-23b5-f032-1bd3-19c75e57af44@gmail.com> Message-ID: <2e697276-0f38-16e0-fbd0-756bef948063@gmail.com> Ok to answer my own question, yes you need section like this for assembly to work: ? ??? ????? image/png> ????? A,B,C ??? ? ? ??? http://localhost/mapcache ? And you don't need a defined for it to work as it reads data from the existing tilesets and assembles the new image. I suppose if you wanted you could also define a new tileset so it would cache the assembled images, but I'm not sure that that is needed except possibly in very high demand situations. But this is just my surmise. Thanks, ? -Steve On 2/13/2020 1:46 PM, Stephen Woodbridge wrote: > On 2/13/2020 12:36 PM, jbo-ads wrote: >> Hi Steve, >> >> Yes, this part of the doc should be improved... A more helpful one is >> >> but it is relative only to second level dimensions. >> >> Assembling several layers can be performed with a WMS request using >> "...&LAYERS=A,B,C&...". Then to create a new layer, you just need to >> define a WMS source using that WMS pattern. > J?rome, > > Thanks that seems simple enough. A couple of questions: > > > ? > ??? > ????? image/png> > ????? A,B,C > ??? > ? > ? > ??? ????? > ? > > > > ? D > ? ... > > > Does this look right? > Should I have an section and what should be in that if anything > for assembly of existing tilesets? > > Thanks, > ? -Steve >> >> J?rome. >> >> >> >> Le 13/02/2020 ? 17:24, Stephen Woodbridge a ?crit?: >>> Hi all, >>> >>> I have three existing layers in my mapcache.xml and I need to create >>> a new layer that assembles this three layers into a single layer. >>> There is a section in the mapcache documentation >>> https://mapserver.org/mapcache/tile_assembling.html but it is not >>> very helpful ;) >>> >>> Can anyone help with with this problem? >>> >>> Say I have existing tilesets "A", "B", "C" how would I create a >>> tileset "D" where it stacks A, B, and C like: >>> >>> C >>> B >>> A >>> >>> Thanks, >>> ? -Steve W >>> _______________________________________________ >>> mapserver-users mailing list >>> mapserver-users at lists.osgeo.org >>> https://lists.osgeo.org/mailman/listinfo/mapserver-users >> >> _______________________________________________ >> mapserver-users mailing list >> mapserver-users at lists.osgeo.org >> https://lists.osgeo.org/mailman/listinfo/mapserver-users > From akrherz at iastate.edu Thu Feb 13 11:39:36 2020 From: akrherz at iastate.edu (Herzmann, Daryl E [AGRON]) Date: Thu, 13 Feb 2020 19:39:36 +0000 Subject: [mapserver-users] Is Mapserver known to play nice with Proj 6.3 ? In-Reply-To: <4875050.2tuTgyzy4T@even-i700> References: <4477689.SsqIGWH1Jc@even-i700> , <4875050.2tuTgyzy4T@even-i700> Message-ID: Hi Even, Thanks for efforting the release. Sadly, since I am using the proj provided by python Anaconda/conda-forge, it will take a few days for the dependency log jam to clear so that I can upgrade to that version. I would like to note that the CPU usage issue was a silly error on my part with a botched apache configuration not running mapserv as FastCGI as I thought :( I do still have the issue of needing ACCEPT_USE_OF_DEPRECATED_PROJ_API_H to build mapserver in the master branch. I don't need it when doing the same build procedure from the branch-7-4. I am unsure if it is worth pursuing. The issue of crashes went away for me when I fixed the apache config issue. My ignorant guess is that CGI execing mapserv hundreds of times per second leads to some fun edge cases. daryl ________________________________________ From: Even Rouault Sent: Monday, February 10, 2020 4:27 AM To: Herzmann, Daryl E [AGRON] Cc: mapserver-users at lists.osgeo.org Subject: Re: [mapserver-users] Is Mapserver known to play nice with Proj 6.3 ? > 4) new proj 6.3.1 release > > Thank you for prioritizing that! I will certainly give it a spin and report > back my findings. PROJ 6.3.1 release candidate announced: https://lists.osgeo.org/pipermail/proj/2020-February/009360.html Even -- Spatialys - Geospatial professional services http://www.spatialys.com From jbo-ads at laposte.net Thu Feb 13 11:49:12 2020 From: jbo-ads at laposte.net (jbo-ads at laposte.net) Date: Thu, 13 Feb 2020 20:49:12 +0100 (CET) Subject: [mapserver-users] How to assemble mapcache tilesets into a new layer? In-Reply-To: <2e697276-0f38-16e0-fbd0-756bef948063@gmail.com> References: <38c45c9b-8d1e-2dc5-5534-3bcc0964e5b8@gmail.com> <2d4d72e8-2998-e1b0-ff45-987b3de0e59b@laposte.net> <0b0a0c46-23b5-f032-1bd3-19c75e57af44@gmail.com> <2e697276-0f38-16e0-fbd0-756bef948063@gmail.com> Message-ID: <1226377533.1594236.1581623352679.JavaMail.zimbra@laposte.net> Yes your configuration looks right. But IIRC, if you want to use that source, you actually need to define a tileset that references it. Something like: /path/to/cache/D.sqlite3 D D ... and use it as: http://localhost/mapcache?REQUEST=GetMap&LAYERS=D&.. . ----- Mail original ----- De: "Stephen Woodbridge" ?: "jbo-ads" , mapserver-users at lists.osgeo.org Envoy?: Jeudi 13 F?vrier 2020 20:33:02 Objet: Re: [mapserver-users] How to assemble mapcache tilesets into a new layer? Ok to answer my own question, yes you need section like this for assembly to work: image/png> A,B,C http://localhost/mapcache And you don't need a defined for it to work as it reads data from the existing tilesets and assembles the new image. I suppose if you wanted you could also define a new tileset so it would cache the assembled images, but I'm not sure that that is needed except possibly in very high demand situations. But this is just my surmise. Thanks, -Steve On 2/13/2020 1:46 PM, Stephen Woodbridge wrote: > On 2/13/2020 12:36 PM, jbo-ads wrote: >> Hi Steve, >> >> Yes, this part of the doc should be improved... A more helpful one is >> >> but it is relative only to second level dimensions. >> >> Assembling several layers can be performed with a WMS request using >> "...&LAYERS=A,B,C&...". Then to create a new layer, you just need to >> define a WMS source using that WMS pattern. > J?rome, > > Thanks that seems simple enough. A couple of questions: > > > > > image/png> > A,B,C > > > > ????? > > > > > D > ... > > > Does this look right? > Should I have an section and what should be in that if anything > for assembly of existing tilesets? > > Thanks, > -Steve >> >> J?rome. >> >> >> >> Le 13/02/2020 ? 17:24, Stephen Woodbridge a ?crit : >>> Hi all, >>> >>> I have three existing layers in my mapcache.xml and I need to create >>> a new layer that assembles this three layers into a single layer. >>> There is a section in the mapcache documentation >>> https://mapserver.org/mapcache/tile_assembling.html but it is not >>> very helpful ;) >>> >>> Can anyone help with with this problem? >>> >>> Say I have existing tilesets "A", "B", "C" how would I create a >>> tileset "D" where it stacks A, B, and C like: >>> >>> C >>> B >>> A >>> >>> Thanks, >>> -Steve W >>> _______________________________________________ >>> mapserver-users mailing list >>> mapserver-users at lists.osgeo.org >>> https://lists.osgeo.org/mailman/listinfo/mapserver-users >> >> _______________________________________________ >> mapserver-users mailing list >> mapserver-users at lists.osgeo.org >> https://lists.osgeo.org/mailman/listinfo/mapserver-users > -------------- next part -------------- An HTML attachment was scrubbed... URL: From jbo-ads at laposte.net Mon Feb 17 04:54:44 2020 From: jbo-ads at laposte.net (jbo-ads) Date: Mon, 17 Feb 2020 13:54:44 +0100 Subject: [mapserver-users] MapCache 1.10.0-rc2 ready for testing Message-ID: <6ea127bd-0bf4-32b1-cd82-1c8d98df9482@laposte.net> Hi all, The second release candidate of MapCache 1.10.0 is out. It fixes some memory leaks. Changelog: https://mapserver.org/development/changelog/mapcache/changelog-1-10.html#changelog-mapcache-1-10-0-rc2 Download: http://download.osgeo.org/mapserver/mapcache-1.10.0-rc1.tar.gz Thank, MapServer / MapCache team -------------- next part -------------- An HTML attachment was scrubbed... URL: From jbo-ads at laposte.net Mon Feb 17 05:00:05 2020 From: jbo-ads at laposte.net (jbo-ads) Date: Mon, 17 Feb 2020 14:00:05 +0100 Subject: [mapserver-users] MapCache 1.10.0-rc2 ready for testing Message-ID: <2277c910-192d-58b0-ea96-3521d8be6676@laposte.net> My bad, links were wrong in the previous message. Hi all, The second release candidate of MapCache 1.10.0 is out. It fixes some memory leaks. Changelog: https://mapserver.org/development/changelog/mapcache/changelog-1-10.html#changelog-mapcache-1-10-0-rc2 Download: http://download.osgeo.org/mapserver/mapcache-1.10.0-rc2.tar.gz Thank, MapServer / MapCache team From atlantageek at gmail.com Sat Feb 22 14:25:06 2020 From: atlantageek at gmail.com (Atlanta Geek) Date: Sat, 22 Feb 2020 17:25:06 -0500 Subject: [mapserver-users] Show traffic on roads. Message-ID: Is there a good way to show heavy traffic using mapserver without drawing each individual road segment as a different line. -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdlime at gmail.com Sun Feb 23 08:20:30 2020 From: sdlime at gmail.com (Steve Lime) Date: Sun, 23 Feb 2020 10:20:30 -0600 Subject: [mapserver-users] Show traffic on roads. In-Reply-To: References: Message-ID: How are the data stored? With PostGIS one could aggregate features (ST_Collect?) based on an attribute and render that. You?re still drawing each segment but likely more efficiently. ?Steve On Sat, Feb 22, 2020 at 4:25 PM Atlanta Geek wrote: > Is there a good way to show heavy traffic using mapserver without drawing > each individual road segment as a different line. > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From jbo-ads at laposte.net Mon Feb 24 04:21:27 2020 From: jbo-ads at laposte.net (jbo-ads) Date: Mon, 24 Feb 2020 13:21:27 +0100 Subject: [mapserver-users] MapCache 1.10.0 released Message-ID: Hi, The project team is glad to announce the release of MapCache 1.10.0. This version includes a long list of bug fixes and feature enhancements since 1.8.0. Changelog: https://mapserver.org/development/changelog/mapcache/changelog-1-10.html Download: http://download.osgeo.org/mapserver/mapcache-1.10.0.tar.gz Thanks, MapServer / MapCache team From erik.h11.01 at gmail.com Tue Feb 25 16:48:07 2020 From: erik.h11.01 at gmail.com (Erik H) Date: Tue, 25 Feb 2020 19:48:07 -0500 Subject: [mapserver-users] Show traffic on roads. In-Reply-To: References: Message-ID: Depends on your requirements. If you just want to visualize typical traffic conditions, MapServer can do the job, it's pretty straightforward. Just join your road geometries with the congestion data (actual speed / free-flow speed), apply some filters (SQL conditions) on road class and maybe congestion (omitting non-congested roads), and render that in the appropriate color. If, on the other hand, you have a feed with speeds that vary frequently, it gets tricky because you can't really use a regular tile cache. I ended up abandoning MapServer for this - the problem was not so much the rendering, but PostGIS was getting overwhelmed. If you get your speed data from a company like HERE or INRIX, you should be able to use their tilers. If not, you have a nice challenge. On Sun, Feb 23, 2020 at 11:20 AM Steve Lime wrote: > How are the data stored? With PostGIS one could aggregate features > (ST_Collect?) based on an attribute and render that. You?re still drawing > each segment but likely more efficiently. > > ?Steve > > On Sat, Feb 22, 2020 at 4:25 PM Atlanta Geek > wrote: > >> Is there a good way to show heavy traffic using mapserver without drawing >> each individual road segment as a different line. >> _______________________________________________ >> mapserver-users mailing list >> mapserver-users at lists.osgeo.org >> https://lists.osgeo.org/mailman/listinfo/mapserver-users > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From johannespaul92 at gmail.com Wed Feb 26 02:11:28 2020 From: johannespaul92 at gmail.com (Johannes Paul) Date: Wed, 26 Feb 2020 11:11:28 +0100 Subject: [mapserver-users] Mapcache : Incompatible libpng version in application and library Message-ID: Hello, I've compiled Mapcache from source, and the installation worked just fine, without any error, however when I run mapcache_seed, I get the following error : libpng warning: Application was compiled with png.h from libpng-1.5.13 libpng warning: Application is running with png.c from libpng-1.2.56 libpng error: Incompatible libpng version in application and library Mapcache has been compiled correctly using libpng 1.5.13, however I don't understand why mapcache_seed is trying to run with libpng 1.2.56 which is not even installed ! Any idea ? Thanks, Johannes -------------- next part -------------- An HTML attachment was scrubbed... URL: From Petros.Likidis at scb.se Wed Feb 26 04:43:55 2020 From: Petros.Likidis at scb.se (Petros.Likidis at scb.se) Date: Wed, 26 Feb 2020 12:43:55 +0000 Subject: [mapserver-users] Bewbie question about MapServer and WPS Message-ID: Hi all, I have to warn you that I am entirely new to GIS and all the terminology so my questions might be strange. Nevertheless, my company wish to expose a service that receives a polygon as input and outputs statistical data about the area defined by the polygon. For instance, it could be the number of residents in different age groups, the average income, the number of companies divided by industry, etc. The service will aggregated the statistical data on the fly according to input polygon. Then it will then preform some type of disclosure control of the aggregated data before it is send back to the caller. I guess that this service should be exposed as a WPS service or is there any other type of service that is more appropriate if it should be consumable from other GIS-applications? If it should be a WPS will I be able to expose it through MapServer? If MapServer can do this or am I bound to use a specific programing language or can MapServer start an arbitrary program that dose the processing? Kind regards Petros -------------- next part -------------- An HTML attachment was scrubbed... URL: From traviskirstine at gmail.com Wed Feb 26 06:24:27 2020 From: traviskirstine at gmail.com (Travis Kirstine) Date: Wed, 26 Feb 2020 09:24:27 -0500 Subject: [mapserver-users] Bewbie question about MapServer and WPS In-Reply-To: References: Message-ID: Petros I'm not sure if MapServer is what you are looking for as I is generally used the the creation and transfer of maps and it sounds like you are only concerned with retrieval of statistical information. MapServer probably could be used for the application you describe but it would be easier to simply use a WPS service of some sort (https://pywps.org/). Alternatively you could look at using postgresql with the geo-spatial postgis extension to perform your analysis any develop your own interface using whatever language you prefer. On Wed, 26 Feb 2020 at 07:51, wrote: > Hi all, > > I have to warn you that I am entirely new to GIS and all the terminology > so my questions might be strange. Nevertheless, my company wish to expose a > service that receives a polygon as input and outputs statistical data about > the area defined by the polygon. For instance, it could be the number of > residents in different age groups, the average income, the number of > companies divided by industry, etc. > > The service will aggregated the statistical data on the fly according to > input polygon. Then it will then preform some type of disclosure control of > the aggregated data before it is send back to the caller. I guess that this > service should be exposed as a WPS service or is there any other type of > service that is more appropriate if it should be consumable from other > GIS-applications? > > If it should be a WPS will I be able to expose it through MapServer? If > MapServer can do this or am I bound to use a specific programing language > or can MapServer start an arbitrary program that dose the processing? > > Kind regards > > Petros > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From jmckenna at gatewaygeomatics.com Wed Feb 26 07:31:35 2020 From: jmckenna at gatewaygeomatics.com (Jeff McKenna) Date: Wed, 26 Feb 2020 11:31:35 -0400 Subject: [mapserver-users] Bewbie question about MapServer and WPS In-Reply-To: References: Message-ID: <834a8c8f-022d-6461-25c3-bdffbea4e94a@gatewaygeomatics.com> Hi Petros, Since you are examining WPS, I recommend ZOO-Project (http://zoo-project.org/), from the MapServer family, which supports writing services in many languages (C, Python, PHP, JavaScript, ...), as well as creating GDAL/OGR services, and even outputting dynamic MapServer WMS services on-the-fly (meaning: it creates a MapServer mapfile that serves the result through a web map service). But here is a great working example: - MapServer is serving the background data (spatialite database) here through GeoJSON/WMS and the application leverages ZOO-Project to execute spatial commands (buffer etc). Give it a try at https://ms4w.dev/zoo-project/demo/ If you check Developer Tools in your browser, you will see at call to the ZOO loader (https://ms4w.dev/cgi-bin/zoo_loader.cgi) and sending a request such as https://pastebin.com/nhpyc2jx And the response from MapServer in GeoJSON: https://pastebin.com/G2VEVYRF All thanks to the power of ZOO-Project WPS !!! Hope that opens doors for you. -jeff -- Jeff McKenna MapServer Consulting and Training Services https://gatewaygeomatics.com/ On 2020-02-26 8:43 a.m., Petros.Likidis at scb.se wrote: > Hi all, > > I have to warn you that I am entirely new to GIS and all the terminology > so my questions might be strange. Nevertheless, my company wish to > expose a service that receives a polygon as input and outputs > statistical data about the area defined by the polygon. For instance, it > could be the number of residents in different age groups, the average > income, the number of companies divided by industry, etc. > > The service will aggregated the statistical data on the fly according to > input polygon. Then it will then preform some type of disclosure control > of the aggregated data before it is send back to the caller. I guess > that this service should be exposed as a WPS service or is there any > other type of service that is more appropriate if it should be > consumable from other GIS-applications? > > If it should be a WPS will I be able to expose it through MapServer? If > MapServer can do this or am I bound to use a specific programing > language or can MapServer start an arbitrary program that dose the > processing? > > Kind regards > > Petros > From ml3p at onghu.com Wed Feb 26 21:46:31 2020 From: ml3p at onghu.com (Mohit Sindhwani) Date: Thu, 27 Feb 2020 13:46:31 +0800 Subject: [mapserver-users] Show traffic on roads. In-Reply-To: References: Message-ID: On 2020-2-26 8:48 am, Erik H wrote: > Depends on your requirements. If you just want to visualize typical > traffic conditions, MapServer can do the job, it's pretty > straightforward. Just join your road geometries with the congestion > data (actual speed / free-flow speed), apply some filters (SQL > conditions) on road class and maybe congestion (omitting non-congested > roads), and render that in the appropriate color. > > If, on the other hand, you have a feed with speeds that vary > frequently, it gets tricky because you can't really use a regular tile > cache. I ended up abandoning MapServer for this - the problem was not > so much the rendering, but PostGIS was getting overwhelmed. If you get > your speed data from a company like HERE or INRIX, you should be able > to use their tilers. If not, you have a nice challenge. How is the data created and stored? How large is the area? We do a bunch of things as a traffic services company, and have found that different things work better for different scenarios. MapServer and GeoServer have both worked for us in the past. The challenge is always on how pretty you want it to be, how much compute you're willing to spend, how often the data updates, etc. It's correct that the regular tile cache doesn't expire data in the best way to support this :) Best Regards, Mohit. 2020-2-27 | 1:44 pm. From Petros.Likidis at scb.se Thu Feb 27 01:47:00 2020 From: Petros.Likidis at scb.se (Petros.Likidis at scb.se) Date: Thu, 27 Feb 2020 09:47:00 +0000 Subject: [mapserver-users] Bewbie question about MapServer and WPS In-Reply-To: <834a8c8f-022d-6461-25c3-bdffbea4e94a@gatewaygeomatics.com> References: <834a8c8f-022d-6461-25c3-bdffbea4e94a@gatewaygeomatics.com> Message-ID: Thanks Jeff, I will give it a look! Kind regards Petros -----Ursprungligt meddelande----- Fr?n: mapserver-users F?r Jeff McKenna Skickat: den 26 februari 2020 16:32 Till: mapserver-users at lists.osgeo.org ?mne: Re: [mapserver-users] Bewbie question about MapServer and WPS Hi Petros, Since you are examining WPS, I recommend ZOO-Project (http://zoo-project.org/), from the MapServer family, which supports writing services in many languages (C, Python, PHP, JavaScript, ...), as well as creating GDAL/OGR services, and even outputting dynamic MapServer WMS services on-the-fly (meaning: it creates a MapServer mapfile that serves the result through a web map service). But here is a great working example: - MapServer is serving the background data (spatialite database) here through GeoJSON/WMS and the application leverages ZOO-Project to execute spatial commands (buffer etc). Give it a try at https://ms4w.dev/zoo-project/demo/ If you check Developer Tools in your browser, you will see at call to the ZOO loader (https://ms4w.dev/cgi-bin/zoo_loader.cgi) and sending a request such as https://pastebin.com/nhpyc2jx And the response from MapServer in GeoJSON: https://pastebin.com/G2VEVYRF All thanks to the power of ZOO-Project WPS !!! Hope that opens doors for you. -jeff -- Jeff McKenna MapServer Consulting and Training Services https://gatewaygeomatics.com/ On 2020-02-26 8:43 a.m., Petros.Likidis at scb.se wrote: > Hi all, > > I have to warn you that I am entirely new to GIS and all the terminology > so my questions might be strange. Nevertheless, my company wish to > expose a service that receives a polygon as input and outputs > statistical data about the area defined by the polygon. For instance, it > could be the number of residents in different age groups, the average > income, the number of companies divided by industry, etc. > > The service will aggregated the statistical data on the fly according to > input polygon. Then it will then preform some type of disclosure control > of the aggregated data before it is send back to the caller. I guess > that this service should be exposed as a WPS service or is there any > other type of service that is more appropriate if it should be > consumable from other GIS-applications? > > If it should be a WPS will I be able to expose it through MapServer? If > MapServer can do this or am I bound to use a specific programing > language or can MapServer start an arbitrary program that dose the > processing? > > Kind regards > > Petros > _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/mapserver-users From atlantageek at gmail.com Thu Feb 27 05:41:15 2020 From: atlantageek at gmail.com (Atlanta Geek) Date: Thu, 27 Feb 2020 08:41:15 -0500 Subject: [mapserver-users] Show traffic on roads. In-Reply-To: References: Message-ID: The display traffic was an example and I was thinking it was just a GUI thing. What I am actually modelling is cable laid in the ground. And what I want to show is a heatmap representing the likelihood of there being an issue at this point on the fiber. The data will be stored as an array of numbers which each cell corresponds to a distance along a route. This array could be thousands of values.The heatmap will be in the shape of the lines. So I did not want to have as many line segments as I do cells in the array just to represent one cable. On Thu, Feb 27, 2020 at 12:53 AM Mohit Sindhwani wrote: > On 2020-2-26 8:48 am, Erik H wrote: > > Depends on your requirements. If you just want to visualize typical > > traffic conditions, MapServer can do the job, it's pretty > > straightforward. Just join your road geometries with the congestion > > data (actual speed / free-flow speed), apply some filters (SQL > > conditions) on road class and maybe congestion (omitting non-congested > > roads), and render that in the appropriate color. > > > > If, on the other hand, you have a feed with speeds that vary > > frequently, it gets tricky because you can't really use a regular tile > > cache. I ended up abandoning MapServer for this - the problem was not > > so much the rendering, but PostGIS was getting overwhelmed. If you get > > your speed data from a company like HERE or INRIX, you should be able > > to use their tilers. If not, you have a nice challenge. > > How is the data created and stored? How large is the area? We do a bunch > of things as a traffic services company, and have found that different > things work better for different scenarios. MapServer and GeoServer have > both worked for us in the past. The challenge is always on how pretty > you want it to be, how much compute you're willing to spend, how often > the data updates, etc. > > It's correct that the regular tile cache doesn't expire data in the best > way to support this :) > > Best Regards, > Mohit. > 2020-2-27 | 1:44 pm. > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -- http://www.atlantageek.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From ml3p at onghu.com Thu Feb 27 06:06:33 2020 From: ml3p at onghu.com (Mohit Sindhwani) Date: Thu, 27 Feb 2020 22:06:33 +0800 Subject: [mapserver-users] Show traffic on roads. In-Reply-To: References: Message-ID: <01aec333-38de-fd8b-fc3b-b799b69d9b71@onghu.com> On 2020-2-27 9:41 pm, Atlanta Geek wrote: > The display traffic was an example and I was thinking it was just a > GUI thing.? What I am actually modelling is cable laid in the ground.? > And what I want to show is a heatmap representing the likelihood of > there being an issue at this point on the fiber. > The data will be stored as an array of numbers which each cell > corresponds to a distance along a route.? This array could be > thousands of values.The heatmap will be in the shape of the lines. So > I did not want to have as many line segments as I do cells in the > array just to represent one cable. > What's the platform that will show this? A GeoJSON/ KML to have icons might be really simple and a vector layer that works very well. Depends what thousands are... at 100 bytes per object, 1K points is only 100K, 10K points is a megabyte... Best Regards, Mohit. 2020-2-27 | 10:01 pm. From sdlime at gmail.com Fri Feb 28 09:38:38 2020 From: sdlime at gmail.com (Steve Lime) Date: Fri, 28 Feb 2020 11:38:38 -0600 Subject: [mapserver-users] Mapcache : Incompatible libpng version in application and library In-Reply-To: References: Message-ID: I'd think you must multiple libpng installed. Did you search your system independent of the package manager? On Wed, Feb 26, 2020 at 4:12 AM Johannes Paul wrote: > Hello, > I've compiled Mapcache from source, and the installation worked just fine, > without any error, however when I run mapcache_seed, I get the following > error : > > libpng warning: Application was compiled with png.h from libpng-1.5.13 > libpng warning: Application is running with png.c from libpng-1.2.56 > libpng error: Incompatible libpng version in application and library > > Mapcache has been compiled correctly using libpng 1.5.13, however I don't > understand why mapcache_seed is trying to run with libpng 1.2.56 which is > not even installed ! > > Any idea ? > Thanks, > Johannes > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From even.rouault at spatialys.com Fri Feb 28 09:48:53 2020 From: even.rouault at spatialys.com (Even Rouault) Date: Fri, 28 Feb 2020 18:48:53 +0100 Subject: [mapserver-users] Mapcache : Incompatible libpng version in application and library In-Reply-To: References: Message-ID: <4555029.gsdy6tMXvh@even-i700> On vendredi 28 f?vrier 2020 11:38:38 CET Steve Lime wrote: > I'd think you must multiple libpng installed. Did you search your system > independent of the package manager? libpng-1.2.56 rings a bell to me. This is copy of libpng that is embedded in GDAL source tree. So you'd better make sure that your GDAL is built against system libpng, instead of the internal copy. Even -- Spatialys - Geospatial professional services http://www.spatialys.com