From breuil at craig.fr Wed Jul 1 07:05:33 2020 From: breuil at craig.fr (Landry Breuil) Date: Wed, 1 Jul 2020 16:05:33 +0200 Subject: [mapserver-users] state of the art to efficiently serve aerial images via WMS ? Message-ID: <1039cf62-b9e1-e88b-4468-a0f4f5053964@craig.fr> Hi, currently rebuilding an infra on new servers, i'm contemplating updating our stack to the state of the art (to be defined ?) So far, we're using mapserver 7.6/gdal 2.4 on debian buster, eventually mapproxy 1.12 in front of it (not all layers), our 25cm imagery is mostly stored in 4000px TIFs (YCbCr, TILED, JPEG 90%, 3/4 levels of overviews, about 6/7Mb per file), depending on datasets/layers/areas we have between 6000 and 600000 files, all stored locally. many datasets are between 50 and 300Gb. In mapserver, we use GROUP layers to 'merge' 3 layers: * a layer using TILEINDEX (pointing at a postgis table generated with gdaltindex) below 1:25000 - thus directly hitting the original tiles * for upper scales, two layers pointing at 6m & 24m resamples of the same dataset on the complete area, stored in single-file TIFFs (with the same compression params, those resamples are between 200Mb & some GB files) So far performance is quite acceptable for end-users (mostly QGIS consuming mapserver or mapproxy as WMS), but i'd like to eventually get rid of mapproxy (less cache handling/recompression/resample issues, less storage, etc...) I've of course looked at COG, as i'm able to convert most of my datasets to it - from my limited testing with GDAL 3.1.0 (now available in debian testing) it only 'reorders' the existing metadata/overviews in a file if it's already compressed as JPEG (and rebuilds the overviews w/ 512px instead of the default 128px i had so far), so from my understanding that wouldnt be lossy 'recompressing already compressed data'. But i fail to see in which direction to go for mapserver. - i've tried keeping the same mechanism with TILEINDEX, it still works and doesnt seem to have an impact on perf. I dunno if it would squeeze some perfs from reading the file, as gdal might read 'less' from the tiff if the MD is COG-optimized, even if stored locally ? - i've tried building a huge (7Mb) vrt for the dataset, pointing mapserver at it via DATA /path/to/vrt - works too, perf seems to be the same. Is it 'clever' than using TILEINDEX, i dunno. - should i rather build/use a huge single-file COG for the dataset, at its original resolution (25cm), and point mapserver at it like for upper-scale resamples ? for a 5800km2 area, a regular JPEG-in-TIFF singlefile is about 17Gb, with 6Gb external overviews. And of course, the same questions also apply to a similar dataset, this time at a 5cm resolution, so much larger sizes. As COG was meant to be used (among other things) via /vsicurl/, is there a point/improvement by pointing mapserver (or the vrt file) at all the same files via /vsicurl/ (and of course a webserver in-between) rather than pointing at local files - ie is GDAL as efficient at reading a local file header as it is at getting chunks from a /vsicurl/ url ? I've played with that scheme, it works, but i dunno if it really brings an improvement for users. I get it that COG/vsicurl allows separating the storage from the actual mapserver process, but in my situation i have no urge to change my infra in this direction, unless it really brings perf improvements. Sure, also serving COG files via a webserver allows nifty things like opening a remote vrt/tif in QGIS and natively use files on a remote web server, which would be somewhat an alternative to WMS (bringing all the shinies of having native files in the client), but all users are not ready yet for such modern concepts...and this doesnt allow setting scale limits serverside, ie if you open a vrt which points at 6000 images and zoom to the dataset extent, you will get as many calls as files to get their metadata - that's not very efficient. All that to say - how are people handling large aerial datasets, with many files, served over WMS (because that's the lowest common denominator so far) in 2020 ? Still using tile caches in front of mapserver ? -- Landry Breuil From bob.basques at ci.stpaul.mn.us Wed Jul 1 14:40:33 2020 From: bob.basques at ci.stpaul.mn.us (Basques, Bob (CI-StPaul)) Date: Wed, 1 Jul 2020 21:40:33 +0000 Subject: [mapserver-users] REMINDER - OSGeo Twin Cities (aka TCMUG) local chapter Meeting Message-ID: <01B23492-E7FD-4902-954B-1CC8860BD68D@ci.stpaul.mn.us> All, Had another good (virtual) meeting in June. More out of towners joining in. Jeff Mckenna & Steve Lime gave a presentation on the ?State of MapServer?. A link to a recording of the presentation can be found on our Local Chapter page below. Our Next meeting we?ll have: Presenter: Howard Butler A presentation on: The GDAL and PROJ Barnraising. ?What was the GDAL Barnraising?? Bio info available in his GeoHipster interview at: https://geohipster.com/2018/03/05/howard-butler-like-good-song-open-source-software-chance-immortal/ This will be a virtual meeting. Here is the connection info: https://meet.jit.si/osgeo_tcmug When: July 8th, 4:30 PM CDT OSGeo, Twin Cities (aka TCMUG), MN, USA Local Chapter Page. bobb -------------- next part -------------- An HTML attachment was scrubbed... URL: From jmckenna at gatewaygeomatics.com Fri Jul 3 04:12:23 2020 From: jmckenna at gatewaygeomatics.com (Jeff McKenna) Date: Fri, 3 Jul 2020 07:12:23 -0400 Subject: [mapserver-users] MS4W version 4.0.4 released In-Reply-To: <9cdc085c-7477-9733-5c92-43be649d2c20@gatewaygeomatics.com> References: <9cdc085c-7477-9733-5c92-43be649d2c20@gatewaygeomatics.com> Message-ID: <9367a305-adce-e1b0-909d-e5be1a76b1d5@gatewaygeomatics.com> Hello everyone, MS4W 4.0.4 is now available, which contains updates to many core libraries and software, including the many recent MapServer additions made in the past few months (CONNECTIONOPTIONS in the layer, wms_essential layers, fix for umlaut special characters in mapfile & filenames, etc.). Get it now at https://ms4w.com Please see MS4W's HISTORY.txt for all of the changes, but here are some of the highlights: - upgraded MapServer and MapScript (CSharp, Java, Python, PHP) to today's 7.7.0-dev - upgraded PHP to 7.2.31 security release (trac ticket 259) - upgraded MapCache to 1.11dev (git-master-20200629) - rebuilt GDAL to 2.4.4 - upgraded Apache HTTP Server to 2.4.43 (trac ticket 269) - upgraded SWIG support to git-master-20200629 - upgraded libjpeg-turbo to git-master-20200628 - rebuilt libTIFF support - upgraded SQLite support to 3.32.3 - upgraded OpenSSL support to 1.1.1g - upgraded cURL support to 7.71.0 (trac ticket 263) - rebuilt GeoTIFF support - upgraded Xerces support to 3.2.3 - rebuilt HDF5 support - rebuilt HDF4 support - rebuilt NetCDF support, to add NC4 and HDF4 support (trac ticket 267) - upgraded PostgreSQL support to 12.3 with SSL enabled - upgraded GEOS support to 3.8.1 (trac ticket 264) - rebuilt RT Topology Library support - rebuilt SpatiaLite support - rebuilt spatialite-tools - upgraded FITS support to 3.480 - upgraded Freetype support to 2.10.2 - rebuilt Cairo support - rebuilt Poppler support - upgraded Python to 3.7.8 (trac ticket 270) - upgraded Zstandard compression support to git-master-20200629 - upgraded to Oracle SDK 19.6.0.0.0 - upgraded HarfBuzz support to 2.6.7 - rebuilt libSVG support - rebuilt libSVG-Cairo support - rebuilt php_ogr extension - updated cURL certificates bundle - rebuilt mod_fcgid - rebuilt Apache H264 Streaming Module - upgraded mod_wsgi to 4.7.1 - upgraded PDAL utilities to git-master-20200629 - added steps for using pip, to the Python section of README_INSTALL.txt (trac ticket 254) When installing, it is very important that (if you are using the .zip) your server must have the C++ Redistributable installed on it beforehand: execute the local file /ms4w/tmp/vcredist_x86.exe (alternatively if you use MS4W's setup.exe installer this is done automatically) As always please provide your requests for enhancements and issues through the MS4W tracker (so the feedback is not lost or forgotten): https://ms4w.com/trac/ You can also contact me directly for support. Thank you for using MS4W. "MS4W: open doors as well as windows" -jeff -- Jeff McKenna MapServer Consulting and Training Services co-founder of FOSS4G http://gatewaygeo.com/ From ahmettemiz88 at gmail.com Sat Jul 4 11:08:13 2020 From: ahmettemiz88 at gmail.com (Ahmet Temiz) Date: Sat, 4 Jul 2020 21:08:13 +0300 Subject: [mapserver-users] sending a polygon to wcs-mapserver for masking Message-ID: Hi, How can I send a polygon to wcs-mapserver for masking through cgi/url ? I want to process polygon sent with wcs/wms. regards -- Ahmet Temiz Jeoloji M?h. Afet ve Acil Durum Y?netimi Ba?kanl??? Deprem Dairesi Ba?kanl??? ________________________ Ahmet Temiz Geological Eng. Disaster and Emergency Management of Presidency -------------- next part -------------- An HTML attachment was scrubbed... URL: From bob.basques at ci.stpaul.mn.us Mon Jul 6 09:28:59 2020 From: bob.basques at ci.stpaul.mn.us (Basques, Bob (CI-StPaul)) Date: Mon, 6 Jul 2020 16:28:59 +0000 Subject: [mapserver-users] REMINDER - OSGeo Twin Cities (aka TCMUG) local chapter Meeting Message-ID: <54BA30B4-EB31-4676-AB36-E619FA19DF4F@ci.stpaul.mn.us> All, Had another good (virtual) meeting in June. More out of towners joining in. Jeff Mckenna & Steve Lime gave a presentation on the ?State of MapServer?. A link to a recording of the presentation can be found on our Local Chapter page below. Our Next meeting we?ll have: Presenter: Howard Butler A presentation on: The GDAL and PROJ Barnraising. ?What was the GDAL Barnraising?? Bio info available in his GeoHipster interview at: https://geohipster.com/2018/03/05/howard-butler-like-good-song-open-source-software-chance-immortal/ This will be a virtual meeting. It will be recorded as well. Here is the connection info: https://meet.jit.si/osgeo_tcmug When: July 8th, 4:30 PM CDT OSGeo, Twin Cities (aka TCMUG), MN, USA Local Chapter Page. bobb -------------- next part -------------- An HTML attachment was scrubbed... URL: From traviskirstine at gmail.com Tue Jul 7 10:36:18 2020 From: traviskirstine at gmail.com (Travis Kirstine) Date: Tue, 7 Jul 2020 13:36:18 -0400 Subject: [mapserver-users] MapCache dimensions with MapServer run time substitution Message-ID: Is it possible to utilize mapcache regex dimensions with mapserver run time substitution (wms) to create a more dynamic and generic tile service Here is my basic configuration for mapserver and mapcache, I can't seem to get it working with QGIS when connecting to the WMTS For example I use run time substitution with my PG DATA settings LAYER NAME "sub_layer" ....... VALIDATION 'layer_table' ^.*$' 'layer_class' '^.*$' END CONNECTIONTYPE postgis CONNECTION "port=9999 user=user password=pw dbname=db host=mydb" DATA "the_geom from (SELECT gid, ms_color, the_geom FROM %layer_table% WHERE class='%layer_class%') AS foo USING UNIQUE gid using SRID=4326" .... END I set my MapCache config up with the same runtime variables as dimensions image/png true sub_layer http://testserver.com/cgi-bin/wms? source_wms composite GoogleMapsCompatible PNG 5 5 10 3600 604800 ^.*$ ^.*$ -------------- next part -------------- An HTML attachment was scrubbed... URL: From sdlime at gmail.com Tue Jul 7 10:46:25 2020 From: sdlime at gmail.com (Steve Lime) Date: Tue, 7 Jul 2020 12:46:25 -0500 Subject: [mapserver-users] sending a polygon to wcs-mapserver for masking In-Reply-To: References: Message-ID: Are you referring to dynamically setting a feature in a mask layer ( https://mapserver.org/development/rfc/ms-rfc-79.html)? On Sat, Jul 4, 2020 at 1:08 PM Ahmet Temiz wrote: > Hi, > How can I send a polygon to wcs-mapserver for masking through cgi/url ? > I want to process polygon sent with wcs/wms. > regards > > -- > Ahmet Temiz > Jeoloji M?h. > Afet ve Acil Durum Y?netimi Ba?kanl??? > Deprem Dairesi Ba?kanl??? > > > ________________________ > > Ahmet Temiz > Geological Eng. > > Disaster and Emergency Management > of Presidency > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From beu at live.jp Mon Jul 13 03:17:04 2020 From: beu at live.jp (Beu Beu) Date: Mon, 13 Jul 2020 10:17:04 +0000 Subject: [mapserver-users] Contours can break off and TILEINDEX does not work In-Reply-To: <1589970754290-0.post@n6.nabble.com> References: <1589970754290-0.post@n6.nabble.com> Message-ID: Dear all, I'm coding Java MapScript program as servlet webapp of Tomcat (on Windows), using "javamapscript.dll" and "mapscript.jar", to process "mapObj" object dyamically. I have some problems on contour rendering. Could someone please tell me how to fix them? I request multiple tiled (client-side tiling) GetMap operations, and get images. Problem 1: The contour can break off on tile edge (not allways). The simple geometric data (vector, raster) does not break off on tile edge. Mapfile: MAP ... LAYER STYLE LINE CONNECTIONTYPE CONTOUR DATA "dem.tif" PROCESSING "BANDS=1" PROCESSING "CONTOUR_ITEM=elevation" PROCESSING "CONTOUR_INTERVAL=0,25000:5" PROCESSING "CONTOUR_INTERVAL=25000,50000:10" PROCESSING "CONTOUR_INTERVAL_50000,1000000:25" ... CLASS STYLE WIDTH 0.25 COLOR 0 0 0 END END END END Problem 2: I create TILEINDEX shapefile with gdaltindex command (on QGIS) specifying one or multiple DEM files. For only 1 DEM file, the contours are shown. But, for multiple DEM files, contours only for one of them are shown. 2 DEMs, 10 DEMs, 100 DEMs, in the same way. Mapfile: MAP ... LAYER STYLE LINE CONNECTION CONTOUR TILEINDEX "tileindex.shp" TILEITEM "location" PROCESSING ... ... CLASS STYLE WIDTH 0.25 COLOR 0 0 0 END END END END With best regards, MapServer (MapScript) 7.4.3 (on Windows) ... release-1911-x64-gdal-3-0-0-mapserver-7-4-3 at GISInternals Tomcat 8.5.51 (on Windows) JavaSE 8u251 (on Windows) Windows Server 2016 Beu From beu at live.jp Mon Jul 13 03:26:00 2020 From: beu at live.jp (Beu Beu) Date: Mon, 13 Jul 2020 10:26:00 +0000 Subject: [mapserver-users] Contours can break off and TILEINDEX does not work Message-ID: Dear all. ? I'm coding Java MapScript program as servlet webapp of Tomcat (on Windows), using "javamapscript.dll" and "mapscript.jar", to process "mapObj" object dyamically.? ? I have some problems on contour rendering.? Could someone please tell me how to fix them?? ? I request multiple tiled (client-side tiling) GetMap operations, and get images.? ? Problem 1:? Some contours can break off on tile edge (not allways).? The simple geometric data (vector, raster) does not break off on tile edge.? ? Mapfile:? MAP? ...? LAYER? STYLE LINE? CONNECTIONTYPE CONTOUR? DATA "dem.tif"? PROCESSING "BANDS=1"? PROCESSING "CONTOUR_ITEM=elevation"? PROCESSING "CONTOUR_INTERVAL=0,25000:5"? PROCESSING "CONTOUR_INTERVAL=25000,50000:10"? PROCESSING "CONTOUR_INTERVAL_50000,1000000:25"? ...? CLASS? STYLE? WIDTH 0.25? COLOR 0 0 0? END? END? END? END? ? Problem 2:? I create TILEINDEX shapefile with gdaltindex command (on QGIS or on CUI) specifying one or multiple DEM files.? For only 1 DEM file, the contours are shown.? But, for multiple DEM files, contours only for one of them are shown.? 2 DEMs, 10 DEMs, 100 DEMs, in the same way.? ? Mapfile:? MAP? ...? LAYER? STYLE LINE? CONNECTION CONTOUR? TILEINDEX "tileindex.shp"? TILEITEM "location"? PROCESSING ...? ...? CLASS? STYLE? WIDTH 0.25? COLOR 0 0 0? END? END? END? END? ? ? With best regards,? ? ? MapServer (MapScript) 7.4.3 (on Windows)? ... release-1911-x64-gdal-3-0-0-mapserver-7-4-3 at GISInternals? Tomcat 8.5.51 (on Windows)? JavaSE 8u251 (on Windows)? Windows Server 2016? ? ? Beu -------------- next part -------------- An HTML attachment was scrubbed... URL: From MarkVolz at co.lyon.mn.us Mon Jul 13 06:04:39 2020 From: MarkVolz at co.lyon.mn.us (Mark Volz) Date: Mon, 13 Jul 2020 13:04:39 +0000 Subject: [mapserver-users] mapserver / mapcache performance when reprojecting many images. Message-ID: <7853ea4173834c329bf94422e72b2db6@co.lyon.mn.us> Hello, I created a Mapserver / Mapcache service that uses a tile index with about 1,000 jpg file. When I use my counties native projection the service is quite fast especially when compared to using MrSID mosaics. However, when I reproject my imagery to EPSG: 3857 the service much slower than my older MrSID service. I presume this may have something to do with Mapserver needing to load and reporject all the tiles. Please let me know if you have any tips that could help speed up the service. Here are a couple things I thought of: * Just use MrSID mosaics which will provide mediocre performance in the source projection, but may be faster when reprojecting. * Convert the data into a geotiff format which will take time. * Use MrSID files at smaller scales, and Jpeg tiles at larger scales. This should give us acceptable speed, but we will need to store more data. * Something else. Thank You! Sincerely, Mark Volz, GISP -------------- next part -------------- An HTML attachment was scrubbed... URL: From jorge.mendesdejesus at isric.org Mon Jul 13 09:50:25 2020 From: jorge.mendesdejesus at isric.org (jorge.mendesdejesus at isric.org) Date: Mon, 13 Jul 2020 16:50:25 +0000 Subject: [mapserver-users] Differerent output format for GetFeatureInfo - template strategy References: Message-ID: <25d16e3657a4.bb7d680897d02@isric.com> An HTML attachment was scrubbed... URL: From MarkVolz at co.lyon.mn.us Mon Jul 13 14:13:20 2020 From: MarkVolz at co.lyon.mn.us (Mark Volz) Date: Mon, 13 Jul 2020 21:13:20 +0000 Subject: [mapserver-users] mapserver / mapcache performance when reprojecting many Message-ID: Hi, I was able to increase the performance of my reprojected service by resampling the raster. If anyone else has any tips please let me know. Thank You Sincerely, Mark Volz, GISP Hello, I created a Mapserver / Mapcache service that uses a tile index with about 1,000 jpg file. When I use my counties native projection the service is quite fast especially when compared to using MrSID mosaics. However, when I reproject my imagery to EPSG: 3857 the service much slower than my older MrSID service. I presume this may have something to do with Mapserver needing to load and reporject all the tiles. Please let me know if you have any tips that could help speed up the service. Here are a couple things I thought of: * Just use MrSID mosaics which will provide mediocre performance in the source projection, but may be faster when reprojecting. * Convert the data into a geotiff format which will take time. * Use MrSID files at smaller scales, and Jpeg tiles at larger scales. This should give us acceptable speed, but we will need to store more data. * Something else. Thank You! Sincerely, Mark Volz, GISP -------------- next part -------------- An HTML attachment was scrubbed... URL: From joerg.thomsen at wheregroup.com Tue Jul 14 04:55:55 2020 From: joerg.thomsen at wheregroup.com (=?UTF-8?Q?J=c3=b6rg_Thomsen_=28WhereGroup=29?=) Date: Tue, 14 Jul 2020 13:55:55 +0200 Subject: [mapserver-users] ScribeUI Message-ID: Hello, is anyone out there using ScribeUI? last commit was 2015, last github-issue Jan 2018 I wonder wether it's the perfect Software or not alive. Viele Gr??e, J?rg -- ---------------------------------------------------------------------- Aufwind durch Wissen! Jetzt neu: Web-Seminare und Online-Schulungen bei der www.foss-academy.com ---------------------------------------------------------------------- J?rg Thomsen WhereGroup GmbH Bundesallee 23 10717 Berlin Germany Fon: +49 (0)30 / 5130 278 74 Fax: +49 (0)30 / 5130 278 11 joerg.thomsen at wheregroup.com www.wheregroup.com Gesch?ftsf?hrer: Olaf Knopp, Peter Stamm Amtsgericht Bonn, HRB 9885 ------------------------------- Folgen Sie der WhereGroup auf twitter: http://twitter.com/WhereGroup_com From traviskirstine at gmail.com Tue Jul 14 05:34:02 2020 From: traviskirstine at gmail.com (Travis Kirstine) Date: Tue, 14 Jul 2020 08:34:02 -0400 Subject: [mapserver-users] mapserver / mapcache performance when reprojecting many In-Reply-To: References: Message-ID: Mark See: https://mapserver.org/input/raster.html#raster-display-performance-tips In summary use internally tiled geotiffs with overviews using gdaladdo in the projection you'd like to publish from mapserver On Mon, 13 Jul 2020 at 17:14, Mark Volz wrote: > Hi, > > > > I was able to increase the performance of my reprojected service by > resampling the raster. If anyone else has any tips please let me know. > > > > Thank You > > Sincerely, > > *Mark Volz, GISP* > > > > Hello, > > I created a Mapserver / Mapcache service that uses a tile index with about > 1,000 jpg file. When I use my counties native projection the service is > quite fast especially when compared to using MrSID mosaics. However, when > I reproject my imagery to EPSG: 3857 the service much slower than my older > MrSID service. I presume this may have something to do with Mapserver > needing to load and reporject all the tiles. > > > > Please let me know if you have any tips that could help speed up the > service. Here are a couple things I thought of: > > > > * Just use MrSID mosaics which will provide mediocre performance > in the source projection, but may be faster when reprojecting. > > > > * Convert the data into a geotiff format which will take time. > > > > * Use MrSID files at smaller scales, and Jpeg tiles at larger > scales. This should give us acceptable speed, but we will need to store > more data. > > > > * Something else. > > > > Thank You! > > > > Sincerely, > > Mark Volz, GISP > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From dmorissette at mapgears.com Tue Jul 14 06:57:53 2020 From: dmorissette at mapgears.com (Daniel Morissette) Date: Tue, 14 Jul 2020 09:57:53 -0400 Subject: [mapserver-users] ScribeUI In-Reply-To: References: Message-ID: We still use it internally at Mapgears for production mapfile work. So I guess the short answer to your question is that it works and does what it needs to do if you can live with its limits and know how to work around them, but you are right that it has not received much love recently. Contributions are always welcome as usual. BTW, I see a couple of commits in March of this year in https://github.com/mapgears/scribeui . Not a huge sign of life, but at least more recent than 2015, which makes me wonder if you may have been looking at a fork. Daniel On 2020-07-14 07:55, J?rg Thomsen (WhereGroup) wrote: > Hello, > > is anyone out there using ScribeUI? > last commit was 2015, last github-issue Jan 2018 > > I wonder wether it's the perfect Software or not alive. > > Viele Gr??e, > J?rg > -- Daniel Morissette Mapgears Inc T: +1 418-696-5056 #201 From paul.english at vaisala.com Wed Jul 22 10:47:55 2020 From: paul.english at vaisala.com (English Paul) Date: Wed, 22 Jul 2020 17:47:55 +0000 Subject: [mapserver-users] Slow and degrading performance with radar (but not satellite) on mapserver-6.0.1-3_0.el6.x86_64 Message-ID: <07D75779-1922-4E41-A587-3896A841378B@vaisala.com> Hi, Newbie here, just got a work assignment to look into some performance issues with mapserver-6.0.1-3_0.el6.x86_64 ? specifically, at one time, it rendered radar images very fast, then it degraded and seemed to consume a lot more CPU. So ? the EC2 instance side was upgraded significantly ? and it still performs badly and uses a lot of CPU. It also seems to be getting slowly worse over time (days/months, not seconds/minutes). I asked this on IRC, but it looks like email might be a better route. During all of this, the same mapserver instance renders satellite images quickly. These seem to be a similar, or in some cases larger size png to start with, rendered onto the same final map/size. So ? the obvious answer is that it isn?t using the CPU to render/re-render, but rather spending it on something else ? I/O most likely ? eg: a network request, disk I/O, SQL query? The previous person working on it tried turning on debug at various levels ? but unfortunately that made it even slower, making it tricky to answer ?what is making it slow when debug is turned off?? My first instinct was to try an strace and nothing was obvious. Next up ? a flame graph from strace, and/or trying dtrace ? but my understanding is that dtrace is a little weak on RHEL/CentOS/Amazon Linux 6.0 *and* I?m not particularly good at that. Also, we?re using fcgi, so attaching to the correct process is a bit tricky. My next instinct was to look at release notes and see if the current stable has anything fixes/improvements that directly address this ? there aren?t any that are obvious to my eyes, but you developers have been busy! So many things! Including some performance fixes and one ?significant? performance fix. Current config file: AddHandler fcgid-script fcgi FcgidIPCDir /var/run/mod_fcgid FcgidProcessTableFile /var/run/mod_fcgid/fcgid_shm FcgidMaxProcesses 10 FcgidMaxProcessesPerClass 10 FcgidMaxRequestInMem 196608 FcgidInitialEnv PROJ_LIB /usr/share/proj FcgidInitialEnv LD_LIBRARY_PATH "/usr/local/lib:/usr/pgsql-9.1/lib" So ? suggestions for my next move? I currently plan to take a quick swing at building 7.6 for RHEL 6.0, knowing there might be old libraries and whatnot that make that a non-starter. Of course ? we?ve got other infra running on this same instance, so upgrading everything is a much bigger task. Strace flame graph? Stretch and try dtrace? A better way to use debug? Something else I?m missing ? eg: differences between the image types that make them perform so differently? Thanks, Paul -------------- next part -------------- An HTML attachment was scrubbed... URL: From stephenwoodbridge37 at gmail.com Wed Jul 22 13:45:16 2020 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Wed, 22 Jul 2020 16:45:16 -0400 Subject: [mapserver-users] Slow and degrading performance with radar (but not satellite) on mapserver-6.0.1-3_0.el6.x86_64 In-Reply-To: <07D75779-1922-4E41-A587-3896A841378B@vaisala.com> References: <07D75779-1922-4E41-A587-3896A841378B@vaisala.com> Message-ID: Hi Paul, So you have a complex historical "mess" and its not clear where the performance issue is. So you need to divide the problem into small problems that you can verify are or are not contributing. I would start with something like this: Take one slow image request and try that as cgi or cli and not fcgi and turn on debugging. ? - copy and rename you mapfile so it doesn't mess with the production requests ? - turn on the debugging and send it to stderr in the debug mapfile ?- you can manually run that image request from the commandline like: if mapserv is not in your path you might need to find it and your the path to it below mapserv -nh QUERY_STRING="everything after the ? in the original query" >junk.png 2>error.txt -nh suppresses headers from being output before the image data error.txt will be stderr output and should contain the debug messages Then report back what you find out. -Steve W On 7/22/2020 1:47 PM, English Paul wrote: > > Hi, > > ?? Newbie here, just got a work assignment to look into some > performance issues with mapserver-6.0.1-3_0.el6.x86_64 ? specifically, > at one time, it rendered radar images very fast, then it degraded and > seemed to consume a lot more CPU. So ? the EC2 instance side was > upgraded significantly ? and it still performs badly and uses a lot of > CPU. It also seems to be getting slowly worse over time (days/months, > not seconds/minutes). I asked this on IRC, but it looks like email > might be a better route. > > ? During all of this, the same mapserver instance renders satellite > images quickly. These seem to be a similar, or in some cases larger > size png to start with, rendered onto the same final map/size. > > ? So ? the obvious answer is that it isn?t using the CPU to > render/re-render, but rather spending it on something else ? I/O most > likely ? eg: a network request, disk I/O, SQL query? > > ? The previous person working on it tried turning on debug at various > levels ? but unfortunately that made it even slower, making it tricky > to answer ?what is making it slow when debug is turned off?? > > ?My first instinct was to try an strace and nothing was obvious. Next > up ? a flame graph from strace, and/or trying dtrace ? but my > understanding is that dtrace is a little weak on RHEL/CentOS/Amazon > Linux 6.0 **and** I?m not particularly good at that. Also, we?re using > fcgi, so attaching to the correct process is a bit tricky. > > ? My next instinct was to look at release notes and see if the current > stable has anything fixes/improvements that directly address this ? > there aren?t any that are obvious to my eyes, but you developers have > been busy! So many things! Including some performance fixes and one > ?significant? performance fix. > > Current config file: > > AddHandler fcgid-script fcgi > > FcgidIPCDir /var/run/mod_fcgid > > FcgidProcessTableFile /var/run/mod_fcgid/fcgid_shm > > FcgidMaxProcesses 10 > > FcgidMaxProcessesPerClass 10 > > FcgidMaxRequestInMem 196608 > > FcgidInitialEnv PROJ_LIB /usr/share/proj > > FcgidInitialEnv LD_LIBRARY_PATH "/usr/local/lib:/usr/pgsql-9.1/lib" > > So ? suggestions for my next move? I currently plan to take a quick > swing at building 7.6 for RHEL 6.0, knowing there might be old > libraries and whatnot that make that a non-starter. Of course ? we?ve > got other infra running on this same instance, so upgrading everything > is a much bigger task. > > ?Strace flame graph? > > ? Stretch and try dtrace? > > ? A better way to use debug? > > ? Something else I?m missing ? eg: differences between the image types > that make them perform so differently? > > Thanks, > > Paul > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From paul.english at vaisala.com Wed Jul 22 16:15:50 2020 From: paul.english at vaisala.com (English Paul) Date: Wed, 22 Jul 2020 23:15:50 +0000 Subject: [mapserver-users] Slow and degrading performance with radar (but not satellite) on mapserver-6.0.1-3_0.el6.x86_64 In-Reply-To: References: <07D75779-1922-4E41-A587-3896A841378B@vaisala.com> Message-ID: <709E4A73-CB43-4E23-9D9E-87CA24B698E8@vaisala.com> So you have a complex historical "mess" and its not clear where the performance issue is. So you need to divide the problem into small problems that you can verify are or are not contributing. I would start with something like this: Thank you ? I would not have thought to try it outside of CGI entirely! Take one slow image request and try that as cgi or cli and not fcgi and turn on debugging. - copy and rename you mapfile so it doesn't mess with the production requests Not a major worry in this case ? I?m working in an entirely dev environment. I did make backup copies though! - turn on the debugging and send it to stderr in the debug mapfile - you can manually run that image request from the commandline like: if mapserv is not in your path you might need to find it and your the path to it below mapserv -nh QUERY_STRING="everything after the ? in the original query" >junk.png 2>error.txt -nh suppresses headers from being output before the image data error.txt will be stderr output and should contain the debug messages I couldn?t quite get there ? which this is what I ended up running: # /usr/libexec/mapserv -nh QUERY_STRING="FORMAT=image%2Fpng&LAYERS=winter1km_5min&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&TIME=2020-07-22T22%3A30%3A00Z&SRS=EPSG%3A900913&BBOX=-11584184.507886,4070118.8849183,-11271098.44003,4383204.9527744&WIDTH=256&HEIGHT=256" > junk.png 2>error.txt I first tried it with our current map file(s), and then with MS_ERRORFILE set to stderr and DEBUG set to 5, in both cases, I got an empty error.txt, and the following in junk.png: Content-type: text/html MapServer Message loadMap(): Web application error. CGI variable "map" is not set. I noticed that if I ran it with just -nh, I get the following: #/usr/libexec/mapserv -nh This script can only be used to decode form results and should be initiated as a CGI process via a httpd server. So maybe this older version just really doesn?t want to be run on the CLI? Or maybe I?m messing up the QUERY_STRING, or need to set the CGI variable to something as the junk.png output suggests? Thanks again and thanks SO MUCH for the super quick reply!! Paul On 7/22/2020 1:47 PM, English Paul wrote: Hi, Newbie here, just got a work assignment to look into some performance issues with mapserver-6.0.1-3_0.el6.x86_64 ? specifically, at one time, it rendered radar images very fast, then it degraded and seemed to consume a lot more CPU. So ? the EC2 instance side was upgraded significantly ? and it still performs badly and uses a lot of CPU. It also seems to be getting slowly worse over time (days/months, not seconds/minutes). I asked this on IRC, but it looks like email might be a better route. During all of this, the same mapserver instance renders satellite images quickly. These seem to be a similar, or in some cases larger size png to start with, rendered onto the same final map/size. So ? the obvious answer is that it isn?t using the CPU to render/re-render, but rather spending it on something else ? I/O most likely ? eg: a network request, disk I/O, SQL query? The previous person working on it tried turning on debug at various levels ? but unfortunately that made it even slower, making it tricky to answer ?what is making it slow when debug is turned off?? My first instinct was to try an strace and nothing was obvious. Next up ? a flame graph from strace, and/or trying dtrace ? but my understanding is that dtrace is a little weak on RHEL/CentOS/Amazon Linux 6.0 *and* I?m not particularly good at that. Also, we?re using fcgi, so attaching to the correct process is a bit tricky. My next instinct was to look at release notes and see if the current stable has anything fixes/improvements that directly address this ? there aren?t any that are obvious to my eyes, but you developers have been busy! So many things! Including some performance fixes and one ?significant? performance fix. Current config file: AddHandler fcgid-script fcgi FcgidIPCDir /var/run/mod_fcgid FcgidProcessTableFile /var/run/mod_fcgid/fcgid_shm FcgidMaxProcesses 10 FcgidMaxProcessesPerClass 10 FcgidMaxRequestInMem 196608 FcgidInitialEnv PROJ_LIB /usr/share/proj FcgidInitialEnv LD_LIBRARY_PATH "/usr/local/lib:/usr/pgsql-9.1/lib" So ? suggestions for my next move? I currently plan to take a quick swing at building 7.6 for RHEL 6.0, knowing there might be old libraries and whatnot that make that a non-starter. Of course ? we?ve got other infra running on this same instance, so upgrading everything is a much bigger task. Strace flame graph? Stretch and try dtrace? A better way to use debug? Something else I?m missing ? eg: differences between the image types that make them perform so differently? Thanks, Paul _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From stephenwoodbridge37 at gmail.com Wed Jul 22 19:53:07 2020 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Wed, 22 Jul 2020 22:53:07 -0400 Subject: [mapserver-users] Slow and degrading performance with radar (but not satellite) on mapserver-6.0.1-3_0.el6.x86_64 In-Reply-To: <709E4A73-CB43-4E23-9D9E-87CA24B698E8@vaisala.com> References: <07D75779-1922-4E41-A587-3896A841378B@vaisala.com> <709E4A73-CB43-4E23-9D9E-87CA24B698E8@vaisala.com> Message-ID: <7dda8a11-582f-6196-bc92-6ae68540dab6@gmail.com> you need to include in your QUERY_STRING=MAP=....& it is probably hard coded in the fcgi config. -Steve W On 7/22/2020 7:15 PM, English Paul wrote: > > So you have a complex historical "mess" and its not clear where the > performance issue is. So you need to divide the problem into small > problems that you can verify are or are not contributing. I would > start with something like this: > > Thank you ? I would not have thought to try it outside of CGI entirely! > > Take one slow image request and try that as cgi or cli and not fcgi > and turn on debugging. > > ? - copy and rename you mapfile so it doesn't mess with the production > requests > > Not a major worry in this case ? I?m working in an entirely dev > environment. I did make backup copies though! > > ? - turn on the debugging and send it to stderr in the debug mapfile > > ?- you can manually run that image request from the commandline like: > > if mapserv is not in your path you might need to find it and your the > path to it below > > mapserv -nh QUERY_STRING="everything after the ? in the original > query" >junk.png 2>error.txt > > -nh suppresses headers from being output before the image data > > error.txt will be stderr output and should contain the debug messages > > I couldn?t quite get there ? which this is what I ended up running: > > # /usr/libexec/mapserv -nh > QUERY_STRING="FORMAT=image%2Fpng&LAYERS=winter1km_5min&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&TIME=2020-07-22T22%3A30%3A00Z&SRS=EPSG%3A900913&BBOX=-11584184.507886,4070118.8849183,-11271098.44003,4383204.9527744&WIDTH=256&HEIGHT=256" > > junk.png 2>error.txt > > I first tried it with our current map file(s), and then with > MS_ERRORFILE set to stderr and DEBUG set to 5, in both cases, I got an > empty error.txt, and the following in junk.png: > > Content-type: text/html > > > > MapServer Message > > > > > > loadMap(): Web application error. CGI variable "map" is not set. > > > > I noticed that if I ran it with just -nh, I get the following: > > #/usr/libexec/mapserv -nh > > This script can only be used to decode form results and > > should be initiated as a CGI process via a httpd server. > > So maybe this older version just really doesn?t want to be run on the > CLI? Or maybe I?m messing up the QUERY_STRING, or need to set the CGI > variable to something as the junk.png output suggests? > > Thanks again and thanks SO MUCH for the super quick reply!! > > Paul > > On 7/22/2020 1:47 PM, English Paul wrote: > > Hi, > > ?? Newbie here, just got a work assignment to look into some > performance issues with mapserver-6.0.1-3_0.el6.x86_64 ? > specifically, at one time, it rendered radar images very fast, > then it degraded and seemed to consume a lot more CPU. So ? the > EC2 instance side was upgraded significantly ? and it still > performs badly and uses a lot of CPU. It also seems to be getting > slowly worse over time (days/months, not seconds/minutes). I asked > this on IRC, but it looks like email might be a better route. > > ? During all of this, the same mapserver instance renders > satellite images quickly. These seem to be a similar, or in some > cases larger size png to start with, rendered onto the same final > map/size. > > ? So ? the obvious answer is that it isn?t using the CPU to > render/re-render, but rather spending it on something else ? I/O > most likely ? eg: a network request, disk I/O, SQL query? > > ? The previous person working on it tried turning on debug at > various levels ? but unfortunately that made it even slower, > making it tricky to answer ?what is making it slow when debug is > turned off?? > > ?My first instinct was to try an strace and nothing was obvious. > Next up ? a flame graph from strace, and/or trying dtrace ? but my > understanding is that dtrace is a little weak on > RHEL/CentOS/Amazon Linux 6.0 **and** I?m not particularly good at > that. Also, we?re using fcgi, so attaching to the correct process > is a bit tricky. > > ? My next instinct was to look at release notes and see if the > current stable has anything fixes/improvements that directly > address this ? there aren?t any that are obvious to my eyes, but > you developers have been busy! So many things! Including some > performance fixes and one ?significant? performance fix. > > Current config file: > > AddHandler fcgid-script fcgi > > FcgidIPCDir /var/run/mod_fcgid > > FcgidProcessTableFile /var/run/mod_fcgid/fcgid_shm > > FcgidMaxProcesses 10 > > FcgidMaxProcessesPerClass 10 > > FcgidMaxRequestInMem 196608 > > FcgidInitialEnv PROJ_LIB /usr/share/proj > > FcgidInitialEnv LD_LIBRARY_PATH "/usr/local/lib:/usr/pgsql-9.1/lib" > > So ? suggestions for my next move? I currently plan to take a > quick swing at building 7.6 for RHEL 6.0, knowing there might be > old libraries and whatnot that make that a non-starter. Of course > ? we?ve got other infra running on this same instance, so > upgrading everything is a much bigger task. > > ?Strace flame graph? > > ? Stretch and try dtrace? > > ? A better way to use debug? > > ? Something else I?m missing ? eg: differences between the image > types that make them perform so differently? > > Thanks, > > Paul > > > > _______________________________________________ > > mapserver-users mailing list > > mapserver-users at lists.osgeo.org > > https://lists.osgeo.org/mailman/listinfo/mapserver-users > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From joerg.thomsen at wheregroup.com Thu Jul 23 07:34:59 2020 From: joerg.thomsen at wheregroup.com (=?UTF-8?Q?J=c3=b6rg_Thomsen_=28WhereGroup=29?=) Date: Thu, 23 Jul 2020 16:34:59 +0200 Subject: [mapserver-users] Clustering and style with [attribute] Message-ID: Hello, there's a clustered feature / class in my mapfile. the color of the features are stored in the database. LAYER NAME "lightrail" GROUP "default" ... CLUSTER MAXDISTANCE 50 REGION "ellipse" END CLASS NAME "Clustered Lightrail Stations" EXPRESSION ("[Cluster_FeatureCount]" != "1") STYLE SIZE 30 SYMBOL "citycircle" COLOR ['color'] END END ... END If there are 4 features clustered into one symbol and each feature has a different attribut-value 'color': f1 | 100 100 100 f2 | 100 100 100 f3 | 0 0 255 f4 | 100 100 100 which color is used an why is it used? My goal: If all features of a cluster have the color-value 100 100 100, it is ok, that the cluster-symbol ist grey. If only one of the clustered features has the color-value 0 255 0 (and the other values are '100 100 100') the cluster-symbol should be blue. How can I achive this? Viele Gr??e, J?rg -- ---------------------------------------------------------------------- Aufwind durch Wissen! Jetzt neu: Web-Seminare und Online-Schulungen bei der www.foss-academy.com ---------------------------------------------------------------------- J?rg Thomsen WhereGroup GmbH Bundesallee 23 10717 Berlin Germany Fon: +49 (0)30 / 5130 278 74 Fax: +49 (0)30 / 5130 278 11 joerg.thomsen at wheregroup.com www.wheregroup.com Gesch?ftsf?hrer: Olaf Knopp, Peter Stamm Amtsgericht Bonn, HRB 9885 ------------------------------- Folgen Sie der WhereGroup auf twitter: http://twitter.com/WhereGroup_com From joerg.thomsen at wheregroup.com Thu Jul 23 08:20:47 2020 From: joerg.thomsen at wheregroup.com (=?UTF-8?Q?J=c3=b6rg_Thomsen_=28WhereGroup=29?=) Date: Thu, 23 Jul 2020 17:20:47 +0200 Subject: [mapserver-users] Clustering and style with [attribute] In-Reply-To: References: Message-ID: Hello me, OK, with an 'order by' it works f?r grey and blue 100 100 100 0 255 0 the last value is taken. But what to do with a third color? 255 0 0 100 100 100 Regards, J?rg Am 23.07.20 um 16:34 schrieb J?rg Thomsen (WhereGroup): > Hello, > > there's a clustered feature / class in my mapfile. > the color of the features are stored in the database. > > LAYER > NAME "lightrail" > GROUP "default" > ... > CLUSTER > MAXDISTANCE 50 > REGION "ellipse" > END > CLASS > NAME "Clustered Lightrail Stations" > EXPRESSION ("[Cluster_FeatureCount]" != "1") > STYLE > SIZE 30 > SYMBOL "citycircle" > COLOR ['color'] > END > END > ... > END > > If there are 4 features clustered into one symbol and each feature has a > different attribut-value 'color': > > f1 | 100 100 100 > f2 | 100 100 100 > f3 | 0 0 255 > f4 | 100 100 100 > > which color is used an why is it used? > > My goal: > If all features of a cluster have the color-value 100 100 100, it is ok, > that the cluster-symbol ist grey. If only one of the clustered features > has the color-value 0 255 0 (and the other values are '100 100 100') the > cluster-symbol should be blue. > > How can I achive this? > > Viele Gr??e, > J?rg > Viele Gr??e, J?rg Thomsen -- ---------------------------------------------------------------------- Aufwind durch Wissen! Jetzt neu: Web-Seminare und Online-Schulungen bei der www.foss-academy.com ---------------------------------------------------------------------- J?rg Thomsen WhereGroup GmbH Bundesallee 23 10717 Berlin Germany Fon: +49 (0)30 / 5130 278 74 Fax: +49 (0)30 / 5130 278 11 joerg.thomsen at wheregroup.com www.wheregroup.com Gesch?ftsf?hrer: Olaf Knopp, Peter Stamm Amtsgericht Bonn, HRB 9885 ------------------------------- Folgen Sie der WhereGroup auf twitter: http://twitter.com/WhereGroup_com From paul.english at vaisala.com Thu Jul 23 09:48:21 2020 From: paul.english at vaisala.com (English Paul) Date: Thu, 23 Jul 2020 16:48:21 +0000 Subject: [mapserver-users] Slow and degrading performance with radar (but not satellite) on mapserver-6.0.1-3_0.el6.x86_64 In-Reply-To: <7dda8a11-582f-6196-bc92-6ae68540dab6@gmail.com> References: <07D75779-1922-4E41-A587-3896A841378B@vaisala.com> <709E4A73-CB43-4E23-9D9E-87CA24B698E8@vaisala.com> <7dda8a11-582f-6196-bc92-6ae68540dab6@gmail.com> Message-ID: <0729D2BB-60C5-4159-89AB-3CAD157069EA@vaisala.com> Thanks again Steve ? progress: $ /usr/libexec/mapserv -nh QUERY_STRING="MAP=wmst?FORMAT=image%2Fpng&LAYERS=winter1km_5min&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&TIME=2020-07-23T16%3A40%3A00Z&SRS=EPSG%3A900913&BBOX=-9392582.0328932,4383204.9527744,-9236038.9989652,4539747.9867024&WIDTH=256&HEIGHT=256" > junk.png Gives the following in junk.png: Content-type: text/html MapServer Message msLoadMap(): Regular expression error. MS_DEFAULT_MAPFILE_PATTERN validation failed. msEvalRegex(): R From: mapserver-users on behalf of Stephen Woodbridge Date: Wednesday, July 22, 2020 at 19:53 To: "mapserver-users at lists.osgeo.org" Subject: Re: [mapserver-users] Slow and degrading performance with radar (but not satellite) on mapserver-6.0.1-3_0.el6.x86_64 you need to include in your QUERY_STRING=MAP=....& it is probably hard coded in the fcgi config. -Steve W On 7/22/2020 7:15 PM, English Paul wrote: So you have a complex historical "mess" and its not clear where the performance issue is. So you need to divide the problem into small problems that you can verify are or are not contributing. I would start with something like this: Thank you ? I would not have thought to try it outside of CGI entirely! Take one slow image request and try that as cgi or cli and not fcgi and turn on debugging. - copy and rename you mapfile so it doesn't mess with the production requests Not a major worry in this case ? I?m working in an entirely dev environment. I did make backup copies though! - turn on the debugging and send it to stderr in the debug mapfile - you can manually run that image request from the commandline like: if mapserv is not in your path you might need to find it and your the path to it below mapserv -nh QUERY_STRING="everything after the ? in the original query" >junk.png 2>error.txt -nh suppresses headers from being output before the image data error.txt will be stderr output and should contain the debug messages I couldn?t quite get there ? which this is what I ended up running: # /usr/libexec/mapserv -nh QUERY_STRING="FORMAT=image%2Fpng&LAYERS=winter1km_5min&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&TIME=2020-07-22T22%3A30%3A00Z&SRS=EPSG%3A900913&BBOX=-11584184.507886,4070118.8849183,-11271098.44003,4383204.9527744&WIDTH=256&HEIGHT=256" > junk.png 2>error.txt I first tried it with our current map file(s), and then with MS_ERRORFILE set to stderr and DEBUG set to 5, in both cases, I got an empty error.txt, and the following in junk.png: Content-type: text/html MapServer Message loadMap(): Web application error. CGI variable "map" is not set. I noticed that if I ran it with just -nh, I get the following: #/usr/libexec/mapserv -nh This script can only be used to decode form results and should be initiated as a CGI process via a httpd server. So maybe this older version just really doesn?t want to be run on the CLI? Or maybe I?m messing up the QUERY_STRING, or need to set the CGI variable to something as the junk.png output suggests? Thanks again and thanks SO MUCH for the super quick reply!! Paul On 7/22/2020 1:47 PM, English Paul wrote: Hi, Newbie here, just got a work assignment to look into some performance issues with mapserver-6.0.1-3_0.el6.x86_64 ? specifically, at one time, it rendered radar images very fast, then it degraded and seemed to consume a lot more CPU. So ? the EC2 instance side was upgraded significantly ? and it still performs badly and uses a lot of CPU. It also seems to be getting slowly worse over time (days/months, not seconds/minutes). I asked this on IRC, but it looks like email might be a better route. During all of this, the same mapserver instance renders satellite images quickly. These seem to be a similar, or in some cases larger size png to start with, rendered onto the same final map/size. So ? the obvious answer is that it isn?t using the CPU to render/re-render, but rather spending it on something else ? I/O most likely ? eg: a network request, disk I/O, SQL query? The previous person working on it tried turning on debug at various levels ? but unfortunately that made it even slower, making it tricky to answer ?what is making it slow when debug is turned off?? My first instinct was to try an strace and nothing was obvious. Next up ? a flame graph from strace, and/or trying dtrace ? but my understanding is that dtrace is a little weak on RHEL/CentOS/Amazon Linux 6.0 *and* I?m not particularly good at that. Also, we?re using fcgi, so attaching to the correct process is a bit tricky. My next instinct was to look at release notes and see if the current stable has anything fixes/improvements that directly address this ? there aren?t any that are obvious to my eyes, but you developers have been busy! So many things! Including some performance fixes and one ?significant? performance fix. Current config file: AddHandler fcgid-script fcgi FcgidIPCDir /var/run/mod_fcgid FcgidProcessTableFile /var/run/mod_fcgid/fcgid_shm FcgidMaxProcesses 10 FcgidMaxProcessesPerClass 10 FcgidMaxRequestInMem 196608 FcgidInitialEnv PROJ_LIB /usr/share/proj FcgidInitialEnv LD_LIBRARY_PATH "/usr/local/lib:/usr/pgsql-9.1/lib" So ? suggestions for my next move? I currently plan to take a quick swing at building 7.6 for RHEL 6.0, knowing there might be old libraries and whatnot that make that a non-starter. Of course ? we?ve got other infra running on this same instance, so upgrading everything is a much bigger task. Strace flame graph? Stretch and try dtrace? A better way to use debug? Something else I?m missing ? eg: differences between the image types that make them perform so differently? Thanks, Paul _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/mapserver-users _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From stephenwoodbridge37 at gmail.com Thu Jul 23 13:54:07 2020 From: stephenwoodbridge37 at gmail.com (Stephen Woodbridge) Date: Thu, 23 Jul 2020 16:54:07 -0400 Subject: [mapserver-users] Slow and degrading performance with radar (but not satellite) on mapserver-6.0.1-3_0.el6.x86_64 In-Reply-To: <0729D2BB-60C5-4159-89AB-3CAD157069EA@vaisala.com> References: <07D75779-1922-4E41-A587-3896A841378B@vaisala.com> <709E4A73-CB43-4E23-9D9E-87CA24B698E8@vaisala.com> <7dda8a11-582f-6196-bc92-6ae68540dab6@gmail.com> <0729D2BB-60C5-4159-89AB-3CAD157069EA@vaisala.com> Message-ID: Paul, This sounds like you have error in your mapfile. you might try posting it to the list if you can't figure it out yourself. There also might be some mapfile tools or sites that can validate the mapfile, but I've never needed them so I don't have them bookmarked anywhere. Can anyone on the list make a suggestion to Paul? -Steve W On 7/23/2020 12:48 PM, English Paul wrote: > > Thanks again Steve ? progress: > > $ /usr/libexec/mapserv -nh > QUERY_STRING="MAP=wmst?FORMAT=image%2Fpng&LAYERS=winter1km_5min&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&TIME=2020-07-23T16%3A40%3A00Z&SRS=EPSG%3A900913&BBOX=-9392582.0328932,4383204.9527744,-9236038.9989652,4539747.9867024&WIDTH=256&HEIGHT=256" > > junk.png > > Gives the following in junk.png: > > Content-type: text/html > > > > MapServer Message > > > > > > msLoadMap(): Regular expression error. MS_DEFAULT_MAPFILE_PATTERN > validation failed. > > msEvalRegex(): R > > *From: *mapserver-users on > behalf of Stephen Woodbridge > *Date: *Wednesday, July 22, 2020 at 19:53 > *To: *"mapserver-users at lists.osgeo.org" > *Subject: *Re: [mapserver-users] Slow and degrading performance with > radar (but not satellite) on mapserver-6.0.1-3_0.el6.x86_64 > > you need to include in your QUERY_STRING=MAP=....& > > it is probably hard coded in the fcgi config. > > -Steve W > > On 7/22/2020 7:15 PM, English Paul wrote: > > So you have a complex historical "mess" and its not clear where > the performance issue is. So you need to divide the problem into > small problems that you can verify are or are not contributing. I > would start with something like this: > > Thank you ? I would not have thought to try it outside of CGI > entirely! > > Take one slow image request and try that as cgi or cli and not > fcgi and turn on debugging. > > ? - copy and rename you mapfile so it doesn't mess with the > production requests > > Not a major worry in this case ? I?m working in an entirely dev > environment. I did make backup copies though! > > ? - turn on the debugging and send it to stderr in the debug mapfile > > ?- you can manually run that image request from the commandline like: > > if mapserv is not in your path you might need to find it and your > the path to it below > > mapserv -nh QUERY_STRING="everything after the ? in the original > query" >junk.png 2>error.txt > > -nh suppresses headers from being output before the image data > > error.txt will be stderr output and should contain the debug messages > > I couldn?t quite get there ? which this is what I ended up running: > > # /usr/libexec/mapserv -nh > QUERY_STRING="FORMAT=image%2Fpng&LAYERS=winter1km_5min&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&TIME=2020-07-22T22%3A30%3A00Z&SRS=EPSG%3A900913&BBOX=-11584184.507886,4070118.8849183,-11271098.44003,4383204.9527744&WIDTH=256&HEIGHT=256" > > junk.png 2>error.txt > > I first tried it with our current map file(s), and then with > MS_ERRORFILE set to stderr and DEBUG set to 5, in both cases, I > got an empty error.txt, and the following in junk.png: > > Content-type: text/html > > > > MapServer Message > > > > > > loadMap(): Web application error. CGI variable "map" is > not set. > > > > I noticed that if I ran it with just -nh, I get the following: > > #/usr/libexec/mapserv -nh > > This script can only be used to decode form results and > > should be initiated as a CGI process via a httpd server. > > So maybe this older version just really doesn?t want to be run on > the CLI? Or maybe I?m messing up the QUERY_STRING, or need to set > the CGI variable to something as the junk.png output suggests? > > Thanks again and thanks SO MUCH for the super quick reply!! > > Paul > > On 7/22/2020 1:47 PM, English Paul wrote: > > Hi, > > ?? Newbie here, just got a work assignment to look into some > performance issues with mapserver-6.0.1-3_0.el6.x86_64 ? > specifically, at one time, it rendered radar images very fast, > then it degraded and seemed to consume a lot more CPU. So ? > the EC2 instance side was upgraded significantly ? and it > still performs badly and uses a lot of CPU. It also seems to > be getting slowly worse over time (days/months, not > seconds/minutes). I asked this on IRC, but it looks like email > might be a better route. > > ? During all of this, the same mapserver instance renders > satellite images quickly. These seem to be a similar, or in > some cases larger size png to start with, rendered onto the > same final map/size. > > ? So ? the obvious answer is that it isn?t using the CPU to > render/re-render, but rather spending it on something else ? > I/O most likely ? eg: a network request, disk I/O, SQL query? > > ? The previous person working on it tried turning on debug at > various levels ? but unfortunately that made it even slower, > making it tricky to answer ?what is making it slow when debug > is turned off?? > > ?My first instinct was to try an strace and nothing was > obvious. Next up ? a flame graph from strace, and/or trying > dtrace ? but my understanding is that dtrace is a little weak > on RHEL/CentOS/Amazon Linux 6.0 **and** I?m not particularly > good at that. Also, we?re using fcgi, so attaching to the > correct process is a bit tricky. > > ? My next instinct was to look at release notes and see if the > current stable has anything fixes/improvements that directly > address this ? there aren?t any that are obvious to my eyes, > but you developers have been busy! So many things! Including > some performance fixes and one ?significant? performance fix. > > Current config file: > > AddHandler fcgid-script fcgi > > FcgidIPCDir /var/run/mod_fcgid > > FcgidProcessTableFile /var/run/mod_fcgid/fcgid_shm > > FcgidMaxProcesses 10 > > FcgidMaxProcessesPerClass 10 > > FcgidMaxRequestInMem 196608 > > FcgidInitialEnv PROJ_LIB /usr/share/proj > > FcgidInitialEnv LD_LIBRARY_PATH > "/usr/local/lib:/usr/pgsql-9.1/lib" > > So ? suggestions for my next move? I currently plan to take a > quick swing at building 7.6 for RHEL 6.0, knowing there might > be old libraries and whatnot that make that a non-starter. Of > course ? we?ve got other infra running on this same instance, > so upgrading everything is a much bigger task. > > ?Strace flame graph? > > ? Stretch and try dtrace? > > ? A better way to use debug? > > ? Something else I?m missing ? eg: differences between the > image types that make them perform so differently? > > Thanks, > > Paul > > _______________________________________________ > > mapserver-users mailing list > > mapserver-users at lists.osgeo.org > > https://lists.osgeo.org/mailman/listinfo/mapserver-users > > > > _______________________________________________ > > mapserver-users mailing list > > mapserver-users at lists.osgeo.org > > https://lists.osgeo.org/mailman/listinfo/mapserver-users > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From dmorissette at mapgears.com Thu Jul 23 14:24:16 2020 From: dmorissette at mapgears.com (Daniel Morissette) Date: Thu, 23 Jul 2020 17:24:16 -0400 Subject: [mapserver-users] Slow and degrading performance with radar (but not satellite) on mapserver-6.0.1-3_0.el6.x86_64 In-Reply-To: References: <07D75779-1922-4E41-A587-3896A841378B@vaisala.com> <709E4A73-CB43-4E23-9D9E-87CA24B698E8@vaisala.com> <7dda8a11-582f-6196-bc92-6ae68540dab6@gmail.com> <0729D2BB-60C5-4159-89AB-3CAD157069EA@vaisala.com> Message-ID: <4b56a142-fb02-52b0-3df1-852f50cd6b76@mapgears.com> Actually, I think this specific error means that the map parameter "MAP=wmst" is missing a ".map" extension in the mapfile name. I'd suggest renaming the mapfile to wmst.map, and also passing the full path in the MAP= param. Daniel On 2020-07-23 16:54, Stephen Woodbridge wrote: > Paul, > > This sounds like you have error in your mapfile. you might try posting > it to the list if you can't figure it out yourself. > > There also might be some mapfile tools or sites that can validate the > mapfile, but I've never needed them so I don't have them bookmarked > anywhere. Can anyone on the list make a suggestion to Paul? > > -Steve W > > > On 7/23/2020 12:48 PM, English Paul wrote: >> >> Thanks again Steve ? progress: >> >> $ /usr/libexec/mapserv -nh >> QUERY_STRING="MAP=wmst?FORMAT=image%2Fpng&LAYERS=winter1km_5min&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&TIME=2020-07-23T16%3A40%3A00Z&SRS=EPSG%3A900913&BBOX=-9392582.0328932,4383204.9527744,-9236038.9989652,4539747.9867024&WIDTH=256&HEIGHT=256" >> > junk.png >> >> Gives the following in junk.png: >> >> Content-type: text/html >> >> >> >> MapServer Message >> >> >> >> >> >> msLoadMap(): Regular expression error. MS_DEFAULT_MAPFILE_PATTERN >> validation failed. >> >> msEvalRegex(): R >> >> *From: *mapserver-users on >> behalf of Stephen Woodbridge >> *Date: *Wednesday, July 22, 2020 at 19:53 >> *To: *"mapserver-users at lists.osgeo.org" >> *Subject: *Re: [mapserver-users] Slow and degrading performance with >> radar (but not satellite) on mapserver-6.0.1-3_0.el6.x86_64 >> >> you need to include in your QUERY_STRING=MAP=....& >> >> it is probably hard coded in the fcgi config. >> >> -Steve W >> >> On 7/22/2020 7:15 PM, English Paul wrote: >> >> So you have a complex historical "mess" and its not clear where >> the performance issue is. So you need to divide the problem into >> small problems that you can verify are or are not contributing. I >> would start with something like this: >> >> Thank you ? I would not have thought to try it outside of CGI >> entirely! >> >> Take one slow image request and try that as cgi or cli and not >> fcgi and turn on debugging. >> >> ? - copy and rename you mapfile so it doesn't mess with the >> production requests >> >> Not a major worry in this case ? I?m working in an entirely dev >> environment. I did make backup copies though! >> >> ? - turn on the debugging and send it to stderr in the debug mapfile >> >> ?- you can manually run that image request from the commandline like: >> >> if mapserv is not in your path you might need to find it and your >> the path to it below >> >> mapserv -nh QUERY_STRING="everything after the ? in the original >> query" >junk.png 2>error.txt >> >> -nh suppresses headers from being output before the image data >> >> error.txt will be stderr output and should contain the debug messages >> >> I couldn?t quite get there ? which this is what I ended up running: >> >> # /usr/libexec/mapserv -nh >> QUERY_STRING="FORMAT=image%2Fpng&LAYERS=winter1km_5min&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&TIME=2020-07-22T22%3A30%3A00Z&SRS=EPSG%3A900913&BBOX=-11584184.507886,4070118.8849183,-11271098.44003,4383204.9527744&WIDTH=256&HEIGHT=256" >> > junk.png 2>error.txt >> >> I first tried it with our current map file(s), and then with >> MS_ERRORFILE set to stderr and DEBUG set to 5, in both cases, I >> got an empty error.txt, and the following in junk.png: >> >> Content-type: text/html >> >> >> >> MapServer Message >> >> >> >> >> >> loadMap(): Web application error. CGI variable "map" is >> not set. >> >> >> >> I noticed that if I ran it with just -nh, I get the following: >> >> #/usr/libexec/mapserv -nh >> >> This script can only be used to decode form results and >> >> should be initiated as a CGI process via a httpd server. >> >> So maybe this older version just really doesn?t want to be run on >> the CLI? Or maybe I?m messing up the QUERY_STRING, or need to set >> the CGI variable to something as the junk.png output suggests? >> >> Thanks again and thanks SO MUCH for the super quick reply!! >> >> Paul >> >> On 7/22/2020 1:47 PM, English Paul wrote: >> >> Hi, >> >> ?? Newbie here, just got a work assignment to look into some >> performance issues with mapserver-6.0.1-3_0.el6.x86_64 ? >> specifically, at one time, it rendered radar images very fast, >> then it degraded and seemed to consume a lot more CPU. So ? >> the EC2 instance side was upgraded significantly ? and it >> still performs badly and uses a lot of CPU. It also seems to >> be getting slowly worse over time (days/months, not >> seconds/minutes). I asked this on IRC, but it looks like email >> might be a better route. >> >> ? During all of this, the same mapserver instance renders >> satellite images quickly. These seem to be a similar, or in >> some cases larger size png to start with, rendered onto the >> same final map/size. >> >> ? So ? the obvious answer is that it isn?t using the CPU to >> render/re-render, but rather spending it on something else ? >> I/O most likely ? eg: a network request, disk I/O, SQL query? >> >> ? The previous person working on it tried turning on debug at >> various levels ? but unfortunately that made it even slower, >> making it tricky to answer ?what is making it slow when debug >> is turned off?? >> >> ?My first instinct was to try an strace and nothing was >> obvious. Next up ? a flame graph from strace, and/or trying >> dtrace ? but my understanding is that dtrace is a little weak >> on RHEL/CentOS/Amazon Linux 6.0 **and** I?m not particularly >> good at that. Also, we?re using fcgi, so attaching to the >> correct process is a bit tricky. >> >> ? My next instinct was to look at release notes and see if the >> current stable has anything fixes/improvements that directly >> address this ? there aren?t any that are obvious to my eyes, >> but you developers have been busy! So many things! Including >> some performance fixes and one ?significant? performance fix. >> >> Current config file: >> >> AddHandler fcgid-script fcgi >> >> FcgidIPCDir /var/run/mod_fcgid >> >> FcgidProcessTableFile /var/run/mod_fcgid/fcgid_shm >> >> FcgidMaxProcesses 10 >> >> FcgidMaxProcessesPerClass 10 >> >> FcgidMaxRequestInMem 196608 >> >> FcgidInitialEnv PROJ_LIB /usr/share/proj >> >> FcgidInitialEnv LD_LIBRARY_PATH >> "/usr/local/lib:/usr/pgsql-9.1/lib" >> >> So ? suggestions for my next move? I currently plan to take a >> quick swing at building 7.6 for RHEL 6.0, knowing there might >> be old libraries and whatnot that make that a non-starter. Of >> course ? we?ve got other infra running on this same instance, >> so upgrading everything is a much bigger task. >> >> ?Strace flame graph? >> >> ? Stretch and try dtrace? >> >> ? A better way to use debug? >> >> ? Something else I?m missing ? eg: differences between the >> image types that make them perform so differently? >> >> Thanks, >> >> Paul >> >> _______________________________________________ >> >> mapserver-users mailing list >> >> mapserver-users at lists.osgeo.org >> >> https://lists.osgeo.org/mailman/listinfo/mapserver-users >> >> >> >> _______________________________________________ >> >> mapserver-users mailing list >> >> mapserver-users at lists.osgeo.org >> >> https://lists.osgeo.org/mailman/listinfo/mapserver-users >> >> >> _______________________________________________ >> mapserver-users mailing list >> mapserver-users at lists.osgeo.org >> https://lists.osgeo.org/mailman/listinfo/mapserver-users > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users > -- Daniel Morissette Mapgears Inc T: +1 418-696-5056 #201 From ben at ausvet.com.au Wed Jul 29 07:44:07 2020 From: ben at ausvet.com.au (Ben Madin) Date: Wed, 29 Jul 2020 22:44:07 +0800 Subject: [mapserver-users] Setting a connection host from ENV Message-ID: G'day all, I am migrating a number of systems onto containers, and have hit a blocker with a solution with over 100 mapfiles, all of which refer to a database that is tucked away in a vpc in the cloud, with an a record for the connection host (ie host.cloud.com) I also have a copy of the database on a development machine (ie host.docker.internal) For most everything else in the docker world (our web interfaces etc), I can set use env variables in the container system, but I'm really struggling with how best to do this in this case. I can do a url variable for the connection parameter, and specify the database in every call... seems pretty clumsy, and not good practice really. but my attempts to reference environment variables in the mapfile have been very unsuccessful. Could I ask : a) is there actually a simpler way to achieve the same outcome, that I have completely missed, or b) does someone have an example of how to do it? c) is this actually just not possible, and I should just get my sed out before every deployment commit? cheers Ben -- [image: Ausvet Logo] Dr Ben Madin BVMS MVPHMgmt PhD MANZCVS GAICD Managing Director Mobile: +61 448 887 220 <+61448887220> E-mail: ben at ausvet.com.au Website: www.ausvet.com.au Skype: benmadin Address: 5 Shuffrey Street Fremantle, WA 6160 Australia -------------- next part -------------- An HTML attachment was scrubbed... URL: From public at postholer.com Thu Jul 30 09:43:16 2020 From: public at postholer.com (Scott) Date: Thu, 30 Jul 2020 09:43:16 -0700 Subject: [mapserver-users] REST API as a LAYER DATA source Message-ID: <253d0800-7baf-f397-46ed-b0e6e9df25ac@postholer.com> I would like to use a REST API as a mapfile LAYER/DATA source, not output. Can someone point me to the correct documentation for that? From sdlime at gmail.com Thu Jul 30 11:29:05 2020 From: sdlime at gmail.com (Steve Lime) Date: Thu, 30 Jul 2020 13:29:05 -0500 Subject: [mapserver-users] REST API as a LAYER DATA source In-Reply-To: <253d0800-7baf-f397-46ed-b0e6e9df25ac@postholer.com> References: <253d0800-7baf-f397-46ed-b0e6e9df25ac@postholer.com> Message-ID: Presumably you could use an OGR layer although I've not done it myself. I guess I'd recommend starting with: * https://mapserver.org/input/vector/ogr.html * https://gdal.org/drivers/vector/esrijson.html#vector-esrijson --Steve On Thu, Jul 30, 2020 at 11:50 AM Scott wrote: > I would like to use a REST API as a mapfile LAYER/DATA source, not output. > > Can someone point me to the correct documentation for that? > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From public at postholer.com Thu Jul 30 13:54:33 2020 From: public at postholer.com (Scott) Date: Thu, 30 Jul 2020 13:54:33 -0700 Subject: [mapserver-users] REST API as a LAYER DATA source In-Reply-To: References: <253d0800-7baf-f397-46ed-b0e6e9df25ac@postholer.com> Message-ID: Thanks! The OGR method works great. --- LAYER NAME "resttest" TYPE POINT STATUS ON CONNECTIONTYPE OGR CONNECTION "https://example.com/query?format=geojson" # DATA layername from: # ogrinfo 'https://example.com/query?format=geojson' DATA "OGRGeoJSON" METADATA ows_title "Rest Test" wms_abstract "Rest Test" gml_include_items "all" wfs_connectiontimeout "30" wfs_maxfeatures "500" wfs_request_method "GET" wfs_typename "resttest" wfs_featureid "fid" wfs_enable_request "*" wfs_getfeature_formatlist "CSV,JSON,GEOJSON" END CLASS NAME 'rest test' LABEL STYLE SYMBOL 'pointMarkUnfilled' SIZE 7 COLOR '#000000' WIDTH 2 END PRIORITY 10 TEXT '[colValue]' COLOR '#000000' OUTLINECOLOR '#ffffff' OUTLINEWIDTH 3 FONT "serifBold" TYPE truetype SIZE 10 ANGLE 0 POSITION AUTO PARTIALS false OFFSET 3 0 WRAP ' ' MAXLENGTH 21 END END END On 7/30/20 11:29 AM, Steve Lime wrote: > Presumably you could use an OGR layer although I've not done it myself. > I guess I'd recommend starting with: > > ? * https://mapserver.org/input/vector/ogr.html > ? * https://gdal.org/drivers/vector/esrijson.html#vector-esrijson > > --Steve > > > On Thu, Jul 30, 2020 at 11:50 AM Scott > wrote: > > I would like to use a REST API as a mapfile LAYER/DATA source, not > output. > > Can someone point me to the correct documentation for that? > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users > From ahmettemiz88 at gmail.com Fri Jul 31 01:22:31 2020 From: ahmettemiz88 at gmail.com (Ahmet Temiz) Date: Fri, 31 Jul 2020 11:22:31 +0300 Subject: [mapserver-users] wcs2.0 with mask ?? Message-ID: Hi. Does mapserver-wcs2.0 work well with polygon masking ? regards -- Ahmet Temiz Jeoloji M?h. Afet ve Acil Durum Y?netimi Ba?kanl??? Deprem Dairesi Ba?kanl??? ________________________ Ahmet Temiz Geological Eng. Disaster and Emergency Management of Presidency -------------- next part -------------- An HTML attachment was scrubbed... URL: From matthew.f.cechini at nasa.gov Fri Jul 31 07:29:55 2020 From: matthew.f.cechini at nasa.gov (Cechini, Matthew F. (GSFC-423.0)[Science Systems & Applications, Inc.]) Date: Fri, 31 Jul 2020 14:29:55 +0000 Subject: [mapserver-users] Referrer Url for _outbound_ WMS requests Message-ID: <859D8312-BB10-435C-BEBE-5E82FE344B5A@nasa.gov> Greetings, When we are collecting metrics for access to our WMS services, we notice that mapserver-originated requests have a user-agent set, but the referrer is always empty. We are trying to gather metrics based on referrer, but these mapserver requests are falling through the cracks because of that missing value. Is there a way to force mapserver to provide a referrer value in its requests to a remote WMS service? We see the CONNECTIONOPTIONS item in later releases, but aren?t sure if that supports this or not. Thanks, Matt ................................................................. Matthew Cechini Contractor, Science Systems and Applications, Inc. NASA GIBS Systems/Software Engineer 410.205.6272 -------------- next part -------------- An HTML attachment was scrubbed... URL: From CFilipovic at geocue.com Fri Jul 31 09:18:09 2020 From: CFilipovic at geocue.com (Connor Filipovic) Date: Fri, 31 Jul 2020 16:18:09 +0000 Subject: [mapserver-users] Layer templates dynamically overwritten bug? Message-ID: I have created a shape layer containing some volume data. The shape layer points to a template that creates a table with 6 labels and 6 values. The values are retrieved from the shapefile and displayed on the table. Upon opening up a 2nd table at the same time the original tables values will change to the new table's values. Opening more tables will change all the open tables to the values of the new tables. I wanted to verify this was a bug before posting an issue on Github. I appreciate any help or feedback. Thanks -------------- next part -------------- An HTML attachment was scrubbed... URL: From jmckenna at gatewaygeomatics.com Fri Jul 31 11:47:52 2020 From: jmckenna at gatewaygeomatics.com (Jeff McKenna) Date: Fri, 31 Jul 2020 15:47:52 -0300 Subject: [mapserver-users] 7.6.1 released Message-ID: The MapServer team is pleased to announce the maintenance release of MapServer 7.6.1 For the list of changes see the Changelog at https://mapserver.org/development/changelog/changelog-7-6.html Or head to Download at https://mapserver.org/download.html For those wanting searchable offline documentation, the updated PDF is available at https://download.osgeo.org/mapserver/docs/MapServer.pdf Happy (fast) mapserving... -- The MapServer Team