[mapserver-users] Very strange problem doing a query and hanging on MS 6.4.1
Stephen Woodbridge
woodbri at swoodbridge.com
Tue Jul 14 08:20:57 PDT 2015
OK, not totally solved! Things are better by explicitly setting
TOLERANCE and TOLERANCEUNITS but I am still getting random hanging of
processes doing queries.
I'm wondering if this is related to apache 2.4 and the way it is setting
up cgi-bin processes. What is the best practice for configuring apache
2.4 (things changed in apache 2.4 from 2.2) cgi for use with mapserver?
I'm running Ubuntu 14.04 LTS and have these packages installed:
apache2:amd64/trusty-security 2.4.7-1ubuntu4.4 uptodate
apache2-bin:amd64/trusty-security 2.4.7-1ubuntu4.4 uptodate
apache2-data:all/trusty-security 2.4.7-1ubuntu4.4 uptodate
apache2-mpm-prefork:amd64/trusty-security 2.4.7-1ubuntu4.4 uptodate
apache2-utils:amd64/trusty-security 2.4.7-1ubuntu4.4 uptodate
libapache2-mod-geoip:amd64/trusty 1.2.8-2 uptodate
libapache2-mod-mapcache:amd64/trusty 1.2.1-2 uptodate
libapache2-mod-php5:amd64/trusty-security 5.5.9+dfsg-1ubuntu4.11 uptodate
libapache2-mod-python:amd64/trusty 3.3.1-11ubuntu2 uptodate
cgi-mapserver:amd64/trusty 6.4.1-2 uptodate
libmapserver1:amd64/trusty 6.4.1-2 uptodate
mapserver-bin:amd64/trusty 6.4.1-2 uptodate
ls /etc/apache2/mods-enabled/
access_compat.load autoindex.load geoip.load php5.conf
alias.load cgi.load mapcache.conf php5.load
auth_basic.load deflate.conf mapcache.load python.load
authn_core.load deflate.load mime.conf setenvif.conf
authn_file.load dir.conf mime.load setenvif.load
authz_core.load dir.load mpm_prefork.conf status.conf
authz_host.load env.load mpm_prefork.load status.load
authz_user.load filter.load negotiation.conf
autoindex.conf geoip.conf negotiation.load
On 7/13/2015 11:48 AM, Stephen Woodbridge wrote:
> SOLVED: see below ...
>
> According to the docs, the defaults are:
>
> TOLERANCE 3
> TOLERANCEUNITS pixels
>
> and with:
>
> QUERY_STRING='map=/maps/wms/bathymetry.map&mode=query&layers=model_query&mapxy=-100.98125+41.58125'
>
>
> How is zoom calculated?
>
> LAYER
> NAME "model_query"
> STATUS on
> TYPE raster
>
> TILEINDEX "NOAA_Coastal_Relief_Model/index.shp"
> TILEITEM "LOCATION"
> CLASS
> TEMPLATE "/maps/wms/pixel.value.html"
> END
> END
>
> Did this behavior change from 6.2.1 to 6.4.1? because it is not noted in
> the MIGRATION-GUIDE if it did. On 6.2.1 I get the following result:
>
> Content-Type: text/html
> <HTML
> <HEAD><TITLE>MapServer Message</TITLE></HEAD
> <!-- MapServer version 6.2.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG
> SUPPORTS=PROJ SUPPORTS=GD SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=CAIRO
> SUPPORTS=SVG_SYMBOLS SUPPORTS=ICONV SUPPORTS=FRIBIDI
> SUPPORTS=WMS_SERVER
> SUPPORTS=WMS_CLIENT SUPPORTS=WFS_SERVER SUPPORTS=WFS_CLIENT
> SUPPORTS=WCS_SERVER SUPPORTS=SOS_SERVER SUPPORTS=FASTCGI
> SUPPORTS=THREADS SUPPORTS=GEOS INPUT=JPEG INPUT=POSTGIS INPUT=OGR
> INPUT=GDAL INPUT=SHAPEFILE -->
> <BODY BGCOLOR="#FFFFFF"
> msQueryByPoint(): Search returned no results. No matching record(s)
> found.
> </BODY></HTML>
>
> which returns very quickly.
>
> I rsynced the data and the mapfile for Ubuntu 12.04 to 14.04 and
> installed the mapserver package. Everything else appears to be working
> without a problem except this issue.
>
> SOLVED:
>
> I explicitly added:
>
> TOLERANCE 1
> TOLERANCEUNITS pixels
>
> to my LAYER definition and now it works.
>
> d# /usr/lib/cgi-bin/mapserv
> QUERY_STRING='map=/maps/wms/bathymetry.map&mode=query&layers=model_query&mapxy=-100.98125+41.58125'
>
> Content-Type: text/html
>
> <HTML>
> <HEAD><TITLE>MapServer Message</TITLE></HEAD>
> <!-- MapServer version 6.4.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG
> OUTPUT=KML SUPPORTS=PROJ SUPPORTS=GD SUPPORTS=AGG SUPPORTS=FREETYPE
> SUPPORTS=CAIRO SUPPORTS=SVG_SYMBOLS SUPPORTS=RSVG SUPPORTS=ICONV
> SUPPORTS=FRIBIDI SUPPORTS=WMS_SERVER SUPPORTS=WMS_CLIENT
> SUPPORTS=WFS_SERVER SUPPORTS=WFS_CLIENT SUPPORTS=WCS_SERVER
> SUPPORTS=SOS_SERVER SUPPORTS=FASTCGI SUPPORTS=THREADS SUPPORTS=GEOS
> INPUT=JPEG INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE -->
> <BODY BGCOLOR="#FFFFFF">
> msQueryByPoint(): Search returned no results. No matching record(s) found.
> </BODY></HTML>
>
> So it looks like maybe the defaults are not getting initialized.
>
> Opened: https://github.com/mapserver/mapserver/issues/5120
>
> Thanks,
> -Steve
>
> On 7/13/2015 11:05 AM, thomas bonfort wrote:
>> Or that could just be the number of pixels under the query point if
>> you are zoomed out far or with a large tolerance...
>>
>> On 13 July 2015 at 17:01, Stephen Woodbridge <woodbri at swoodbridge.com>
>> wrote:
>>> Thomas,
>>>
>>> More information:
>>>
>>> /u/software/mapserver-rel-6-4-2/maptemplate.c:4366
>>>
>>> 4366 for(j=0; j<lp->resultcache->numresults; j++) {
>>> (gdb) p lp->resultcache->numresults
>>> $7 = 2884991
>>>
>>> this is clearly a bad value my guess is that it is not getting
>>> initialized
>>> to zero and assumes it will get set when some number of results are
>>> found,
>>> but if no results are found it is not getting set to zero. (Just a
>>> hypothesis)
>>>
>>> -Steve W
>>>
>>>
>>> On 7/13/2015 10:41 AM, Stephen Woodbridge wrote:
>>>>
>>>> Thomas,
>>>>
>>>> Here is the initial backtrace afte starting it and and ^C while it is
>>>> printing -99999 lines:
>>>>
>>>> #0 processLine (mapserv=0x609050, instr=0x7fffffffcc60 "[value_0]\n",
>>>> stream=0x688460, mode=9)
>>>> at /u/software/mapserver-rel-6-4-2/maptemplate.c:3697
>>>> #1 0x00007ffff7a2e9cc in msReturnPage (mapserv=0x609050,
>>>> html=0x6612e0 "/maps/wms/pixel.value.html", mode=9,
>>>> papszBuffer=0x0)
>>>> at /u/software/mapserver-rel-6-4-2/maptemplate.c:4159
>>>> #2 0x00007ffff7a2f7ed in msReturnNestedTemplateQuery
>>>> (mapserv=0x609050,
>>>> pszMimeType=0x60c8f0 "text/html", papszBuffer=0x0)
>>>> at /u/software/mapserver-rel-6-4-2/maptemplate.c:4385
>>>> #3 0x00007ffff7a1f586 in msReturnTemplateQuery (mapserv=0x609050,
>>>> queryFormat=0x60c8f0 "text/html", papszBuffer=0x0)
>>>> at /u/software/mapserver-rel-6-4-2/maptemplate.c:315
>>>> #4 0x00007ffff79f1230 in msCGIDispatchQueryRequest (mapserv=0x609050)
>>>> at /u/software/mapserver-rel-6-4-2/mapservutil.c:1476
>>>> #5 0x00007ffff79f2205 in msCGIDispatchRequest (mapserv=0x609050)
>>>> at /u/software/mapserver-rel-6-4-2/mapservutil.c:1784
>>>> #6 0x000000000040115b in main (argc=2, argv=0x7fffffffdf98)
>>>> at /u/software/mapserver-rel-6-4-2/mapserv.c:259
>>>>
>>>> I'll poke around a little more in gdb and see if I can figure out
>>>> anything more.
>>>>
>>>> Thanks,
>>>> -Steve
>>>>
>>>>
>>>> On 7/13/2015 4:12 AM, thomas bonfort wrote:
>>>>>
>>>>> Steve,
>>>>> please include a backtrace from gdb where you believe the infinite
>>>>> loop is happening.
>>>>>
>>>>> --
>>>>> thomas
>>>>>
>>>>> On 13 July 2015 at 01:22, Stephen Woodbridge <woodbri at swoodbridge.com>
>>>>> wrote:
>>>>>>
>>>>>> I added gdalinfo on an actual raster file below. It turns out the
>>>>>> -99999 is
>>>>>> the NoData Value. I would be happy to just get this value back
>>>>>> (once), but I
>>>>>> think something is broken and putting mapserver into an infinite
>>>>>> loop.
>>>>>>
>>>>>> -Steve W
>>>>>>
>>>>>>
>>>>>> On 7/12/2015 7:14 PM, Stephen Woodbridge wrote:
>>>>>>>
>>>>>>>
>>>>>>> Hi all,
>>>>>>>
>>>>>>> I have run into a very strange problem doing a mapserver query. I'm
>>>>>>> upgrading a system that was running fine. The details are below.
>>>>>>> I also
>>>>>>> tried to put the template inside a CLASS ... END block that didn't
>>>>>>> help.
>>>>>>>
>>>>>>> Can anyone else reproduce something like this?
>>>>>>> Got any ideas on how to work around it?
>>>>>>>
>>>>>>> Thanks,
>>>>>>> -Steve W
>>>>>>>
>>>>>>> Old system:
>>>>>>> Ubuntu 12.04 LTS
>>>>>>>
>>>>>>> MapServer version 6.2.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG
>>>>>>> SUPPORTS=PROJ
>>>>>>> SUPPORTS=GD SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=CAIRO
>>>>>>> SUPPORTS=SVG_SYMBOLS SUPPORTS=ICONV SUPPORTS=FRIBIDI
>>>>>>> SUPPORTS=WMS_SERVER
>>>>>>> SUPPORTS=WMS_CLIENT SUPPORTS=WFS_SERVER SUPPORTS=WFS_CLIENT
>>>>>>> SUPPORTS=WCS_SERVER SUPPORTS=SOS_SERVER SUPPORTS=FASTCGI
>>>>>>> SUPPORTS=THREADS SUPPORTS=GEOS INPUT=JPEG INPUT=POSTGIS INPUT=OGR
>>>>>>> INPUT=GDAL INPUT=SHAPEFILE
>>>>>>>
>>>>>>> New system:
>>>>>>> Ubuntu 14.04 LTS
>>>>>>>
>>>>>>> MapServer version 6.4.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=KML
>>>>>>> SUPPORTS=PROJ SUPPORTS=GD SUPPORTS=AGG SUPPORTS=FREETYPE
>>>>>>> SUPPORTS=CAIRO
>>>>>>> SUPPORTS=SVG_SYMBOLS SUPPORTS=RSVG SUPPORTS=ICONV SUPPORTS=FRIBIDI
>>>>>>> SUPPORTS=WMS_SERVER SUPPORTS=WMS_CLIENT SUPPORTS=WFS_SERVER
>>>>>>> SUPPORTS=WFS_CLIENT SUPPORTS=WCS_SERVER SUPPORTS=SOS_SERVER
>>>>>>> SUPPORTS=FASTCGI SUPPORTS=THREADS SUPPORTS=GEOS INPUT=JPEG
>>>>>>> INPUT=POSTGIS
>>>>>>> INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE
>>>>>>>
>>>>>>> The query layer looks like this:
>>>>>>>
>>>>>>> LAYER
>>>>>>> NAME "model_query"
>>>>>>> STATUS on
>>>>>>> TYPE raster
>>>>>>>
>>>>>>> TILEINDEX "NOAA_Coastal_Relief_Model/index.shp"
>>>>>>> TILEITEM "LOCATION"
>>>>>>> TEMPLATE "/maps/wms/pixel.value.html"
>>>>>>> END
>>>>>>>
>>>>>>>
>>>>>>> cat "/maps/wms/pixel.value.html"
>>>>>>> <!-- MapServer Template -->
>>>>>>> [value_0]
>>>>>>>
>>>>>>>
>>>>>>> dbf_dump -info wms/data/Bathy/NOAA_Coastal_Relief_Model/index.dbf
>>>>>>> Filename: wms/data/Bathy/NOAA_Coastal_Relief_Model/index.dbf
>>>>>>> Version: 0x03 (ver. 3)
>>>>>>> Num of records: 61
>>>>>>> Header length: 65
>>>>>>> Record length: 256
>>>>>>> Last change: 1995/7/26
>>>>>>> Num fields: 1
>>>>>>> Field info:
>>>>>>> Num Name Type Len Decimal
>>>>>>> 1. LOCATION C 255 0
>>>>>>>
>>>>>>>
>>>>>>> dbf_dump wms/data/Bathy/NOAA_Coastal_Relief_Model/index.dbf | head
>>>>>>> NOAA_Coastal_Relief_Model/BSM-1035.tif
>>>>>>> NOAA_Coastal_Relief_Model/BSM-1156.tif
>>>>>>> NOAA_Coastal_Relief_Model/BSM-1193.tif
>>>>>>> NOAA_Coastal_Relief_Model/BSM-1239.tif
>>>>>>> NOAA_Coastal_Relief_Model/BSM-1261.tif
>>>>>>> NOAA_Coastal_Relief_Model/BSM-1326.tif
>>>>>>> NOAA_Coastal_Relief_Model/BSM-1343.tif
>>>>>>> NOAA_Coastal_Relief_Model/BSM-1536.tif
>>>>>>> NOAA_Coastal_Relief_Model/BSM-1557.tif
>>>>>>> NOAA_Coastal_Relief_Model/BSM-1801.tif
>>>>>>>
>>>>>>> ogrinfo -so wms/data/Bathy/NOAA_Coastal_Relief_Model/index.shp index
>>>>>>> INFO: Open of `wms/data/Bathy/NOAA_Coastal_Relief_Model/index.shp'
>>>>>>> using driver `ESRI Shapefile' successful.
>>>>>>>
>>>>>>> Layer name: index
>>>>>>> Geometry: Polygon
>>>>>>> Feature Count: 61
>>>>>>> Extent: (-130.000417, 16.999583) - (-65.999599, 49.000401)
>>>>>>> Layer SRS WKT:
>>>>>>> (unknown)
>>>>>>> location: String (255.0)
>>>>>>>
>>>>>>>
>>>>>>> When I issue a query like:
>>>>>>>
>>>>>>> /usr/lib/cgi-bin/mapserv
>>>>>>>
>>>>>>>
>>>>>>> QUERY_STRING='map=/maps/wms/bathymetry.map&mode=query&layers=model_query&mapxy=-100.98125+41.58125'
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> The old server responded with:
>>>>>>> Content-Type: text/html
>>>>>>>
>>>>>>> <HTML>
>>>>>>> <HEAD><TITLE>MapServer Message</TITLE></HEAD>
>>>>>>> <!-- MapServer version 6.2.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG
>>>>>>> SUPPORTS=PROJ SUPPORTS=GD SUPPORTS=AGG SUPPORTS=FREETYPE
>>>>>>> SUPPORTS=CAIRO
>>>>>>> SUPPORTS=SVG_SYMBOLS SUPPORTS=ICONV SUPPORTS=FRIBIDI
>>>>>>> SUPPORTS=WMS_SERVER
>>>>>>> SUPPORTS=WMS_CLIENT SUPPORTS=WFS_SERVER SUPPORTS=WFS_CLIENT
>>>>>>> SUPPORTS=WCS_SERVER SUPPORTS=SOS_SERVER SUPPORTS=FASTCGI
>>>>>>> SUPPORTS=THREADS SUPPORTS=GEOS INPUT=JPEG INPUT=POSTGIS INPUT=OGR
>>>>>>> INPUT=GDAL INPUT=SHAPEFILE -->
>>>>>>> <BODY BGCOLOR="#FFFFFF">
>>>>>>> msQueryByPoint(): Search returned no results. No matching record(s)
>>>>>>> found.
>>>>>>> </BODY></HTML>You have new mail in /var/mail/root
>>>>>>>
>>>>>>>
>>>>>>> I get an infinite number of lines like the following on the new
>>>>>>> server:
>>>>>>>
>>>>>>> # /usr/lib/cgi-bin/mapserv
>>>>>>>
>>>>>>>
>>>>>>> QUERY_STRING='map=/maps/wms/bathymetry.map&mode=query&layers=model_query&mapxy=-100.98125+41.58125'
>>>>>>>
>>>>>>>
>>>>>>> | head
>>>>>>> Content-Type: text/html
>>>>>>>
>>>>>>> -99999
>>>>>>> -99999
>>>>>>> -99999
>>>>>>> -99999
>>>>>>> -99999
>>>>>>> -99999
>>>>>>> -99999
>>>>>>> -99999
>>>>>>> ^C
>>>>>>
>>>>>>
>>>>>>
>>>>>> # gdalinfo wms/data/Bathy/NOAA_Coastal_Relief_Model/BSM-1156.tif
>>>>>> Driver: GTiff/GeoTIFF
>>>>>> Files: wms/data/Bathy/NOAA_Coastal_Relief_Model/BSM-1156.tif
>>>>>> Size is 4801, 4801
>>>>>> Coordinate System is:
>>>>>> GEOGCS["WGS 84",
>>>>>> DATUM["WGS_1984",
>>>>>> SPHEROID["WGS 84",6378137,298.257223563,
>>>>>> AUTHORITY["EPSG","7030"]],
>>>>>> AUTHORITY["EPSG","6326"]],
>>>>>> PRIMEM["Greenwich",0],
>>>>>> UNIT["degree",0.0174532925199433],
>>>>>> AUTHORITY["EPSG","4326"]]
>>>>>> Origin = (-102.000833330000006,41.000817329999997)
>>>>>> Pixel Size = (0.000833330000000,-0.000833330000000)
>>>>>> Metadata:
>>>>>> AREA_OR_POINT=Point
>>>>>> Image Structure Metadata:
>>>>>> INTERLEAVE=BAND
>>>>>> Corner Coordinates:
>>>>>> Upper Left (-102.0008333, 41.0008173) (102d 0' 3.00"W, 41d 0'
>>>>>> 2.94"N)
>>>>>> Lower Left (-102.0008333, 37.0000000) (102d 0' 3.00"W, 37d 0'
>>>>>> 0.00"N)
>>>>>> Upper Right ( -98.0000160, 41.0008173) ( 98d 0' 0.06"W, 41d 0'
>>>>>> 2.94"N)
>>>>>> Lower Right ( -98.0000160, 37.0000000) ( 98d 0' 0.06"W, 37d 0'
>>>>>> 0.00"N)
>>>>>> Center (-100.0004247, 39.0004087) (100d 0' 1.53"W, 39d 0'
>>>>>> 1.47"N)
>>>>>> Band 1 Block=256x256 Type=Float32, ColorInterp=Gray
>>>>>> NoData Value=-99999
>>>>>> Overviews: 2401x2401, 1201x1201, 601x601, 301x301, 151x151,
>>>>>> 76x76,
>>>>>> 38x38
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> You have to ^C to kill it, even when using head. This seems like a
>>>>>>> serious bug as it runs for about 10 mins taking 100% CPU. If you
>>>>>>> call it
>>>>>>> via file_get_contents() in php is hangs the request and freezea
>>>>>>> my OL
>>>>>>> app until it is killed or kills php reading all the data.
>>>>>>> _______________________________________________
>>>>>>> mapserver-users mailing list
>>>>>>> mapserver-users at lists.osgeo.org
>>>>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> mapserver-users mailing list
>>>>>> mapserver-users at lists.osgeo.org
>>>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>>
>>>>
>>>> _______________________________________________
>>>> mapserver-users mailing list
>>>> mapserver-users at lists.osgeo.org
>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>
>>>
>>> _______________________________________________
>>> mapserver-users mailing list
>>> mapserver-users at lists.osgeo.org
>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>
More information about the mapserver-users
mailing list