Hello World

DeDuikertjes wrote: >> >> It gives me a LOT of errors like: >> [Thu Mar 4 15:14:05 2010].903727 msGetEncodedString(): Unknown >> identifier. Encoding not supported by libiconv (UTF8). >> >> Searching and reading up on this I couldn't find a reason why things >> work in 5.1-dev and work not in 5.4.2. >> > > Maybe the difference is caused by a different version of iconv being > used by the new build? > > Anyway, the error message says "encoding UTF8 not supported". I > believe the identifier should be "UTF-8" and not "UTF8". > > FYI, "iconv -l" can be used at the command-line to list the encodings > supported by your version of libiconv. > > Daniel From dmorissette at mapgears.com Fri Mar 5 11:26:57 2010 From: dmorissette at mapgears.com (Daniel Morissette) Date: Fri, 05 Mar 2010 14:26:57 -0500 Subject: [mapserver-users] More upgrade problems In-Reply-To: <4B915A00.3080409@xs4all.nl> References: <20100221170123.B1F56E0132D@lists.osgeo.org> <4B90D4B9.5060505@xs4all.nl> <4B910B34.3080606@mapgears.com> <4B915A00.3080409@xs4all.nl> Message-ID: <4B915B01.8090107@mapgears.com> DeDuikertjes wrote: > > postgis tells me the database ppa_test_database is encoded in UTF8 and > not UTF-8. > > So apparently postgis wants to state UTF8 and iconv wants to hear UTF-8. > > Is there any way around this? > I don't think MapServer reads the encoding value from PostGIS, it gets it from the ENCODING parameter in your LABEL block in your mapfile. Make sure the ENCODING value in your mapfile are all valid (one of them must be using UTF8 instead of UTF-8). Daniel -- Daniel Morissette http://www.mapgears.com/ From khatriprateek at gmail.com Sat Mar 6 02:32:42 2010 From: khatriprateek at gmail.com (mrityunjay) Date: Sat, 6 Mar 2010 02:32:42 -0800 (PST) Subject: [mapserver-users] mapscript.dll error while using mapscript in java Message-ID: <1267871562565-4685796.post@n2.nabble.com> Dear users I'm facing the following problem while using the mapscript in my java program (using Netbeans on windows): Whenever the glassfish (the app server I'm using) is started for the first time, my program runs fine but when I rerun the program, it (glassfish) gives the following error: java.lang.UnsatisfiedLinkError: Native Library C:\WINDOWS\system32\mapscript.dll already loaded in another classloader to run the program correctly i have to restart the glassfish server everytime, which is not a practical solution. Can anybody help me with this? -- View this message in context: http://n2.nabble.com/mapscript-dll-error-while-using-mapscript-in-java-tp4685796p4685796.html Sent from the Mapserver - User mailing list archive at Nabble.com. From tiedtke at gmail.com Sat Mar 6 08:03:44 2010 From: tiedtke at gmail.com (Thiago Tiedtke dos Reis) Date: Sat, 6 Mar 2010 13:03:44 -0300 Subject: [mapserver-users] Mapserver + Tcl Mapscript Message-ID: <82108beb1003060803g629f8a5fx19abcc0a3a16b5ca@mail.gmail.com> Hi All, Anyone know if the status of tclmapscript is really stopped? There are a "step-by-step" to recompile the new mapserver with new tcl version (swing)? There are a people interested in do this? (me too, of course, want help, if need) Thanks in advance! Thiago Tiedtke dos Reis -------------- next part -------------- An HTML attachment was scrubbed... URL: From DeDuikertjes at xs4all.nl Sat Mar 6 09:44:04 2010 From: DeDuikertjes at xs4all.nl (DeDuikertjes) Date: Sat, 06 Mar 2010 18:44:04 +0100 Subject: [mapserver-users] [SOLVED] More upgrade problems In-Reply-To: <4B915B01.8090107@mapgears.com> References: <20100221170123.B1F56E0132D@lists.osgeo.org> <4B90D4B9.5060505@xs4all.nl> <4B910B34.3080606@mapgears.com> <4B915A00.3080409@xs4all.nl> <4B915B01.8090107@mapgears.com> Message-ID: <4B929464.3040707@xs4all.nl> Daniel, Thank You ! It is the mapfile indeed. The LABEL block stated UTF8. Changing that to UTF-8 solved the problem. MArco Daniel Morissette schreef: >

DeDuikertjes wrote: >> >> postgis tells me the database ppa_test_database is encoded in UTF8 >> and not UTF-8. >> >> So apparently postgis wants to state UTF8 and iconv wants to hear UTF-8. >> >> Is there any way around this? >> > > I don't think MapServer reads the encoding value from PostGIS, it gets > it from the ENCODING parameter in your LABEL block in your mapfile. > > Make sure the ENCODING value in your mapfile are all valid (one of > them must be using UTF8 instead of UTF-8). > > Daniel From szekerest at gmail.com Sat Mar 6 13:56:45 2010 From: szekerest at gmail.com (Tamas Szekeres) Date: Sat, 6 Mar 2010 22:56:45 +0100 Subject: [mapserver-users] Re: Getfeatureinfo and MSsql 2008 server In-Reply-To: <33fad6881003030922x7fa5657bv580ab5d4941a9d28@mail.gmail.com> References: <1267346521269-4648413.post@n2.nabble.com> <481001603-1267446496-cardhu_decombobulator_blackberry.rim.net-1327865842-@bda2004.bisx.produk.on.blackberry> <1267518885358-4659685.post@n2.nabble.com> <33fad6881003021133i67ce4b4bh90c353bc762cae0e@mail.gmail.com> <33fad6881003030921m75b3a7dcu27a99d4449adf4f@mail.gmail.com> <33fad6881003030922x7fa5657bv580ab5d4941a9d28@mail.gmail.com> Message-ID: I've just applied a couple of fixes in both the development and the stable branches with regards to the MSSQL2008 driver. The details of the fixes have been added to. http://trac.osgeo.org/mapserver/ticket/3058 Ready to use binaries containing the recent fixes are available at: http://vbkto.dyndns.org/sdk/ Any feedback and further testing efforts would be helpful, before we issue the next stable release 5.6.2 (hopefully in the next week) Best regards, Tamas 2010/3/3 Paul james > > Hi > I?m sending a point table that I?m using to test... > > > Layer definition : > LAYER > NAME Test > METADATA > "wms_title" "Test" ##required > > "wms_feature_info_mime_type" "text/html" > END > TYPE POINT > STATUS ON > INCLUDE "Connection.map" > DATA "the_geom from tblGeo_Porto USING UNIQUE CodigoPorto USING > SRID=0" > > TOLERANCE 14 > TEMPLATE "query.html" > > CLASS > TEMPLATE "dummy" > NAME "Test" > STYLE > SYMBOL 'test_15' > COLOR 0 0 0 > ANTIALIAS TRUE > END > END > END > > Nquery CGI call : > > http://localhost/cgi-bin-last/mapserv.exe?map=Map.map&mode=nquery&LAYERS=Test&mapext=-54.463422851562+-28.5204328125+-54.155805664062+-28.267747265625&imgext=-54.463422851562+-28.5204328125+-54.155805664062+-28.267747265625&map_size=1221+670&imgxy=1221+670&imgbox=0+0+1221+670 > > I got : > Content-type: text/html > > Using Postgis (same code) works fine... > > If you need, I can send the GetFeatureInfo code as well... But I think it?s > the same "bug" ... > > The db data is attached... > > Paul > > > > > On Tue, Mar 2, 2010 at 8:01 PM, Tamas Szekeres wrote: > >> Paul >> >> It would be helpful to have some test data to reproduce your problem. >> >> In the meantime I've found an issue with regards of the query handling in >> the sql2008 driver and working on a fix right now, however I'm not sure if >> it is related to the problem of yours. >> >> Best regards, >> >> Tamas >> >> >> 2010/3/2 Paul james >> >> Hi ... >>> >>> I have the same error here using Getfeature and Mssql2008... Works fine >>> with Postgis connection ... >>> >>> My last test was using Getfeature with a Point Layer... The message >>> returned was : >>> >>> >>> Content-type: application/vnd.ogc.se_xml >>> >>> >>> >> http://schemas.opengis.net/wms/1.1.1/exception_1_1_1.dtd"> >>> >>> >>> >>> >>> >>> No error reported using DEBUG mode... >>> >>> The query generated was : >>> >>> SELECT convert(varchar(max), oid),convert(varchar(max), >>> id),the_geom.STAsBinary(),convert(varchar(20), oid) from viw_test WHERE >>> the_geom.STIntersects(Geometry::STGeomFromText('POLYGON((-62.4340041752662 >>> -11.1071026733531,-61.8187697837838 -11.1071026733531,-61.8187697837838 >>> -10.4918682818707,-62.4340041752662 -10.4918682818707,-62.4340041752662 >>> -11.1071026733531))',0)) = 1 >>> >>> That query executed in Analyser return the right result: >>> 0x010100000000917EFB3A104FC061A6ED5F598925C0 >>> >>> Using CGI NQuery also doesnt work, returning : >>> Content-type: text/html >>> >>> If you need more details, let me know... >>> >>> Paul >>> >>> >>> >>> >>> On Tue, Mar 2, 2010 at 5:34 AM, Afroz Kannancheri wrote: >>> >>>> >>>> Dear Tamas, >>>> Heres the debug log obtained when i clicked on the polygon >>>> >>>> [Tue Mar 02 12:28:47 2010].113000 msMSSQL2008LayerOpen called >>>> datastatement: >>>> geom from region1 USING UNIQUE id USING SRID=4326 >>>> [Tue Mar 02 12:28:47 2010].113000 MSMSSQL2008LayerOpen -- shared >>>> connection >>>> not available. >>>> [Tue Mar 02 12:28:47 2010].957000 >>>> >>>> msConnPoolRegister(region1,server=3.254.254.34;uid=sa;pwd=pwd;database=map;Integrated >>>> Security=false,01E39FC0) >>>> [Tue Mar 02 12:28:47 2010].957000 msMSSQL2008LayerParseData: unique >>>> column = >>>> id, srid='4326', geom_column_name = geom, table_name=region1 >>>> [Tue Mar 02 12:28:47 2010].957000 msMSSQL2008LayerFreeItemInfo called >>>> [Tue Mar 02 12:28:47 2010].957000 in msMSSQL2008LayerGetItems (find >>>> column >>>> names) >>>> [Tue Mar 02 12:28:48 2010].113000 msMSSQL2008LayerInitItemInfo called >>>> [Tue Mar 02 12:28:48 2010].113000 msMSSQL2008LayerInitItemInfo called >>>> [Tue Mar 02 12:28:48 2010].113000 msMSSQL2008LayerWhichShapes called >>>> [Tue Mar 02 12:28:48 2010].113000 query_string_temp:SELECT >>>> convert(varchar(max), ID),convert(varchar(max), >>>> name),convert(varchar(max), >>>> flag1),convert(varchar(max), flag2),convert(varchar(max), >>>> flag3),geom.STAsBinary(),convert(varchar(20), id) from region1 WHERE >>>> geom.STIntersects(Geometry::STGeomFromText('POLYGON((55.4843749962207 >>>> -4.59960928778372,56.5390624973545 -4.59960928778372,56.5390624973545 >>>> -3.54492178664993,55.4843749962207 -3.54492178664993,55.4843749962207 >>>> -4.59960928778372))',4326)) = 1 >>>> [Tue Mar 02 12:28:48 2010].394000 msMSSQL2008LayerClose datastatement: >>>> geom >>>> from region1 USING UNIQUE id USING SRID=4326 >>>> [Tue Mar 02 12:28:48 2010].394000 >>>> >>>> msConnPoolRelease(region1,server=3.254.254.34;uid=sa;pwd=pwd;database=map;Integrated >>>> Security=false,01E39FC0) >>>> [Tue Mar 02 12:28:48 2010].394000 >>>> >>>> msConnPoolClose(server=3.254.254.34;uid=sa;pwd=pwd;database=map;Integrated >>>> Security=false,01E39FC0) >>>> [Tue Mar 02 12:28:48 2010].410000 freeLayer(): freeing layer at >>>> 01E15180. >>>> >>>> Thnx >>>> Afroz >>>> -- >>>> View this message in context: >>>> http://n2.nabble.com/Getfeatureinfo-and-MSsql-2008-server-tp4631781p4659685.html >>>> Sent from the Mapserver - User mailing list archive at Nabble.com. >>>> _______________________________________________ >>>> mapserver-users mailing list >>>> mapserver-users at lists.osgeo.org >>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users >>>> >>> >>> >> > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From afrozk at gmail.com Sat Mar 6 22:23:43 2010 From: afrozk at gmail.com (Afroz Kannancheri) Date: Sat, 6 Mar 2010 22:23:43 -0800 (PST) Subject: [mapserver-users] Re: Getfeatureinfo and MSsql 2008 server In-Reply-To: References: <481001603-1267446496-cardhu_decombobulator_blackberry.rim.net-1327865842-@bda2004.bisx.produk.on.blackberry> <1267518885358-4659685.post@n2.nabble.com> <33fad6881003021133i67ce4b4bh90c353bc762cae0e@mail.gmail.com> <33fad6881003030922x7fa5657bv580ab5d4941a9d28@mail.gmail.com> Message-ID: <1267943023319-4689344.post@n2.nabble.com> Dear All, Just installed the patch and tried. Works great now . Great Work. Would do more tests n let you know if thers anything. Once again a big thanks to Mr. Tamaz for his extensive support and help and for bringing up this fix. Also thanku all who has supported nd helped Thnks Afroz kannancheri Kodiyathur. -- View this message in context: http://n2.nabble.com/Getfeatureinfo-and-MSsql-2008-server-tp4631781p4689344.html Sent from the Mapserver - User mailing list archive at Nabble.com. From khatriprateek at gmail.com Sun Mar 7 05:33:49 2010 From: khatriprateek at gmail.com (mrityunjay) Date: Sun, 7 Mar 2010 05:33:49 -0800 (PST) Subject: [mapserver-users] shapeObj constructor Message-ID: <1267968829745-4690347.post@n2.nabble.com> I'm using mapscript in java. The shapeObj constructor requires a variable of type int. The available options in the mapscript constants are: MS_SHP_POINTZ, MS_SHP_ARCZ, MS_SHP_POLYGONZ, MS_SHP_MULTIPOINTZ MS_SHP_POINTM, MS_SHP_ARCM, MS_SHP_POLYGONM, MS_SHP_MULTIPOINTM Which one should I use for shapeObj for line type geometry feature? Actually using MS_SHP_POLYGONZ gives error for the layer of type line. Thanks -- View this message in context: http://n2.nabble.com/shapeObj-constructor-tp4690347p4690347.html Sent from the Mapserver - User mailing list archive at Nabble.com. From szekerest at gmail.com Sun Mar 7 07:18:23 2010 From: szekerest at gmail.com (Tamas Szekeres) Date: Sun, 7 Mar 2010 16:18:23 +0100 Subject: [mapserver-users] shapeObj constructor In-Reply-To: <1267968829745-4690347.post@n2.nabble.com> References: <1267968829745-4690347.post@n2.nabble.com> Message-ID: You must specify the desired shape type as the argument which can be: MS_SHAPE_TYPE.MS_SHAPE_NULL MS_SHAPE_TYPE.MS_SHAPE_POINT MS_SHAPE_TYPE.MS_SHAPE_LINE MS_SHAPE_TYPE.MS_SHAPE_POLYGON Best regards, Tamas 2010/3/7 mrityunjay > > I'm using mapscript in java. The shapeObj constructor requires a variable > of > type int. The available options in the mapscript constants are: > MS_SHP_POINTZ, MS_SHP_ARCZ, MS_SHP_POLYGONZ, MS_SHP_MULTIPOINTZ > MS_SHP_POINTM, MS_SHP_ARCM, MS_SHP_POLYGONM, MS_SHP_MULTIPOINTM > > Which one should I use for shapeObj for line type geometry feature? > Actually > using MS_SHP_POLYGONZ gives error for the layer of type line. > Thanks > -- > View this message in context: > http://n2.nabble.com/shapeObj-constructor-tp4690347p4690347.html > Sent from the Mapserver - User mailing list archive at Nabble.com. > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > -------------- next part -------------- An HTML attachment was scrubbed... URL: From khatriprateek at gmail.com Sun Mar 7 07:41:46 2010 From: khatriprateek at gmail.com (Prateek Khatri) Date: Sun, 7 Mar 2010 21:11:46 +0530 Subject: [mapserver-users] shapeObj constructor In-Reply-To: References: <1267968829745-4690347.post@n2.nabble.com> Message-ID: Hi Tamas, Thanks for the reply. I tried that also but it gives error because MS_SHAPE_TYPE.MS_SHAPE_LINE is not of type int. On Sun, Mar 7, 2010 at 8:48 PM, Tamas Szekeres wrote: > You must specify the desired shape type as the argument which can be: > > MS_SHAPE_TYPE.MS_SHAPE_NULL > MS_SHAPE_TYPE.MS_SHAPE_POINT > MS_SHAPE_TYPE.MS_SHAPE_LINE > MS_SHAPE_TYPE.MS_SHAPE_POLYGON > > Best regards, > > Tamas > > > > 2010/3/7 mrityunjay > >> >> I'm using mapscript in java. The shapeObj constructor requires a variable >> of >> type int. The available options in the mapscript constants are: >> MS_SHP_POINTZ, MS_SHP_ARCZ, MS_SHP_POLYGONZ, MS_SHP_MULTIPOINTZ >> MS_SHP_POINTM, MS_SHP_ARCM, MS_SHP_POLYGONM, MS_SHP_MULTIPOINTM >> >> Which one should I use for shapeObj for line type geometry feature? >> Actually >> using MS_SHP_POLYGONZ gives error for the layer of type line. >> Thanks >> -- >> View this message in context: >> http://n2.nabble.com/shapeObj-constructor-tp4690347p4690347.html >> Sent from the Mapserver - User mailing list archive at Nabble.com. >> _______________________________________________ >> mapserver-users mailing list >> mapserver-users at lists.osgeo.org >> http://lists.osgeo.org/mailman/listinfo/mapserver-users >> > > -- Regards Prateek Khatri Fourth Year Undergraduate Computer Science and Engineering Indian Institute of Technology Bombay -------------- next part -------------- An HTML attachment was scrubbed... URL: From medvezs84 at gmail.com Sun Mar 7 11:46:44 2010 From: medvezs84 at gmail.com (Medve Zsolt) Date: Sun, 07 Mar 2010 20:46:44 +0100 Subject: [mapserver-users] Raster Display Performance Message-ID: <4B9402A4.4050506@gmail.com> Hy all! I would like to ask for a help. I have a dataset. 30 pieces of Tif file, aproximately 240 MB each. I make a layer in the map file: LAYER NAME "something" STATUS ON TILEINDEX "sh.shp" TILEITEM "Location" TYPE RASTER METADATA "DESCRIPTION" "Something too" "ows_title" "dem" END END I use this in the pmapper framework.(But its doing the same thing in ka-map either) But its apeaars very slowly and when i panning its reload all and its very slowly too.. i would like to tune up the performance somwhow. I am looking the gdaladdo program, because mapserver documentation suggest it. But when i tried the given examples (http://www.gdal.org/gdaladdo.html) it wont work, or i dont know what to see, Its just do nothing i think.. Can anybody help me on this? Or any method to make a better performance? please! thanks, Zsolt From SansonR at asurequality.com Sun Mar 7 12:17:56 2010 From: SansonR at asurequality.com (Robert Sanson) Date: Mon, 08 Mar 2010 09:17:56 +1300 Subject: [mapserver-users] Raster Display Performance In-Reply-To: <4B9402A4.4050506@gmail.com> References: <4B9402A4.4050506@gmail.com> Message-ID: <4B94C0C3.379F.0037.0@asurequality.com> Hi Zsolt Before you use gdaladdo, I would make sure that the internal structure on your TIFF files is tile based. You can use gdalinfo to check. If not, use gdal_translate to turn into a tile structure: gdal_translate -of GTiff -co TILED=YES -co BLOCKXSIZE=64 -co BLOCKYSIZE=64 input.tif output.tif After that use gdaladdo: gdaladdo -r average abc.tif 2 4 8 16 You should repeat this for every TIF image you have. Thirdly, create your index file using gdaltindex Finally, use shptree to create a spatial index on your index Shape file: shptree index.shp regards, Robert >>> Medve Zsolt 8/03/2010 8:46 a.m. >>> Hy all! I would like to ask for a help. I have a dataset. 30 pieces of Tif file, aproximately 240 MB each. I make a layer in the map file: LAYER NAME "something" STATUS ON TILEINDEX "sh.shp" TILEITEM "Location" TYPE RASTER METADATA "DESCRIPTION" "Something too" "ows_title" "dem" END END I use this in the pmapper framework.(But its doing the same thing in ka-map either) But its apeaars very slowly and when i panning its reload all and its very slowly too.. i would like to tune up the performance somwhow. I am looking the gdaladdo program, because mapserver documentation suggest it. But when i tried the given examples (http://www.gdal.org/gdaladdo.html) it wont work, or i dont know what to see, Its just do nothing i think.. Can anybody help me on this? Or any method to make a better performance? please! thanks, Zsolt _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ------------------------------------------------------------------ The contents of this email are confidential to AsureQuality. If you have received this communication in error please notify the sender immediately and delete the message and any attachments. The opinions expressed in this email are not necessarily those of AsureQuality. This message has been scanned for known viruses before delivery. AsureQuality supports the Unsolicited Electronic Messages Act 2007. If you do not wish to receive similar communications in future, please notify the sender of this message. ------------------------------------------------------------------ This message has been scanned for malware by SurfControl plc. www.surfcontrol.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From szekerest at gmail.com Sun Mar 7 12:24:53 2010 From: szekerest at gmail.com (Tamas Szekeres) Date: Sun, 7 Mar 2010 21:24:53 +0100 Subject: [mapserver-users] shapeObj constructor In-Reply-To: References: <1267968829745-4690347.post@n2.nabble.com> Message-ID: Just try to cast the value to int type. Best regards, Tamas 2010/3/7 Prateek Khatri > Hi Tamas, > Thanks for the reply. I tried that also but it gives error because > MS_SHAPE_TYPE.MS_SHAPE_LINE is not of type int. > > > > > On Sun, Mar 7, 2010 at 8:48 PM, Tamas Szekeres wrote: > >> You must specify the desired shape type as the argument which can be: >> >> MS_SHAPE_TYPE.MS_SHAPE_NULL >> MS_SHAPE_TYPE.MS_SHAPE_POINT >> MS_SHAPE_TYPE.MS_SHAPE_LINE >> MS_SHAPE_TYPE.MS_SHAPE_POLYGON >> >> Best regards, >> >> Tamas >> >> >> >> 2010/3/7 mrityunjay >> >>> >>> I'm using mapscript in java. The shapeObj constructor requires a variable >>> of >>> type int. The available options in the mapscript constants are: >>> MS_SHP_POINTZ, MS_SHP_ARCZ, MS_SHP_POLYGONZ, MS_SHP_MULTIPOINTZ >>> MS_SHP_POINTM, MS_SHP_ARCM, MS_SHP_POLYGONM, MS_SHP_MULTIPOINTM >>> >>> Which one should I use for shapeObj for line type geometry feature? >>> Actually >>> using MS_SHP_POLYGONZ gives error for the layer of type line. >>> Thanks >>> -- >>> View this message in context: >>> http://n2.nabble.com/shapeObj-constructor-tp4690347p4690347.html >>> Sent from the Mapserver - User mailing list archive at Nabble.com. >>> _______________________________________________ >>> mapserver-users mailing list >>> mapserver-users at lists.osgeo.org >>> http://lists.osgeo.org/mailman/listinfo/mapserver-users >>> >> >> > > > -- > Regards > Prateek Khatri > Fourth Year Undergraduate > Computer Science and Engineering > Indian Institute of Technology Bombay > -------------- next part -------------- An HTML attachment was scrubbed... URL: From warmerdam at pobox.com Sun Mar 7 13:30:24 2010 From: warmerdam at pobox.com (Frank Warmerdam) Date: Sun, 07 Mar 2010 16:30:24 -0500 Subject: [mapserver-users] Raster Display Performance In-Reply-To: <4B9402A4.4050506@gmail.com> References: <4B9402A4.4050506@gmail.com> Message-ID: <4B941AF0.9030800@pobox.com> Medve Zsolt wrote: > I am looking the gdaladdo program, because mapserver documentation > suggest it. But when i tried the given examples > (http://www.gdal.org/gdaladdo.html) it wont work, or i dont know what to > see, Its just do nothing i think.. > > Can anybody help me on this? Or any method to make a better performance? > please! Zsolt, Building overviews is a useful step. It would be helpful if you could be more specific about what you did, and how it failed. Best regards, -- ---------------------------------------+-------------------------------------- I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com light and sound - activate the windows | http://pobox.com/~warmerdam and watch the world go round - Rush | Geospatial Programmer for Rent From siki at agt.bme.hu Sun Mar 7 14:01:52 2010 From: siki at agt.bme.hu (Siki Zoltan) Date: Sun, 7 Mar 2010 23:01:52 +0100 (CET) Subject: [mapserver-users] Raster Display Performance In-Reply-To: <4B9402A4.4050506@gmail.com> References: <4B9402A4.4050506@gmail.com> Message-ID: Dear Zsolt, You sould make pyramid and tiles. Divide the original images into smaller pieces. You can use gdal_translate. (I usually use approx 10 MB or smaller image size) Use gdaladdo to create pyramid. Regards Zoltan On Sun, 7 Mar 2010, Medve Zsolt wrote: > Hy all! > > I would like to ask for a help. I have a dataset. 30 pieces of Tif file, > aproximately 240 MB each. > I make a layer in the map file: > > LAYER > NAME "something" > STATUS ON > TILEINDEX "sh.shp" > TILEITEM "Location" > TYPE RASTER > > METADATA > "DESCRIPTION" "Something too" > "ows_title" "dem" > END > END > > I use this in the pmapper framework.(But its doing the same thing in ka-map > either) But its apeaars very slowly and when i panning its reload all and its > very slowly too.. i would like to tune up the performance somwhow. > I am looking the gdaladdo program, because mapserver documentation suggest > it. But when i tried the given examples (http://www.gdal.org/gdaladdo.html) > it wont work, or i dont know what to see, Its just do nothing i think.. > > Can anybody help me on this? Or any method to make a better performance? > please! > > thanks, > Zsolt > > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From pauljame at gmail.com Mon Mar 8 06:25:16 2010 From: pauljame at gmail.com (Paul james) Date: Mon, 8 Mar 2010 11:25:16 -0300 Subject: [mapserver-users] Re: Getfeatureinfo and MSsql 2008 server In-Reply-To: References: <1267346521269-4648413.post@n2.nabble.com> <481001603-1267446496-cardhu_decombobulator_blackberry.rim.net-1327865842-@bda2004.bisx.produk.on.blackberry> <1267518885358-4659685.post@n2.nabble.com> <33fad6881003021133i67ce4b4bh90c353bc762cae0e@mail.gmail.com> <33fad6881003030921m75b3a7dcu27a99d4449adf4f@mail.gmail.com> <33fad6881003030922x7fa5657bv580ab5d4941a9d28@mail.gmail.com> Message-ID: <33fad6881003080625r397d63e6n92d647902d4784f1@mail.gmail.com> Now It?s working Tamas... I?ll test more later... Thanks ! Paul On Sat, Mar 6, 2010 at 6:56 PM, Tamas Szekeres wrote: > I've just applied a couple of fixes in both the development and the stable > branches with regards to the MSSQL2008 driver. > > The details of the fixes have been added to. > http://trac.osgeo.org/mapserver/ticket/3058 > > Ready to use binaries containing the recent fixes are available at: > > http://vbkto.dyndns.org/sdk/ > > Any feedback and further testing efforts would be helpful, before we issue > the next stable release 5.6.2 (hopefully in the next week) > > Best regards, > > Tamas > > > > 2010/3/3 Paul james > > >> Hi >> I?m sending a point table that I?m using to test... >> >> >> Layer definition : >> LAYER >> NAME Test >> METADATA >> "wms_title" "Test" ##required >> >> "wms_feature_info_mime_type" "text/html" >> END >> TYPE POINT >> STATUS ON >> INCLUDE "Connection.map" >> DATA "the_geom from tblGeo_Porto USING UNIQUE CodigoPorto USING >> SRID=0" >> >> TOLERANCE 14 >> TEMPLATE "query.html" >> >> CLASS >> TEMPLATE "dummy" >> NAME "Test" >> STYLE >> SYMBOL 'test_15' >> COLOR 0 0 0 >> ANTIALIAS TRUE >> END >> END >> END >> >> Nquery CGI call : >> >> http://localhost/cgi-bin-last/mapserv.exe?map=Map.map&mode=nquery&LAYERS=Test&mapext=-54.463422851562+-28.5204328125+-54.155805664062+-28.267747265625&imgext=-54.463422851562+-28.5204328125+-54.155805664062+-28.267747265625&map_size=1221+670&imgxy=1221+670&imgbox=0+0+1221+670 >> >> I got : >> Content-type: text/html >> >> Using Postgis (same code) works fine... >> >> If you need, I can send the GetFeatureInfo code as well... But I think >> it?s the same "bug" ... >> >> The db data is attached... >> >> Paul >> >> >> >> >> On Tue, Mar 2, 2010 at 8:01 PM, Tamas Szekeres wrote: >> >>> Paul >>> >>> It would be helpful to have some test data to reproduce your problem. >>> >>> In the meantime I've found an issue with regards of the query handling in >>> the sql2008 driver and working on a fix right now, however I'm not sure if >>> it is related to the problem of yours. >>> >>> Best regards, >>> >>> Tamas >>> >>> >>> 2010/3/2 Paul james >>> >>> Hi ... >>>> >>>> I have the same error here using Getfeature and Mssql2008... Works fine >>>> with Postgis connection ... >>>> >>>> My last test was using Getfeature with a Point Layer... The message >>>> returned was : >>>> >>>> >>>> Content-type: application/vnd.ogc.se_xml >>>> >>>> >>>> >>> http://schemas.opengis.net/wms/1.1.1/exception_1_1_1.dtd"> >>>> >>>> >>>> >>>> >>>> >>>> No error reported using DEBUG mode... >>>> >>>> The query generated was : >>>> >>>> SELECT convert(varchar(max), oid),convert(varchar(max), >>>> id),the_geom.STAsBinary(),convert(varchar(20), oid) from viw_test WHERE >>>> the_geom.STIntersects(Geometry::STGeomFromText('POLYGON((-62.4340041752662 >>>> -11.1071026733531,-61.8187697837838 -11.1071026733531,-61.8187697837838 >>>> -10.4918682818707,-62.4340041752662 -10.4918682818707,-62.4340041752662 >>>> -11.1071026733531))',0)) = 1 >>>> >>>> That query executed in Analyser return the right result: >>>> 0x010100000000917EFB3A104FC061A6ED5F598925C0 >>>> >>>> Using CGI NQuery also doesnt work, returning : >>>> Content-type: text/html >>>> >>>> If you need more details, let me know... >>>> >>>> Paul >>>> >>>> >>>> >>>> >>>> On Tue, Mar 2, 2010 at 5:34 AM, Afroz Kannancheri wrote: >>>> >>>>> >>>>> Dear Tamas, >>>>> Heres the debug log obtained when i clicked on the polygon >>>>> >>>>> [Tue Mar 02 12:28:47 2010].113000 msMSSQL2008LayerOpen called >>>>> datastatement: >>>>> geom from region1 USING UNIQUE id USING SRID=4326 >>>>> [Tue Mar 02 12:28:47 2010].113000 MSMSSQL2008LayerOpen -- shared >>>>> connection >>>>> not available. >>>>> [Tue Mar 02 12:28:47 2010].957000 >>>>> >>>>> msConnPoolRegister(region1,server=3.254.254.34;uid=sa;pwd=pwd;database=map;Integrated >>>>> Security=false,01E39FC0) >>>>> [Tue Mar 02 12:28:47 2010].957000 msMSSQL2008LayerParseData: unique >>>>> column = >>>>> id, srid='4326', geom_column_name = geom, table_name=region1 >>>>> [Tue Mar 02 12:28:47 2010].957000 msMSSQL2008LayerFreeItemInfo called >>>>> [Tue Mar 02 12:28:47 2010].957000 in msMSSQL2008LayerGetItems (find >>>>> column >>>>> names) >>>>> [Tue Mar 02 12:28:48 2010].113000 msMSSQL2008LayerInitItemInfo called >>>>> [Tue Mar 02 12:28:48 2010].113000 msMSSQL2008LayerInitItemInfo called >>>>> [Tue Mar 02 12:28:48 2010].113000 msMSSQL2008LayerWhichShapes called >>>>> [Tue Mar 02 12:28:48 2010].113000 query_string_temp:SELECT >>>>> convert(varchar(max), ID),convert(varchar(max), >>>>> name),convert(varchar(max), >>>>> flag1),convert(varchar(max), flag2),convert(varchar(max), >>>>> flag3),geom.STAsBinary(),convert(varchar(20), id) from region1 WHERE >>>>> geom.STIntersects(Geometry::STGeomFromText('POLYGON((55.4843749962207 >>>>> -4.59960928778372,56.5390624973545 -4.59960928778372,56.5390624973545 >>>>> -3.54492178664993,55.4843749962207 -3.54492178664993,55.4843749962207 >>>>> -4.59960928778372))',4326)) = 1 >>>>> [Tue Mar 02 12:28:48 2010].394000 msMSSQL2008LayerClose datastatement: >>>>> geom >>>>> from region1 USING UNIQUE id USING SRID=4326 >>>>> [Tue Mar 02 12:28:48 2010].394000 >>>>> >>>>> msConnPoolRelease(region1,server=3.254.254.34;uid=sa;pwd=pwd;database=map;Integrated >>>>> Security=false,01E39FC0) >>>>> [Tue Mar 02 12:28:48 2010].394000 >>>>> >>>>> msConnPoolClose(server=3.254.254.34;uid=sa;pwd=pwd;database=map;Integrated >>>>> Security=false,01E39FC0) >>>>> [Tue Mar 02 12:28:48 2010].410000 freeLayer(): freeing layer at >>>>> 01E15180. >>>>> >>>>> Thnx >>>>> Afroz >>>>> -- >>>>> View this message in context: >>>>> http://n2.nabble.com/Getfeatureinfo-and-MSsql-2008-server-tp4631781p4659685.html >>>>> Sent from the Mapserver - User mailing list archive at Nabble.com. >>>>> _______________________________________________ >>>>> mapserver-users mailing list >>>>> mapserver-users at lists.osgeo.org >>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users >>>>> >>>> >>>> >>> >> >> >> _______________________________________________ >> mapserver-users mailing list >> mapserver-users at lists.osgeo.org >> http://lists.osgeo.org/mailman/listinfo/mapserver-users >> >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: From Steve.Lime at state.mn.us Mon Mar 8 12:37:05 2010 From: Steve.Lime at state.mn.us (Lime, Steve D (DNR)) Date: Mon, 8 Mar 2010 14:37:05 -0600 Subject: [mapserver-users] Mapserver + Tcl Mapscript In-Reply-To: <82108beb1003060803g629f8a5fx19abcc0a3a16b5ca@mail.gmail.com> References: <82108beb1003060803g629f8a5fx19abcc0a3a16b5ca@mail.gmail.com> Message-ID: There are folks using TCL, but they're not terribly active on the development side of things. One group does have a set of patches they plan to supply that brings the Swig/TCL binding in line with others. I was hoping to get that into 5.6 but it didn't happen and now I'm hoping for 6.0. Hopefully they're reading along and chime in... ;-) Steve From: mapserver-users-bounces at lists.osgeo.org [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Thiago Tiedtke dos Reis Sent: Saturday, March 06, 2010 10:04 AM To: mapserver-users at lists.osgeo.org Subject: [mapserver-users] Mapserver + Tcl Mapscript Hi All, Anyone know if the status of tclmapscript is really stopped? There are a "step-by-step" to recompile the new mapserver with new tcl version (swing)? There are a people interested in do this? (me too, of course, want help, if need) Thanks in advance! Thiago Tiedtke dos Reis -------------- next part -------------- An HTML attachment was scrubbed... URL: From dalda at ikt.es Tue Mar 9 02:34:34 2010 From: dalda at ikt.es (David Alda Fernandez de Lezea) Date: Tue, 9 Mar 2010 11:34:34 +0100 Subject: [mapserver-users] Looking for advice for OGC Services Server hardware requirements Message-ID: <224DBDAF88A6AC47BD22432815351BE007CDDFF9@nekaposta1> Hello list, In our company, we are planning to set up a OGC Services Server using MapServer (we are currently using version 5.2.1, and at the moment it's working fine) to serve amounts of geographical data. We are going to serve big raster files (45 GB aprox each raster), so we need a big HDD (we know this). We are planning to have this raster files tiled with TileCache. We also are going to serve data via MapServer from another server in which we have an Oracle Spatial DataBase with very big tables and millions of rows, so we think that the communication between these 2 servers should be very fluid. All this services will be consumed by our own employees (50 aprox) or other people using desktop GIS software like gvSIG, Kosmo or ArcGIS. Besides, we are developing some web applications using OpenLayers, and this web apps will also consume those ogc services. So, our doubts have to do with the following subjects: - Processor - RAM Memory - HDD (we know that has to be large, i.e. 1TB - 2TB) - Number of network adapters (is advisable to have more than one?) - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) - Other suggestions... IMPORTANT: Take into account that this is going to be at PRODUCTION LEVEL. Hope someone can help me. Thanks!! Un saludo, ?????????????????????????????????????????????????????????????????????????????????? David Alda Fern?ndez de Lezea Lurralde eta Biodibertsitate Saila / Dpto. de Territorio y Biodiversidad IKT Granja Modelo s/n ? 01192 ? Arkaute (Araba) ?????????????????????????????????????????????????????????????????????????????????? Tlfnos.: 945-00-32-95 Fax: 945-00.32.90 ?????????????????????????????????????????????????????????????????????????????????? email: dalda at ikt.es web: www.ikt.es ?????????????????????????????????????????????????????????????????????????????????? From jiangtianscarlett at hotmail.com Tue Mar 9 03:19:39 2010 From: jiangtianscarlett at hotmail.com (Scarlett Jiang) Date: Tue, 9 Mar 2010 19:19:39 +0800 Subject: [mapserver-users] inquiries about mapserver functionalities Message-ID: Functionality Compatible Data XY data (point data) ESRI shapefiles SQL Server 2008 Spatial Map Service Access WMS WFS Background maps included (like Bing Maps or Google Maps) Map Handling Define layers? symbology Label placement Legend / Layer symbology thumbnail Layer thumbnails for table of content Dynamic overview map Create graphic output layers Tiled maps output Preproduction of map tiles Handle projections GIS Analysis Select by attribute Select by location Spatial queries like intersect Buffer analysis Advanced analysis tools like ESRI?s geoprocessing tools Editing Point editing Line editing Polygon editing Advanced editing support tools like snapping, trace etc To Who it may concern: I am a thesis student at WSP Sweden. Temporarily, we at WSP Sweden are trying to consider alternative map servers to ArcIMS. And we think that MapServer may be a good option. Nevertheless, We have a requirement list regarding functionalities that a map server should provide (see the table). Since we are new to Mapserver, we are not sure whether MapServer offers these functionalities. Can you please check this list and tell us what functionalities that MapServer is capable of doing? Thank you. Best Regards Scarlett Jiang _________________________________________________________________ Hotmail: Powerful Free email with security by Microsoft. https://signup.live.com/signup.aspx?id=60969 -------------- next part -------------- An HTML attachment was scrubbed... URL: From stephan.holl at intevation.de Tue Mar 9 05:54:05 2010 From: stephan.holl at intevation.de (Stephan Holl) Date: Tue, 9 Mar 2010 14:54:05 +0100 Subject: [mapserver-users] LABEL-formatting options Message-ID: <20100309145405.39e35896@thoe.hq.intevation.de> Hello mapservers, we are using MapServer for visualizing shapefiles with double entries inside. Mainly this are contour-lines from waterdepth. The double values have 32 decimal places and mapserver tries to render them _all_ along a contourline. This does not look nice... Is there an option to trim the values with a dedicated mapfile-parameter, e.g. where a prinft-syntax can be used to format the values? The shapefiles are generated automatically so adding another column with trunc()ed or round()ed values is no option. Are there any options to format label-values/strings? I have not found anything in the docs. TIA Stephan -- Stephan Holl | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabr?ck - HR B 18998 Gesch?ftsf?hrer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: not available URL: From crispinf at esdm.co.uk Tue Mar 9 07:26:28 2010 From: crispinf at esdm.co.uk (CrispinF) Date: Tue, 9 Mar 2010 07:26:28 -0800 (PST) Subject: [mapserver-users] WFS from database WKT: CONFIG "ODBC_OGR_FID" problem with text field Message-ID: <1268148388807-4702079.post@n2.nabble.com> Hi all Mapserver 5.6 WFS generated from WKT in SQL Server 2000 database. Connecting with: CONNECTIONTYPE OGR CONNECTION "ODBC:username/pwd at DSNname,viewname(geometryfieldname)" PROCESSING "CLOSE_CONNECTION=DEFER" All works fine for WMS, but for WFS requests I see the same SQL executed at the server for every record, along these lines Select * from viewname WHERE XMAX > 545000.00000000 AND XMIN < 550786.00000000 AND YMAX > 260040.00000000 AND YMIN < 270000.00000000 which works OK for small areas, but is tragic for larger ones. >From posts on these lists I realised MapServer cannot work out which is the PK, so I added this setting CONFIG "ODBC_OGR_FID" "UID" But IF my "UID" field is text, then it breaks my WFS completely. In the SQL trace I see this: Select * from viewname WHERE UID = 0 (which gives an error, and the WFS returns no records. I don't know where it makes up the 0 from, as that is not in my UID field - perhaps an arbitrary rowID assigned by MS?). Now if I make sure my table has an integer unique field, and refer to this in the CONFIG setting, it all works fine, but this is rather inconvenient in my scenario. I'm thinking this is a new bug in 5.6, because we used this setting in 4.10 to make GetFeatureInfo work and it liked text fields then. NB this setting with a text field also breaks GetFeatureInfo - I get an exception. Any tips on how to make this work with text field greatly appreciated, or perhaps confirmation that this is a bug? thanks Crispin -- View this message in context: http://n2.nabble.com/WFS-from-database-WKT-CONFIG-ODBC-OGR-FID-problem-with-text-field-tp4702079p4702079.html Sent from the Mapserver - User mailing list archive at Nabble.com. From warmerdam at pobox.com Tue Mar 9 07:40:49 2010 From: warmerdam at pobox.com (Frank Warmerdam) Date: Tue, 09 Mar 2010 10:40:49 -0500 Subject: [mapserver-users] WFS from database WKT: CONFIG "ODBC_OGR_FID" problem with text field In-Reply-To: <1268148388807-4702079.post@n2.nabble.com> References: <1268148388807-4702079.post@n2.nabble.com> Message-ID: <4B966C01.6060407@pobox.com> CrispinF wrote: > Hi all > Mapserver 5.6 WFS generated from WKT in SQL Server 2000 database. Connecting > with: > CONNECTIONTYPE OGR > CONNECTION "ODBC:username/pwd at DSNname,viewname(geometryfieldname)" > PROCESSING "CLOSE_CONNECTION=DEFER" > > All works fine for WMS, but for WFS requests I see the same SQL executed at > the server for every record, along these lines > Select * from viewname WHERE XMAX > 545000.00000000 AND XMIN < > 550786.00000000 AND YMAX > 260040.00000000 AND YMIN < 270000.00000000 > which works OK for small areas, but is tragic for larger ones. Crispin, I have recently incorporated support for the new query mechanism in the MapServer OGR connection type and with this it should avoid reissuing the select for each feature requests in queries (as WFS operates). Perhaps you could try MapServer built from the 5.6 branch or trunk? I do not believe this made it into 5.6.1 which I assume is the last released MapServer. >>From posts on these lists I realised MapServer cannot work out which is the > PK, so I added this setting > CONFIG "ODBC_OGR_FID" "UID" > But IF my "UID" field is text, then it breaks my WFS completely. In the SQL > trace I see this: > Select * from viewname WHERE UID = 0 (which gives an error, and the WFS > returns no records. I don't know where it makes up the 0 from, as that is > not in my UID field - perhaps an arbitrary rowID assigned by MS?). > Now if I make sure my table has an integer unique field, and refer to this > in the CONFIG setting, it all works fine, but this is rather inconvenient in > my scenario. > I'm thinking this is a new bug in 5.6, because we used this setting in 4.10 > to make GetFeatureInfo work and it liked text fields then. > NB this setting with a text field also breaks GetFeatureInfo - I get an > exception. > Any tips on how to make this work with text field greatly appreciated, or > perhaps confirmation that this is a bug? OGR will certainly not work with non-integer feature ids so if your feature id field is non-integer you should not try and convince OGR to use it as an fid. I'm not sure of the implications of non-integer feature ids at the MapServer WFS level - perhaps it works fine as long as OGR does not try to treat this value as it's own feature id. Best regards, -- ---------------------------------------+-------------------------------------- I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com light and sound - activate the windows | http://pobox.com/~warmerdam and watch the world go round - Rush | Geospatial Programmer for Rent From crispinf at esdm.co.uk Tue Mar 9 09:30:26 2010 From: crispinf at esdm.co.uk (CrispinF) Date: Tue, 9 Mar 2010 09:30:26 -0800 (PST) Subject: [mapserver-users] Re: WFS from database WKT: CONFIG "ODBC_OGR_FID" problem with text field In-Reply-To: <4B966C01.6060407@pobox.com> References: <1268148388807-4702079.post@n2.nabble.com> <4B966C01.6060407@pobox.com> Message-ID: <1268155826454-4703668.post@n2.nabble.com> Thanks Frank I think I've got your latest version by putting all the files from the bin folder of FWTools 2.4.7 into my MapServer scripts folder. After that, I see only two SQL requests hitting the database for each WFS layer request, instead of one per record. Overall it seems to be faster. And so this solves my CONFIG "ODBC_OGR_FID" problem, because it no longer matters whether OGR knows the FID. yours Crispin PS I've just noticed that this has done something odd to the appearance of my WMS, perhaps broken the anti-aliasing - looks like I need to be more selective over which new things to use from FWTools! -- View this message in context: http://n2.nabble.com/WFS-from-database-WKT-CONFIG-ODBC-OGR-FID-problem-with-text-field-tp4702079p4703668.html Sent from the Mapserver - User mailing list archive at Nabble.com. From warmerdam at pobox.com Tue Mar 9 09:36:23 2010 From: warmerdam at pobox.com (Frank Warmerdam) Date: Tue, 09 Mar 2010 12:36:23 -0500 Subject: [mapserver-users] Re: WFS from database WKT: CONFIG "ODBC_OGR_FID" problem with text field In-Reply-To: <1268155826454-4703668.post@n2.nabble.com> References: <1268148388807-4702079.post@n2.nabble.com> <4B966C01.6060407@pobox.com> <1268155826454-4703668.post@n2.nabble.com> Message-ID: <4B968717.6050201@pobox.com> CrispinF wrote: > Thanks Frank > I think I've got your latest version by putting all the files from the bin > folder of FWTools 2.4.7 into my MapServer scripts folder. > After that, I see only two SQL requests hitting the database for each WFS > layer request, instead of one per record. Overall it seems to be faster. > And so this solves my CONFIG "ODBC_OGR_FID" problem, because it no longer > matters whether OGR knows the FID. > yours > Crispin > > PS I've just noticed that this has done something odd to the appearance of > my WMS, perhaps broken the anti-aliasing - looks like I need to be more > selective over which new things to use from FWTools! Crispin, I am very uncomfortable with piecemeal use of FWTools libraries mixed with others ...lots of things can go wrong! You may be seeing issues with the versions of GD, AGG, etc in FWTools. Best regards, -- ---------------------------------------+-------------------------------------- I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com light and sound - activate the windows | http://pobox.com/~warmerdam and watch the world go round - Rush | Geospatial Programmer for Rent From ml at lingner.eu Tue Mar 9 09:46:00 2010 From: ml at lingner.eu (Lars Lingner) Date: Tue, 09 Mar 2010 18:46:00 +0100 Subject: [mapserver-users] LABEL-formatting options In-Reply-To: <20100309145405.39e35896@thoe.hq.intevation.de> References: <20100309145405.39e35896@thoe.hq.intevation.de> Message-ID: <4B968958.1020805@lingner.eu> Stephan Holl schrieb: > Hello mapservers, > > we are using MapServer for visualizing shapefiles with double entries > inside. > > Mainly this are contour-lines from waterdepth. The double values have > 32 decimal places and mapserver tries to render them _all_ along a > contourline. > This does not look nice... > > Is there an option to trim the values with a dedicated > mapfile-parameter, e.g. where a prinft-syntax can be used to format the > values? > > The shapefiles are generated automatically so adding another column with > trunc()ed or round()ed values is no option. > > Are there any options to format label-values/strings? I have not found > anything in the docs. > AFAIK there isn't a trim/cut function. If the numbers have the same ending you could define them as WARP character and they would be replaced by a line break. Would mapscript help you here? Or to make things more complicated: Couldn't you write the the shapefiles into an database? Then you could use trim/cut the value within your sql statement. Lars From Steve.Lime at state.mn.us Tue Mar 9 20:35:51 2010 From: Steve.Lime at state.mn.us (Lime, Steve D (DNR)) Date: Tue, 9 Mar 2010 22:35:51 -0600 Subject: [mapserver-users] LABEL-formatting options In-Reply-To: <20100309145405.39e35896@thoe.hq.intevation.de> References: <20100309145405.39e35896@thoe.hq.intevation.de> Message-ID: Hi Stephan: This is an increasingly asked question but at the moment I don't have a good solution or workaround, it's just not possible at the moment. There's a ticket already filed on the subject and it will be addressed in 6.0. Are you in a position where you could apply a patch to deal with the problem if one were available? Steve ________________________________________ From: mapserver-users-bounces at lists.osgeo.org [mapserver-users-bounces at lists.osgeo.org] On Behalf Of Stephan Holl [stephan.holl at intevation.de] Sent: Tuesday, March 09, 2010 7:54 AM To: mapserver-users at lists.osgeo.org Subject: [mapserver-users] LABEL-formatting options Hello mapservers, we are using MapServer for visualizing shapefiles with double entries inside. Mainly this are contour-lines from waterdepth. The double values have 32 decimal places and mapserver tries to render them _all_ along a contourline. This does not look nice... Is there an option to trim the values with a dedicated mapfile-parameter, e.g. where a prinft-syntax can be used to format the values? The shapefiles are generated automatically so adding another column with trunc()ed or round()ed values is no option. Are there any options to format label-values/strings? I have not found anything in the docs. TIA Stephan -- Stephan Holl | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabr?ck - HR B 18998 Gesch?ftsf?hrer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner From pcreso at pcreso.com Tue Mar 9 23:49:56 2010 From: pcreso at pcreso.com (pcreso at pcreso.com) Date: Tue, 9 Mar 2010 23:49:56 -0800 (PST) Subject: [mapserver-users] LABEL-formatting options In-Reply-To: Message-ID: <393448.721.qm@web33206.mail.mud.yahoo.com> Hi Stephan, Can you not add an appropriate column automatically as the shapefile is generated? Tools such as dbfscript (http://www.whitetown.com/dbf-script/) or perhaps script something with the shapelib libraries or tools or the ogr tools? I have found that using Postgis rather than shapefiles gives you the ability to easily manage such issues as the data retrieved by mapserver is derived from an SQL query which allows the creation of virtual "columns" for labels on the fly. Treating this sort of problem as a data management problem, in terms of supplying the desired data derived on the fly from the stored data, allows a tool such a Postgis to do what a database is designed for. A script using shp2pgsql or ogr2ogr to automatically turn your shapefile into a Postgis table, and render this using mapserver instead of the shapefile should fix your problem. Cheers, Brent Wood > On Behalf Of Stephan Holl [stephan.holl at intevation.de] > Sent: Tuesday, March 09, 2010 7:54 AM > To: mapserver-users at lists.osgeo.org > Subject: [mapserver-users] LABEL-formatting options > > Hello mapservers, > > we are using MapServer for visualizing shapefiles with > double entries > inside. > > Mainly this are contour-lines from waterdepth. The double > values have > 32 decimal places and mapserver tries to render them _all_ > along a > contourline. > This does not look nice... > > Is there an option to trim the values with a dedicated > mapfile-parameter, e.g. where a prinft-syntax can be used > to format the > values? > > The shapefiles are generated automatically so adding > another column with > trunc()ed or round()ed values is no option. > > Are there any options to format label-values/strings? I > have not found > anything in the docs. > > TIA > > ? ? ? ? Stephan > > -- > Stephan Holl > | Tel.: +49 (0)541-33 508 3663 > Intevation GmbH, Neuer Graben 17, 49074 OS? |? AG > Osnabr?ck - HR B 18998 > Gesch?ftsf?hrer:? Frank Koormann, Bernhard Reiter, > Dr. Jan-Oliver Wagner > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From stephan.holl at intevation.de Tue Mar 9 23:59:53 2010 From: stephan.holl at intevation.de (Stephan Holl) Date: Wed, 10 Mar 2010 08:59:53 +0100 Subject: [mapserver-users] LABEL-formatting options In-Reply-To: References: <20100309145405.39e35896@thoe.hq.intevation.de> Message-ID: <20100310085953.7b896727@thoe.hq.intevation.de> Hello Steve, "Lime, Steve D (DNR)" , [20100309 - 22:35:51] > Hi Stephan: This is an increasingly asked question but at the moment > I don't have a good solution or workaround, it's just not possible at > the moment. There's a ticket already filed on the subject and it will > be addressed in 6.0. > > Are you in a position where you could apply a patch to deal with the > problem if one were available? Sure I am, I would be happy to test a patch and give feedback. I will CC myself to the ticket[1], hopefully I have found the right one, there is another one with a similar topic[2] which seems only apply for templating. Anyway, thanks for your response, I am awaiting your patches for testing :) Cheers Stephan [1] http://trac.osgeo.org/mapserver/ticket/60 [2] http://trac.osgeo.org/mapserver/ticket/1634 > > Hello mapservers, > > we are using MapServer for visualizing shapefiles with double entries > inside. > > Mainly this are contour-lines from waterdepth. The double values have > 32 decimal places and mapserver tries to render them _all_ along a > contourline. > This does not look nice... > > Is there an option to trim the values with a dedicated > mapfile-parameter, e.g. where a prinft-syntax can be used to format > the values? > > The shapefiles are generated automatically so adding another column > with trunc()ed or round()ed values is no option. > > Are there any options to format label-values/strings? I have not found > anything in the docs. > > TIA > > Stephan > > -- > Stephan Holl | Tel.: +49 (0)541-33 508 > 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabr?ck - HR > B 18998 Gesch?ftsf?hrer: Frank Koormann, Bernhard Reiter, Dr. > Jan-Oliver Wagner -- Stephan Holl | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabr?ck - HR B 18998 Gesch?ftsf?hrer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: not available URL: From stephan.holl at intevation.de Wed Mar 10 00:09:14 2010 From: stephan.holl at intevation.de (Stephan Holl) Date: Wed, 10 Mar 2010 09:09:14 +0100 Subject: [mapserver-users] LABEL-formatting options In-Reply-To: <393448.721.qm@web33206.mail.mud.yahoo.com> References: <393448.721.qm@web33206.mail.mud.yahoo.com> Message-ID: <20100310090914.3becb84f@thoe.hq.intevation.de> Hello Brent, pcreso at pcreso.com, [20100309 - 23:49:56] > Hi Stephan, > > Can you not add an appropriate column automatically as the shapefile > is generated? > > Tools such as dbfscript (http://www.whitetown.com/dbf-script/) or > perhaps script something with the shapelib libraries or tools or the > ogr tools? Yes, it is possible. But: I think it is a feature which mapserver should deal with. > > I have found that using Postgis rather than shapefiles gives you the > ability to easily manage such issues as the data retrieved by > mapserver is derived from an SQL query which allows the creation of > virtual "columns" for labels on the fly. In our case we do not have a chance to use any DB at all, since the infrastructure permits it. The data are retrieved from caclculations, which are itself done on a (remote) server. > > Treating this sort of problem as a data management problem, in terms > of supplying the desired data derived on the fly from the stored > data, allows a tool such a Postgis to do what a database is designed > for. A script using shp2pgsql or ogr2ogr to automatically turn your > shapefile into a Postgis table, and render this using mapserver > instead of the shapefile should fix your problem. As said, the specific infrastructure (sadly) does not allow to use PostGIS and the like (yet).... I am after a more general approach (in order to make MapServer a little better), for my usecase it is easy to add a 'display'-column with the right decimal values trimmed. Cheers Stephan > > On Behalf Of Stephan Holl [stephan.holl at intevation.de] > > Sent: Tuesday, March 09, 2010 7:54 AM > > To: mapserver-users at lists.osgeo.org > > Subject: [mapserver-users] LABEL-formatting options > > > > Hello mapservers, > > > > we are using MapServer for visualizing shapefiles with > > double entries > > inside. > > > > Mainly this are contour-lines from waterdepth. The double > > values have > > 32 decimal places and mapserver tries to render them _all_ > > along a > > contourline. > > This does not look nice... > > > > Is there an option to trim the values with a dedicated > > mapfile-parameter, e.g. where a prinft-syntax can be used > > to format the > > values? > > > > The shapefiles are generated automatically so adding > > another column with > > trunc()ed or round()ed values is no option. > > > > Are there any options to format label-values/strings? I > > have not found > > anything in the docs. > > > > TIA > > > > ? ? ? ? Stephan > > > > -- > > Stephan Holl > > | Tel.: +49 (0)541-33 508 3663 > > Intevation GmbH, Neuer Graben 17, 49074 OS? |? AG > > Osnabr?ck - HR B 18998 > > Gesch?ftsf?hrer:? Frank Koormann, Bernhard Reiter, > > Dr. Jan-Oliver Wagner > > _______________________________________________ > > mapserver-users mailing list > > mapserver-users at lists.osgeo.org > > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > -- Stephan Holl | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabr?ck - HR B 18998 Gesch?ftsf?hrer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: not available URL: From pcreso at pcreso.com Wed Mar 10 00:25:21 2010 From: pcreso at pcreso.com (pcreso at pcreso.com) Date: Wed, 10 Mar 2010 00:25:21 -0800 (PST) Subject: [mapserver-users] LABEL-formatting options In-Reply-To: <20100310090914.3becb84f@thoe.hq.intevation.de> Message-ID: <590929.37701.qm@web33208.mail.mud.yahoo.com> Yep, always frustrating to suffer such constraints. Can you not define the layer in mapserver as an ogr layer rather than a native shapefile, and use ogr's pseudo-sql to cast/retrieve the value as a numeric more suitable for labeling with? http://www.gdal.org/ogr/ogr_sql.html Then in your mapfile use connectiontype ogr, as in: http://mapserver.org/input/vector/ogr.html (see example 4 with shapefiles joined in an ogr query) I agree it would be nice to have mapserver able to do this, but until then there should be some workaround (like this) that will suffice. Cheers, Brent --- On Wed, 3/10/10, Stephan Holl wrote: > From: Stephan Holl > Subject: Re: [mapserver-users] LABEL-formatting options > To: pcreso at pcreso.com > Cc: mapserver-users at lists.osgeo.org > Date: Wednesday, March 10, 2010, 9:09 PM > Hello Brent, > > pcreso at pcreso.com, > [20100309 - 23:49:56] > > > Hi Stephan, > > > > Can you not add an appropriate column automatically as > the shapefile > > is generated? > > > > Tools such as dbfscript (http://www.whitetown.com/dbf-script/) or > > perhaps script something with the shapelib libraries > or tools or the > > ogr tools? > > Yes, it is possible. > > But: I think it is a feature which mapserver should deal > with. > > > > > I have found that using Postgis rather than shapefiles > gives you the > > ability to easily manage such issues as the data > retrieved by > > mapserver is derived from an SQL query which allows > the creation of > > virtual "columns" for labels on the fly. > > In our case we do not have a chance to use any DB at all, > since the > infrastructure permits it. The data are retrieved from > caclculations, > which are itself done on a (remote) server. > > > > > Treating this sort of problem as a data management > problem, in terms > > of supplying the desired data derived on the fly from > the stored > > data, allows a tool such a Postgis to do what a > database is designed > > for. A script using shp2pgsql or ogr2ogr to > automatically turn your > > shapefile into a Postgis table, and render this using > mapserver > > instead of the shapefile should fix your problem. > > As said, the specific infrastructure (sadly) does not allow > to use > PostGIS and the like (yet).... > I am after a more general approach (in > order to make MapServer a little better), for my usecase it > is easy to > add a 'display'-column with the right decimal values > trimmed. > > Cheers > ??? > ??? Stephan > > > > On Behalf Of Stephan Holl [stephan.holl at intevation.de] > > > Sent: Tuesday, March 09, 2010 7:54 AM > > > To: mapserver-users at lists.osgeo.org > > > Subject: [mapserver-users] LABEL-formatting > options > > > > > > Hello mapservers, > > > > > > we are using MapServer for visualizing shapefiles > with > > > double entries > > > inside. > > > > > > Mainly this are contour-lines from waterdepth. > The double > > > values have > > > 32 decimal places and mapserver tries to render > them _all_ > > > along a > > > contourline. > > > This does not look nice... > > > > > > Is there an option to trim the values with a > dedicated > > > mapfile-parameter, e.g. where a prinft-syntax can > be used > > > to format the > > > values? > > > > > > The shapefiles are generated automatically so > adding > > > another column with > > > trunc()ed or round()ed values is no option. > > > > > > Are there any options to format > label-values/strings? I > > > have not found > > > anything in the docs. > > > > > > TIA > > > > > > ? ? ? ? Stephan > > > > > > -- > > > Stephan Holl > > > | Tel.: +49 (0)541-33 508 3663 > > > Intevation GmbH, Neuer Graben 17, 49074 OS? |? > AG > > > Osnabr?ck - HR B 18998 > > > Gesch?ftsf?hrer:? Frank Koormann, Bernhard > Reiter, > > > Dr. Jan-Oliver Wagner > > > _______________________________________________ > > > mapserver-users mailing list > > > mapserver-users at lists.osgeo.org > > > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > > > > > -- > Stephan Holl > | Tel.: +49 (0)541-33 508 3663 > Intevation GmbH, Neuer Graben 17, 49074 OS? |? AG > Osnabr?ck - HR B 18998 > Gesch?ftsf?hrer:? Frank Koormann, Bernhard Reiter, > Dr. Jan-Oliver Wagner > From stephan.holl at intevation.de Wed Mar 10 00:30:51 2010 From: stephan.holl at intevation.de (Stephan Holl) Date: Wed, 10 Mar 2010 09:30:51 +0100 Subject: [mapserver-users] LABEL-formatting options In-Reply-To: <590929.37701.qm@web33208.mail.mud.yahoo.com> References: <20100310090914.3becb84f@thoe.hq.intevation.de> <590929.37701.qm@web33208.mail.mud.yahoo.com> Message-ID: <20100310093051.2d697fbd@thoe.hq.intevation.de> Hello Brent, pcreso at pcreso.com, [20100310 - 00:25:21] > Yep, always frustrating to suffer such constraints. > > Can you not define the layer in mapserver as an ogr layer rather than > a native shapefile, and use ogr's pseudo-sql to cast/retrieve the > value as a numeric more suitable for labeling with? > > http://www.gdal.org/ogr/ogr_sql.html > > Then in your mapfile use connectiontype ogr, as in: > http://mapserver.org/input/vector/ogr.html > > (see example 4 with shapefiles joined in an ogr query) I have seen this example, but have not done any experiences in a productive env. Can you say anything about performance for this sort of ogr-layer? Is this comparable to shapefiles? > I agree it would be nice to have mapserver able to do this, but until > then there should be some workaround (like this) that will suffice. yes, sure. I guess it will be only some more lines of java-code to add another column with trim()ed values to the shape, but a generic solution will be even better. Cheers Stephan > --- On Wed, 3/10/10, Stephan Holl wrote: > > > From: Stephan Holl > > Subject: Re: [mapserver-users] LABEL-formatting options > > To: pcreso at pcreso.com > > Cc: mapserver-users at lists.osgeo.org > > Date: Wednesday, March 10, 2010, 9:09 PM > > Hello Brent, > > > > pcreso at pcreso.com, > > [20100309 - 23:49:56] > > > > > Hi Stephan, > > > > > > Can you not add an appropriate column automatically as > > the shapefile > > > is generated? > > > > > > Tools such as dbfscript (http://www.whitetown.com/dbf-script/) or > > > perhaps script something with the shapelib libraries > > or tools or the > > > ogr tools? > > > > Yes, it is possible. > > > > But: I think it is a feature which mapserver should deal > > with. > > > > > > > > I have found that using Postgis rather than shapefiles > > gives you the > > > ability to easily manage such issues as the data > > retrieved by > > > mapserver is derived from an SQL query which allows > > the creation of > > > virtual "columns" for labels on the fly. > > > > In our case we do not have a chance to use any DB at all, > > since the > > infrastructure permits it. The data are retrieved from > > caclculations, > > which are itself done on a (remote) server. > > > > > > > > Treating this sort of problem as a data management > > problem, in terms > > > of supplying the desired data derived on the fly from > > the stored > > > data, allows a tool such a Postgis to do what a > > database is designed > > > for. A script using shp2pgsql or ogr2ogr to > > automatically turn your > > > shapefile into a Postgis table, and render this using > > mapserver > > > instead of the shapefile should fix your problem. > > > > As said, the specific infrastructure (sadly) does not allow > > to use > > PostGIS and the like (yet).... > > I am after a more general approach (in > > order to make MapServer a little better), for my usecase it > > is easy to > > add a 'display'-column with the right decimal values > > trimmed. > > > > Cheers > > ??? > > ??? Stephan > > > > > > On Behalf Of Stephan Holl [stephan.holl at intevation.de] > > > > Sent: Tuesday, March 09, 2010 7:54 AM > > > > To: mapserver-users at lists.osgeo.org > > > > Subject: [mapserver-users] LABEL-formatting > > options > > > > > > > > Hello mapservers, > > > > > > > > we are using MapServer for visualizing shapefiles > > with > > > > double entries > > > > inside. > > > > > > > > Mainly this are contour-lines from waterdepth. > > The double > > > > values have > > > > 32 decimal places and mapserver tries to render > > them _all_ > > > > along a > > > > contourline. > > > > This does not look nice... > > > > > > > > Is there an option to trim the values with a > > dedicated > > > > mapfile-parameter, e.g. where a prinft-syntax can > > be used > > > > to format the > > > > values? > > > > > > > > The shapefiles are generated automatically so > > adding > > > > another column with > > > > trunc()ed or round()ed values is no option. > > > > > > > > Are there any options to format > > label-values/strings? I > > > > have not found > > > > anything in the docs. > > > > > > > > TIA > > > > > > > > ? ? ? ? Stephan > > > > > > > > -- > > > > Stephan Holl > > > > | Tel.: +49 (0)541-33 508 3663 > > > > Intevation GmbH, Neuer Graben 17, 49074 OS? |? > > AG > > > > Osnabr?ck - HR B 18998 > > > > Gesch?ftsf?hrer:? Frank Koormann, Bernhard > > Reiter, > > > > Dr. Jan-Oliver Wagner > > > > _______________________________________________ > > > > mapserver-users mailing list > > > > mapserver-users at lists.osgeo.org > > > > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > > > > > > > > > -- > > Stephan Holl > > | Tel.: +49 (0)541-33 508 3663 > > Intevation GmbH, Neuer Graben 17, 49074 OS? |? AG > > Osnabr?ck - HR B 18998 > > Gesch?ftsf?hrer:? Frank Koormann, Bernhard Reiter, > > Dr. Jan-Oliver Wagner > > -- Stephan Holl | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabr?ck - HR B 18998 Gesch?ftsf?hrer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: not available URL: From sdc at sdc.com.au Wed Mar 10 00:34:41 2010 From: sdc at sdc.com.au (Stephen Davies) Date: Wed, 10 Mar 2010 19:04:41 +1030 Subject: [mapserver-users] LABEL-formatting options In-Reply-To: References: <20100309145405.39e35896@thoe.hq.intevation.de> Message-ID: <201003101904.41192.sdc@sdc.com.au> I also would be very happy to test any patch that added label formatting capabilities. Cheers, Stephen On Wednesday 10 March 2010 15:05:51 Lime, Steve D (DNR) wrote: > Hi Stephan: This is an increasingly asked question but at the moment I > don't have a good solution or workaround, it's just not possible at the > moment. There's a ticket already filed on the subject and it will be > addressed in 6.0. > > Are you in a position where you could apply a patch to deal with the > problem if one were available? > > Steve > > ________________________________________ > From: mapserver-users-bounces at lists.osgeo.org > [mapserver-users-bounces at lists.osgeo.org] On Behalf Of Stephan Holl > [stephan.holl at intevation.de] Sent: Tuesday, March 09, 2010 7:54 AM > To: mapserver-users at lists.osgeo.org > Subject: [mapserver-users] LABEL-formatting options > > Hello mapservers, > > we are using MapServer for visualizing shapefiles with double entries > inside. > > Mainly this are contour-lines from waterdepth. The double values have > 32 decimal places and mapserver tries to render them _all_ along a > contourline. > This does not look nice... > > Is there an option to trim the values with a dedicated > mapfile-parameter, e.g. where a prinft-syntax can be used to format the > values? > > The shapefiles are generated automatically so adding another column with > trunc()ed or round()ed values is no option. > > Are there any options to format label-values/strings? I have not found > anything in the docs. > > TIA > > Stephan > > -- > Stephan Holl | Tel.: +49 (0)541-33 508 3663 > Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabr?ck - HR B 18998 > Gesch?ftsf?hrer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner -- ============================================================================= Stephen Davies Consulting P/L Voice: 08-8177 1595 Adelaide, South Australia. Fax : 08-8177 0133 Computing & Network solutions. Mobile:040 304 0583 From dalda at ikt.es Wed Mar 10 03:20:35 2010 From: dalda at ikt.es (David Alda Fernandez de Lezea) Date: Wed, 10 Mar 2010 12:20:35 +0100 Subject: RV: [mapserver-users] Looking for advice for OGC Services Server hardware requirements Message-ID: <224DBDAF88A6AC47BD22432815351BE007CDE4D5@nekaposta1> Nobody suggests anything?? -----Mensaje original----- De: mapserver-users-bounces at lists.osgeo.org [mailto:mapserver-users-bounces at lists.osgeo.org] En nombre de David Alda Fernandez de Lezea Enviado el: martes, 09 de marzo de 2010 11:35 Para: mapserver-users at lists.osgeo.org Asunto: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements Hello list, In our company, we are planning to set up a OGC Services Server using MapServer (we are currently using version 5.2.1, and at the moment it's working fine) to serve amounts of geographical data. We are going to serve big raster files (45 GB aprox each raster), so we need a big HDD (we know this). We are planning to have this raster files tiled with TileCache. We also are going to serve data via MapServer from another server in which we have an Oracle Spatial DataBase with very big tables and millions of rows, so we think that the communication between these 2 servers should be very fluid. All this services will be consumed by our own employees (50 aprox) or other people using desktop GIS software like gvSIG, Kosmo or ArcGIS. Besides, we are developing some web applications using OpenLayers, and this web apps will also consume those ogc services. So, our doubts have to do with the following subjects: - Processor - RAM Memory - HDD (we know that has to be large, i.e. 1TB - 2TB) - Number of network adapters (is advisable to have more than one?) - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) - Other suggestions... IMPORTANT: Take into account that this is going to be at PRODUCTION LEVEL. Hope someone can help me. Thanks!! Un saludo, ?????????????????????????????????????????????????????????????????????????????????? David Alda Fern?ndez de Lezea Lurralde eta Biodibertsitate Saila / Dpto. de Territorio y Biodiversidad IKT Granja Modelo s/n ? 01192 ? Arkaute (Araba) ?????????????????????????????????????????????????????????????????????????????????? Tlfnos.: 945-00-32-95 Fax: 945-00.32.90 ?????????????????????????????????????????????????????????????????????????????????? email: dalda at ikt.es web: www.ikt.es ?????????????????????????????????????????????????????????????????????????????????? _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users From James.Card at calcad.com Wed Mar 10 05:15:38 2010 From: James.Card at calcad.com (James Card) Date: Wed, 10 Mar 2010 05:15:38 -0800 Subject: [mapserver-users] Looking for advice for OGC Services Server hardware requirements In-Reply-To: <224DBDAF88A6AC47BD22432815351BE007CDE4D5@nekaposta1> References: <224DBDAF88A6AC47BD22432815351BE007CDE4D5@nekaposta1> Message-ID: On Wed, 10 Mar 2010 03:20:35 -0800, David Alda Fernandez de Lezea wrote: > So, our doubts have to do with the following subjects: > - Processor > - RAM Memory > - HDD (we know that has to be large, i.e. 1TB - 2TB) > - Number of network adapters (is advisable to have more than one?) > - Which OS is best for MapServer, Linux or Windows 2003 (in terms of > performance) > - Other suggestions... > > IMPORTANT: Take into account that this is going to be at PRODUCTION > LEVEL. I'm relatively new to MapServer so my experience is pretty limited. One of the tests we did was on a Dell Inspiron 8500 laptop that dual-booted Windows XP and Ubuntu 9.04 Desktop. On that machine our MapServer application ran about 14% faster on Linux than when running Windows. The limiting factor was CPU time. Our production server has 4GB of RAM and runs Windows Server 2008 64-bit. It provides good performance for our MapServer application, but it is not under heavy load and our data-set is less than one-tenth the size of yours. Multiple network connections sounds like a good plan to ensure that you can get data from your Oracle server quickly enough. -- James Card California CAD Solutions, Inc. 209-578-5580 - Voice 209-521-6493 - FAX From jfuch at indec.mecon.gov.ar Wed Mar 10 05:12:28 2010 From: jfuch at indec.mecon.gov.ar (Fuchs Juan Carlos) Date: Wed, 10 Mar 2010 10:12:28 -0300 Subject: [mapserver-users] Looking for advice for OGC Services Server hardware requirements Message-ID: Hi David Check out "Building a GIS System Architecture Design Strategies for Managers" from Dave Peters - Esri Press. Just as a start point. Cheers JC -----Mensaje original----- De: David Alda Fernandez de Lezea [mailto:dalda at ikt.es] Enviado el: Mi?rcoles, 10 de Marzo de 2010 08:21 a.m. Para: mapserver-users at lists.osgeo.org Asunto: RV: [mapserver-users] Looking for advice for OGC Services Server hardware requirements Nobody suggests anything?? -----Mensaje original----- De: mapserver-users-bounces at lists.osgeo.org [mailto:mapserver-users-bounces at lists.osgeo.org] En nombre de David Alda Fernandez de Lezea Enviado el: martes, 09 de marzo de 2010 11:35 Para: mapserver-users at lists.osgeo.org Asunto: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements Hello list, In our company, we are planning to set up a OGC Services Server using MapServer (we are currently using version 5.2.1, and at the moment it's working fine) to serve amounts of geographical data. We are going to serve big raster files (45 GB aprox each raster), so we need a big HDD (we know this). We are planning to have this raster files tiled with TileCache. We also are going to serve data via MapServer from another server in which we have an Oracle Spatial DataBase with very big tables and millions of rows, so we think that the communication between these 2 servers should be very fluid. All this services will be consumed by our own employees (50 aprox) or other people using desktop GIS software like gvSIG, Kosmo or ArcGIS. Besides, we are developing some web applications using OpenLayers, and this web apps will also consume those ogc services. So, our doubts have to do with the following subjects: - Processor - RAM Memory - HDD (we know that has to be large, i.e. 1TB - 2TB) - Number of network adapters (is advisable to have more than one?) - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) - Other suggestions... IMPORTANT: Take into account that this is going to be at PRODUCTION LEVEL. Hope someone can help me. Thanks!! Un saludo, ???????????????????????????????????????????????????????????????????????????? ?????? David Alda Fern?ndez de Lezea Lurralde eta Biodibertsitate Saila / Dpto. de Territorio y Biodiversidad IKT Granja Modelo s/n ? 01192 ? Arkaute (Araba) ???????????????????????????????????????????????????????????????????????????? ?????? Tlfnos.: 945-00-32-95 Fax: 945-00.32.90 ???????????????????????????????????????????????????????????????????????????? ?????? email: dalda at ikt.es web: www.ikt.es ???????????????????????????????????????????????????????????????????????????? ?????? _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users From luigi.cardeles at gmail.com Wed Mar 10 05:43:24 2010 From: luigi.cardeles at gmail.com (Luigi Castro Cardeles) Date: Wed, 10 Mar 2010 10:43:24 -0300 Subject: [mapserver-users] Looking for advice for OGC Services Server hardware requirements In-Reply-To: References: Message-ID: Hi, Maybe this can help you. http://2009.foss4g.org/presentations/#presentation_109 []'s Luigi Castro Cardeles 2010/3/10 Fuchs Juan Carlos : > Hi David > Check out "Building a GIS System Architecture Design Strategies for > Managers" from Dave Peters - Esri Press. Just as a start point. > Cheers > JC > > > > -----Mensaje original----- > De: David Alda Fernandez de Lezea [mailto:dalda at ikt.es] > Enviado el: Mi?rcoles, 10 de Marzo de 2010 08:21 a.m. > Para: mapserver-users at lists.osgeo.org > Asunto: RV: [mapserver-users] Looking for advice for OGC Services Server > hardware requirements > > > Nobody suggests anything?? > > -----Mensaje original----- > De: mapserver-users-bounces at lists.osgeo.org > [mailto:mapserver-users-bounces at lists.osgeo.org] En nombre de David Alda > Fernandez de Lezea > Enviado el: martes, 09 de marzo de 2010 11:35 > Para: mapserver-users at lists.osgeo.org > Asunto: [mapserver-users] Looking for advice for OGC Services Serverhardware > requirements > > > Hello list, > > In our company, we are planning to set up a OGC Services Server using > MapServer (we are currently using version 5.2.1, and at the moment it's > working fine) to serve amounts of geographical data. We are going to serve > big raster files (45 GB aprox each raster), so we need a big HDD (we know > this). We are planning to have this raster files tiled with TileCache. We > also are going to serve data via MapServer from another server in which we > have an Oracle Spatial DataBase with very big tables and millions of rows, > so we think that the communication between these 2 servers should be very > fluid. > > All this services will be consumed by our own employees (50 aprox) or other > people using desktop GIS software like gvSIG, Kosmo or ArcGIS. > > Besides, we are developing some web applications using OpenLayers, and this > web apps will also consume those ogc services. > > ?So, our doubts have to do with the following subjects: > ?- Processor > ?- RAM Memory > ?- HDD (we know that has to be large, i.e. 1TB - 2TB) > ?- Number of network adapters (is advisable to have more than one?) > ?- Which OS is best for MapServer, Linux or Windows 2003 (in terms of > performance) > ?- Other suggestions... > > IMPORTANT: Take into account that this is going to be at PRODUCTION LEVEL. > > Hope someone can help me. Thanks!! > > Un saludo, > > ???????????????????????????????????????????????????????????????????????????? > ?????? > > David Alda Fern?ndez de Lezea > Lurralde eta Biodibertsitate Saila / Dpto. de Territorio y Biodiversidad > > IKT > Granja Modelo s/n ? 01192 ? Arkaute (Araba) > > ???????????????????????????????????????????????????????????????????????????? > ?????? > Tlfnos.: 945-00-32-95 ? ? ? ? ? ? ? ? ? ? ? ? Fax: 945-00.32.90 > ???????????????????????????????????????????????????????????????????????????? > ?????? > email: dalda at ikt.es ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?web: www.ikt.es > ???????????????????????????????????????????????????????????????????????????? > ?????? > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From dalda at ikt.es Wed Mar 10 06:13:46 2010 From: dalda at ikt.es (David Alda Fernandez de Lezea) Date: Wed, 10 Mar 2010 15:13:46 +0100 Subject: [mapserver-users] Looking for advice for OGC Services Server hardware requirements Message-ID: <224DBDAF88A6AC47BD22432815351BE007CDE602@nekaposta1> Thanks Luigi, I'll have a look. -----Mensaje original----- De: Luigi Castro Cardeles [mailto:luigi.cardeles at gmail.com] Enviado el: mi?rcoles, 10 de marzo de 2010 14:43 Para: Fuchs Juan Carlos CC: David Alda Fernandez de Lezea; mapserver-users at lists.osgeo.org Asunto: Re: [mapserver-users] Looking for advice for OGC Services Server hardware requirements Hi, Maybe this can help you. http://2009.foss4g.org/presentations/#presentation_109 []'s Luigi Castro Cardeles 2010/3/10 Fuchs Juan Carlos : > Hi David > Check out "Building a GIS System Architecture Design Strategies for > Managers" from Dave Peters - Esri Press. Just as a start point. > Cheers > JC > > > > -----Mensaje original----- > De: David Alda Fernandez de Lezea [mailto:dalda at ikt.es] Enviado el: > Mi?rcoles, 10 de Marzo de 2010 08:21 a.m. > Para: mapserver-users at lists.osgeo.org > Asunto: RV: [mapserver-users] Looking for advice for OGC Services > Server hardware requirements > > > Nobody suggests anything?? > > -----Mensaje original----- > De: mapserver-users-bounces at lists.osgeo.org > [mailto:mapserver-users-bounces at lists.osgeo.org] En nombre de David > Alda Fernandez de Lezea Enviado el: martes, 09 de marzo de 2010 11:35 > Para: mapserver-users at lists.osgeo.org > Asunto: [mapserver-users] Looking for advice for OGC Services > Serverhardware requirements > > > Hello list, > > In our company, we are planning to set up a OGC Services Server using > MapServer (we are currently using version 5.2.1, and at the moment > it's working fine) to serve amounts of geographical data. We are going > to serve big raster files (45 GB aprox each raster), so we need a big > HDD (we know this). We are planning to have this raster files tiled > with TileCache. We also are going to serve data via MapServer from > another server in which we have an Oracle Spatial DataBase with very > big tables and millions of rows, so we think that the communication > between these 2 servers should be very fluid. > > All this services will be consumed by our own employees (50 aprox) or > other people using desktop GIS software like gvSIG, Kosmo or ArcGIS. > > Besides, we are developing some web applications using OpenLayers, and > this web apps will also consume those ogc services. > > ?So, our doubts have to do with the following subjects: > ?- Processor > ?- RAM Memory > ?- HDD (we know that has to be large, i.e. 1TB - 2TB) > ?- Number of network adapters (is advisable to have more than one?) > ?- Which OS is best for MapServer, Linux or Windows 2003 (in terms of > performance) > ?- Other suggestions... > > IMPORTANT: Take into account that this is going to be at PRODUCTION LEVEL. > > Hope someone can help me. Thanks!! > > Un saludo, > > ?????????????????????????????????????????????????????????????????????? > ?????? > ?????? > > David Alda Fern?ndez de Lezea > Lurralde eta Biodibertsitate Saila / Dpto. de Territorio y > Biodiversidad > > IKT > Granja Modelo s/n ? 01192 ? Arkaute (Araba) > > ?????????????????????????????????????????????????????????????????????? > ?????? > ?????? > Tlfnos.: 945-00-32-95 ? ? ? ? ? ? ? ? ? ? ? ? Fax: 945-00.32.90 > ?????????????????????????????????????????????????????????????????????? > ?????? > ?????? > email: dalda at ikt.es ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?web: www.ikt.es > ?????????????????????????????????????????????????????????????????????? > ?????? > ?????? > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From David.Fawcett at state.mn.us Wed Mar 10 06:35:57 2010 From: David.Fawcett at state.mn.us (Fawcett, David (MPCA)) Date: Wed, 10 Mar 2010 08:35:57 -0600 Subject: [mapserver-users] LABEL-formatting options In-Reply-To: References: <20100309145405.39e35896@thoe.hq.intevation.de> Message-ID: Stephan, Since there isn't a MapServer solution until 6.0, a work around could be a python/php/other language script to populate a new column with a lower precision value. It wouldn't be that hard to write. David. -----Original Message----- From: mapserver-users-bounces at lists.osgeo.org [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Lime, Steve D (DNR) Sent: Tuesday, March 09, 2010 10:36 PM To: Stephan Holl; mapserver-users at lists.osgeo.org Subject: RE: [mapserver-users] LABEL-formatting options Hi Stephan: This is an increasingly asked question but at the moment I don't have a good solution or workaround, it's just not possible at the moment. There's a ticket already filed on the subject and it will be addressed in 6.0. Are you in a position where you could apply a patch to deal with the problem if one were available? Steve ________________________________________ From: mapserver-users-bounces at lists.osgeo.org [mapserver-users-bounces at lists.osgeo.org] On Behalf Of Stephan Holl [stephan.holl at intevation.de] Sent: Tuesday, March 09, 2010 7:54 AM To: mapserver-users at lists.osgeo.org Subject: [mapserver-users] LABEL-formatting options Hello mapservers, we are using MapServer for visualizing shapefiles with double entries inside. Mainly this are contour-lines from waterdepth. The double values have 32 decimal places and mapserver tries to render them _all_ along a contourline. This does not look nice... Is there an option to trim the values with a dedicated mapfile-parameter, e.g. where a prinft-syntax can be used to format the values? The shapefiles are generated automatically so adding another column with trunc()ed or round()ed values is no option. Are there any options to format label-values/strings? I have not found anything in the docs. TIA Stephan -- Stephan Holl | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabr?ck - HR B 18998 Gesch?ftsf?hrer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users From dalda at ikt.es Wed Mar 10 06:46:36 2010 From: dalda at ikt.es (David Alda Fernandez de Lezea) Date: Wed, 10 Mar 2010 15:46:36 +0100 Subject: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements Message-ID: <224DBDAF88A6AC47BD22432815351BE007D10CF1@nekaposta1> Steve, Thanks for your response. The thing is that the technology we have to use is MapServer + TileCache + OL, so there's no possible discussion about this, it's not my decision. We have now everything setted up in a test environment (it's an Intel Core 2 Duo E4600 at 2.4 GHz PC with 2 GB of RAM, and it's used for some other tasks, apart from web mapping). I think that the performance now it's OK, but not for a production level, I just needed some guidelines or suggestions on hardware requirements for a server that will serve geographical data. I'll have to investigate a bit more with the information taken from your responses. Thanks again. David. -----Mensaje original----- De: Steve Kelly [mailto:steve at sjk.net.au] Enviado el: mi?rcoles, 10 de marzo de 2010 13:08 Para: David Alda Fernandez de Lezea Asunto: RE: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements David, If you want we can have a skype chat and I can help you with some of the settings and setting things up - we render billions of images here a year using mapserver. I am also keen to talk to you about our tilecache technology and map engine (to replace openlayers and the tilecahce you are using) If you want to have a talk over Skype - add me Stephen.kelly2 (I am based in Australia GMT+10) But am around for the next hour or so on and off I look forward to a chat Thanks Steve -----Original Message----- From: mapserver-users-bounces at lists.osgeo.org [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of David Alda Fernandez de Lezea Sent: Wednesday, 10 March 2010 9:30 PM To: mapserver-users at lists.osgeo.org Subject: RV: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements Nobody suggests anything?? -----Mensaje original----- De: mapserver-users-bounces at lists.osgeo.org [mailto:mapserver-users-bounces at lists.osgeo.org] En nombre de David Alda Fernandez de Lezea Enviado el: martes, 09 de marzo de 2010 11:35 Para: mapserver-users at lists.osgeo.org Asunto: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements Hello list, In our company, we are planning to set up a OGC Services Server using MapServer (we are currently using version 5.2.1, and at the moment it's working fine) to serve amounts of geographical data. We are going to serve big raster files (45 GB aprox each raster), so we need a big HDD (we know this). We are planning to have this raster files tiled with TileCache. We also are going to serve data via MapServer from another server in which we have an Oracle Spatial DataBase with very big tables and millions of rows, so we think that the communication between these 2 servers should be very fluid. All this services will be consumed by our own employees (50 aprox) or other people using desktop GIS software like gvSIG, Kosmo or ArcGIS. Besides, we are developing some web applications using OpenLayers, and this web apps will also consume those ogc services. So, our doubts have to do with the following subjects: - Processor - RAM Memory - HDD (we know that has to be large, i.e. 1TB - 2TB) - Number of network adapters (is advisable to have more than one?) - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) - Other suggestions... IMPORTANT: Take into account that this is going to be at PRODUCTION LEVEL. Hope someone can help me. Thanks!! Un saludo, ?????????????????????????????????????????????????????????????????????????????????? David Alda Fern?ndez de Lezea Lurralde eta Biodibertsitate Saila / Dpto. de Territorio y Biodiversidad IKT Granja Modelo s/n ? 01192 ? Arkaute (Araba) ?????????????????????????????????????????????????????????????????????????????????? Tlfnos.: 945-00-32-95 Fax: 945-00.32.90 ?????????????????????????????????????????????????????????????????????????????????? email: dalda at ikt.es web: www.ikt.es ?????????????????????????????????????????????????????????????????????????????????? _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users From schroete at iup.physik.uni-bremen.de Wed Mar 10 07:22:29 2010 From: schroete at iup.physik.uni-bremen.de (Heiko =?iso-8859-1?q?Schr=F6ter?=) Date: Wed, 10 Mar 2010 16:22:29 +0100 Subject: [mapserver-users] WMS TIME parameter slow Message-ID: <201003101622.29741.schroete@iup.physik.uni-bremen.de> Hello, using mapserv (5.6.1) with PostGIS (8.3) and accessing ten-thousands of geo locations in the PostGIS db results in very slow speed when using the WMS TIME parameter: (in this example the number is about 4000 datapoints for this day, timing measurements with DEBUG OFF). 1) Very fast using FILTER, approx. 5 seconds: .... CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" DATA "geocoord from xyz_ref using unique datum" VALIDATION 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" END FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" .... 2) Very slow using WMS TIME, approx 210 and more seconds: (Leaving the VALIDATION/FILTER on or leaving out 'using unique datum' doesn't change a thing) ... METADATA "wms_timeextent" "1970-01-01/2030-12-31" "wms_timeitem" "datum" "wms_timedefault" "2007-12-10/2007-12-11" "wms_title" "xyz_r" "wms_srs" "init=epsg:-1" END ... The MS ERRORFILE is very noisy spilling out all datapoints when running 2). This does not happen when running 1). Database is the same. No other changes have been made. Why is mapserver so slow when using the WMS TIME parameter ? It would be nice to stick to the "official" WMS configuration and not to introduce a "vendor specific" workaround. Thanks and Regards Heiko # ###################################################################################################### /var/www/localhost/cgi-bin/mapserv -v MapServer version 5.6.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=ICONV SUPPORTS=WMS_SERVER SUPPORTS=WFS_SERVER SUPPORTS=WCS_SERVER INPUT=EPPL7 INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE A complete Layer definition: LAYER EXTENT -180 -90 180 90 CONNECTIONTYPE POSTGIS NAME "SACURA_REF_R" PROCESSING "CLOSE_CONNECTION=DEFER" OPACITY 60 STATUS ON METADATA # "wms_timeextent" "1970-01-01/2030-12-31" # "wms_timeitem" "datum" # "wms_timedefault" "2007-12-10/2007-12-11" "wms_title" "xyz_ref_r" "wms_srs" "init=epsg:-1" END PROJECTION "init=epsg:4326" END CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" DATA "geocoord from xyz_ref using unique datum" VALIDATION 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" END FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" TYPE POLYGON SIZEUNITS meters CLASS DEBUG OFF NAME "xyz_ref_class" STYLE OUTLINECOLOR 0 0 0 COLOR [rfarbe] END END END # Layer From dalda at ikt.es Wed Mar 10 07:31:17 2010 From: dalda at ikt.es (David Alda Fernandez de Lezea) Date: Wed, 10 Mar 2010 16:31:17 +0100 Subject: RV: [mapserver-users] Looking for advice for OGC Services Server hardware requirements Message-ID: <224DBDAF88A6AC47BD22432815351BE007D10D6A@nekaposta1> Hi Frank, I know it's difficult to answer those questions, I just needed some guidelines, or some indications of where search. I appreciate the answers and help of these kind people. Now I have some ideas. Thanks. David. -----Mensaje original----- De: Frank Warmerdam [mailto:warmerdam at pobox.com] Enviado el: mi?rcoles, 10 de marzo de 2010 16:21 Para: David Alda Fernandez de Lezea Asunto: Re: RV: [mapserver-users] Looking for advice for OGC Services Server hardware requirements David Alda Fernandez de Lezea wrote: > Nobody suggests anything?? David, Hardware requirement requests traditionally do not result in specific answers. Really you need to benchmark your workload to have a good sense. There are just too many variables. I think folks have just given up trying to respond to them because they are essentially unanswerable. Best regards, -- ---------------------------------------+-------------------------------- ---------------------------------------+------ I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com light and sound - activate the windows | http://pobox.com/~warmerdam and watch the world go round - Rush | Geospatial Programmer for Rent From andy at squeakycode.net Wed Mar 10 07:32:33 2010 From: andy at squeakycode.net (Andy Colson) Date: Wed, 10 Mar 2010 09:32:33 -0600 Subject: [mapserver-users] Looking for advice for OGC Services Server hardware requirements In-Reply-To: <224DBDAF88A6AC47BD22432815351BE007CDDFF9@nekaposta1> References: <224DBDAF88A6AC47BD22432815351BE007CDDFF9@nekaposta1> Message-ID: <4B97BB91.90107@squeakycode.net> On 3/9/2010 4:34 AM, David Alda Fernandez de Lezea wrote: > > Hello list, > > So, our doubts have to do with the following subjects: > - Processor > - RAM Memory > - HDD (we know that has to be large, i.e. 1TB - 2TB) > - Number of network adapters (is advisable to have more than one?) > - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) > - Other suggestions... Disclamer: I am a linux guy. Processor is a little hard, a faster processor will grind through the imagery faster. Imagery is CPU intensive. A fast processor is better than multi-core. For one user. There is probably a sweet spot for multi-user's between fast core and many core. You'll have to test. Memory is easy. Buy as much as you can. HDD is hard. Everyone think's CPU, CPU, CPU, and they never pay attention to IO. Lots of loads are IO bound and not CPU bound, so buying more and faster CPU's wont help at all. Here is where OS choice will come into play. Linux has fantastic software raid. I can recommend Linux 100% for fast drive IO across multiple SATA drives. NIC's: that's really dependent on your load. If you have the imagery local and only get shapes from across the network, then it wouldn't require too much network bandwidth. You didnt give us near enough info to help you decide. You'll have to test. OS: That's not the right question. You have a hammer and screw driver in your tool chest. Use the right tool for the right job. CGI, for example, is faster on Linux because of the way it spawns processes. FastCGI/mapscript/threads/etc will be similar on both OS's. The biggest question is what your admins are better at. Making a windows person admin a linux box is just asking for trouble. A windows person will get 10 times the performance from a windows box than a linux box. Other: You asked a huge question and gave very little usage info. I'd suggest you test, and benchmark. Set something cheap up and load test it. If you find you are CPU bound, then you'll know where you need to invest money. If you cant make it go any faster and the CPU's are not at 100%, then its either NIC or IO. You'll have to understand your load before you buy hardware for it. I run mapserver on a slackware linux box, with PostGIS db. cpu: AMD 64 X2 Dual Core Processor 3800+ hd: 3 1TB green Western Digital in raid 5. I get 100+ Mbs write, and 130 Mbs read. The cpu's sit around 5% usage. I get 70k hits a day. I have 180 gig of imagery, and PostGis db is 2.6 gig. The box was hand built for $350 bucks, with a few old parts and a few new. PRODUCTION LEVEL: this means different things. To me it means having a second $350 box sitting at standby ready to take over if my first box dies. To you it means, (based on your questions and a lot of guessing on my part) spending a lot of money on one box that'll be "really good". I guess, in the end, my advice would be: if money is no object, get whatever. Otherwise, start small and try to understand your load requirements. A $350 linux box will go really far (but then my load is neither CPU or IO bound... I just dont have that much traffic). Don't you hate it when you ask a question, only to be asked more questions? -Andy From pramsey at opengeo.org Wed Mar 10 07:42:02 2010 From: pramsey at opengeo.org (Paul Ramsey) Date: Wed, 10 Mar 2010 07:42:02 -0800 Subject: [mapserver-users] WMS TIME parameter slow In-Reply-To: <201003101622.29741.schroete@iup.physik.uni-bremen.de> References: <201003101622.29741.schroete@iup.physik.uni-bremen.de> Message-ID: <30fe546d1003100742y5ef3b5cfya5250d4dae4eb159@mail.gmail.com> Firstly, 2 seconds is not fast, so you have another performance troll beyond this one. Secondly, it's impossible to know what's going on inside the database without seeing the actual SQL being generated. Turn on statement loggging in PgSQL and extract the SQL that is being run against the database. Then you can put that into PgAdmin or psql and get EXPLAIN ANALYZE results which will tell you why there's a problem, hopefully. P. On Wed, Mar 10, 2010 at 7:22 AM, Heiko Schr?ter wrote: > Hello, > > using mapserv (5.6.1) with PostGIS (8.3) and accessing ten-thousands of geo locations in the PostGIS db results in very slow speed when using the WMS TIME parameter: > (in this example the number is about 4000 datapoints for this day, timing measurements with DEBUG OFF). > > 1) Very fast using FILTER, approx. 5 seconds: > .... > CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" > DATA "geocoord from xyz_ref using unique datum" > VALIDATION > 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" > END > FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" > .... > > 2) Very slow using WMS TIME, approx 210 and more seconds: > (Leaving the VALIDATION/FILTER on or leaving out 'using unique datum' doesn't change a thing) > ... > METADATA > "wms_timeextent" "1970-01-01/2030-12-31" > "wms_timeitem" "datum" > "wms_timedefault" "2007-12-10/2007-12-11" > "wms_title" "xyz_r" > "wms_srs" "init=epsg:-1" > END > ... > > The MS ERRORFILE is very noisy spilling out all datapoints when running 2). This does not happen when running 1). > Database is the same. No other changes have been made. > > Why is mapserver so slow when using the WMS TIME parameter ? > > It would be nice to stick to the "official" WMS configuration and not to introduce a "vendor specific" workaround. > > Thanks and Regards > Heiko > > # ###################################################################################################### > > /var/www/localhost/cgi-bin/mapserv -v > MapServer version 5.6.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=ICONV SUPPORTS=WMS_SERVER SUPPORTS=WFS_SERVER SUPPORTS=WCS_SERVER INPUT=EPPL7 INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE > > A complete Layer definition: > > ? ? ? ?LAYER > ? ? ? ? ? ? ? ?EXTENT -180 -90 180 90 > ? ? ? ? ? ? ? ?CONNECTIONTYPE POSTGIS > ? ? ? ? ? ? ? ?NAME "SACURA_REF_R" > ? ? ? ? ? ? ? ?PROCESSING "CLOSE_CONNECTION=DEFER" > ? ? ? ? ? ? ? ?OPACITY 60 > ? ? ? ? ? ? ? ?STATUS ON > ? ? ? ? ? ? ? ?METADATA > # ? ? ? ? ? ? ? ? ? ? ? "wms_timeextent" "1970-01-01/2030-12-31" > # ? ? ? ? ? ? ? ? ? ? ? "wms_timeitem" "datum" > # ? ? ? ? ? ? ? ? ? ? ? "wms_timedefault" "2007-12-10/2007-12-11" > ? ? ? ? ? ? ? ? ? ? ? ?"wms_title" "xyz_ref_r" > ? ? ? ? ? ? ? ? ? ? ? ?"wms_srs" "init=epsg:-1" > ? ? ? ? ? ? ? ?END > ? ? ? ? ? ? ? ?PROJECTION > ? ? ? ? ? ? ? ? ? ? ? ?"init=epsg:4326" > ? ? ? ? ? ? ? ?END > ? ? ? ? ? ? ? ?CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" > ? ? ? ? ? ? ? ?DATA "geocoord from xyz_ref using unique datum" > ? ? ? ? ? ? ? ?VALIDATION > ? ? ? ? ? ? ? ? ? ? ? ?'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" > ? ? ? ? ? ? ? ?END > ? ? ? ? ? ? ? ?FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" > > ? ? ? ? ? ? ? ?TYPE POLYGON > ? ? ? ? ? ? ? ?SIZEUNITS meters > ? ? ? ? ? ? ? ?CLASS > ? ? ? ? ? ? ? ? ? ? ? ?DEBUG OFF > ? ? ? ? ? ? ? ? ? ? ? ?NAME "xyz_ref_class" > ? ? ? ? ? ? ? ? ? ? ? ?STYLE > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?OUTLINECOLOR 0 0 0 > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?COLOR [rfarbe] > ? ? ? ? ? ? ? ? ? ? ? ?END > ? ? ? ? ? ? ? ?END > ? ? ? ?END # Layer > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From David.Fawcett at state.mn.us Wed Mar 10 07:42:29 2010 From: David.Fawcett at state.mn.us (Fawcett, David (MPCA)) Date: Wed, 10 Mar 2010 09:42:29 -0600 Subject: [mapserver-users] Looking for advice for OGC Services Server hardware requirements In-Reply-To: <4B97BB91.90107@squeakycode.net> References: <224DBDAF88A6AC47BD22432815351BE007CDDFF9@nekaposta1> <4B97BB91.90107@squeakycode.net> Message-ID: David, I don't remember all of your original post, so forgive me if you have already covered this. When looking at performance, make sure that you have done everything possible to optimize your data. -tiles and pyramids for rasters -all data in the output spatial reference system -precompute any complex classification expressions that you can Etc. David. -----Original Message----- From: mapserver-users-bounces at lists.osgeo.org [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Andy Colson Sent: Wednesday, March 10, 2010 9:33 AM To: David Alda Fernandez de Lezea Cc: mapserver-users at lists.osgeo.org Subject: Re: [mapserver-users] Looking for advice for OGC Services Server hardware requirements On 3/9/2010 4:34 AM, David Alda Fernandez de Lezea wrote: > > Hello list, > > So, our doubts have to do with the following subjects: > - Processor > - RAM Memory > - HDD (we know that has to be large, i.e. 1TB - 2TB) > - Number of network adapters (is advisable to have more than one?) > - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) > - Other suggestions... Disclamer: I am a linux guy. Processor is a little hard, a faster processor will grind through the imagery faster. Imagery is CPU intensive. A fast processor is better than multi-core. For one user. There is probably a sweet spot for multi-user's between fast core and many core. You'll have to test. Memory is easy. Buy as much as you can. HDD is hard. Everyone think's CPU, CPU, CPU, and they never pay attention to IO. Lots of loads are IO bound and not CPU bound, so buying more and faster CPU's wont help at all. Here is where OS choice will come into play. Linux has fantastic software raid. I can recommend Linux 100% for fast drive IO across multiple SATA drives. NIC's: that's really dependent on your load. If you have the imagery local and only get shapes from across the network, then it wouldn't require too much network bandwidth. You didnt give us near enough info to help you decide. You'll have to test. OS: That's not the right question. You have a hammer and screw driver in your tool chest. Use the right tool for the right job. CGI, for example, is faster on Linux because of the way it spawns processes. FastCGI/mapscript/threads/etc will be similar on both OS's. The biggest question is what your admins are better at. Making a windows person admin a linux box is just asking for trouble. A windows person will get 10 times the performance from a windows box than a linux box. Other: You asked a huge question and gave very little usage info. I'd suggest you test, and benchmark. Set something cheap up and load test it. If you find you are CPU bound, then you'll know where you need to invest money. If you cant make it go any faster and the CPU's are not at 100%, then its either NIC or IO. You'll have to understand your load before you buy hardware for it. I run mapserver on a slackware linux box, with PostGIS db. cpu: AMD 64 X2 Dual Core Processor 3800+ hd: 3 1TB green Western Digital in raid 5. I get 100+ Mbs write, and 130 Mbs read. The cpu's sit around 5% usage. I get 70k hits a day. I have 180 gig of imagery, and PostGis db is 2.6 gig. The box was hand built for $350 bucks, with a few old parts and a few new. PRODUCTION LEVEL: this means different things. To me it means having a second $350 box sitting at standby ready to take over if my first box dies. To you it means, (based on your questions and a lot of guessing on my part) spending a lot of money on one box that'll be "really good". I guess, in the end, my advice would be: if money is no object, get whatever. Otherwise, start small and try to understand your load requirements. A $350 linux box will go really far (but then my load is neither CPU or IO bound... I just dont have that much traffic). Don't you hate it when you ask a question, only to be asked more questions? -Andy _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users From schroete at iup.physik.uni-bremen.de Wed Mar 10 07:52:28 2010 From: schroete at iup.physik.uni-bremen.de (Heiko =?iso-8859-1?q?Schr=F6ter?=) Date: Wed, 10 Mar 2010 16:52:28 +0100 Subject: [mapserver-users] WMS TIME parameter slow In-Reply-To: <30fe546d1003100742y5ef3b5cfya5250d4dae4eb159@mail.gmail.com> References: <201003101622.29741.schroete@iup.physik.uni-bremen.de> <30fe546d1003100742y5ef3b5cfya5250d4dae4eb159@mail.gmail.com> Message-ID: <201003101652.28250.schroete@iup.physik.uni-bremen.de> Am Mittwoch 10 M?rz 2010 16:42:02 schrieben Sie: Thanks for the hint. Hm, i thought 4000 out of 4.5 Millions datasets for the whole year in 5 sec would be not that bad .... The timing figure shall just show the huge difference between the two types of requests. I will follow your advice and test the db. And yes the db is indexed. Heiko > Firstly, 2 seconds is not fast, so you have another performance troll > beyond this one. > > Secondly, it's impossible to know what's going on inside the database > without seeing the actual SQL being generated. Turn on statement > loggging in PgSQL and extract the SQL that is being run against the > database. Then you can put that into PgAdmin or psql and get EXPLAIN > ANALYZE results which will tell you why there's a problem, hopefully. > > P. > > On Wed, Mar 10, 2010 at 7:22 AM, Heiko Schr?ter > wrote: > > Hello, > > > > using mapserv (5.6.1) with PostGIS (8.3) and accessing ten-thousands of geo locations in the PostGIS db results in very slow speed when using the WMS TIME parameter: > > (in this example the number is about 4000 datapoints for this day, timing measurements with DEBUG OFF). > > > > 1) Very fast using FILTER, approx. 5 seconds: > > .... > > CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" > > DATA "geocoord from xyz_ref using unique datum" > > VALIDATION > > 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" > > END > > FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" > > .... > > > > 2) Very slow using WMS TIME, approx 210 and more seconds: > > (Leaving the VALIDATION/FILTER on or leaving out 'using unique datum' doesn't change a thing) > > ... > > METADATA > > "wms_timeextent" "1970-01-01/2030-12-31" > > "wms_timeitem" "datum" > > "wms_timedefault" "2007-12-10/2007-12-11" > > "wms_title" "xyz_r" > > "wms_srs" "init=epsg:-1" > > END > > ... > > > > The MS ERRORFILE is very noisy spilling out all datapoints when running 2). This does not happen when running 1). > > Database is the same. No other changes have been made. > > > > Why is mapserver so slow when using the WMS TIME parameter ? > > > > It would be nice to stick to the "official" WMS configuration and not to introduce a "vendor specific" workaround. > > > > Thanks and Regards > > Heiko > > > > # ###################################################################################################### > > > > /var/www/localhost/cgi-bin/mapserv -v > > MapServer version 5.6.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=ICONV SUPPORTS=WMS_SERVER SUPPORTS=WFS_SERVER SUPPORTS=WCS_SERVER INPUT=EPPL7 INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE > > > > A complete Layer definition: > > > > LAYER > > EXTENT -180 -90 180 90 > > CONNECTIONTYPE POSTGIS > > NAME "SACURA_REF_R" > > PROCESSING "CLOSE_CONNECTION=DEFER" > > OPACITY 60 > > STATUS ON > > METADATA > > # "wms_timeextent" "1970-01-01/2030-12-31" > > # "wms_timeitem" "datum" > > # "wms_timedefault" "2007-12-10/2007-12-11" > > "wms_title" "xyz_ref_r" > > "wms_srs" "init=epsg:-1" > > END > > PROJECTION > > "init=epsg:4326" > > END > > CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" > > DATA "geocoord from xyz_ref using unique datum" > > VALIDATION > > 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" > > END > > FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" > > > > TYPE POLYGON > > SIZEUNITS meters > > CLASS > > DEBUG OFF > > NAME "xyz_ref_class" > > STYLE > > OUTLINECOLOR 0 0 0 > > COLOR [rfarbe] > > END > > END > > END # Layer > > _______________________________________________ > > mapserver-users mailing list > > mapserver-users at lists.osgeo.org > > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > From boolean10001 at yahoo.com Wed Mar 10 13:53:45 2010 From: boolean10001 at yahoo.com (Carlos Ruiz) Date: Wed, 10 Mar 2010 13:53:45 -0800 (PST) Subject: [mapserver-users] Something odd with queries in 5.6.1 Message-ID: <998191.85108.qm@web38208.mail.mud.yahoo.com> Hi all, I noticed something odd when I do a query with the new 5.6.1 version. The getFeature method seems to return a NULL value, when it was working good before the new version update. Here's the code: $n = $map->numlayers; for ($i = 0; $i < $n; $i++) { $theme = $map->GetLayer($i); if ($tema->isVisible()) { if (($regs = $theme->getNumResults()) == 0) { continue; } } else { continue; } $theme->open(); $values = $theme->getitems(); unset($atts); for ($reg = 0; $reg < $regs; $reg++) { $result = $theme->getResult($reg); // getFeature is returning NULL with the 5.6.1 version $element = $theme->getFeature($result->shapeindex, $result->tileindex); for ($value = 0; $value < count($values); $value++) { $atts[] = $values[$value] . " " . $element->values[$values[$value]]; } // php crash because $element is a non object $element->free(); } $theme->close(); ... } Any help or idea will be appreciated. Thanks in advance IC Carlos Ruiz -------------- next part -------------- An HTML attachment was scrubbed... URL: From andy at squeakycode.net Wed Mar 10 14:46:28 2010 From: andy at squeakycode.net (Andy Colson) Date: Wed, 10 Mar 2010 16:46:28 -0600 Subject: [mapserver-users] Something odd with queries in 5.6.1 In-Reply-To: <998191.85108.qm@web38208.mail.mud.yahoo.com> References: <998191.85108.qm@web38208.mail.mud.yahoo.com> Message-ID: <4B982144.4040007@squeakycode.net> On 3/10/2010 3:53 PM, Carlos Ruiz wrote: > Hi all, > > I noticed something odd when I do a query with the new 5.6.1 version. > > The getFeature method seems to return a NULL value, when it was working > good before the new version update. > > Here's the code: > > $n = $map->numlayers; > > for ($i = 0; $i < $n; $i++) { > > $theme = $map->GetLayer($i); > > if ($tema->isVisible()) { --------^ theme? > if (($regs = $theme->getNumResults()) == 0) { > continue; > } > } > else { > continue; > } > > $theme->open(); > $values = $theme->getitems(); > > unset($atts); > > for ($reg = 0; $reg < $regs; $reg++) { > > $result = $theme->getResult($reg); > // getFeature is returning NULL with the 5.6.1 version > $element = $theme->getFeature($result->shapeindex, $result->tileindex); > > for ($value = 0; $value < count($values); $value++) { > $atts[] = $values[$value] . " " . $element->values[$values[$value]]; > } > > // php crash because $element is a non object > $element->free(); > > } > > $theme->close(); > > ... > > } > > Any help or idea will be appreciated. > > Thanks in advance > > IC Carlos Ruiz > > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users From dmorissette at mapgears.com Wed Mar 10 14:54:09 2010 From: dmorissette at mapgears.com (Daniel Morissette) Date: Wed, 10 Mar 2010 17:54:09 -0500 Subject: [mapserver-users] Something odd with queries in 5.6.1 In-Reply-To: <998191.85108.qm@web38208.mail.mud.yahoo.com> References: <998191.85108.qm@web38208.mail.mud.yahoo.com> Message-ID: <4B982311.3000209@mapgears.com> Carlos Ruiz wrote: > Hi all, > > I noticed something odd when I do a query with the new 5.6.1 version. > > The getFeature method seems to return a NULL value, when it was working > good before the new version update. > Due to a change in the handling of queries in version 5.6, ols scripts must be updated to use the new $layer->resultsGetShape() method instead of $layer->GetShape() or $layer->GetFeature() to read query results. There is a mention of this change in the migration guide, but it may not be clear enough (contributions welcome): http://trac.osgeo.org/mapserver/browser/branches/branch-5-6/mapserver/MIGRATION_GUIDE.TXT Daniel -- Daniel Morissette http://www.mapgears.com/ From jmckenna at gatewaygeomatics.com Wed Mar 10 23:23:04 2010 From: jmckenna at gatewaygeomatics.com (Jeff McKenna) Date: Thu, 11 Mar 2010 16:23:04 +0900 Subject: [mapserver-users] Looking for advice for OGC Services Server hardware requirements In-Reply-To: References: Message-ID: <4B989A58.8010006@gatewaygeomatics.com> Luigi Castro Cardeles wrote: > Hi, > > Maybe this can help you. > http://2009.foss4g.org/presentations/#presentation_109 > I would like to add that there is at least some off-list talk of some Windows vs Unix benchmarking for the 2010 exercise (http://wiki.osgeo.org/wiki/Benchmarking_2010). As the maintainer of MapServer 4 Windows (MS4W) I can tell you that the download/use statistics are staggering (very popular); it is used in production environments for both government and private industry. I encourage you to give it a try (even though most developers on this MapServer mailing list are unix-based, don't let them scare you away from Windows, if you are more comfortable in that environment). Hope this helps a little. -jeff -- Jeff McKenna MapServer Consulting and Training Services http://www.gatewaygeomatics.com/ From schroete at iup.physik.uni-bremen.de Thu Mar 11 01:39:13 2010 From: schroete at iup.physik.uni-bremen.de (Heiko =?iso-8859-1?q?Schr=F6ter?=) Date: Thu, 11 Mar 2010 10:39:13 +0100 Subject: [mapserver-users] WMS TIME parameter slow In-Reply-To: <201003101652.28250.schroete@iup.physik.uni-bremen.de> References: <201003101622.29741.schroete@iup.physik.uni-bremen.de> <30fe546d1003100742y5ef3b5cfya5250d4dae4eb159@mail.gmail.com> <201003101652.28250.schroete@iup.physik.uni-bremen.de> Message-ID: <201003111039.14199.schroete@iup.physik.uni-bremen.de> Am Mittwoch 10 M?rz 2010 16:52:28 schrieb Heiko Schr?ter: Done what has been suggested. The 'date_trunc' function forces sequential scans instead of using the indexed scans. I've tried and failed: sc_gis=# CREATE INDEX o_v20_y2007_date_trunc ON o_v20_y2007 (date_trunc('day', datum at time zone 'GMT')); ERROR: functions in index expression must be marked IMMUTABLE Probably the MS list is not the right place to ask. But may be a kind soul has some pointers to more infos. I admit that db's are not my field of experience and i'am still learning. On the other hand it would be nice to have a hint about the indexing issue inside the MS docs when using the WMS Time extension. Heiko sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and (datum >= '2007-12-10' and datum <= '2007-12-30'); QUERY PLAN ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Result (cost=0.00..585.37 rows=4420 width=450) (actual time=0.083..35.821 rows=5322 loops=1) -> Append (cost=0.00..541.17 rows=4420 width=450) (actual time=0.067..13.852 rows=5322 loops=1) -> Seq Scan on o3_v20 (cost=0.00..16.65 rows=1 width=55) (actual time=0.001..0.001 rows=0 loops=1) Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) -> Index Scan using o3_v20_y2002_datum on o3_v20_y2002 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.012..0.012 rows=0 loops=1) Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) -> Index Scan using o3_v20_y2003_datum on o3_v20_y2003 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.006..0.006 rows=0 loops=1) Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) -> Index Scan using o3_v20_y2004_datum on o3_v20_y2004 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) -> Index Scan using o3_v20_y2005_datum on o3_v20_y2005 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) -> Index Scan using o3_v20_y2006_datum on o3_v20_y2006 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) -> Index Scan using o3_v20_y2007_datum on o3_v20_y2007 o3_v20 (cost=0.00..458.27 rows=4411 width=450) (actual time=0.031..10.732 rows=5322 loops=1) Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) -> Index Scan using o3_v20_y2008_datum on o3_v20_y2008 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.010..0.010 rows=0 loops=1) Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) -> Index Scan using o3_v20_y2009_datum on o3_v20_y2009 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.006..0.006 rows=0 loops=1) Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) -> Index Scan using o3_v20_y2010_datum on o3_v20_y2010 o3_v20 (cost=0.00..8.27 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) Total runtime: 37.760 ms (32 rows) sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum) >= '2007-12-10' AND date_trunc('day', datum) <= '2007-12-30')); QUERY PLAN -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Result (cost=0.00..55305.53 rows=2873 width=450) (actual time=1368.129..2371.436 rows=5322 loops=1) -> Append (cost=0.00..55276.80 rows=2873 width=450) (actual time=1368.100..2339.593 rows=5322 loops=1) -> Seq Scan on o3_v20 (cost=0.00..20.45 rows=1 width=55) (actual time=0.001..0.001 rows=0 loops=1) Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) -> Seq Scan on o3_v20_y2002 o3_v20 (cost=0.00..2228.21 rows=123 width=450) (actual time=79.684..79.684 rows=0 loops=1) Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) -> Seq Scan on o3_v20_y2003 o3_v20 (cost=0.00..6587.07 rows=349 width=450) (actual time=238.174..238.174 rows=0 loops=1) Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) -> Seq Scan on o3_v20_y2004 o3_v20 (cost=0.00..7417.62 rows=378 width=450) (actual time=260.250..260.250 rows=0 loops=1) Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) -> Seq Scan on o3_v20_y2005 o3_v20 (cost=0.00..7328.16 rows=379 width=450) (actual time=264.246..264.246 rows=0 loops=1) Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) -> Seq Scan on o3_v20_y2006 o3_v20 (cost=0.00..7299.65 rows=383 width=450) (actual time=263.991..263.991 rows=0 loops=1) Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) -> Seq Scan on o3_v20_y2007 o3_v20 (cost=0.00..7642.97 rows=397 width=450) (actual time=261.744..297.122 rows=5322 loops=1) Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) -> Seq Scan on o3_v20_y2008 o3_v20 (cost=0.00..8583.06 rows=439 width=450) (actual time=472.648..472.648 rows=0 loops=1) Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) -> Seq Scan on o3_v20_y2009 o3_v20 (cost=0.00..6961.72 rows=361 width=450) (actual time=394.525..394.525 rows=0 loops=1) Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) -> Seq Scan on o3_v20_y2010 o3_v20 (cost=0.00..1207.89 rows=63 width=450) (actual time=65.417..65.417 rows=0 loops=1) Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) Total runtime: 2374.403 ms (23 rows) > Am Mittwoch 10 M?rz 2010 16:42:02 schrieben Sie: > > Thanks for the hint. > Hm, i thought 4000 out of 4.5 Millions datasets for the whole year in 5 sec would be not that bad .... > The timing figure shall just show the huge difference between the two types of requests. > > I will follow your advice and test the db. And yes the db is indexed. > > Heiko > > > Firstly, 2 seconds is not fast, so you have another performance troll > > beyond this one. > > > > Secondly, it's impossible to know what's going on inside the database > > without seeing the actual SQL being generated. Turn on statement > > loggging in PgSQL and extract the SQL that is being run against the > > database. Then you can put that into PgAdmin or psql and get EXPLAIN > > ANALYZE results which will tell you why there's a problem, hopefully. > > > > P. > > > > On Wed, Mar 10, 2010 at 7:22 AM, Heiko Schr?ter > > wrote: > > > Hello, > > > > > > using mapserv (5.6.1) with PostGIS (8.3) and accessing ten-thousands of geo locations in the PostGIS db results in very slow speed when using the WMS TIME parameter: > > > (in this example the number is about 4000 datapoints for this day, timing measurements with DEBUG OFF). > > > > > > 1) Very fast using FILTER, approx. 5 seconds: > > > .... > > > CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" > > > DATA "geocoord from xyz_ref using unique datum" > > > VALIDATION > > > 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" > > > END > > > FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" > > > .... > > > > > > 2) Very slow using WMS TIME, approx 210 and more seconds: > > > (Leaving the VALIDATION/FILTER on or leaving out 'using unique datum' doesn't change a thing) > > > ... > > > METADATA > > > "wms_timeextent" "1970-01-01/2030-12-31" > > > "wms_timeitem" "datum" > > > "wms_timedefault" "2007-12-10/2007-12-11" > > > "wms_title" "xyz_r" > > > "wms_srs" "init=epsg:-1" > > > END > > > ... > > > > > > The MS ERRORFILE is very noisy spilling out all datapoints when running 2). This does not happen when running 1). > > > Database is the same. No other changes have been made. > > > > > > Why is mapserver so slow when using the WMS TIME parameter ? > > > > > > It would be nice to stick to the "official" WMS configuration and not to introduce a "vendor specific" workaround. > > > > > > Thanks and Regards > > > Heiko > > > > > > # ###################################################################################################### > > > > > > /var/www/localhost/cgi-bin/mapserv -v > > > MapServer version 5.6.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=ICONV SUPPORTS=WMS_SERVER SUPPORTS=WFS_SERVER SUPPORTS=WCS_SERVER INPUT=EPPL7 INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE > > > > > > A complete Layer definition: > > > > > > LAYER > > > EXTENT -180 -90 180 90 > > > CONNECTIONTYPE POSTGIS > > > NAME "SACURA_REF_R" > > > PROCESSING "CLOSE_CONNECTION=DEFER" > > > OPACITY 60 > > > STATUS ON > > > METADATA > > > # "wms_timeextent" "1970-01-01/2030-12-31" > > > # "wms_timeitem" "datum" > > > # "wms_timedefault" "2007-12-10/2007-12-11" > > > "wms_title" "xyz_ref_r" > > > "wms_srs" "init=epsg:-1" > > > END > > > PROJECTION > > > "init=epsg:4326" > > > END > > > CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" > > > DATA "geocoord from xyz_ref using unique datum" > > > VALIDATION > > > 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" > > > END > > > FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" > > > > > > TYPE POLYGON > > > SIZEUNITS meters > > > CLASS > > > DEBUG OFF > > > NAME "xyz_ref_class" > > > STYLE > > > OUTLINECOLOR 0 0 0 > > > COLOR [rfarbe] > > > END > > > END > > > END # Layer > > > _______________________________________________ > > > mapserver-users mailing list > > > mapserver-users at lists.osgeo.org > > > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > -- ----------------------------------------------------------------------- Dipl.-Ing. Heiko Schr?ter Institute of Environmental Physics (IUP) phone: ++49-(0)421-218-62092 Institute of Remote Sensing (IFE) fax: ++49-(0)421-218-4555 University of Bremen (FB1) P.O. Box 330440 email: schroete at iup.physik.uni-bremen.de Otto-Hahn-Allee 1 28359 Bremen Germany ----------------------------------------------------------------------- From pramsey at cleverelephant.ca Thu Mar 11 05:35:53 2010 From: pramsey at cleverelephant.ca (Paul Ramsey) Date: Thu, 11 Mar 2010 05:35:53 -0800 Subject: [mapserver-users] WMS TIME parameter slow In-Reply-To: <201003111039.14199.schroete@iup.physik.uni-bremen.de> References: <201003101622.29741.schroete@iup.physik.uni-bremen.de> <30fe546d1003100742y5ef3b5cfya5250d4dae4eb159@mail.gmail.com> <201003101652.28250.schroete@iup.physik.uni-bremen.de> <201003111039.14199.schroete@iup.physik.uni-bremen.de> Message-ID: <30fe546d1003110535x1f663841ia5fdcd0ea85bce84@mail.gmail.com> Good job getting this far on your own! Create a SQL wrapper function on top of date_trunc which *is* marked as immutable and you'll be able to build a functional index on it. P. On Thu, Mar 11, 2010 at 1:39 AM, Heiko Schr?ter wrote: > Am Mittwoch 10 M?rz 2010 16:52:28 schrieb Heiko Schr?ter: > > Done what has been suggested. The 'date_trunc' function forces sequential scans instead of using the indexed scans. > > I've tried and failed: > sc_gis=# CREATE INDEX o_v20_y2007_date_trunc ON o_v20_y2007 (date_trunc('day', datum at time zone 'GMT')); > ERROR: ?functions in index expression must be marked IMMUTABLE > > Probably the MS list is not the right place to ask. > But may be a kind soul has some pointers to more infos. > I admit that db's are not my field of experience and i'am still learning. > > On the other hand it would be nice to have a hint about the indexing issue inside the MS docs when using the WMS Time extension. > > Heiko > > > sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck > && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 > 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and (datum >= '2007-12-10' and datum <= '2007-12-30'); > QUERY PLAN > ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ > ?Result ?(cost=0.00..585.37 rows=4420 width=450) (actual time=0.083..35.821 rows=5322 loops=1) > ? -> ?Append ?(cost=0.00..541.17 rows=4420 width=450) (actual time=0.067..13.852 rows=5322 loops=1) > ? ? ? ? -> ?Seq Scan on o3_v20 ?(cost=0.00..16.65 rows=1 width=55) (actual time=0.001..0.001 rows=0 loops=1) > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > ? ? ? ? -> ?Index Scan using o3_v20_y2002_datum on o3_v20_y2002 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.012..0.012 rows=0 loops=1) > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > ? ? ? ? -> ?Index Scan using o3_v20_y2003_datum on o3_v20_y2003 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.006..0.006 rows=0 loops=1) > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > ? ? ? ? -> ?Index Scan using o3_v20_y2004_datum on o3_v20_y2004 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > ? ? ? ? -> ?Index Scan using o3_v20_y2005_datum on o3_v20_y2005 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > ? ? ? ? -> ?Index Scan using o3_v20_y2006_datum on o3_v20_y2006 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > ? ? ? ? -> ?Index Scan using o3_v20_y2007_datum on o3_v20_y2007 o3_v20 ?(cost=0.00..458.27 rows=4411 width=450) (actual time=0.031..10.732 rows=5322 loops=1) > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > ? ? ? ? -> ?Index Scan using o3_v20_y2008_datum on o3_v20_y2008 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.010..0.010 rows=0 loops=1) > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > ? ? ? ? -> ?Index Scan using o3_v20_y2009_datum on o3_v20_y2009 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.006..0.006 rows=0 loops=1) > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > ? ? ? ? -> ?Index Scan using o3_v20_y2010_datum on o3_v20_y2010 o3_v20 ?(cost=0.00..8.27 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > ?Total runtime: 37.760 ms > (32 rows) > > sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck > && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 > 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum) >= '2007-12-10' AND date_trunc('day', datum) <= '2007-12-30')); > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? QUERY PLAN > -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- > ?Result ?(cost=0.00..55305.53 rows=2873 width=450) (actual time=1368.129..2371.436 rows=5322 loops=1) > ? -> ?Append ?(cost=0.00..55276.80 rows=2873 width=450) (actual time=1368.100..2339.593 rows=5322 loops=1) > ? ? ? ? -> ?Seq Scan on o3_v20 ?(cost=0.00..20.45 rows=1 width=55) (actual time=0.001..0.001 rows=0 loops=1) > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > ? ? ? ? -> ?Seq Scan on o3_v20_y2002 o3_v20 ?(cost=0.00..2228.21 rows=123 width=450) (actual time=79.684..79.684 rows=0 loops=1) > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > ? ? ? ? -> ?Seq Scan on o3_v20_y2003 o3_v20 ?(cost=0.00..6587.07 rows=349 width=450) (actual time=238.174..238.174 rows=0 loops=1) > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > ? ? ? ? -> ?Seq Scan on o3_v20_y2004 o3_v20 ?(cost=0.00..7417.62 rows=378 width=450) (actual time=260.250..260.250 rows=0 loops=1) > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > ? ? ? ? -> ?Seq Scan on o3_v20_y2005 o3_v20 ?(cost=0.00..7328.16 rows=379 width=450) (actual time=264.246..264.246 rows=0 loops=1) > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > ? ? ? ? -> ?Seq Scan on o3_v20_y2006 o3_v20 ?(cost=0.00..7299.65 rows=383 width=450) (actual time=263.991..263.991 rows=0 loops=1) > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > ? ? ? ? -> ?Seq Scan on o3_v20_y2007 o3_v20 ?(cost=0.00..7642.97 rows=397 width=450) (actual time=261.744..297.122 rows=5322 loops=1) > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > ? ? ? ? -> ?Seq Scan on o3_v20_y2008 o3_v20 ?(cost=0.00..8583.06 rows=439 width=450) (actual time=472.648..472.648 rows=0 loops=1) > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > ? ? ? ? -> ?Seq Scan on o3_v20_y2009 o3_v20 ?(cost=0.00..6961.72 rows=361 width=450) (actual time=394.525..394.525 rows=0 loops=1) > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > ? ? ? ? -> ?Seq Scan on o3_v20_y2010 o3_v20 ?(cost=0.00..1207.89 rows=63 width=450) (actual time=65.417..65.417 rows=0 loops=1) > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > ?Total runtime: 2374.403 ms > (23 rows) > > > >> Am Mittwoch 10 M?rz 2010 16:42:02 schrieben Sie: >> >> Thanks for the hint. >> Hm, i thought 4000 out of 4.5 Millions datasets for the whole year in 5 sec would be not that bad .... >> The timing figure shall just show the huge difference between the two types of requests. >> >> I will follow your advice and test the db. And yes the db is indexed. >> >> Heiko >> >> > Firstly, 2 seconds is not fast, so you have another performance troll >> > beyond this one. >> > >> > Secondly, it's impossible to know what's going on inside the database >> > without seeing the actual SQL being generated. Turn on statement >> > loggging in PgSQL and extract the SQL that is being run against the >> > database. Then you can put that into PgAdmin or psql and get EXPLAIN >> > ANALYZE results which will tell you why there's a problem, hopefully. >> > >> > P. >> > >> > On Wed, Mar 10, 2010 at 7:22 AM, Heiko Schr?ter >> > wrote: >> > > Hello, >> > > >> > > using mapserv (5.6.1) with PostGIS (8.3) and accessing ten-thousands of geo locations in the PostGIS db results in very slow speed when using the WMS TIME parameter: >> > > (in this example the number is about 4000 datapoints for this day, timing measurements with DEBUG OFF). >> > > >> > > 1) Very fast using FILTER, approx. 5 seconds: >> > > .... >> > > CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" >> > > DATA "geocoord from xyz_ref using unique datum" >> > > VALIDATION >> > > 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" >> > > END >> > > FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" >> > > .... >> > > >> > > 2) Very slow using WMS TIME, approx 210 and more seconds: >> > > (Leaving the VALIDATION/FILTER on or leaving out 'using unique datum' doesn't change a thing) >> > > ... >> > > METADATA >> > > "wms_timeextent" "1970-01-01/2030-12-31" >> > > "wms_timeitem" "datum" >> > > "wms_timedefault" "2007-12-10/2007-12-11" >> > > "wms_title" "xyz_r" >> > > "wms_srs" "init=epsg:-1" >> > > END >> > > ... >> > > >> > > The MS ERRORFILE is very noisy spilling out all datapoints when running 2). This does not happen when running 1). >> > > Database is the same. No other changes have been made. >> > > >> > > Why is mapserver so slow when using the WMS TIME parameter ? >> > > >> > > It would be nice to stick to the "official" WMS configuration and not to introduce a "vendor specific" workaround. >> > > >> > > Thanks and Regards >> > > Heiko >> > > >> > > # ###################################################################################################### >> > > >> > > /var/www/localhost/cgi-bin/mapserv -v >> > > MapServer version 5.6.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=ICONV SUPPORTS=WMS_SERVER SUPPORTS=WFS_SERVER SUPPORTS=WCS_SERVER INPUT=EPPL7 INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE >> > > >> > > A complete Layer definition: >> > > >> > > ? ? ? ?LAYER >> > > ? ? ? ? ? ? ? ?EXTENT -180 -90 180 90 >> > > ? ? ? ? ? ? ? ?CONNECTIONTYPE POSTGIS >> > > ? ? ? ? ? ? ? ?NAME "SACURA_REF_R" >> > > ? ? ? ? ? ? ? ?PROCESSING "CLOSE_CONNECTION=DEFER" >> > > ? ? ? ? ? ? ? ?OPACITY 60 >> > > ? ? ? ? ? ? ? ?STATUS ON >> > > ? ? ? ? ? ? ? ?METADATA >> > > # ? ? ? ? ? ? ? ? ? ? ? "wms_timeextent" "1970-01-01/2030-12-31" >> > > # ? ? ? ? ? ? ? ? ? ? ? "wms_timeitem" "datum" >> > > # ? ? ? ? ? ? ? ? ? ? ? "wms_timedefault" "2007-12-10/2007-12-11" >> > > ? ? ? ? ? ? ? ? ? ? ? ?"wms_title" "xyz_ref_r" >> > > ? ? ? ? ? ? ? ? ? ? ? ?"wms_srs" "init=epsg:-1" >> > > ? ? ? ? ? ? ? ?END >> > > ? ? ? ? ? ? ? ?PROJECTION >> > > ? ? ? ? ? ? ? ? ? ? ? ?"init=epsg:4326" >> > > ? ? ? ? ? ? ? ?END >> > > ? ? ? ? ? ? ? ?CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" >> > > ? ? ? ? ? ? ? ?DATA "geocoord from xyz_ref using unique datum" >> > > ? ? ? ? ? ? ? ?VALIDATION >> > > ? ? ? ? ? ? ? ? ? ? ? ?'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" >> > > ? ? ? ? ? ? ? ?END >> > > ? ? ? ? ? ? ? ?FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" >> > > >> > > ? ? ? ? ? ? ? ?TYPE POLYGON >> > > ? ? ? ? ? ? ? ?SIZEUNITS meters >> > > ? ? ? ? ? ? ? ?CLASS >> > > ? ? ? ? ? ? ? ? ? ? ? ?DEBUG OFF >> > > ? ? ? ? ? ? ? ? ? ? ? ?NAME "xyz_ref_class" >> > > ? ? ? ? ? ? ? ? ? ? ? ?STYLE >> > > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?OUTLINECOLOR 0 0 0 >> > > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?COLOR [rfarbe] >> > > ? ? ? ? ? ? ? ? ? ? ? ?END >> > > ? ? ? ? ? ? ? ?END >> > > ? ? ? ?END # Layer >> > > _______________________________________________ >> > > mapserver-users mailing list >> > > mapserver-users at lists.osgeo.org >> > > http://lists.osgeo.org/mailman/listinfo/mapserver-users >> > > >> _______________________________________________ >> mapserver-users mailing list >> mapserver-users at lists.osgeo.org >> http://lists.osgeo.org/mailman/listinfo/mapserver-users >> > > -- > ----------------------------------------------------------------------- > Dipl.-Ing. Heiko Schr?ter > Institute of Environmental Physics (IUP) ? ?phone: ++49-(0)421-218-62092 > Institute of Remote Sensing (IFE) ? ? ? ? ? fax: ? ++49-(0)421-218-4555 > University of Bremen (FB1) > P.O. Box 330440 ? ? ? ? ? ? ? email: ?schroete at iup.physik.uni-bremen.de > Otto-Hahn-Allee 1 > 28359 Bremen > Germany > ----------------------------------------------------------------------- > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From schroete at iup.physik.uni-bremen.de Thu Mar 11 05:59:13 2010 From: schroete at iup.physik.uni-bremen.de (Heiko =?iso-8859-1?q?Schr=F6ter?=) Date: Thu, 11 Mar 2010 14:59:13 +0100 Subject: [mapserver-users] WMS TIME parameter slow In-Reply-To: <30fe546d1003110535x1f663841ia5fdcd0ea85bce84@mail.gmail.com> References: <201003101622.29741.schroete@iup.physik.uni-bremen.de> <201003111039.14199.schroete@iup.physik.uni-bremen.de> <30fe546d1003110535x1f663841ia5fdcd0ea85bce84@mail.gmail.com> Message-ID: <201003111459.13411.schroete@iup.physik.uni-bremen.de> Am Donnerstag 11 M?rz 2010 14:35:53 schrieben Sie: Paul, thanks for staying at it. These timings i get with the variation of the theme. The second best is to cast 'datum::timestamp'. But still beeing 32times slower than just a trivial compare on the index as in 1). The slowest run is the brute force 'date_trunc' without cast 3). So to me this is a bit voodo why postgres refuses to scan the indices in proper speed in 2) and 3). The maximum index scan i get with 'date_trunc' is a 'Bitmap Heap Scan' on the index with scenario 2). Of what i have found inside the docs/google is that even when casting 'datum' inside postgres the request, here generated by MS, should or have to be casted as well which is not (at least by now). Heiko 1) The brute force compare: sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and (datum >= '2007-12-10' and datum <= '2007-12-11'); Total runtime: 41.018 ms (32 rows) Now Create Immutable Index on our play table: CREATE INDEX o_v20_y2007_date_trunc ON o_v20_y2007 (date_trunc('day', datum::timestamp without time zone)); 2) sc_gis=# CREATE INDEX o3_v20_y2007_date_trunc ON o3_v20_y2007 (date_trunc('day', datum::timestamp without time zone)); ERROR: relation "o3_v20_y2007_date_trunc" already exists scia_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum::timestamp without time zone) >= '2007-12-10' AND date_trunc('day', datum::timestamp without time zone) <= '2007-12-11')); Total runtime: 1250.679 ms (26 rows) 3) sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum) >= '2007-12-10' AND date_trunc('day', datum) <= '2007-12-11')); Total runtime: 2329.380 ms (23 rows) > Good job getting this far on your own! Create a SQL wrapper function > on top of date_trunc which *is* marked as immutable and you'll be able > to build a functional index on it. > > P. > > On Thu, Mar 11, 2010 at 1:39 AM, Heiko Schr?ter > wrote: > > Am Mittwoch 10 M?rz 2010 16:52:28 schrieb Heiko Schr?ter: > > > > Done what has been suggested. The 'date_trunc' function forces sequential scans instead of using the indexed scans. > > > > I've tried and failed: > > sc_gis=# CREATE INDEX o_v20_y2007_date_trunc ON o_v20_y2007 (date_trunc('day', datum at time zone 'GMT')); > > ERROR: functions in index expression must be marked IMMUTABLE > > > > Probably the MS list is not the right place to ask. > > But may be a kind soul has some pointers to more infos. > > I admit that db's are not my field of experience and i'am still learning. > > > > On the other hand it would be nice to have a hint about the indexing issue inside the MS docs when using the WMS Time extension. > > > > Heiko > > > > > > sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck > > && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 > > 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and (datum >= '2007-12-10' and datum <= '2007-12-30'); > > QUERY PLAN > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > Result (cost=0.00..585.37 rows=4420 width=450) (actual time=0.083..35.821 rows=5322 loops=1) > > -> Append (cost=0.00..541.17 rows=4420 width=450) (actual time=0.067..13.852 rows=5322 loops=1) > > -> Seq Scan on o3_v20 (cost=0.00..16.65 rows=1 width=55) (actual time=0.001..0.001 rows=0 loops=1) > > Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > > -> Index Scan using o3_v20_y2002_datum on o3_v20_y2002 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.012..0.012 rows=0 loops=1) > > Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > > Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > > -> Index Scan using o3_v20_y2003_datum on o3_v20_y2003 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.006..0.006 rows=0 loops=1) > > Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > > Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > > -> Index Scan using o3_v20_y2004_datum on o3_v20_y2004 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) > > Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > > Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > > -> Index Scan using o3_v20_y2005_datum on o3_v20_y2005 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) > > Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > > Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > > -> Index Scan using o3_v20_y2006_datum on o3_v20_y2006 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) > > Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > > Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > > -> Index Scan using o3_v20_y2007_datum on o3_v20_y2007 o3_v20 (cost=0.00..458.27 rows=4411 width=450) (actual time=0.031..10.732 rows=5322 loops=1) > > Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > > Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > > -> Index Scan using o3_v20_y2008_datum on o3_v20_y2008 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.010..0.010 rows=0 loops=1) > > Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > > Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > > -> Index Scan using o3_v20_y2009_datum on o3_v20_y2009 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.006..0.006 rows=0 loops=1) > > Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > > Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > > -> Index Scan using o3_v20_y2010_datum on o3_v20_y2010 o3_v20 (cost=0.00..8.27 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) > > Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > > Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > > Total runtime: 37.760 ms > > (32 rows) > > > > sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck > > && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 > > 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum) >= '2007-12-10' AND date_trunc('day', datum) <= '2007-12-30')); > > QUERY PLAN > > -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- > > Result (cost=0.00..55305.53 rows=2873 width=450) (actual time=1368.129..2371.436 rows=5322 loops=1) > > -> Append (cost=0.00..55276.80 rows=2873 width=450) (actual time=1368.100..2339.593 rows=5322 loops=1) > > -> Seq Scan on o3_v20 (cost=0.00..20.45 rows=1 width=55) (actual time=0.001..0.001 rows=0 loops=1) > > Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > > -> Seq Scan on o3_v20_y2002 o3_v20 (cost=0.00..2228.21 rows=123 width=450) (actual time=79.684..79.684 rows=0 loops=1) > > Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > > -> Seq Scan on o3_v20_y2003 o3_v20 (cost=0.00..6587.07 rows=349 width=450) (actual time=238.174..238.174 rows=0 loops=1) > > Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > > -> Seq Scan on o3_v20_y2004 o3_v20 (cost=0.00..7417.62 rows=378 width=450) (actual time=260.250..260.250 rows=0 loops=1) > > Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > > -> Seq Scan on o3_v20_y2005 o3_v20 (cost=0.00..7328.16 rows=379 width=450) (actual time=264.246..264.246 rows=0 loops=1) > > Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > > -> Seq Scan on o3_v20_y2006 o3_v20 (cost=0.00..7299.65 rows=383 width=450) (actual time=263.991..263.991 rows=0 loops=1) > > Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > > -> Seq Scan on o3_v20_y2007 o3_v20 (cost=0.00..7642.97 rows=397 width=450) (actual time=261.744..297.122 rows=5322 loops=1) > > Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > > -> Seq Scan on o3_v20_y2008 o3_v20 (cost=0.00..8583.06 rows=439 width=450) (actual time=472.648..472.648 rows=0 loops=1) > > Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > > -> Seq Scan on o3_v20_y2009 o3_v20 (cost=0.00..6961.72 rows=361 width=450) (actual time=394.525..394.525 rows=0 loops=1) > > Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > > -> Seq Scan on o3_v20_y2010 o3_v20 (cost=0.00..1207.89 rows=63 width=450) (actual time=65.417..65.417 rows=0 loops=1) > > Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > > Total runtime: 2374.403 ms > > (23 rows) > > > > > > > >> Am Mittwoch 10 M?rz 2010 16:42:02 schrieben Sie: > >> > >> Thanks for the hint. > >> Hm, i thought 4000 out of 4.5 Millions datasets for the whole year in 5 sec would be not that bad .... > >> The timing figure shall just show the huge difference between the two types of requests. > >> > >> I will follow your advice and test the db. And yes the db is indexed. > >> > >> Heiko > >> > >> > Firstly, 2 seconds is not fast, so you have another performance troll > >> > beyond this one. > >> > > >> > Secondly, it's impossible to know what's going on inside the database > >> > without seeing the actual SQL being generated. Turn on statement > >> > loggging in PgSQL and extract the SQL that is being run against the > >> > database. Then you can put that into PgAdmin or psql and get EXPLAIN > >> > ANALYZE results which will tell you why there's a problem, hopefully. > >> > > >> > P. > >> > > >> > On Wed, Mar 10, 2010 at 7:22 AM, Heiko Schr?ter > >> > wrote: > >> > > Hello, > >> > > > >> > > using mapserv (5.6.1) with PostGIS (8.3) and accessing ten-thousands of geo locations in the PostGIS db results in very slow speed when using the WMS TIME parameter: > >> > > (in this example the number is about 4000 datapoints for this day, timing measurements with DEBUG OFF). > >> > > > >> > > 1) Very fast using FILTER, approx. 5 seconds: > >> > > .... > >> > > CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" > >> > > DATA "geocoord from xyz_ref using unique datum" > >> > > VALIDATION > >> > > 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" > >> > > END > >> > > FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" > >> > > .... > >> > > > >> > > 2) Very slow using WMS TIME, approx 210 and more seconds: > >> > > (Leaving the VALIDATION/FILTER on or leaving out 'using unique datum' doesn't change a thing) > >> > > ... > >> > > METADATA > >> > > "wms_timeextent" "1970-01-01/2030-12-31" > >> > > "wms_timeitem" "datum" > >> > > "wms_timedefault" "2007-12-10/2007-12-11" > >> > > "wms_title" "xyz_r" > >> > > "wms_srs" "init=epsg:-1" > >> > > END > >> > > ... > >> > > > >> > > The MS ERRORFILE is very noisy spilling out all datapoints when running 2). This does not happen when running 1). > >> > > Database is the same. No other changes have been made. > >> > > > >> > > Why is mapserver so slow when using the WMS TIME parameter ? > >> > > > >> > > It would be nice to stick to the "official" WMS configuration and not to introduce a "vendor specific" workaround. > >> > > > >> > > Thanks and Regards > >> > > Heiko > >> > > > >> > > # ###################################################################################################### > >> > > > >> > > /var/www/localhost/cgi-bin/mapserv -v > >> > > MapServer version 5.6.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=ICONV SUPPORTS=WMS_SERVER SUPPORTS=WFS_SERVER SUPPORTS=WCS_SERVER INPUT=EPPL7 INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE > >> > > > >> > > A complete Layer definition: > >> > > > >> > > LAYER > >> > > EXTENT -180 -90 180 90 > >> > > CONNECTIONTYPE POSTGIS > >> > > NAME "SACURA_REF_R" > >> > > PROCESSING "CLOSE_CONNECTION=DEFER" > >> > > OPACITY 60 > >> > > STATUS ON > >> > > METADATA > >> > > # "wms_timeextent" "1970-01-01/2030-12-31" > >> > > # "wms_timeitem" "datum" > >> > > # "wms_timedefault" "2007-12-10/2007-12-11" > >> > > "wms_title" "xyz_ref_r" > >> > > "wms_srs" "init=epsg:-1" > >> > > END > >> > > PROJECTION > >> > > "init=epsg:4326" > >> > > END > >> > > CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" > >> > > DATA "geocoord from xyz_ref using unique datum" > >> > > VALIDATION > >> > > 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" > >> > > END > >> > > FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" > >> > > > >> > > TYPE POLYGON > >> > > SIZEUNITS meters > >> > > CLASS > >> > > DEBUG OFF > >> > > NAME "xyz_ref_class" > >> > > STYLE > >> > > OUTLINECOLOR 0 0 0 > >> > > COLOR [rfarbe] > >> > > END > >> > > END > >> > > END # Layer > >> > > _______________________________________________ > >> > > mapserver-users mailing list > >> > > mapserver-users at lists.osgeo.org > >> > > http://lists.osgeo.org/mailman/listinfo/mapserver-users > >> > > > >> _______________________________________________ > >> mapserver-users mailing list > >> mapserver-users at lists.osgeo.org > >> http://lists.osgeo.org/mailman/listinfo/mapserver-users > >> > > > > -- > > ----------------------------------------------------------------------- > > Dipl.-Ing. Heiko Schr?ter > > Institute of Environmental Physics (IUP) phone: ++49-(0)421-218-62092 > > Institute of Remote Sensing (IFE) fax: ++49-(0)421-218-4555 > > University of Bremen (FB1) > > P.O. Box 330440 email: schroete at iup.physik.uni-bremen.de > > Otto-Hahn-Allee 1 > > 28359 Bremen > > Germany > > ----------------------------------------------------------------------- > > _______________________________________________ > > mapserver-users mailing list > > mapserver-users at lists.osgeo.org > > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > > -- ----------------------------------------------------------------------- Dipl.-Ing. Heiko Schr?ter Institute of Environmental Physics (IUP) phone: ++49-(0)421-218-62092 Institute of Remote Sensing (IFE) fax: ++49-(0)421-218-4555 University of Bremen (FB1) P.O. Box 330440 email: schroete at iup.physik.uni-bremen.de Otto-Hahn-Allee 1 28359 Bremen Germany ----------------------------------------------------------------------- From enrico.oemi at gmail.com Thu Mar 11 06:02:52 2010 From: enrico.oemi at gmail.com (Kiks) Date: Thu, 11 Mar 2010 06:02:52 -0800 (PST) Subject: [mapserver-users] OSM2 SqlServer 2008 Message-ID: <1268316172146-4716063.post@n2.nabble.com> ...I wondered if there is an utility like OSM2pgsql that can import OSM data directly to SqlServer 2008. Has anybody any suggestion about it? Can I import data to PostGIS and then from PostGIS transfer data to SqlServer? thank to all, Kiks -- View this message in context: http://n2.nabble.com/OSM2-SqlServer-2008-tp4716063p4716063.html Sent from the Mapserver - User mailing list archive at Nabble.com. From Jukka.Rahkonen at mmmtike.fi Thu Mar 11 06:09:44 2010 From: Jukka.Rahkonen at mmmtike.fi (Rahkonen Jukka) Date: Thu, 11 Mar 2010 16:09:44 +0200 Subject: [mapserver-users] OSM2 SqlServer 2008 In-Reply-To: <1268316172146-4716063.post@n2.nabble.com> References: <1268316172146-4716063.post@n2.nabble.com> Message-ID: Hi, I believe that the best way at the moment is to import data with osm2pgsql into PostGIS first and continue then with ogr2ogr. -Jukka Rahkonen- Kiks wrote: > > > ...I wondered if there is an utility like OSM2pgsql that can > import OSM data > directly to SqlServer 2008. > Has anybody any suggestion about it? > Can I import data to PostGIS and then from PostGIS transfer data to > SqlServer? > > thank to all, > Kiks > -- > View this message in context: > http://n2.nabble.com/OSM2-SqlServer-2008-tp4716063p4716063.html > Sent from the Mapserver - User mailing list archive at Nabble.com. > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From pramsey at cleverelephant.ca Thu Mar 11 06:11:51 2010 From: pramsey at cleverelephant.ca (Paul Ramsey) Date: Thu, 11 Mar 2010 06:11:51 -0800 Subject: [mapserver-users] WMS TIME parameter slow In-Reply-To: <201003111459.13411.schroete@iup.physik.uni-bremen.de> References: <201003101622.29741.schroete@iup.physik.uni-bremen.de> <201003111039.14199.schroete@iup.physik.uni-bremen.de> <30fe546d1003110535x1f663841ia5fdcd0ea85bce84@mail.gmail.com> <201003111459.13411.schroete@iup.physik.uni-bremen.de> Message-ID: <30fe546d1003110611y5c149dfeq241d4d22f49747b1@mail.gmail.com> Sorry, there's not much more I can offer, you've done a great job debugging, but at the end of the day the SQL being generated by the WMS Time module is not great. Make sure to run 'ANALYZE' on your database so the planner has the latest stats. P. On Thu, Mar 11, 2010 at 5:59 AM, Heiko Schr?ter wrote: > Am Donnerstag 11 M?rz 2010 14:35:53 schrieben Sie: > > Paul, > > thanks for staying at it. These timings i get with the variation of the theme. The second best is to cast 'datum::timestamp'. But still beeing 32times slower than just a trivial compare on the index as in 1). The slowest run is the brute force 'date_trunc' without cast 3). So to me this is a bit voodo why postgres refuses to scan the indices in proper speed in 2) and 3). > The maximum index scan i get with 'date_trunc' is a 'Bitmap Heap Scan' on the index with scenario 2). > Of what i have found inside the docs/google is that even when casting 'datum' inside postgres the request, here generated by MS, should or have to be casted as well which is not (at least by now). > > Heiko > > > 1) The brute force compare: > sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck > && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 > 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and (datum >= '2007-12-10' and datum <= '2007-12-11'); > > ?Total runtime: 41.018 ms > (32 rows) > > Now Create Immutable Index on our play table: > CREATE INDEX o_v20_y2007_date_trunc ON o_v20_y2007 (date_trunc('day', datum::timestamp without time zone)); > 2) > sc_gis=# CREATE INDEX o3_v20_y2007_date_trunc ON o3_v20_y2007 (date_trunc('day', datum::timestamp without time zone)); > ERROR: ?relation "o3_v20_y2007_date_trunc" already exists > scia_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck > && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 > 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum::timestamp without time zone) >= '2007-12-10' AND date_trunc('day', datum::timestamp without time zone) <= '2007-12-11')); > > ?Total runtime: 1250.679 ms > (26 rows) > > 3) > sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck > && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 > 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum) >= '2007-12-10' AND date_trunc('day', datum) <= '2007-12-11')); > > ?Total runtime: 2329.380 ms > (23 rows) > >> Good job getting this far on your own! Create a SQL wrapper function >> on top of date_trunc which *is* marked as immutable and you'll be able >> to build a functional index on it. >> >> P. >> >> On Thu, Mar 11, 2010 at 1:39 AM, Heiko Schr?ter >> wrote: >> > Am Mittwoch 10 M?rz 2010 16:52:28 schrieb Heiko Schr?ter: >> > >> > Done what has been suggested. The 'date_trunc' function forces sequential scans instead of using the indexed scans. >> > >> > I've tried and failed: >> > sc_gis=# CREATE INDEX o_v20_y2007_date_trunc ON o_v20_y2007 (date_trunc('day', datum at time zone 'GMT')); >> > ERROR: ?functions in index expression must be marked IMMUTABLE >> > >> > Probably the MS list is not the right place to ask. >> > But may be a kind soul has some pointers to more infos. >> > I admit that db's are not my field of experience and i'am still learning. >> > >> > On the other hand it would be nice to have a hint about the indexing issue inside the MS docs when using the WMS Time extension. >> > >> > Heiko >> > >> > >> > sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck >> > && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 >> > 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and (datum >= '2007-12-10' and datum <= '2007-12-30'); >> > QUERY PLAN >> > ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ >> > ?Result ?(cost=0.00..585.37 rows=4420 width=450) (actual time=0.083..35.821 rows=5322 loops=1) >> > ? -> ?Append ?(cost=0.00..541.17 rows=4420 width=450) (actual time=0.067..13.852 rows=5322 loops=1) >> > ? ? ? ? -> ?Seq Scan on o3_v20 ?(cost=0.00..16.65 rows=1 width=55) (actual time=0.001..0.001 rows=0 loops=1) >> > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >> > ? ? ? ? -> ?Index Scan using o3_v20_y2002_datum on o3_v20_y2002 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.012..0.012 rows=0 loops=1) >> > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >> > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >> > ? ? ? ? -> ?Index Scan using o3_v20_y2003_datum on o3_v20_y2003 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.006..0.006 rows=0 loops=1) >> > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >> > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >> > ? ? ? ? -> ?Index Scan using o3_v20_y2004_datum on o3_v20_y2004 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) >> > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >> > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >> > ? ? ? ? -> ?Index Scan using o3_v20_y2005_datum on o3_v20_y2005 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) >> > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >> > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >> > ? ? ? ? -> ?Index Scan using o3_v20_y2006_datum on o3_v20_y2006 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) >> > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >> > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >> > ? ? ? ? -> ?Index Scan using o3_v20_y2007_datum on o3_v20_y2007 o3_v20 ?(cost=0.00..458.27 rows=4411 width=450) (actual time=0.031..10.732 rows=5322 loops=1) >> > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >> > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >> > ? ? ? ? -> ?Index Scan using o3_v20_y2008_datum on o3_v20_y2008 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.010..0.010 rows=0 loops=1) >> > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >> > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >> > ? ? ? ? -> ?Index Scan using o3_v20_y2009_datum on o3_v20_y2009 o3_v20 ?(cost=0.00..8.28 rows=1 width=450) (actual time=0.006..0.006 rows=0 loops=1) >> > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >> > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >> > ? ? ? ? -> ?Index Scan using o3_v20_y2010_datum on o3_v20_y2010 o3_v20 ?(cost=0.00..8.27 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) >> > ? ? ? ? ? ? ? Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >> > ? ? ? ? ? ? ? Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >> > ?Total runtime: 37.760 ms >> > (32 rows) >> > >> > sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck >> > && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 >> > 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum) >= '2007-12-10' AND date_trunc('day', datum) <= '2007-12-30')); >> > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? QUERY PLAN >> > -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- >> > ?Result ?(cost=0.00..55305.53 rows=2873 width=450) (actual time=1368.129..2371.436 rows=5322 loops=1) >> > ? -> ?Append ?(cost=0.00..55276.80 rows=2873 width=450) (actual time=1368.100..2339.593 rows=5322 loops=1) >> > ? ? ? ? -> ?Seq Scan on o3_v20 ?(cost=0.00..20.45 rows=1 width=55) (actual time=0.001..0.001 rows=0 loops=1) >> > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >> > ? ? ? ? -> ?Seq Scan on o3_v20_y2002 o3_v20 ?(cost=0.00..2228.21 rows=123 width=450) (actual time=79.684..79.684 rows=0 loops=1) >> > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >> > ? ? ? ? -> ?Seq Scan on o3_v20_y2003 o3_v20 ?(cost=0.00..6587.07 rows=349 width=450) (actual time=238.174..238.174 rows=0 loops=1) >> > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >> > ? ? ? ? -> ?Seq Scan on o3_v20_y2004 o3_v20 ?(cost=0.00..7417.62 rows=378 width=450) (actual time=260.250..260.250 rows=0 loops=1) >> > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >> > ? ? ? ? -> ?Seq Scan on o3_v20_y2005 o3_v20 ?(cost=0.00..7328.16 rows=379 width=450) (actual time=264.246..264.246 rows=0 loops=1) >> > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >> > ? ? ? ? -> ?Seq Scan on o3_v20_y2006 o3_v20 ?(cost=0.00..7299.65 rows=383 width=450) (actual time=263.991..263.991 rows=0 loops=1) >> > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >> > ? ? ? ? -> ?Seq Scan on o3_v20_y2007 o3_v20 ?(cost=0.00..7642.97 rows=397 width=450) (actual time=261.744..297.122 rows=5322 loops=1) >> > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >> > ? ? ? ? -> ?Seq Scan on o3_v20_y2008 o3_v20 ?(cost=0.00..8583.06 rows=439 width=450) (actual time=472.648..472.648 rows=0 loops=1) >> > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >> > ? ? ? ? -> ?Seq Scan on o3_v20_y2009 o3_v20 ?(cost=0.00..6961.72 rows=361 width=450) (actual time=394.525..394.525 rows=0 loops=1) >> > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >> > ? ? ? ? -> ?Seq Scan on o3_v20_y2010 o3_v20 ?(cost=0.00..1207.89 rows=63 width=450) (actual time=65.417..65.417 rows=0 loops=1) >> > ? ? ? ? ? ? ? Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >> > ?Total runtime: 2374.403 ms >> > (23 rows) >> > >> > >> > >> >> Am Mittwoch 10 M?rz 2010 16:42:02 schrieben Sie: >> >> >> >> Thanks for the hint. >> >> Hm, i thought 4000 out of 4.5 Millions datasets for the whole year in 5 sec would be not that bad .... >> >> The timing figure shall just show the huge difference between the two types of requests. >> >> >> >> I will follow your advice and test the db. And yes the db is indexed. >> >> >> >> Heiko >> >> >> >> > Firstly, 2 seconds is not fast, so you have another performance troll >> >> > beyond this one. >> >> > >> >> > Secondly, it's impossible to know what's going on inside the database >> >> > without seeing the actual SQL being generated. Turn on statement >> >> > loggging in PgSQL and extract the SQL that is being run against the >> >> > database. Then you can put that into PgAdmin or psql and get EXPLAIN >> >> > ANALYZE results which will tell you why there's a problem, hopefully. >> >> > >> >> > P. >> >> > >> >> > On Wed, Mar 10, 2010 at 7:22 AM, Heiko Schr?ter >> >> > wrote: >> >> > > Hello, >> >> > > >> >> > > using mapserv (5.6.1) with PostGIS (8.3) and accessing ten-thousands of geo locations in the PostGIS db results in very slow speed when using the WMS TIME parameter: >> >> > > (in this example the number is about 4000 datapoints for this day, timing measurements with DEBUG OFF). >> >> > > >> >> > > 1) Very fast using FILTER, approx. 5 seconds: >> >> > > .... >> >> > > CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" >> >> > > DATA "geocoord from xyz_ref using unique datum" >> >> > > VALIDATION >> >> > > 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" >> >> > > END >> >> > > FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" >> >> > > .... >> >> > > >> >> > > 2) Very slow using WMS TIME, approx 210 and more seconds: >> >> > > (Leaving the VALIDATION/FILTER on or leaving out 'using unique datum' doesn't change a thing) >> >> > > ... >> >> > > METADATA >> >> > > "wms_timeextent" "1970-01-01/2030-12-31" >> >> > > "wms_timeitem" "datum" >> >> > > "wms_timedefault" "2007-12-10/2007-12-11" >> >> > > "wms_title" "xyz_r" >> >> > > "wms_srs" "init=epsg:-1" >> >> > > END >> >> > > ... >> >> > > >> >> > > The MS ERRORFILE is very noisy spilling out all datapoints when running 2). This does not happen when running 1). >> >> > > Database is the same. No other changes have been made. >> >> > > >> >> > > Why is mapserver so slow when using the WMS TIME parameter ? >> >> > > >> >> > > It would be nice to stick to the "official" WMS configuration and not to introduce a "vendor specific" workaround. >> >> > > >> >> > > Thanks and Regards >> >> > > Heiko >> >> > > >> >> > > # ###################################################################################################### >> >> > > >> >> > > /var/www/localhost/cgi-bin/mapserv -v >> >> > > MapServer version 5.6.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=ICONV SUPPORTS=WMS_SERVER SUPPORTS=WFS_SERVER SUPPORTS=WCS_SERVER INPUT=EPPL7 INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE >> >> > > >> >> > > A complete Layer definition: >> >> > > >> >> > > ? ? ? ?LAYER >> >> > > ? ? ? ? ? ? ? ?EXTENT -180 -90 180 90 >> >> > > ? ? ? ? ? ? ? ?CONNECTIONTYPE POSTGIS >> >> > > ? ? ? ? ? ? ? ?NAME "SACURA_REF_R" >> >> > > ? ? ? ? ? ? ? ?PROCESSING "CLOSE_CONNECTION=DEFER" >> >> > > ? ? ? ? ? ? ? ?OPACITY 60 >> >> > > ? ? ? ? ? ? ? ?STATUS ON >> >> > > ? ? ? ? ? ? ? ?METADATA >> >> > > # ? ? ? ? ? ? ? ? ? ? ? "wms_timeextent" "1970-01-01/2030-12-31" >> >> > > # ? ? ? ? ? ? ? ? ? ? ? "wms_timeitem" "datum" >> >> > > # ? ? ? ? ? ? ? ? ? ? ? "wms_timedefault" "2007-12-10/2007-12-11" >> >> > > ? ? ? ? ? ? ? ? ? ? ? ?"wms_title" "xyz_ref_r" >> >> > > ? ? ? ? ? ? ? ? ? ? ? ?"wms_srs" "init=epsg:-1" >> >> > > ? ? ? ? ? ? ? ?END >> >> > > ? ? ? ? ? ? ? ?PROJECTION >> >> > > ? ? ? ? ? ? ? ? ? ? ? ?"init=epsg:4326" >> >> > > ? ? ? ? ? ? ? ?END >> >> > > ? ? ? ? ? ? ? ?CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" >> >> > > ? ? ? ? ? ? ? ?DATA "geocoord from xyz_ref using unique datum" >> >> > > ? ? ? ? ? ? ? ?VALIDATION >> >> > > ? ? ? ? ? ? ? ? ? ? ? ?'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" >> >> > > ? ? ? ? ? ? ? ?END >> >> > > ? ? ? ? ? ? ? ?FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" >> >> > > >> >> > > ? ? ? ? ? ? ? ?TYPE POLYGON >> >> > > ? ? ? ? ? ? ? ?SIZEUNITS meters >> >> > > ? ? ? ? ? ? ? ?CLASS >> >> > > ? ? ? ? ? ? ? ? ? ? ? ?DEBUG OFF >> >> > > ? ? ? ? ? ? ? ? ? ? ? ?NAME "xyz_ref_class" >> >> > > ? ? ? ? ? ? ? ? ? ? ? ?STYLE >> >> > > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?OUTLINECOLOR 0 0 0 >> >> > > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?COLOR [rfarbe] >> >> > > ? ? ? ? ? ? ? ? ? ? ? ?END >> >> > > ? ? ? ? ? ? ? ?END >> >> > > ? ? ? ?END # Layer >> >> > > _______________________________________________ >> >> > > mapserver-users mailing list >> >> > > mapserver-users at lists.osgeo.org >> >> > > http://lists.osgeo.org/mailman/listinfo/mapserver-users >> >> > > >> >> _______________________________________________ >> >> mapserver-users mailing list >> >> mapserver-users at lists.osgeo.org >> >> http://lists.osgeo.org/mailman/listinfo/mapserver-users >> >> >> > >> > -- >> > ----------------------------------------------------------------------- >> > Dipl.-Ing. Heiko Schr?ter >> > Institute of Environmental Physics (IUP) ? ?phone: ++49-(0)421-218-62092 >> > Institute of Remote Sensing (IFE) ? ? ? ? ? fax: ? ++49-(0)421-218-4555 >> > University of Bremen (FB1) >> > P.O. Box 330440 ? ? ? ? ? ? ? email: ?schroete at iup.physik.uni-bremen.de >> > Otto-Hahn-Allee 1 >> > 28359 Bremen >> > Germany >> > ----------------------------------------------------------------------- >> > _______________________________________________ >> > mapserver-users mailing list >> > mapserver-users at lists.osgeo.org >> > http://lists.osgeo.org/mailman/listinfo/mapserver-users >> > >> > > -- > ----------------------------------------------------------------------- > Dipl.-Ing. Heiko Schr?ter > Institute of Environmental Physics (IUP) ? ?phone: ++49-(0)421-218-62092 > Institute of Remote Sensing (IFE) ? ? ? ? ? fax: ? ++49-(0)421-218-4555 > University of Bremen (FB1) > P.O. Box 330440 ? ? ? ? ? ? ? email: ?schroete at iup.physik.uni-bremen.de > Otto-Hahn-Allee 1 > 28359 Bremen > Germany > ----------------------------------------------------------------------- > From steve at sjk.net.au Thu Mar 11 07:05:46 2010 From: steve at sjk.net.au (Steve Kelly) Date: Fri, 12 Mar 2010 01:05:46 +1000 Subject: [mapserver-users] OSM2 SqlServer 2008 Message-ID: <5C65DBD1C99A094BAF684EC61761C56907C94A@cargobay1.SJK.local> We have created a lot of custom tools here that we use internally that were used to being OSM into SQL 2005 - we haven't used them for a while - as we use postgres now. We imported the planet dump into a customised format (in SQL 2005) for a set particular purpose. I don't know of any publicly available product - but I am sure that there is some. Thanks Steve -----Original Message----- From: mapserver-users-bounces at lists.osgeo.org [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Rahkonen Jukka Sent: Friday, 12 March 2010 12:16 AM To: Kiks; mapserver-users at lists.osgeo.org Subject: Re: [mapserver-users] OSM2 SqlServer 2008 Hi, I believe that the best way at the moment is to import data with osm2pgsql into PostGIS first and continue then with ogr2ogr. -Jukka Rahkonen- Kiks wrote: > > > ...I wondered if there is an utility like OSM2pgsql that can > import OSM data > directly to SqlServer 2008. > Has anybody any suggestion about it? > Can I import data to PostGIS and then from PostGIS transfer data to > SqlServer? > > thank to all, > Kiks > -- > View this message in context: > http://n2.nabble.com/OSM2-SqlServer-2008-tp4716063p4716063.html > Sent from the Mapserver - User mailing list archive at Nabble.com. > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users From boolean10001 at yahoo.com Thu Mar 11 07:25:31 2010 From: boolean10001 at yahoo.com (Carlos Ruiz) Date: Thu, 11 Mar 2010 07:25:31 -0800 (PST) Subject: [mapserver-users] Something odd with queries in 5.6.1 In-Reply-To: <4B982311.3000209@mapgears.com> References: <998191.85108.qm@web38208.mail.mud.yahoo.com> <4B982311.3000209@mapgears.com> Message-ID: <807504.44215.qm@web38201.mail.mud.yahoo.com> Thanks Daniel, I was reading the mapscript documentation before the post of this message and I found this: layer.getShape(int tileindex, int shapeindex)) has been deprecated and renamed to layer.getFeature(int shapeindex [, int tileindex = -1]) to match the SWIG MapScript equivalent. Note that the order of the arguments is reversed since tileindex is optional in getFeature(). But I didn't look the Mapserver RFC 52. Thanks once again ! IC Carlos Ruiz ________________________________ From: Daniel Morissette To: mapserver-users Sent: Wed, March 10, 2010 4:54:09 PM Subject: Re: [mapserver-users] Something odd with queries in 5.6.1 Carlos Ruiz wrote: > Hi all, > > I noticed something odd when I do a query with the new 5.6.1 version. > > The getFeature method seems to return a NULL value, when it was working good before the new version update. > Due to a change in the handling of queries in version 5.6, ols scripts must be updated to use the new $layer->resultsGetShape() method instead of $layer->GetShape() or $layer->GetFeature() to read query results. There is a mention of this change in the migration guide, but it may not be clear enough (contributions welcome): http://trac.osgeo.org/mapserver/browser/branches/branch-5-6/mapserver/MIGRATION_GUIDE.TXT Daniel -- Daniel Morissette http://www.mapgears.com/ _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From boolean10001 at yahoo.com Thu Mar 11 07:39:03 2010 From: boolean10001 at yahoo.com (Carlos Ruiz) Date: Thu, 11 Mar 2010 07:39:03 -0800 (PST) Subject: Documentation - Re: [mapserver-users] Something odd with queries in 5.6.1 In-Reply-To: <4B982311.3000209@mapgears.com> References: <998191.85108.qm@web38208.mail.mud.yahoo.com> <4B982311.3000209@mapgears.com> Message-ID: <302141.30540.qm@web38205.mail.mud.yahoo.com> Maybe the PHP Mapscript documentation must specify in the getFeature method description of the LayerObj Class section (http://www.mapserver.org/mapscript/php/index.html#layerobj-class) that it's deprecated since version 5.6.1, as the getShape method description: Deprecated in v5.0, use getFeature() instead (note that the order of the arguments is reversed since tileindex is optional in getFeature()) IC Carlos Ruiz ________________________________ From: Daniel Morissette To: mapserver-users Sent: Wed, March 10, 2010 4:54:09 PM Subject: Re: [mapserver-users] Something odd with queries in 5.6.1 Carlos Ruiz wrote: > Hi all, > > I noticed something odd when I do a query with the new 5.6.1 version. > > The getFeature method seems to return a NULL value, when it was working good before the new version update. > Due to a change in the handling of queries in version 5.6, ols scripts must be updated to use the new $layer->resultsGetShape() method instead of $layer->GetShape() or $layer->GetFeature() to read query results. There is a mention of this change in the migration guide, but it may not be clear enough (contributions welcome): http://trac.osgeo.org/mapserver/browser/branches/branch-5-6/mapserver/MIGRATION_GUIDE.TXT Daniel -- Daniel Morissette http://www.mapgears.com/ _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From enrico.oemi at gmail.com Thu Mar 11 09:29:42 2010 From: enrico.oemi at gmail.com (Kiks) Date: Thu, 11 Mar 2010 09:29:42 -0800 (PST) Subject: [mapserver-users] Re: OSM2 SqlServer 2008 In-Reply-To: References: <1268316172146-4716063.post@n2.nabble.com> Message-ID: <1268328582692-4717357.post@n2.nabble.com> I manage to install and import data to PostGIS. Now I'm trying to transfer data with ogr2ogr, but I have some problems to understand the syntax: I have a System ODBC data source called CG. I tried to run: ogr2ogr -f "ODBC:CG" -t_srs "EPSG:3003" PG:"host=localhost user=postgres dbname=osm password=postgres port=5432" -update -lco OVERWRITE=yes -nlt NONE But it is not accepted. I don't understand where I'm wrong thanks for your help, Kiks -- View this message in context: http://n2.nabble.com/OSM2-SqlServer-2008-tp4716063p4717357.html Sent from the Mapserver - User mailing list archive at Nabble.com. From szekerest at gmail.com Thu Mar 11 12:19:52 2010 From: szekerest at gmail.com (Tamas Szekeres) Date: Thu, 11 Mar 2010 21:19:52 +0100 Subject: [mapserver-users] Re: OSM2 SqlServer 2008 In-Reply-To: <1268328582692-4717357.post@n2.nabble.com> References: <1268316172146-4716063.post@n2.nabble.com> <1268328582692-4717357.post@n2.nabble.com> Message-ID: Hi, It must be noted the OGR ODBC driver is read only at the moment, so you cannot import data to SQL server by using ogr2ogr directly. Moreover to support the SQL 2008 spatial data types further enhancements should be implemented in the driver. For an offline solution you might wan to convert your data to shapefiles and use the shapefile importer tool described at: http://www.sharpgis.net/post/2007/12/Shapefile-to-SqlServer-2008-to-WPF.aspx Best regards, Tamas 2010/3/11 Kiks > > I manage to install and import data to PostGIS. > Now I'm trying to transfer data with ogr2ogr, but I have some problems to > understand the syntax: > > I have a System ODBC data source called CG. > I tried to run: > ogr2ogr -f "ODBC:CG" -t_srs "EPSG:3003" PG:"host=localhost user=postgres > dbname=osm password=postgres port=5432" -update -lco OVERWRITE=yes -nlt > NONE > > But it is not accepted. > I don't understand where I'm wrong > > thanks for your help, > Kiks > -- > View this message in context: > http://n2.nabble.com/OSM2-SqlServer-2008-tp4716063p4717357.html > Sent from the Mapserver - User mailing list archive at Nabble.com. > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > -------------- next part -------------- An HTML attachment was scrubbed... URL: From wal3 at mindspring.com Thu Mar 11 17:01:47 2010 From: wal3 at mindspring.com (Worth Lutz) Date: Thu, 11 Mar 2010 20:01:47 -0500 Subject: [mapserver-users] PHP mapscript and getResult() In-Reply-To: <4A2E47DA.4010105@dmsolutions.ca> References: <9621C11FBE5A4DB3BCF1FE27C7913C42@Worthlaptop> <49DA41CD.4070402@dmsolutions.ca> <4A2E47DA.4010105@dmsolutions.ca> Message-ID: I've been using the PHP mapscript method $results = layer->getResults(); to get: $results->numresults -and- $results->bounds of a query result. This is described in the query example in the manual at: http://www.mapserver.org/mapscript/querying.html?highlight=query and in the SWIG mapscript documentation. It was added to a 5.4 branch which I have been using in my development. I just got Mapserver 5.6 running on my test machine and the layer does not have this method. Is the information not available any more? Did this get deleted due to the 1-pass query? Do I need to reinsert the code I previously had to loop through the results to calculate the bounds of the results to set a map extent or is it possible to add this back in? Thanks in advance for clarifying this, Worth -----Original Message----- From: Yewondwossen Assefa [mailto:yassefa at dmsolutions.ca] Sent: Tuesday, June 09, 2009 7:31 AM To: Worth Lutz Cc: mapserver-users at lists.osgeo.org Subject: Re: [mapserver-users] PHP mapscript and getResult() Worth Lutz wrote: > Did this get added into PHP mapscript in the 5.4.1 release? If so, is it a > layer object method? > It missed the release. It is now committed in the the 5.4.x branch and the ticket is updated to reflect that. best regards, > -----Original Message----- > From: Yewondwossen Assefa [mailto:yassefa at dmsolutions.ca] > Sent: Monday, April 06, 2009 1:54 PM > To: Worth Lutz > Cc: mapserver-users at lists.osgeo.org > Subject: Re: [mapserver-users] PHP mapscript and getResult() > > > Worth Lutz wrote: >> There is a SWIG mapscript reference to a "layerObj" method "getResults()" >> returning a resultCacheObj. The resultCacheObj has an attribute "bounds" >> which is the extent of the results. >> >> Is this available in PHP mapscript. It seems to be missing. >> > > It is missing in php mapscript. Added a ticket on it and It should be > available for the 5.4.1 release: > http://trac.osgeo.org/mapserver/ticket/2967 > > Best Regards > > >> Worth >> >> >> >> _______________________________________________ >> mapserver-users mailing list >> mapserver-users at lists.osgeo.org >> http://lists.osgeo.org/mailman/listinfo/mapserver-users >> > > -- ---------------------------------------------------------------- Assefa Yewondwossen Software Analyst Email: assefa at dmsolutions.ca http://www.dmsolutions.ca/ Phone: (613) 565-5056 (ext 14) Fax: (613) 565-0925 ---------------------------------------------------------------- From pcreso at pcreso.com Thu Mar 11 20:21:51 2010 From: pcreso at pcreso.com (pcreso at pcreso.com) Date: Thu, 11 Mar 2010 20:21:51 -0800 (PST) Subject: [mapserver-users] runtime substitution not working In-Reply-To: Message-ID: <771896.58542.qm@web33203.mail.mud.yahoo.com> Hi, I'm obviously doing something wrong, but can't see what it is... I have a Postgis table of species occurences & I want to pass a variable to the mapfile to select which speciesusing runtime substitution. The relevant DATA statement (joining species in the catch to locations in the station) in the mapfile is: DATA "startp from (select c.id, s.startp, s.trip_code, s.station_no, c.species, c.weight from t_station s, catch c where s.station_no=c.station_no and c.species ilike '%%spp%%') as myquery using unique id using srid=4326" The query works in Postgis & in the mapfile (via QGIS) when I hard code the %spp% (eg, to 'TAR') I'm using QGIS to open the layer, with the URL: http://wms-dev/cgi-bin/mapserv?map=/srv/www/htdocs/mapdata/catch.map&spp=TAR QGIS appends the request type, etc & it works with the hard coded "spp" The mapfile also has: METADATA "wms_title" "species" "wms_srs" "epsg:4326" "wfs_title" "species" "wfs_version" "1.0.0" "wfs_typename" "species" "wfs_request_method" "GET" "wfs_service" "WFS" "spp_validation_pattern" '^[A-Z0-9][A-Z0-9][A-Z0-9]$' END The version I'm running is MapServer version 5.4.1 (so no default supported) The docs say I can use shp2img to test runtime substitution in a mapfile, but I can't see how to invoke the substitution with the equivalent of a spp=TAR statement to test this. Any suggestions? Thanks Brent Wood From martijnvanderpauw at gmail.com Fri Mar 12 05:57:23 2010 From: martijnvanderpauw at gmail.com (windfreak) Date: Fri, 12 Mar 2010 05:57:23 -0800 (PST) Subject: [mapserver-users] Masking labels Message-ID: <1268402243598-4722191.post@n2.nabble.com> Hello, I have made a mapserver image (see the example). This image consists of 2 layers. The top layers works as a mask over the bottom layer so I only see the bottom layer where I want it to see. Unfortunately, the labels of the bottom layer aren't masked. Can somebody tell me how to do that in one image? When possible, I don't want to see half labels. Thanks http://n2.nabble.com/file/n4722191/mapserv.png ----- http://www.topspots.org -- View this message in context: http://n2.nabble.com/Masking-labels-tp4722191p4722191.html Sent from the Mapserver - User mailing list archive at Nabble.com. From bthoen at gisnet.com Fri Mar 12 08:23:14 2010 From: bthoen at gisnet.com (Bill Thoen) Date: Fri, 12 Mar 2010 09:23:14 -0700 Subject: [mapserver-users] Masking labels In-Reply-To: <1268402243598-4722191.post@n2.nabble.com> References: <1268402243598-4722191.post@n2.nabble.com> Message-ID: <4B9A6A72.5070207@gisnet.com> windfreak wrote: > Hello, > > I have made a mapserver image (see the example). This image consists of 2 > layers. The top layers works as a mask over the bottom layer so I only see > the bottom layer where I want it to see. > Unfortunately, the labels of the bottom layer aren't masked. Can somebody > tell me how to do that in one image? When possible, I don't want to see half > labels. > There's a clause in one of the map objects to show a layer only if another layer is present. Unfortunately, this is one of those cases that maddens documenters -- How to document something when a reader knows what they're looking for, but doesn't know what it's called. Ah, using the "seek an ye shall find" method on the docs and I think what you want to look at is the LABELREQUIRES entry under LAYER in the MapServer Mapfile docs at http://mapserver.org/mapfile/layer.html. -- Bill Thoen GISnet - www.gisnet.com 1401 Walnut St., Suite C Boulder, CO 80302 303-786-9961 tel 303-443-4856 fax From cjauvin at gmail.com Fri Mar 12 09:19:36 2010 From: cjauvin at gmail.com (Christian Jauvin) Date: Fri, 12 Mar 2010 12:19:36 -0500 Subject: [mapserver-users] Publishing a dynamically created (and transient) map Message-ID: Hi, In a surveillance application I am creating (DraconesPH), I build new maps by dynamically adding features on static layers (for instance, convex hull polygons computed with PostGIS, illustrating the results of a cluster detection algorithm). Someone asked me recently if there was a way to publish those dynamic maps as a WMS service: at any point in the application flow, a user wanting to publish the current map would push a button, which would save it (perhaps as GML?) and make it accessible from an external application (along with some useful metadata), despite the fact that the current map, being transient, may have changed meanwhile. At first I thought that this was going to be easy, and that I would simply have to study and understand the WMS/WFS model. In particular, this page seems highly relevant to what I want to do: http://mapserver.org/ogc/mapscript.html But then I am not sure if this model exactly applies to what I have in mind, and so I would appreciate any possible help or guidance. Best, Christian From Steve.Lime at state.mn.us Fri Mar 12 12:09:03 2010 From: Steve.Lime at state.mn.us (Lime, Steve D (DNR)) Date: Fri, 12 Mar 2010 14:09:03 -0600 Subject: [mapserver-users] Masking labels In-Reply-To: <1268402243598-4722191.post@n2.nabble.com> References: <1268402243598-4722191.post@n2.nabble.com> Message-ID: This isn't a built-in feature... If the masking layer has no labels associated with it then you can try setting a parameter called POSTLABELCACHE to TRUE. That will draw the layer in question after the labels have been placed. However that will result in partially obscured labels. Your best bet would be to somehow identify polygons that can be labeled ahead of time, perhaps be intersecting their centroids and your mask. It would be an interesting hack to define a label mask layer or something along those lines to filter labels against before rendering. Steve -----Original Message----- From: mapserver-users-bounces at lists.osgeo.org [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of windfreak Sent: Friday, March 12, 2010 7:57 AM To: mapserver-users at lists.osgeo.org Subject: [mapserver-users] Masking labels Hello, I have made a mapserver image (see the example). This image consists of 2 layers. The top layers works as a mask over the bottom layer so I only see the bottom layer where I want it to see. Unfortunately, the labels of the bottom layer aren't masked. Can somebody tell me how to do that in one image? When possible, I don't want to see half labels. Thanks http://n2.nabble.com/file/n4722191/mapserv.png ----- http://www.topspots.org -- View this message in context: http://n2.nabble.com/Masking-labels-tp4722191p4722191.html Sent from the Mapserver - User mailing list archive at Nabble.com. _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users From Steve.Lime at state.mn.us Fri Mar 12 14:06:19 2010 From: Steve.Lime at state.mn.us (Lime, Steve D (DNR)) Date: Fri, 12 Mar 2010 16:06:19 -0600 Subject: [mapserver-users] runtime substitution not working In-Reply-To: <771896.58542.qm@web33203.mail.mud.yahoo.com> References: <771896.58542.qm@web33203.mail.mud.yahoo.com> Message-ID: I don't see anything obvious. You can test at the command-line with the CGI (shp2img won't work). Syntax is like so: mapserv -nh "QUERY_STRING=map=/srv/www/htdocs/mapdata/catch.map&spp=TAR" The -nh switch suppresses the HTTP headers which helps if you're creating an image. Steve -----Original Message----- From: mapserver-users-bounces at lists.osgeo.org [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of pcreso at pcreso.com Sent: Thursday, March 11, 2010 10:22 PM To: mapserver-users at lists.osgeo.org Subject: [mapserver-users] runtime substitution not working Hi, I'm obviously doing something wrong, but can't see what it is... I have a Postgis table of species occurences & I want to pass a variable to the mapfile to select which speciesusing runtime substitution. The relevant DATA statement (joining species in the catch to locations in the station) in the mapfile is: DATA "startp from (select c.id, s.startp, s.trip_code, s.station_no, c.species, c.weight from t_station s, catch c where s.station_no=c.station_no and c.species ilike '%%spp%%') as myquery using unique id using srid=4326" The query works in Postgis & in the mapfile (via QGIS) when I hard code the %spp% (eg, to 'TAR') I'm using QGIS to open the layer, with the URL: http://wms-dev/cgi-bin/mapserv?map=/srv/www/htdocs/mapdata/catch.map&spp=TAR QGIS appends the request type, etc & it works with the hard coded "spp" The mapfile also has: METADATA "wms_title" "species" "wms_srs" "epsg:4326" "wfs_title" "species" "wfs_version" "1.0.0" "wfs_typename" "species" "wfs_request_method" "GET" "wfs_service" "WFS" "spp_validation_pattern" '^[A-Z0-9][A-Z0-9][A-Z0-9]$' END The version I'm running is MapServer version 5.4.1 (so no default supported) The docs say I can use shp2img to test runtime substitution in a mapfile, but I can't see how to invoke the substitution with the equivalent of a spp=TAR statement to test this. Any suggestions? Thanks Brent Wood _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users From bob.b at gritechnologies.com Fri Mar 12 19:50:20 2010 From: bob.b at gritechnologies.com (Bob Basques) Date: Fri, 12 Mar 2010 21:50:20 -0600 Subject: [mapserver-users] Publishing a dynamically created (and transient) map In-Reply-To: References: Message-ID: <4B9B0B7C.9040203@gritechnologies.com> Christian, From what you describe (and I'm not sure I understand it 100%), I think you are simply talking about a Listener service for your surveillance process, similar to a GPS listener. If that's the case, then I would simply set up a database table in POSTGIS and feed it records (CML or WKT, or) at some interval and use a Mapserver to POSTGIS rendering process to visualize things. Let the Database client decide how often it wants to see an update by querying the database at it's leisure. I've set up similar configurations for GPS devices. Or did I get the wrong intent? bobb On 3/12/2010 11:19 AM, Christian Jauvin wrote: > Hi, > > In a surveillance application I am creating (DraconesPH), I build new > maps by dynamically adding features on static layers (for instance, > convex hull polygons computed with PostGIS, illustrating the results > of a cluster detection algorithm). > > Someone asked me recently if there was a way to publish those dynamic > maps as a WMS service: at any point in the application flow, a user > wanting to publish the current map would push a button, which would > save it (perhaps as GML?) and make it accessible from an external > application (along with some useful metadata), despite the fact that > the current map, being transient, may have changed meanwhile. > > At first I thought that this was going to be easy, and that I would > simply have to study and understand the WMS/WFS model. In particular, > this page seems highly relevant to what I want to do: > > http://mapserver.org/ogc/mapscript.html > > But then I am not sure if this model exactly applies to what I have in > mind, and so I would appreciate any possible help or guidance. > > Best, > > Christian > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > > From ekrgdim at gmail.com Sat Mar 13 05:14:04 2010 From: ekrgdim at gmail.com (georgeDim) Date: Sat, 13 Mar 2010 05:14:04 -0800 (PST) Subject: [mapserver-users] Re: msLoadMap() Unable to access file In-Reply-To: <482CA163.3050704@gmail.com> References: <482CA163.3050704@gmail.com> Message-ID: <1268486044548-4727322.post@n2.nabble.com> 1) C:\ms4w\httpd.d\httpd_geomatics.conf #This is the Apache config (httpd_geomatics.conf) file for the MapServer workshop. Alias /geomatics "/ms4w/apps/geomatics/htdocs" AllowOverride None Options Indexes MultiViews Includes FollowSymLinks Order allow,deny Allow from all 2) C:\ms4w\apps\geomatics\htdocs\hello.map MAP NAME "Hello_World" SIZE 400 300 IMAGECOLOR 249 245 186 IMAGETYPE png EXTENT -1.00 -1.00 1.00 1.00 WEB TEMPLATE 'hello.html' IMAGEPATH '/ms4w/tmp/ms_tmp/' IMAGEURL '/ms_tmp/' END LAYER NAME hello STATUS default TYPE point FEATURE POINTS 0.0 0.0 END TEXT "Hello World" END # end feature CLASS STYLE COLOR 255 0 0 END LABEL TYPE bitmap END END END END 3)C:\ms4w\apps\geomatics\htdocs\hello.html Hello World

good luck -- View this message in context: http://n2.nabble.com/msLoadMap-Unable-to-access-file-tp1971168p4727322.html Sent from the Mapserver - User mailing list archive at Nabble.com. From lists at remoteinformation.com.au Sat Mar 13 16:25:37 2010 From: lists at remoteinformation.com.au (Ben Madin) Date: Sun, 14 Mar 2010 07:25:37 +0700 Subject: [mapserver-users] runtime substitution not working In-Reply-To: <20100312170020.C7ED6E01DC1@lists.osgeo.org> References: <20100312170020.C7ED6E01DC1@lists.osgeo.org> Message-ID: <4A839E76-ED46-4109-9360-BF6CEBC0584A@remoteinformation.com.au> G'day Brent, It might not matter, but you have double %% in the DATA statement you have passed, and for whatever reason - I recevied advice from this list or OpenLayers list - I have all my variable names capitalised in the query: WHERE transferdate >= '%STARTDATE%' AND transferdate <= '%ENDDATE%' AND line_geom IS NOT NULL AND sourceshire NOT LIKE destinationshire AND sourceshire LIKE '%SOURCESHIRE%' So I hope these might help if Steve's solution didn't cheers Ben On 13/03/2010, at 24:00 , mapserver-users-request at lists.osgeo.org wrote: > I'm obviously doing something wrong, but can't see what it is... I have a Postgis table of species occurences & I want to pass a variable to the mapfile to select which speciesusing runtime substitution. > > The relevant DATA statement (joining species in the catch to locations in the station) in the mapfile is: > > DATA "startp from (select c.id, s.startp, s.trip_code, > s.station_no, c.species, > c.weight > from t_station s, catch c > where s.station_no=c.station_no > and c.species ilike '%%spp%%') > as myquery > using unique id using srid=4326" > > > The query works in Postgis & in the mapfile (via QGIS) when I hard code the %spp% (eg, to 'TAR') > > I'm using QGIS to open the layer, with the URL: > http://wms-dev/cgi-bin/mapserv?map=/srv/www/htdocs/mapdata/catch.map&spp=TAR > > QGIS appends the request type, etc & it works with the hard coded "spp" > > The mapfile also has: > METADATA > "wms_title" "species" > "wms_srs" "epsg:4326" > "wfs_title" "species" > "wfs_version" "1.0.0" > "wfs_typename" "species" > "wfs_request_method" "GET" > "wfs_service" "WFS" > "spp_validation_pattern" '^[A-Z0-9][A-Z0-9][A-Z0-9]$' > END > > The version I'm running is MapServer version 5.4.1 > (so no default supported) > > The docs say I can use shp2img to test runtime substitution in a mapfile, but I can't see how to invoke the substitution with the equivalent of a spp=TAR statement to test this. > > > Any suggestions? > > Thanks > > Brent Wood From pcreso at pcreso.com Sun Mar 14 10:29:46 2010 From: pcreso at pcreso.com (pcreso at pcreso.com) Date: Sun, 14 Mar 2010 10:29:46 -0700 (PDT) Subject: [mapserver-users] runtime substitution not working In-Reply-To: <4A839E76-ED46-4109-9360-BF6CEBC0584A@remoteinformation.com.au> Message-ID: <1689.83799.qm@web33202.mail.mud.yahoo.com> Hi Ben... I have it working in other setups fine - just this one won't behave. If I use "like '%spp%'" & pass &spp=TAR, then the query that gets run is "like 'TAR', which is basically an un-indexed = I need a "like '%TAR%'" in the SQL hence the double % sign. I have this working elsewhere fine (but with different versions of mapserver & Postgis) Capitalisation might be the problem... I'll try that... Thanks, Brent --- On Sun, 3/14/10, Ben Madin wrote: > From: Ben Madin > Subject: Re: [mapserver-users] runtime substitution not working > To: mapserver-users at lists.osgeo.org > Cc: pcreso at pcreso.com > Date: Sunday, March 14, 2010, 1:25 PM > G'day Brent, > > It might not matter, but you have double %% in the DATA > statement you have passed, > > and for whatever reason - I recevied advice from this list > or OpenLayers list - I have all my variable names > capitalised in the query: > > > WHERE transferdate > >= '%STARTDATE%' AND transferdate <= '%ENDDATE%' > > AND > line_geom IS NOT NULL > > AND > sourceshire NOT LIKE destinationshire > > AND > sourceshire LIKE '%SOURCESHIRE%' > > So I hope these might help if Steve's solution didn't > > cheers > > Ben > > > > On 13/03/2010, at 24:00 , mapserver-users-request at lists.osgeo.org > wrote: > > > I'm obviously doing something wrong, but can't see > what it is... I have a Postgis table of species occurences > & I want to pass a variable to the mapfile to select > which speciesusing runtime substitution. > > > > The relevant DATA statement (joining species in the > catch to locations in the station) in the mapfile is: > > > > DATA "startp from (select c.id, s.startp, s.trip_code, > > > > > s.station_no, c.species, > > > c.weight > > > from t_station s, catch c > > > where > s.station_no=c.station_no > > > and c.species ilike > '%%spp%%') > > > as myquery > > > using unique id using > srid=4326" > > > > > > The query works in Postgis & in the mapfile (via > QGIS) when I hard code the %spp% (eg, to 'TAR') > > > > I'm using QGIS to open the layer, with the URL: > > http://wms-dev/cgi-bin/mapserv?map=/srv/www/htdocs/mapdata/catch.map&spp=TAR > > > > QGIS appends the request type, etc & it works with > the hard coded "spp" > > > > The mapfile also has: > > METADATA > > "wms_title" "species" > > > "wms_srs" "epsg:4326" > > "wfs_title" "species" > > "wfs_version" "1.0.0" > > "wfs_typename" "species" > > "wfs_request_method" "GET" > > "wfs_service" "WFS" > > "spp_validation_pattern" > '^[A-Z0-9][A-Z0-9][A-Z0-9]$' > > END > > > > The version I'm running is MapServer version 5.4.1 > > (so no default supported) > > > > The docs say I can use shp2img to test runtime > substitution in a mapfile, but I can't see how to invoke the > substitution with the equivalent of a spp=TAR statement to > test this. From jhevenor at rogers.com Sun Mar 14 17:03:14 2010 From: jhevenor at rogers.com (Joshua Hevenor) Date: Sun, 14 Mar 2010 17:03:14 -0700 (PDT) Subject: [mapserver-users] runtime substitution not working In-Reply-To: <1689.83799.qm@web33202.mail.mud.yahoo.com> Message-ID: <155138.89145.qm@web88001.mail.re2.yahoo.com> I see what Ben was worried about and what you're trying to do. I haven't done a lot of variable substitution but I have done a lot of head scratching to when queries don't work as expected. A couple things that might shed some light you could try: "like '%spp%'" ?? and? pass &spp=%TAR% If you're looking for a string containing TAR.? It might confirm that the double %% are being misinterpreted. Or you could try if this is the case and you want to force the wildcards at the mapfile level. "like '%' || '%spp%' || '%"' Josh --- On Sun, 3/14/10, pcreso at pcreso.com wrote: From: pcreso at pcreso.com Subject: Re: [mapserver-users] runtime substitution not working To: mapserver-users at lists.osgeo.org Date: Sunday, March 14, 2010, 1:29 PM Hi Ben... I have it working in other setups fine - just this one won't behave. If I use "like '%spp%'" & pass &spp=TAR, then the query that gets run is "like 'TAR', which is basically an un-indexed = I need a "like '%TAR%'" in the SQL hence the double % sign. I have this working elsewhere fine (but with different versions of mapserver & Postgis) Capitalisation might be the problem... I'll try that... Thanks, ???Brent --- On Sun, 3/14/10, Ben Madin wrote: > From: Ben Madin > Subject: Re: [mapserver-users] runtime substitution not working > To: mapserver-users at lists.osgeo.org > Cc: pcreso at pcreso.com > Date: Sunday, March 14, 2010, 1:25 PM > G'day Brent, > > It might not matter, but you have double %% in the DATA > statement you have passed, > > and for whatever reason - I recevied advice from this list > or OpenLayers list - I have all my variable names > capitalised in the query: > >? ? ? ? ? ? >? ? ? ???WHERE transferdate > >= '%STARTDATE%' AND transferdate <= '%ENDDATE%' >? ? ? ? ? ? >? ? ? ? ? ???AND > line_geom IS NOT NULL >? ? ? ? ? ? >? ? ? ? ? ???AND > sourceshire NOT LIKE destinationshire >? ? ? ? ? ? >? ? ? ? ? ???AND > sourceshire LIKE '%SOURCESHIRE%' > > So I hope these might help if Steve's solution didn't > > cheers > > Ben > > > > On 13/03/2010, at 24:00 , mapserver-users-request at lists.osgeo.org > wrote: > > > I'm obviously doing something wrong, but can't see > what it is... I have a Postgis table of species occurences > & I want to pass a variable to the mapfile to select > which speciesusing runtime substitution. > > > > The relevant DATA statement (joining species in the > catch to locations in the station) in the mapfile is: > > > > DATA "startp from (select c.id, s.startp, s.trip_code, > > >? ? ? ? ? ? ??? >? ? ? ? ? ? ? > s.station_no, c.species, > >? ? ? ? ? ? ??? >? ? ? ? ? ? ???c.weight > >? ? ? ? ? ? ??? >? ? ? ? from t_station s, catch c > >? ? ? ? ? ? ??? >? ? ? ? where > s.station_no=c.station_no > >? ? ? ? ? ? ??? >? ? ? ? ? and c.species ilike > '%%spp%%') > >? ? ? ? ? ? ??? >? ? ? ? as myquery > >? ? ? ? ? ? ??? >? ? ? ? using unique id using > srid=4326" > > > > > > The query works in Postgis & in the mapfile (via > QGIS) when I hard code the %spp% (eg, to 'TAR') > > > > I'm using QGIS to open the layer, with the URL: > > http://wms-dev/cgi-bin/mapserv?map=/srv/www/htdocs/mapdata/catch.map&spp=TAR > > > > QGIS appends the request type, etc & it works with > the hard coded "spp" > > > > The mapfile also has: > >? ? METADATA > >? ? ? "wms_title" "species" > >? ??? > "wms_srs"???"epsg:4326" > >? ? ? "wfs_title" "species" > >? ? ? "wfs_version" "1.0.0" > >? ? ? "wfs_typename" "species" > >? ? ? "wfs_request_method" "GET" > >? ? ? "wfs_service" "WFS" > >? ? ? "spp_validation_pattern" > '^[A-Z0-9][A-Z0-9][A-Z0-9]$' > >? ? END > > > > The version I'm running is MapServer version 5.4.1 > > (so no default supported) > > > > The docs say I can use shp2img to test runtime > substitution in a mapfile, but I can't see how to invoke the > substitution with the equivalent of a spp=TAR statement to > test this. _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From SansonR at asurequality.com Sun Mar 14 17:29:44 2010 From: SansonR at asurequality.com (Robert Sanson) Date: Mon, 15 Mar 2010 13:29:44 +1300 Subject: [mapserver-users] runtime substitution not working In-Reply-To: <155138.89145.qm@web88001.mail.re2.yahoo.com> References: <1689.83799.qm@web33202.mail.mud.yahoo.com> <155138.89145.qm@web88001.mail.re2.yahoo.com> Message-ID: <4B9E3647.379F.0037.0@asurequality.com> Use double %% "like '%%spp%%'" and pass &spp=TAR Regards, Robert >>> Joshua Hevenor 15/03/2010 1:03 p.m. >>> I see what Ben was worried about and what you're trying to do. I haven't done a lot of variable substitution but I have done a lot of head scratching to when queries don't work as expected. A couple things that might shed some light you could try: "like '%spp%'" and pass &spp=%TAR% If you're looking for a string containing TAR. It might confirm that the double %% are being misinterpreted. Or you could try if this is the case and you want to force the wildcards at the mapfile level. "like '%' || '%spp%' || '%"' Josh --- On Sun, 3/14/10, pcreso at pcreso.com wrote: From: pcreso at pcreso.com Subject: Re: [mapserver-users] runtime substitution not working To: mapserver-users at lists.osgeo.org Date: Sunday, March 14, 2010, 1:29 PM Hi Ben... I have it working in other setups fine - just this one won't behave. If I use "like '%spp%'" & pass &spp=TAR, then the query that gets run is "like 'TAR', which is basically an un-indexed = I need a "like '%TAR%'" in the SQL hence the double % sign. I have this working elsewhere fine (but with different versions of mapserver & Postgis) Capitalisation might be the problem... I'll try that... Thanks, Brent --- On Sun, 3/14/10, Ben Madin wrote: > From: Ben Madin > Subject: Re: [mapserver-users] runtime substitution not working > To: mapserver-users at lists.osgeo.org ( /mc/compose?to=mapserver-users at lists.osgeo.org ) > Cc: pcreso at pcreso.com ( /mc/compose?to=pcreso at pcreso.com ) > Date: Sunday, March 14, 2010, 1:25 PM > G'day Brent, > > It might not matter, but you have double %% in the DATA > statement you have passed, > > and for whatever reason - I recevied advice from this list > or OpenLayers list - I have all my variable names > capitalised in the query: > > > WHERE transferdate > >= '%STARTDATE%' AND transferdate <= '%ENDDATE%' > > AND > line_geom IS NOT NULL > > AND > sourceshire NOT LIKE destinationshire > > AND > sourceshire LIKE '%SOURCESHIRE%' > > So I hope these might help if Steve's solution didn't > > cheers > > Ben > > > > On 13/03/2010, at 24:00 , mapserver-users-request at lists.osgeo.org ( /mc/compose?to=mapserver-users-request at lists.osgeo.org ) > wrote: > > > I'm obviously doing something wrong, but can't see > what it is... I have a Postgis table of species occurences > & I want to pass a variable to the mapfile to select > which speciesusing runtime substitution. > > > > The relevant DATA statement (joining species in the > catch to locations in the station) in the mapfile is: > > > > DATA "startp from (select c.id, s.startp, s.trip_code, > > > > > s.station_no, c.species, > > > c.weight > > > from t_station s, catch c > > > where > s.station_no=c.station_no > > > and c.species ilike > '%%spp%%') > > > as myquery > > > using unique id using > srid=4326" > > > > > > The query works in Postgis & in the mapfile (via > QGIS) when I hard code the %spp% (eg, to 'TAR') > > > > I'm using QGIS to open the layer, with the URL: > > http://wms-dev/cgi-bin/mapserv?map=/srv/www/htdocs/mapdata/catch.map&spp=TAR > > > > QGIS appends the request type, etc & it works with > the hard coded "spp" > > > > The mapfile also has: > > METADATA > > "wms_title" "species" > > > "wms_srs" "epsg:4326" > > "wfs_title" "species" > > "wfs_version" "1.0.0" > > "wfs_typename" "species" > > "wfs_request_method" "GET" > > "wfs_service" "WFS" > > "spp_validation_pattern" > '^[A-Z0-9][A-Z0-9][A-Z0-9]$' > > END > > > > The version I'm running is MapServer version 5.4.1 > > (so no default supported) > > > > The docs say I can use shp2img to test runtime > substitution in a mapfile, but I can't see how to invoke the > substitution with the equivalent of a spp=TAR statement to > test this. _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org ( /mc/compose?to=mapserver-users at lists.osgeo.org ) http://lists.osgeo.org/mailman/listinfo/mapserver-users Click here ( https://www.mailcontrol.com/sr/wQw0zmjPoHdJTZGyOCrrhg== ) to report this email as spam. ------------------------------------------------------------------ The contents of this email are confidential to AsureQuality. If you have received this communication in error please notify the sender immediately and delete the message and any attachments. The opinions expressed in this email are not necessarily those of AsureQuality. This message has been scanned for known viruses before delivery. AsureQuality supports the Unsolicited Electronic Messages Act 2007. If you do not wish to receive similar communications in future, please notify the sender of this message. ------------------------------------------------------------------ This message has been scanned for malware by SurfControl plc. www.surfcontrol.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From james.perrins at gmail.com Mon Mar 15 02:12:20 2010 From: james.perrins at gmail.com (James Perrins) Date: Mon, 15 Mar 2010 09:12:20 +0000 Subject: [mapserver-users] GDAL WMS Message-ID: Hi, I've been trying to use this: http://www.gdal.org/frmt_wms.html I've tried both with a tile server - and with a WMS service (as it seemed like an easy way to get caching) It basically works, but I have problems with the quality of the image that mapserver produces It seems that mapserver requests too many tiles / images from WMS for the current screen image required - it then re-samples this resulting in poor quality being served through mapserver (and often with too much detail for the size returned meaning its still more broken up on labels etc) The images from the WMS / tile server (and stored in the cache) are fine - so its definitely mapserver / GDAL minidriver thats causing the problem. Also - with the WMS call - what are SizeX and SizeY about - altering these can effect the quality of the image - its almost as if this is the image size that the WMS would be if served out as one massive image as the most details scale ?? I don't really see why they are needed? example for WMS: 1.1.1 http://localhost/scripts/mapserv.exe?map=D:\My.map& EPSG:27700 image/png TOPOLINE,TOPOAREA 300965 236781 323072 216968 1115800 1000000 512 512 EPSG:27700 Many Thanks James From szekerest at gmail.com Mon Mar 15 03:41:54 2010 From: szekerest at gmail.com (Tamas Szekeres) Date: Mon, 15 Mar 2010 11:41:54 +0100 Subject: [mapserver-users] GDAL WMS In-Reply-To: References: Message-ID: 2010/3/15 James Perrins > > It seems that mapserver requests too many tiles / images from WMS for > the current screen image required - it then re-samples this resulting > in poor quality being served through mapserver (and often with too > much detail for the size returned meaning its still more broken up on > labels etc) > > James, MapServer resamples the image according to the desired scale (which is not necessarily the same as the scale of the WMS source). You could somewhat increase the quality of the resampling by specifying a more sophisticated algorithm as a layer processing option, for example: PROCESSING "RESAMPLE=BILINEAR" By default a larger image is requersted from the data source which may result in a higher amount of tiles to be downloaded. This effect can be controlled by specifying the oversample ratio, for example: PROCESSING "OVERSAMPLE_RATIO=1" Best regards, Tamas -------------- next part -------------- An HTML attachment was scrubbed... URL: From james.perrins at gmail.com Mon Mar 15 05:05:46 2010 From: james.perrins at gmail.com (James Perrins) Date: Mon, 15 Mar 2010 12:05:46 +0000 Subject: [mapserver-users] GDAL WMS In-Reply-To: References: Message-ID: Thanks Tamas, PROCESSING "OVERSAMPLE_RATIO=1" seems to have greatly improved things - especially for the tile server- I didn't see this in the documentation was I looking in the wrong place ? I presume 1 means don't oversize 2.0 means get double etc Do you know what the SizeX does for WMS as well ? Many Thanks James From szekerest at gmail.com Mon Mar 15 05:15:14 2010 From: szekerest at gmail.com (Tamas Szekeres) Date: Mon, 15 Mar 2010 13:15:14 +0100 Subject: [mapserver-users] GDAL WMS In-Reply-To: References: Message-ID: 2010/3/15 James Perrins > > Do you know what the SizeX does for WMS as well ? > > SizeX,SizeY corresponds to the raster dimensions in pixels Best regards, Tamas -------------- next part -------------- An HTML attachment was scrubbed... URL: From mulone at rome.com Mon Mar 15 05:44:52 2010 From: mulone at rome.com (Mulone) Date: Mon, 15 Mar 2010 04:44:52 -0800 (PST) Subject: [mapserver-users] OSM2pgsql, latlong, OpenStreetMap data, uDig = weird projection Message-ID: <1268657092841-4736654.post@n2.nabble.com> Hi guys, I have an issue trying to import OSM data on PostGIS. I download an xml file from the CloudMade site. I use this script to import the file into postgis (on Windows, latlong projection): ./osm2pgsql -U userId -W -H myhost -d maps -p myprefix -S default.style -c -l data.osm.bz2 This works, but when I visualise the spatial data on uDIG (default projection: WGS84) proportions are wrong. The vertical axis is much shorter than it is on regular online maps (e.g. openstreetmap.org, google maps, etc), like here: http://img7.imageshack.us/img7/8279/imagelw.png So I read somewhere that the OSM data is stored in mercator, and I tried to run the same script with -m option: ./osm2pgsql -U userId -W -H myhost -d maps -p myprefix -S default.style -c -m data.osm.bz2 The command works but then I can't visualise any data in uDig. How can I load OSM data with the right SRS and then project it properly? Cheers, Mulone ----- Mulone PhD student -- View this message in context: http://n2.nabble.com/OSM2pgsql-latlong-OpenStreetMap-data-uDig-weird-projection-tp4736654p4736654.html Sent from the Mapserver - User mailing list archive at Nabble.com. From pal.kristensen at statkart.no Mon Mar 15 06:40:25 2010 From: pal.kristensen at statkart.no (paalkr) Date: Mon, 15 Mar 2010 05:40:25 -0800 (PST) Subject: [mapserver-users] Re: GDAL WMS In-Reply-To: References: Message-ID: <1268660425525-4737001.post@n2.nabble.com> Hi! I have pointed out the missing documentation of the OVERSAMPLING_RATIO process directive before, and even made a ticket. As the directive enhances raster quality a lot in different situations I think it really deserves to be documented. Hopefully some with committing rights will pick it up soon. Se my earlier post with a link to the ticket: http://n2.nabble.com/Documentation-update-td2396593.html#a2396593 Regards, P?l Kristensen ----- Regards, P?l Kristensen -- View this message in context: http://n2.nabble.com/GDAL-WMS-tp4735781p4737001.html Sent from the Mapserver - User mailing list archive at Nabble.com. From james.perrins at gmail.com Mon Mar 15 06:51:28 2010 From: james.perrins at gmail.com (James Perrins) Date: Mon, 15 Mar 2010 13:51:28 +0000 Subject: [mapserver-users] GDAL WMS In-Reply-To: References: Message-ID: Thanks Tamas - but I'm still confused.. With a WMS call I can specify the BlockSize - which I believe controls the size of the tiles that I get back from the WMS service If I have set blocksize to be 256 then if I am requesting a WMS image to fill a 512x512 space on the screen and I have the OVERSAMPLING_RATIO=1 - I would expect it to request 4 to 9 256x256 tiles (depending on how aligned it was) "SizeX,SizeY corresponds to the raster dimensions in pixels" - - is this the raster of the source image (the WMS is vector so this doesn't make much sense to me?) - or is it the size of the image produced - which is a series of 256x256 tiles stitched together to whatever size I have requested through mapserver - so again it doesn't make much sense to me to define this in the xml file - as it will change as my window resizes. If talking about a tileserver - e.g OpenStreetMap - what is the SizeX,Y then - the size of the source raster at its maximum resolution ? Sorry if these are silly questions - but I'm clearly missing some bit of basic understanding here Many Thanks James On Mon, Mar 15, 2010 at 12:15 PM, Tamas Szekeres wrote: > > > 2010/3/15 James Perrins >> >> Do you know what the SizeX does for WMS as well ? >> > > SizeX,SizeY corresponds to the raster dimensions in pixels > > Best regards, > > Tamas > > From thomaschx at gmx.de Mon Mar 15 07:01:18 2010 From: thomaschx at gmx.de (Thomasch) Date: Mon, 15 Mar 2010 15:01:18 +0100 Subject: [mapserver-users] OSM2pgsql, latlong, OpenStreetMap data, uDig = weird projection In-Reply-To: <1268657092841-4736654.post@n2.nabble.com> References: <1268657092841-4736654.post@n2.nabble.com> Message-ID: <4B9E3DAE.80800@gmx.de> Hi, there is an HowTo: http://trac.osgeo.org/mapserver/wiki/RenderingOsmData In your Mapfile, you have to state the Projection like the following: Map PROJECTION "init=epsg:4326" END [...] LAYER METADATA "WMS_TITLE" "Parks" END CLASSITEM "leisure" CONNECTION "user=xxx password=xxx dbname=xxx host=localhost port=5432" CONNECTIONTYPE POSTGIS DATA "way FROM planet_osm_polygon using unique gid using srid=900913 " NAME "OSM_Parks" STATUS ON TOLERANCE 0 TYPE POLYGON LabelItem "name" CLASS NAME "Parks" EXPRESSION "park" STYLE COLOR 89 150 89 END LABEL COLOR 0 0 0 FONT vera_sans TYPE truetype SIZE 8 POSITION AUTO MINDISTANCE 0 PARTIALS FALSE OUTLINECOLOR 255 255 255 END END PROJECTION "init=epsg:900913" END END END Maybe that helps. Thomasch From thomaschx at gmx.de Mon Mar 15 07:11:03 2010 From: thomaschx at gmx.de (Thomasch) Date: Mon, 15 Mar 2010 15:11:03 +0100 Subject: [mapserver-users] wms with gernerated Layers Message-ID: <4B9E3FF7.4040400@gmx.de> Hi, I've got an map which contains some generated Layers using PHP Mapscript. How do I serve these Layers as wms? I read http://mapserver.org/ogc/mapscript.html but I don't really understand at which place i could modify the map itself. Thomasch From mark at spatialcloud.com Mon Mar 15 08:38:01 2010 From: mark at spatialcloud.com (Mark Korver) Date: Mon, 15 Mar 2010 09:38:01 -0600 Subject: [mapserver-users] Looking for advice for OGC Services Server hardware requirements In-Reply-To: <4B989A58.8010006@gatewaygeomatics.com> References: <4B989A58.8010006@gatewaygeomatics.com> Message-ID: <47b96b01003150838u1e06b04w6486ca9464abfda6@mail.gmail.com> We all know that benchmarking is no easy task. Benchmarking when you don't have the hardware in the first place makes things just a bit more difficult. I know this is not exactly the same thing. But cloud services, like Amazon EC2, which give you access to a number of base configurations, with different hardware specs and os (nix and Windows) installs that are ready to go can give you a good idea of what parts of the overall pie are more important. And who knows? You might even find that just doing it in the cloud is the way to go. The point is, you don't have to buy anything but server time to test diff configs. - Mark On Thu, Mar 11, 2010 at 1:23 AM, Jeff McKenna wrote: > Luigi Castro Cardeles wrote: >> >> Hi, >> >> Maybe this can help you. >> http://2009.foss4g.org/presentations/#presentation_109 >> > > I would like to add that there is at least some off-list talk of some > Windows vs Unix benchmarking for the 2010 exercise > (http://wiki.osgeo.org/wiki/Benchmarking_2010). ?As the maintainer of > MapServer 4 Windows (MS4W) I can tell you that the download/use statistics > are staggering (very popular); it is used in production environments for > both government and private industry. ?I encourage you to give it a try > (even though most developers on this MapServer mailing list are unix-based, > don't let them scare you away from Windows, if you are more comfortable in > that environment). > > Hope this helps a little. > > -jeff > > > -- > Jeff McKenna > MapServer Consulting and Training Services > http://www.gatewaygeomatics.com/ > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From jasonbeverage at gmail.com Mon Mar 15 08:53:25 2010 From: jasonbeverage at gmail.com (Jason Beverage) Date: Mon, 15 Mar 2010 11:53:25 -0400 Subject: [mapserver-users] Average/Bilinear Resampling and Alpha Bands Message-ID: <2c4bbbeb1003150853i7e19c655re1260caf60461feb@mail.gmail.com> Hi all, I have some imagery that is in UTM that contains an alpha band that masks out areas with no data. When I use MapServer to reproject it to epsg:4326, the masked out area looks good if I set RESAMPLE=NEAREST on the layer. If I change the RESAMPLE option to BILINEAR or AVERAGE I get black splotches in the area that is transparent. Has anyone else seen this behavior? I'm using MapServer 5.6.1 Thanks, Jason From warmerdam at pobox.com Mon Mar 15 09:20:25 2010 From: warmerdam at pobox.com (Frank Warmerdam) Date: Mon, 15 Mar 2010 12:20:25 -0400 Subject: [mapserver-users] Average/Bilinear Resampling and Alpha Bands In-Reply-To: <2c4bbbeb1003150853i7e19c655re1260caf60461feb@mail.gmail.com> References: <2c4bbbeb1003150853i7e19c655re1260caf60461feb@mail.gmail.com> Message-ID: <4B9E5E49.3000501@pobox.com> Jason Beverage wrote: > Hi all, > > I have some imagery that is in UTM that contains an alpha band that > masks out areas with no data. When I use MapServer to reproject it to > epsg:4326, the masked out area looks good if I set RESAMPLE=NEAREST on > the layer. If I change the RESAMPLE option to BILINEAR or AVERAGE I > get black splotches in the area that is transparent. > > Has anyone else seen this behavior? Jason, I haven't run into this before, but it sounds like a bug in the resampler. If you can file a detailed ticket on this so that I can easily reproduce the problem I should be able to fix it. Best regards, -- ---------------------------------------+-------------------------------------- I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com light and sound - activate the windows | http://pobox.com/~warmerdam and watch the world go round - Rush | Geospatial Programmer for Rent From mulone at rome.com Mon Mar 15 11:17:01 2010 From: mulone at rome.com (Mulone) Date: Mon, 15 Mar 2010 10:17:01 -0800 (PST) Subject: [mapserver-users] Re: OSM2pgsql, latlong, OpenStreetMap data, uDig = weird projection In-Reply-To: <4B9E3DAE.80800@gmx.de> References: <1268657092841-4736654.post@n2.nabble.com> <4B9E3DAE.80800@gmx.de> Message-ID: <1268677021861-4738825.post@n2.nabble.com> Thanks for your hint! I tried to do that but without success. The system used to work with epsg:4326 but in our project we need a GoogleMaps like projection and we chose epsg:900913. These are the steps I followed to reimport everything for the new projection: 1) download osm xml file from Cloudmade (e.g. Italy.osm.bz2) 2) Run 900913.sql on my PostGIS 3) import that file into PostGIS with command: ./osm2pgsql -U userid -W -H host -d maps -p myprefix -S default.style -c -m italy.osm.bz2 4) At this point everything seems ok. The geometry columns have 900913 as SRID. 5) update MapFile with: WEB METADATA wms_srs "epsg:900913" ... PROJECTION "init=epsg:900913" END Then in each layer I put: PROJECTION "init=epsg:900913" END and all of the queries have: using srid=900913 6) load the wms layer into OpenLayers with var wms = new OpenLayers.Layer.WMS("OpenStreetMap", mainurl, { ... units : 'm', projection:new OpenLayers.Projection("EPSG:900913"), ... Unfortunately all I get is a grey empty image. Looking at the map server log I noticed that it's full of: [Mon Mar 15 17:49:44 2010].517000 msPostGISLayerWhichShapes query status: 2 [Mon Mar 15 17:49:44 2010].517000 msPostGISLayerWhichShapes got 0 records in result. [Mon Mar 15 17:49:44 2010].517000 msPostGISLayerNextShape called. With the other projection I was getting the records. Do you have any idea about what could be wrong in my set up? I tried to debug it in several ways but I couldn't find anything wrong. Is there some debug procedure I can try to see what's failing? Cheers, Mulone ----- Mulone PhD student -- View this message in context: http://n2.nabble.com/OSM2pgsql-latlong-OpenStreetMap-data-uDig-weird-projection-tp4736654p4738825.html Sent from the Mapserver - User mailing list archive at Nabble.com. From SansonR at asurequality.com Mon Mar 15 12:52:01 2010 From: SansonR at asurequality.com (Robert Sanson) Date: Tue, 16 Mar 2010 08:52:01 +1300 Subject: [mapserver-users] GDAL WMS In-Reply-To: References: Message-ID: <4B9F46B0.379F.0037.0@asurequality.com> Hi JAmes I believe sizex,sizey refers to the size a given pixel represents on the ground. eg. a 1:25,000 scale orthophoto may be represented with each pixel = 2.5m on the ground. Here is an example from my mapfile: LAYER NAME nz50ktm GROUP "Toposcans" TYPE RASTER STATUS ON CONNECTION "http://ws-esrimt/arcgis/services/mapservice_topography_raster/MapServer/WMSServer?" CONNECTIONTYPE WMS MAXSCALE 60000 MINSCALE 10000 METADATA # OGC:WMS specific tags "ows_title" "NZ 1:50k scale NZTM" "ows_abstract" "This layer came from the LINZ Topo50 series maps in NZTM" "WMS_FORMAT" "image/png" "wms_server_version" "1.1.1" "wms_opaque" "1" "wms_group_title" "Toposcans" "wms_resx" "4.233" "wms_resy" "4.233" "ows_extent" "1083997.88 4722000.45 2092003.23 6234002.12" "wms_srs" "EPSG:2193" "WMS_NAME" "3" "wms_exceptions_format" "application/vnd.ogc.se_xml" END END Regards, Robert S >>> James Perrins 16/03/2010 2:51 a.m. >>> Thanks Tamas - but I'm still confused.. With a WMS call I can specify the BlockSize - which I believe controls the size of the tiles that I get back from the WMS service If I have set blocksize to be 256 then if I am requesting a WMS image to fill a 512x512 space on the screen and I have the OVERSAMPLING_RATIO=1 - I would expect it to request 4 to 9 256x256 tiles (depending on how aligned it was) "SizeX,SizeY corresponds to the raster dimensions in pixels" - - is this the raster of the source image (the WMS is vector so this doesn't make much sense to me?) - or is it the size of the image produced - which is a series of 256x256 tiles stitched together to whatever size I have requested through mapserver - so again it doesn't make much sense to me to define this in the xml file - as it will change as my window resizes. If talking about a tileserver - e.g OpenStreetMap - what is the SizeX,Y then - the size of the source raster at its maximum resolution ? Sorry if these are silly questions - but I'm clearly missing some bit of basic understanding here Many Thanks James On Mon, Mar 15, 2010 at 12:15 PM, Tamas Szekeres wrote: > > > 2010/3/15 James Perrins >> >> Do you know what the SizeX does for WMS as well ? >> > > SizeX,SizeY corresponds to the raster dimensions in pixels > > Best regards, > > Tamas > > _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ------------------------------------------------------------------ The contents of this email are confidential to AsureQuality. If you have received this communication in error please notify the sender immediately and delete the message and any attachments. The opinions expressed in this email are not necessarily those of AsureQuality. This message has been scanned for known viruses before delivery. AsureQuality supports the Unsolicited Electronic Messages Act 2007. If you do not wish to receive similar communications in future, please notify the sender of this message. ------------------------------------------------------------------ This message has been scanned for malware by SurfControl plc. www.surfcontrol.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From thomaschx at gmx.de Mon Mar 15 12:56:21 2010 From: thomaschx at gmx.de (Thomasch) Date: Mon, 15 Mar 2010 20:56:21 +0100 Subject: [mapserver-users] Re: OSM2pgsql, latlong, OpenStreetMap data, uDig = weird projection In-Reply-To: <1268677021861-4738825.post@n2.nabble.com> References: <1268657092841-4736654.post@n2.nabble.com> <4B9E3DAE.80800@gmx.de> <1268677021861-4738825.post@n2.nabble.com> Message-ID: <4B9E90E5.8030009@gmx.de> Hi Mulone, I'm not familiar with OpenLayers - in a quick search I found http://trac.openlayers.org/wiki/SphericalMercator If the Map itself (without using wms) is displayed correctly, did you try another WMS Client? Thomasch From SansonR at asurequality.com Mon Mar 15 12:55:29 2010 From: SansonR at asurequality.com (Robert Sanson) Date: Tue, 16 Mar 2010 08:55:29 +1300 Subject: [mapserver-users] Average/Bilinear Resampling and Alpha Bands In-Reply-To: <2c4bbbeb1003150853i7e19c655re1260caf60461feb@mail.gmail.com> References: <2c4bbbeb1003150853i7e19c655re1260caf60461feb@mail.gmail.com> Message-ID: <4B9F4781.379F.0037.0@asurequality.com> Hi Jason That's not unexpected. RESAMPLE=NEAREST preserves the "nodata" vales used in the mask. BILINEAR or AVERAGE combine values from adjoining pixels, so the "nodata" pixels get some other value. regards, Robert >>> Jason Beverage 16/03/2010 4:53 a.m. >>> Hi all, I have some imagery that is in UTM that contains an alpha band that masks out areas with no data. When I use MapServer to reproject it to epsg:4326, the masked out area looks good if I set RESAMPLE=NEAREST on the layer. If I change the RESAMPLE option to BILINEAR or AVERAGE I get black splotches in the area that is transparent. Has anyone else seen this behavior? I'm using MapServer 5.6.1 Thanks, Jason _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ------------------------------------------------------------------ The contents of this email are confidential to AsureQuality. If you have received this communication in error please notify the sender immediately and delete the message and any attachments. The opinions expressed in this email are not necessarily those of AsureQuality. This message has been scanned for known viruses before delivery. AsureQuality supports the Unsolicited Electronic Messages Act 2007. If you do not wish to receive similar communications in future, please notify the sender of this message. ------------------------------------------------------------------ This message has been scanned for malware by SurfControl plc. www.surfcontrol.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From jasonbeverage at gmail.com Mon Mar 15 14:27:59 2010 From: jasonbeverage at gmail.com (Jason Beverage) Date: Mon, 15 Mar 2010 17:27:59 -0400 Subject: [mapserver-users] Average/Bilinear Resampling and Alpha Bands In-Reply-To: <4B9F4781.379F.0037.0@asurequality.com> References: <2c4bbbeb1003150853i7e19c655re1260caf60461feb@mail.gmail.com> <4B9F4781.379F.0037.0@asurequality.com> Message-ID: <2c4bbbeb1003151427n4125ac04h22a01dd25f8ecc15@mail.gmail.com> Hey again, Some more information, the file I was using was an ECW I converted from a tif. The black splotches appear if I use the ECW, but if I use the original tif file I don't see them. However, when using AVERAGE or BILINEAR, it appears as if the alpha values are either completely transparent or completely opaque. The image I'm using is an image I used the gdalwarp -cblend option on to do some polygon cutting so I'm losing my blending line if I do average or bilinear resampling. I'll see if I can create a small example that shows the issue. Thanks, Jason On Mon, Mar 15, 2010 at 3:55 PM, Robert Sanson wrote: > Hi Jason > > That's not unexpected. RESAMPLE=NEAREST preserves the "nodata" vales used > in the mask. BILINEAR or AVERAGE combine values from adjoining pixels, so > the "nodata" pixels get some other value. > > regards, > > Robert > > >>> Jason Beverage 16/03/2010 4:53 a.m. >>> > > Hi all, > > I have some imagery that is in UTM that contains an alpha band that > masks out areas with no data. When I use MapServer to reproject it to > epsg:4326, the masked out area looks good if I set RESAMPLE=NEAREST on > the layer. If I change the RESAMPLE option to BILINEAR or AVERAGE I > get black splotches in the area that is transparent. > > Has anyone else seen this behavior? > > I'm using MapServer 5.6.1 > > Thanks, > > Jason > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > > > > ------------------------------------------------------------------ > > The contents of this email are confidential to AsureQuality. If you have received this communication in error please notify the sender immediately and delete the message and any attachments. The opinions expressed in this email are not necessarily those of AsureQuality. This message has been scanned for known viruses before delivery. AsureQuality supports the Unsolicited Electronic Messages Act 2007. If you do not wish to receive similar communications in future, please notify the sender of this message. > ------------------------------------------------------------------ > > This message has been scanned for malware by SurfControl plc. > www.surfcontrol.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From SansonR at asurequality.com Mon Mar 15 14:44:41 2010 From: SansonR at asurequality.com (Robert Sanson) Date: Tue, 16 Mar 2010 10:44:41 +1300 Subject: [mapserver-users] Average/Bilinear Resampling and Alpha Bands In-Reply-To: <2c4bbbeb1003151427n4125ac04h22a01dd25f8ecc15@mail.gmail.com> References: <2c4bbbeb1003150853i7e19c655re1260caf60461feb@mail.gmail.com> <4B9F4781.379F.0037.0@asurequality.com> <2c4bbbeb1003151427n4125ac04h22a01dd25f8ecc15@mail.gmail.com> Message-ID: <4B9F6118.379F.0037.0@asurequality.com> Hi Jason Well, ECW use wavelet compression, which is lossy, and data values can get changed slightly. regards, Robert >>> Jason Beverage 16/03/2010 10:27 a.m. >>> Hey again, Some more information, the file I was using was an ECW I converted from a tif. The black splotches appear if I use the ECW, but if I use the original tif file I don't see them. However, when using AVERAGE or BILINEAR, it appears as if the alpha values are either completely transparent or completely opaque. The image I'm using is an image I used the gdalwarp -cblend option on to do some polygon cutting so I'm losing my blending line if I do average or bilinear resampling. I'll see if I can create a small example that shows the issue. Thanks, Jason On Mon, Mar 15, 2010 at 3:55 PM, Robert Sanson wrote: Hi Jason That's not unexpected. RESAMPLE=NEAREST preserves the "nodata" vales used in the mask. BILINEAR or AVERAGE combine values from adjoining pixels, so the "nodata" pixels get some other value. regards, Robert >>> Jason Beverage 16/03/2010 4:53 a.m. >>> Hi all, I have some imagery that is in UTM that contains an alpha band that masks out areas with no data. When I use MapServer to reproject it to epsg:4326, the masked out area looks good if I set RESAMPLE=NEAREST on the layer. If I change the RESAMPLE option to BILINEAR or AVERAGE I get black splotches in the area that is transparent. Has anyone else seen this behavior? I'm using MapServer 5.6.1 Thanks, Jason _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ------------------------------------------------------------------ The contents of this email are confidential to AsureQuality. If you have received this communication in error please notify the sender immediately and delete the message and any attachments. The opinions expressed in this email are not necessarily those of AsureQuality. This message has been scanned for known viruses before delivery. AsureQuality supports the Unsolicited Electronic Messages Act 2007. If you do not wish to receive similar communications in future, please notify the sender of this message. ------------------------------------------------------------------ This message has been scanned for malware by SurfControl plc. www.surfcontrol.com ( http://www.surfcontrol.com/ ) Click here ( https://www.mailcontrol.com/sr/D7!VF8Wy1bvTndxI!oX7UnIFdu++nxPn8TyWuTsECDRa2Inu1mF0RyIAxMxkdMyGu1AQC+ell+VjEfBJ2k7YZA== ) to report this email as spam. ------------------------------------------------------------------ The contents of this email are confidential to AsureQuality. If you have received this communication in error please notify the sender immediately and delete the message and any attachments. The opinions expressed in this email are not necessarily those of AsureQuality. This message has been scanned for known viruses before delivery. AsureQuality supports the Unsolicited Electronic Messages Act 2007. If you do not wish to receive similar communications in future, please notify the sender of this message. ------------------------------------------------------------------ -------------- next part -------------- An HTML attachment was scrubbed... URL: From j.l.h.hartmann at uva.nl Tue Mar 16 04:28:07 2010 From: j.l.h.hartmann at uva.nl (Jan Hartmann) Date: Tue, 16 Mar 2010 12:28:07 +0100 Subject: [mapserver-users] Forcing WMS errors in XML-format in PHP-MapScript In-Reply-To: <4B982311.3000209@mapgears.com> References: <998191.85108.qm@web38208.mail.mud.yahoo.com> <4B982311.3000209@mapgears.com> Message-ID: <4B9F6B47.7070204@uva.nl> This is probably something I should try to look up myself, but perhaps someone on this list has a quick answer. I'm generating WMS output completely from PHP MapScript (essentially to make non-projected raster files available for WMS clients under a fake projection number, to georeference raw coordinates). If something goes wrong with the getCapabilities request, I would like to output a valid XML error string that can be understood by regular WMS clients. Any pointers to documentation on the required/optional XML formats? Jan From dmorissette at mapgears.com Tue Mar 16 06:05:02 2010 From: dmorissette at mapgears.com (Daniel Morissette) Date: Tue, 16 Mar 2010 09:05:02 -0400 Subject: [mapserver-users] Forcing WMS errors in XML-format in PHP-MapScript In-Reply-To: <4B9F6B47.7070204@uva.nl> References: <998191.85108.qm@web38208.mail.mud.yahoo.com> <4B982311.3000209@mapgears.com> <4B9F6B47.7070204@uva.nl> Message-ID: <4B9F81FE.9050104@mapgears.com> Jan Hartmann wrote: > This is probably something I should try to look up myself, but perhaps > someone on this list has a quick answer. > > I'm generating WMS output completely from PHP MapScript (essentially > to make non-projected raster files available for WMS clients under a > fake projection number, to georeference raw coordinates). If something > goes wrong with the getCapabilities request, I would like to output a > valid XML error string that can be understood by regular WMS clients. > Any pointers to documentation on the required/optional XML formats? > I guess the best reference will be the WMS spec document itself, for the version of WMS that you are implementing. The spec docs are available at http://www.opengeospatial.org/standards/wms If you look at the WMS 1.1.1 doc from that list, section 6.7 discusses service exceptions and Annex A contains the XML exception DTD as well as an exception example. Dnaiel -- Daniel Morissette http://www.mapgears.com/ From mulone at rome.com Tue Mar 16 07:47:14 2010 From: mulone at rome.com (Mulone) Date: Tue, 16 Mar 2010 06:47:14 -0800 (PST) Subject: [mapserver-users] Re: OSM2pgsql, latlong, OpenStreetMap data, uDig = weird projection In-Reply-To: <4B9E90E5.8030009@gmx.de> References: <1268657092841-4736654.post@n2.nabble.com> <4B9E3DAE.80800@gmx.de> <1268677021861-4738825.post@n2.nabble.com> <4B9E90E5.8030009@gmx.de> Message-ID: <1268750834529-4744064.post@n2.nabble.com> Thanks for your reply. Yes, I tried to visualise the WMS server on uDig, but apparently it doesn't support the Google Mercator proj. Is there another way of checking the wms data? Cheers! ----- Mulone PhD student -- View this message in context: http://n2.nabble.com/OSM2pgsql-latlong-OpenStreetMap-data-uDig-weird-projection-tp4736654p4744064.html Sent from the Mapserver - User mailing list archive at Nabble.com. From Jukka.Rahkonen at mmmtike.fi Tue Mar 16 08:01:28 2010 From: Jukka.Rahkonen at mmmtike.fi (Rahkonen Jukka) Date: Tue, 16 Mar 2010 17:01:28 +0200 Subject: [mapserver-users] Re: OSM2pgsql, latlong, OpenStreetMap data, uDig = weird projection In-Reply-To: <1268750834529-4744064.post@n2.nabble.com> References: <1268657092841-4736654.post@n2.nabble.com> <4B9E3DAE.80800@gmx.de><1268677021861-4738825.post@n2.nabble.com><4B9E90E5.8030009@gmx.de> <1268750834529-4744064.post@n2.nabble.com> Message-ID: Hi, At least uDig 1.2 M9 milestone version does support Google Mercator as EPSG:900913. However, there are more alternatives. QGis and OpenJUMP, for example. You can also add more supported output projections to your WEB METADATA and LAYER METADATA sections in the mapfile as a space limited list and you are not limited to use just that one projection. "wms_srs" "EPSG:3067 EPSG:2393 EPSG:4326 EPSG 900913" OpenJUMP gives much better user interface for selecting SRS and output format than uDig. It does not zoom automatically to WMS layer so open some vector data in the project first. You can also try Right click - Zoom to WMS layer but it does not necessarily work because Mapserver is sending only lat/long bounding box and one projected bounding box to zoom in. -Jukka Rahkonen- Mulone wrote: > Thanks for your reply. > Yes, I tried to visualise the WMS server on uDig, but > apparently it doesn't > support the Google Mercator proj. > Is there another way of checking the wms data? > > Cheers! > > ----- > Mulone > PhD student > -- > View this message in context: > http://n2.nabble.com/OSM2pgsql-latlong-OpenStreetMap-data-uDig > -weird-projection-tp4736654p4744064.html > Sent from the Mapserver - User mailing list archive at Nabble.com. > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From barnhart.pat at gmail.com Tue Mar 16 08:44:15 2010 From: barnhart.pat at gmail.com (Pat B) Date: Tue, 16 Mar 2010 07:44:15 -0800 (PST) Subject: [mapserver-users] Custom Symbology using C# MapScript and SLDs Message-ID: <1268754255489-4744442.post@n2.nabble.com> Hi all - the following c# mapscript code is intended to change the symbol displayed for a point layer from an existing .sym file and write the style to an sld. Overall my goal is to let the user customize the map symbology on the fly using predfined symbols and save those changes in a sld. My understanding is that I should also be able to use WellKnownName symbols (square, circle, triangle, star, cross, x) even if they don't exist in the .sym. I've gotten it to work with the first two only (square and circle) by setting the style.symbolname directly instead of using setSymbolByName but it defaults back to one of those two for any of the other known names and doesn't work for my predefined symbols. I'm pretty sure I'm missing a step somewhere but have spent days on this with no luck, any help would be greatly appreciated! mapObj map = new mapObj("c:/ms4w/tmp/maps/myMapFile.map"); map.setSymbolSet("c:/ms4w/tmp/maps/symbols/symbols.sym"); layerObj layer = map.getLayerByName(layerName); classObj cls = new classObj(layer); styleObj style = new styleObj(cls); style.setSymbolByName(map,"mySymbol"); cls.insertStyle(style, 0); //remove any existing styles for(var w=1;w Point Layer Point Layer 100000.000000 ... Here's what I want to get in the output sld: ... Point Layer Point Layer mySymbol #ff0000 10 ... -- View this message in context: http://n2.nabble.com/Custom-Symbology-using-C-MapScript-and-SLDs-tp4744442p4744442.html Sent from the Mapserver - User mailing list archive at Nabble.com. From j.l.h.hartmann at uva.nl Tue Mar 16 10:05:11 2010 From: j.l.h.hartmann at uva.nl (Jan Hartmann) Date: Tue, 16 Mar 2010 18:05:11 +0100 Subject: [mapserver-users] Forcing WMS errors in XML-format in PHP-MapScript In-Reply-To: <4B9F81FE.9050104@mapgears.com> References: <998191.85108.qm@web38208.mail.mud.yahoo.com> <4B982311.3000209@mapgears.com> <4B9F6B47.7070204@uva.nl> <4B9F81FE.9050104@mapgears.com> Message-ID: <4B9FBA47.2060307@uva.nl> On 2010-03-16 14:05, Daniel Morissette wrote: > Jan Hartmann wrote: >> This is probably something I should try to look up myself, but >> perhaps someone on this list has a quick answer. >> >> I'm generating WMS output completely from PHP MapScript >> (essentially to make non-projected raster files available for WMS >> clients under a fake projection number, to georeference raw >> coordinates). If something goes wrong with the getCapabilities >> request, I would like to output a valid XML error string that can be >> understood by regular WMS clients. Any pointers to documentation on >> the required/optional XML formats? >> > > I guess the best reference will be the WMS spec document itself, for > the version of WMS that you are implementing. The spec docs are > available at http://www.opengeospatial.org/standards/wms > > If you look at the WMS 1.1.1 doc from that list, section 6.7 discusses > service exceptions and Annex A contains the XML exception DTD as well > as an exception example. > > Dnaiel The DTD in this document is validated as "http://www.digitalearth.gov/wmt/xml/exception_1_1_0.dtd". This site has been renamed www.digitalearth.org (http://trac.osgeo.org/mapserver/ticket/659) six years ago, but even that location doesn't exist anymore. Where do I find the DTD? Jan From dmorissette at mapgears.com Tue Mar 16 10:43:06 2010 From: dmorissette at mapgears.com (Daniel Morissette) Date: Tue, 16 Mar 2010 13:43:06 -0400 Subject: [mapserver-users] Forcing WMS errors in XML-format in PHP-MapScript In-Reply-To: <4B9FBA47.2060307@uva.nl> References: <998191.85108.qm@web38208.mail.mud.yahoo.com> <4B982311.3000209@mapgears.com> <4B9F6B47.7070204@uva.nl> <4B9F81FE.9050104@mapgears.com> <4B9FBA47.2060307@uva.nl> Message-ID: <4B9FC32A.9010107@mapgears.com> Jan Hartmann wrote: > > The DTD in this document is validated as > "http://www.digitalearth.gov/wmt/xml/exception_1_1_0.dtd". This site has > been renamed www.digitalearth.org > (http://trac.osgeo.org/mapserver/ticket/659) six years ago, but even > that location doesn't exist anymore. Where do I find the DTD? > The actual DTD is in A.3 of the specs document, it is really only 4 lines. The new official location for all OGC Web Services schemas (and older DTDs) is now http://schemas.opengis.net/, and more specifically for WMS 1.1.1 you'll find them at: http://schemas.opengis.net/wms/1.1.1/ -- Daniel Morissette http://www.mapgears.com/ From bartvde at osgis.nl Tue Mar 16 10:43:59 2010 From: bartvde at osgis.nl (Bart van den Eijnden) Date: Tue, 16 Mar 2010 18:43:59 +0100 Subject: [mapserver-users] Forcing WMS errors in XML-format in PHP-MapScript In-Reply-To: <4B9FBA47.2060307@uva.nl> References: <998191.85108.qm@web38208.mail.mud.yahoo.com> <4B982311.3000209@mapgears.com> <4B9F6B47.7070204@uva.nl> <4B9F81FE.9050104@mapgears.com> <4B9FBA47.2060307@uva.nl> Message-ID: <2BF12FA2-C0AD-4A0F-AC9B-077DA8DB8206@osgis.nl> schemas.opengis.net Best regards, Bart On Mar 16, 2010, at 6:05 PM, Jan Hartmann wrote: > > > On 2010-03-16 14:05, Daniel Morissette wrote: >> Jan Hartmann wrote: >>> This is probably something I should try to look up myself, but perhaps someone on this list has a quick answer. >>> >>> I'm generating WMS output completely from PHP MapScript (essentially to make non-projected raster files available for WMS clients under a fake projection number, to georeference raw coordinates). If something goes wrong with the getCapabilities request, I would like to output a valid XML error string that can be understood by regular WMS clients. Any pointers to documentation on the required/optional XML formats? >>> >> >> I guess the best reference will be the WMS spec document itself, for the version of WMS that you are implementing. The spec docs are available at http://www.opengeospatial.org/standards/wms >> >> If you look at the WMS 1.1.1 doc from that list, section 6.7 discusses service exceptions and Annex A contains the XML exception DTD as well as an exception example. >> >> Dnaiel > > The DTD in this document is validated as "http://www.digitalearth.gov/wmt/xml/exception_1_1_0.dtd". This site has been renamed www.digitalearth.org (http://trac.osgeo.org/mapserver/ticket/659) six years ago, but even that location doesn't exist anymore. Where do I find the DTD? > > Jan > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From russell at flora.ca Tue Mar 16 14:05:52 2010 From: russell at flora.ca (Russell McOrmond) Date: Tue, 16 Mar 2010 17:05:52 -0400 (EDT) Subject: [mapserver-users] Oddball mapserver/ArcSDE issue -- looking for advice. Message-ID: We are running Mapserver 5.4.0 compiled against the ArcSDE SDK and doing requests against an SDE database. This on RHEL5 and CentOS5 servers. We have an intermittent problem where the same Mapserver request will often work, but sometimes has a segmentation fault (possibly 1 out of every 5 times). The segmentation fault is caused by using a string which is actually null being returned from string functions, with the null then being used as if it were a string. See: http://trac.osgeo.org/mapserver/ticket/2988 "Check error returns from mapstring functions." I am wondering if anyone using ArcSDE for their database has seen this type of problem? There is some speculation here that this is a number of licenses issue (IE: that for the requests that are failing that it is actually ArcSDE not returning data because it didn't get a license). Does this seem plausible? It would be ideal if we could get an error message into the MS_ERRORFILE rather than core dumping, which might make it easier to diagnose this problem -- and to also keep the business folks from thinking it is a mapserver issue. -- Russell McOrmond, Internet Consultant: Please help us tell the Canadian Parliament to protect our property rights as owners of Information Technology. Sign the petition! http://digital-copyright.ca/petition/ict/ http://KillBillC61.ca "The government, lobbied by legacy copyright holders and hardware manufacturers, can pry control over my camcorder, computer, home theatre, or portable media player from my cold dead hands!" From zachc1980 at gmail.com Tue Mar 16 15:16:02 2010 From: zachc1980 at gmail.com (zach cruise) Date: Tue, 16 Mar 2010 18:16:02 -0400 Subject: [mapserver-users] how to contribute to development? Message-ID: i want to contribute to the development of mapserver (maybe postgis later :)). can someone break it down in simple steps? preferably what's the best way to check-out outstanding dev/bug issues, work at them, and then check them back-in for approval (without tripping over ego ;))? From jmckenna at gatewaygeomatics.com Tue Mar 16 19:01:10 2010 From: jmckenna at gatewaygeomatics.com (Jeff McKenna) Date: Wed, 17 Mar 2010 11:01:10 +0900 Subject: [mapserver-users] wms with gernerated Layers In-Reply-To: <4B9E3FF7.4040400@gmx.de> References: <4B9E3FF7.4040400@gmx.de> Message-ID: <4BA037E6.4090603@gatewaygeomatics.com> Thomasch wrote: > Hi, > I've got an map which contains some generated Layers using PHP > Mapscript. How do I serve these Layers as wms? > > I read http://mapserver.org/ogc/mapscript.html but I don't really > understand at which place i could modify the map itself. > Hi Thomasch, For instructions on how to serve your mapfile through WMS, please see the WMS Server document: http://www.mapserver.org/ogc/wms_server.html The example in that document is probably most helpful: http://www.mapserver.org/ogc/wms_server.html#sample-wms-server-mapfile I hope this gets you going in the right direction. -jeff -- Jeff McKenna MapServer Consulting and Training Services http://www.gatewaygeomatics.com/ From aberenyi at burken.hu Wed Mar 17 00:55:58 2010 From: aberenyi at burken.hu (=?ISO-8859-15?Q?Attila_BER=C9NYI?=) Date: Wed, 17 Mar 2010 08:55:58 +0100 Subject: [mapserver-users] WFS GetFeature with Mapserver In-Reply-To: <4BA037E6.4090603@gatewaygeomatics.com> References: <4B9E3FF7.4040400@gmx.de> <4BA037E6.4090603@gatewaygeomatics.com> Message-ID: <4BA08B0E.8070706@burken.hu> Dear All, I'd like to create something similar to this http://openlayers.org/dev/examples/getfeature-wfs.html only difference, that I'd like to use Mapserver. This is the actual state: http://webgis.fmt.bme.hu/gfi/t4.html, the according WFS dump: http://webgis.fmt.bme.hu/cgi-bin/mvmNew?SERVICE=WFS&VERSION=1.0.0&REQUEST=getfeature&TYPENAME=elteresek I've configured featureNS, featurePrefix, featureType, layerName, version and geometryName properly, but the events aren't fired... Could someone help me? Thanks, Attila From Jukka.Rahkonen at mmmtike.fi Wed Mar 17 01:41:06 2010 From: Jukka.Rahkonen at mmmtike.fi (Rahkonen Jukka) Date: Wed, 17 Mar 2010 10:41:06 +0200 Subject: [mapserver-users] WFS GetFeature with Mapserver In-Reply-To: <4BA08B0E.8070706@burken.hu> References: <4B9E3FF7.4040400@gmx.de> <4BA037E6.4090603@gatewaygeomatics.com> <4BA08B0E.8070706@burken.hu> Message-ID: Hi, I tested the gml file returned by Mapserver and it seems to be valid and your Mapserver side is obviously OK. Perhaps somebody on OpenLayers mailing list can help you with the application. -Jukka Rahkonen- Attila BER?NYI wrote: > Dear All, > > I'd like to create something similar to this > http://openlayers.org/dev/examples/getfeature-wfs.html only > difference, > that I'd like to use Mapserver. This is the actual state: > http://webgis.fmt.bme.hu/gfi/t4.html, the according WFS dump: > http://webgis.fmt.bme.hu/cgi-bin/mvmNew?SERVICE=WFS&VERSION=1. > 0.0&REQUEST=getfeature&TYPENAME=elteresek > .0.0&REQUEST=getfeature&TYPENAME=elteresek> > > I've configured featureNS, featurePrefix, featureType, layerName, > version and geometryName properly, but the events aren't fired... > > Could someone help me? > > Thanks, > Attila > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From mani2604 at gmail.com Wed Mar 17 02:45:43 2010 From: mani2604 at gmail.com (mani .,) Date: Wed, 17 Mar 2010 15:15:43 +0530 Subject: [mapserver-users] Mapserver ITEMQUERY problem; Message-ID: Hi everyone, Well I am student just stated on Mapserver. I've been using the example code from Bill kropla book, for Query modes. the QUERY & NQUERY modes are woking well; ITEMQUERY and its related ones doesn't seem to work at all. I am using his example of: qlayer=Cities qitem=STATE qstring=/Tex./ The error is :- mapserv(): Web application error. Parameter 'qstring' value fails to validate. msValidateParameter(): Regular expression error. Parameter pattern validation failed. ** There were similar posts on the same context with the exact same problem but there seems to be no formidable solution mentioned. ** the .map file has 2 layers - cities & countries ** I am running ms4w on windows 2003 server Thanks, -------------- next part -------------- An HTML attachment was scrubbed... URL: From wmsinspector at gmail.com Wed Mar 17 11:46:36 2010 From: wmsinspector at gmail.com (=?ISO-8859-1?Q?Adri=E0_Mercader?=) Date: Wed, 17 Mar 2010 19:46:36 +0100 Subject: [mapserver-users] [Off-topic] Announcing the WMS Inspector project Message-ID: [Apologies for the cross-posting] This is a post to announce the first public release of WMS Inspector, an open source Firefox add-on with tools for working with Web Map Services (WMS). It can be specially useful when working with Javascript mapping libraries like OpenLayers or MapBender or setting up WMS services with servers like MapServer, GeoServer or deegree. Main features include: * Load all WMS requests in the current page and their parameters * Requests sorting by service or type * Individual WMS requests (images or errors) visualization * Copy services, requests or parameters to the clipboard * Direct edition of request parameters values * Output GetCapabilities response as an HTML report or original file The WMS Inspector can be downloaded from the official Mozilla repository: https://addons.mozilla.org/firefox/addon/91406 For more information, please visit http://wiki.github.com/amercader/WMS-Inspector/ If you want to contribute as a developer, tester or translator or just give your opinion, do not hesitate to subscribe or post to the discussion list: wmsinspector at freelists.org Thank you, Adri? Mercader From mulone at rome.com Wed Mar 17 14:39:56 2010 From: mulone at rome.com (Mulone) Date: Wed, 17 Mar 2010 13:39:56 -0800 (PST) Subject: [mapserver-users] MapServer, OpenStreetMap, OpenLayers + Reprojection from Latlong to Mercator: a real nightmare Message-ID: <1268861996817-4753197.post@n2.nabble.com> (apologies for cross-posting) Hi everybody, I'm trying to render openstreetmap data on a WMS on MapServer and I posted something already about this. Now it's time to summarise everything and make some sense of this. The system used to work with epsg:4326 (LATLONG from now on) but in our project we need a GoogleMaps like projection and we chose epsg:900913/epsg:3785 (MERC from now on). This is our problem. We need the image on the right but we're getting the one on the left, a flattened map: http://img7.imageshack.us/img7/8279/imagelw.png After a lot of work and unsucceful tests I post here the outcome, hoping that it will be helpful to the community - and to us :-) These are the steps I followed from the very start: 1) download osm xml file from Cloudmade (e.g. Italy.osm.bz2) 2) Run 900913.sql on my PostGIS (optional, it shouldn't matter). 3) import that file into PostGIS with command (latlong option selected): ./osm2pgsql -U userid -W -H host -d maps -p myprefix -S default.style -c -l italy.osm.bz2 4) At this point everything seems ok. The geometry columns have latlong as SRID and the tables contain geometries. It's possible to visualise this dataset with uDig or other tools and reproject it. 5) Now we want to render this stuff on MapServer. So we add the espg configs from http://spatialreference.org/ref/epsg/3785/ to our mapserver espg file: <900913> +proj=merc +lon_0=0 +k=1 +x_0=0 +y_0=0 +a=6378137 +b=6378137 +towgs84=0,0,0,0,0,0,0 +units=m +no_defs <> <3785> +proj=merc +lon_0=0 +k=1 +x_0=0 +y_0=0 +a=6378137 +b=6378137 +towgs84=0,0,0,0,0,0,0 +units=m +no_defs <> 6) define this minimal mapfile with one layer: http://virtualpaste.com/82467 7) run several tests with different projections and annotate the outcome. Have a look at the report: http://docs.google.com/View?id=dftx6j46_166d6r38pcs Does anybody have any idea about how we could tackle this issue? I don't know if the problem is arising from MapServer or OpenLayers, so maybe you can help me design a better test to narrow the problem down. I presume a lot of people are doing something similar to us, so others might come across this issue. Cheers, Mulone ----- Mulone PhD student -- View this message in context: http://n2.nabble.com/MapServer-OpenStreetMap-OpenLayers-Reprojection-from-Latlong-to-Mercator-a-real-nightmare-tp4753197p4753197.html Sent from the Mapserver - User mailing list archive at Nabble.com. From thomaschx at gmx.de Thu Mar 18 00:13:35 2010 From: thomaschx at gmx.de (Thomasch) Date: Thu, 18 Mar 2010 08:13:35 +0100 Subject: [mapserver-users] wms with gernerated Layers In-Reply-To: <4BA037E6.4090603@gatewaygeomatics.com> References: <4B9E3FF7.4040400@gmx.de> <4BA037E6.4090603@gatewaygeomatics.com> Message-ID: <4BA1D29F.3070302@gmx.de> Hi, at first thanks for your hint - I'm now trying to write a simple wrapper in PHP Mapscript But the follwoing simple Code doesn't work. Unfortunately the example in http://www.mapserver.org/ogc/wms_server.html is in Python. loadParams(); $myMap->owsdispatch($req); ?> The plain Call of GetCapabilities like http://myserver/cgi-bin/mapserv?map=/home/thomas/public_html/wms/maps/wms.map&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetCapabilities works fine. Thomasch Am 17.03.2010 03:01, Jeff McKenna wrote: > Thomasch wrote: >> Hi, >> I've got an map which contains some generated Layers using PHP >> Mapscript. How do I serve these Layers as wms? >> >> I read http://mapserver.org/ogc/mapscript.html but I don't really >> understand at which place i could modify the map itself. >> > > Hi Thomasch, > > For instructions on how to serve your mapfile through WMS, please see > the WMS Server document: http://www.mapserver.org/ogc/wms_server.html > > The example in that document is probably most helpful: > http://www.mapserver.org/ogc/wms_server.html#sample-wms-server-mapfile > > I hope this gets you going in the right direction. > > -jeff > > > From iacovlev.pavel at gmail.com Thu Mar 18 01:40:32 2010 From: iacovlev.pavel at gmail.com (Pavel Iacovlev) Date: Thu, 18 Mar 2010 10:40:32 +0200 Subject: [mapserver-users] WMS GetFeatureInfo Message-ID: <2a37f67a1003180140g67c93a92tdc202a2a0edf09f4@mail.gmail.com> Good day all, I am looking for a standard way to query multiple WMS servers and merge the results. Example: query a random mapserver and geoserver (or any other server) and merge their results. I created wms client layer in phpmapscript and it worked perfectly, after that I tried "int queryByPoint(pointObj point, int mode, double buffer)" but it does nothing, no wms request is sent to the server, does mapserver support query by point on a wms layer ? After that did not work I tried to create a hack in php. INFO_FORMAT text/html and text/plain are not suitable for this job because "I need to extract the layers and attributes" in order to merge, so I tried "application/vnd.ogc.gml" and I encountered the following problems: 1) ArcGIS does not support it 2) If one of the layers is raster it returns an exception in Geoserver (bug) 3) Mapserver and Geoserver return different results, Mapserver is more like a plain GML, GeoServer uses WFS schema or something (not an XML,GML guru) Should a "standard" prevent this kind of issues ? can anyone suggest a better solution ? -- http://iap.md, The future is open From Clement.MONIER at v-trafic.com Thu Mar 18 02:10:32 2010 From: Clement.MONIER at v-trafic.com (=?iso-8859-1?Q?Cl=E9ment_MONIER?=) Date: Thu, 18 Mar 2010 10:10:32 +0100 Subject: [mapserver-users] MapServer, OpenStreetMap, OpenLayers + Reprojection from Latlong to Mercator: a real nightmare In-Reply-To: <1268861996817-4753197.post@n2.nabble.com> References: <1268861996817-4753197.post@n2.nabble.com> Message-ID: <0B6D7F516315594DBEFE58178D91BD32B7E515D2B6@exchangemm.mm.fr> Hi Mulone, We're using the 2 same projection systems to build the service you might see at www.v-trafic.com It's working but with no use of OpenLayers to perform the overlay and no PostGIS database (shapefile instead with WGS84 long/lat coordinates, epsg:4326). So if your problem comes from either OpenLayers or PostGIS, the following description won't help you anyway. The layers are requested with a WMS-formatted url with CRS=EPSG:3785 and BBOX in meters. Here is the content of epsg nad file (Proj4 lib) : # WGS 84 <4326> +proj=longlat +ellps=WGS84 +datum=WGS84 +no_defs <> # Web Spherical Mercator <3785> +proj=merc +lon_0=0 +k=1 +x_0=0 +y_0=0 +a=6378137 +b=6378137 +towgs84=0,0,0,0,0,0,0 +units=m no_defs Mapfile content : (Header "MAP" section) ... PROJECTION "init=epsg:3785" END ... (Layer section) ... PROJECTION "init=epsg:4326" END ... I'm quite sure all these basic things won't probably help you but it's worth trying. Regards Clement -----Message d'origine----- De?: mapserver-users-bounces at lists.osgeo.org [mailto:mapserver-users-bounces at lists.osgeo.org] De la part de Mulone Envoy??: mercredi 17 mars 2010 22:40 ??: mapserver-users at lists.osgeo.org Objet?: [mapserver-users] MapServer, OpenStreetMap, OpenLayers + Reprojection from Latlong to Mercator: a real nightmare (apologies for cross-posting) Hi everybody, I'm trying to render openstreetmap data on a WMS on MapServer and I posted something already about this. Now it's time to summarise everything and make some sense of this. The system used to work with epsg:4326 (LATLONG from now on) but in our project we need a GoogleMaps like projection and we chose epsg:900913/epsg:3785 (MERC from now on). This is our problem. We need the image on the right but we're getting the one on the left, a flattened map: http://img7.imageshack.us/img7/8279/imagelw.png After a lot of work and unsucceful tests I post here the outcome, hoping that it will be helpful to the community - and to us :-) These are the steps I followed from the very start: 1) download osm xml file from Cloudmade (e.g. Italy.osm.bz2) 2) Run 900913.sql on my PostGIS (optional, it shouldn't matter). 3) import that file into PostGIS with command (latlong option selected): ./osm2pgsql -U userid -W -H host -d maps -p myprefix -S default.style -c -l italy.osm.bz2 4) At this point everything seems ok. The geometry columns have latlong as SRID and the tables contain geometries. It's possible to visualise this dataset with uDig or other tools and reproject it. 5) Now we want to render this stuff on MapServer. So we add the espg configs from http://spatialreference.org/ref/epsg/3785/ to our mapserver espg file: <900913> +proj=merc +lon_0=0 +k=1 +x_0=0 +y_0=0 +a=6378137 +b=6378137 +towgs84=0,0,0,0,0,0,0 +units=m +no_defs <> <3785> +proj=merc +lon_0=0 +k=1 +x_0=0 +y_0=0 +a=6378137 +b=6378137 +towgs84=0,0,0,0,0,0,0 +units=m +no_defs <> 6) define this minimal mapfile with one layer: http://virtualpaste.com/82467 7) run several tests with different projections and annotate the outcome. Have a look at the report: http://docs.google.com/View?id=dftx6j46_166d6r38pcs Does anybody have any idea about how we could tackle this issue? I don't know if the problem is arising from MapServer or OpenLayers, so maybe you can help me design a better test to narrow the problem down. I presume a lot of people are doing something similar to us, so others might come across this issue. Cheers, Mulone ----- Mulone PhD student -- View this message in context: http://n2.nabble.com/MapServer-OpenStreetMap-OpenLayers-Reprojection-from-Latlong-to-Mercator-a-real-nightmare-tp4753197p4753197.html Sent from the Mapserver - User mailing list archive at Nabble.com. _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users From Jukka.Rahkonen at mmmtike.fi Thu Mar 18 02:14:01 2010 From: Jukka.Rahkonen at mmmtike.fi (Rahkonen Jukka) Date: Thu, 18 Mar 2010 11:14:01 +0200 Subject: [mapserver-users] WMS GetFeatureInfo In-Reply-To: <2a37f67a1003180140g67c93a92tdc202a2a0edf09f4@mail.gmail.com> References: <2a37f67a1003180140g67c93a92tdc202a2a0edf09f4@mail.gmail.com> Message-ID: Hi, I fear you are in trouble. WMS standard tells how to send GetFeatureInfo request and that a server must send the list of supported formats in the GetCapabilities document. No format is compulsory and therefore all the the WMS servers are behaving in a different way. The only interoperability I have found this far is between Mapserver and deegree WMS. They both send rather similar response to INFO_FORMAT=application/vnd.ogc.gml. However even with these two there is some difference in behaviour. If INFO_FORMAT parameter is left out Mapserver default is text/plain but deegree default is application/vnd.ogc.gml. And Mapserver does not produce gml at all by default but the WMS manager must especially make each layer to support gml output. On the other hand with Mapserver there is good control over the attributes included in the GetFeatureInfo but at least Geoserver sends always all the attributes. Very messy situation. Clients supporting GetFeatureInfo are not especially clever either. They do not offer a possibility to select the info format nor featureCount(uDig, QGis, OpenJUMP with deeJump plugin). OpenJUMP-deeJUMP use featurecount of 1000 while uDig and QGis do not use featurecount at all, which means featurecount=1 and users can't get usable information about overlapping areas, for example. I have not studied GetFeatureInfo behaviour actively lately and my knowledge may be partly outdated. WFS would work in a more standard way but usually WMS services do not have a parallel WFS service running. -Jukka Rahkonen- Pavel Iacovlev wrote: > > Good day all, > > I am looking for a standard way to query multiple WMS servers and > merge the results. Example: query a random mapserver and geoserver (or > any other server) and merge their results. > I created wms client layer in phpmapscript and it worked perfectly, > after that I tried "int queryByPoint(pointObj point, int mode, double > buffer)" but it does nothing, no wms request is sent to the server, > does mapserver support query by point on a wms layer ? > After that did not work I tried to create a hack in php. INFO_FORMAT > text/html and text/plain are not suitable for this job because "I need > to extract the layers and attributes" in order to merge, so I tried > "application/vnd.ogc.gml" and I encountered the following problems: > 1) ArcGIS does not support it > 2) If one of the layers is raster it returns an exception in > Geoserver (bug) > 3) Mapserver and Geoserver return different results, Mapserver is more > like a plain GML, GeoServer uses WFS schema or something (not an > XML,GML guru) > > Should a "standard" prevent this kind of issues ? can anyone suggest a > better solution ? > > -- > http://iap.md, The future is open > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From thomas.bonfort at gmail.com Thu Mar 18 02:14:23 2010 From: thomas.bonfort at gmail.com (thomas bonfort) Date: Thu, 18 Mar 2010 10:14:23 +0100 Subject: [mapserver-users] MapServer, OpenStreetMap, OpenLayers + Reprojection from Latlong to Mercator: a real nightmare In-Reply-To: <1268861996817-4753197.post@n2.nabble.com> References: <1268861996817-4753197.post@n2.nabble.com> Message-ID: the projection blocks in your layer should be the projection of the actual data, i.e. 4326 if you've run osm2pgsql with the -l switch. it should *not* be 3785 as you have put it. -- thomas On Wed, Mar 17, 2010 at 22:39, Mulone wrote: > > (apologies for cross-posting) > > Hi everybody, > > I'm trying to render openstreetmap data on a WMS on MapServer and I posted > something already about this. Now it's time to summarise everything and make > some sense of this. > > The system used to work with epsg:4326 (LATLONG from now on) but in our > project we need a GoogleMaps like projection and we chose > epsg:900913/epsg:3785 (MERC from now on). > This is our problem. > We need the image on the right but we're getting the one on the left, a > flattened map: > http://img7.imageshack.us/img7/8279/imagelw.png > > After a lot of work and unsucceful tests I post here the outcome, hoping > that it will be helpful to the community - and to us :-) > > These are the steps I followed from the very start: > > 1) download osm xml file from Cloudmade (e.g. Italy.osm.bz2) > 2) Run 900913.sql on my PostGIS (optional, it shouldn't matter). > 3) import that file into PostGIS with command (latlong option selected): > > ./osm2pgsql -U userid -W -H host -d maps -p myprefix -S default.style -c -l > italy.osm.bz2 > > 4) At this point everything seems ok. The geometry columns have latlong as > SRID and the tables contain geometries. > It's possible to visualise this dataset with uDig or other tools and > reproject it. > > 5) Now we want to render this stuff on MapServer. So we add the espg configs > from > ?http://spatialreference.org/ref/epsg/3785/ to our mapserver espg file: > > <900913> +proj=merc +lon_0=0 +k=1 +x_0=0 +y_0=0 +a=6378137 +b=6378137 > +towgs84=0,0,0,0,0,0,0 +units=m +no_defs <> > <3785> +proj=merc +lon_0=0 +k=1 +x_0=0 +y_0=0 +a=6378137 +b=6378137 > +towgs84=0,0,0,0,0,0,0 +units=m +no_defs <> > > 6) define this minimal mapfile with one layer: > http://virtualpaste.com/82467 > > 7) run several tests with different projections and annotate the outcome. > > Have a look at the report: > http://docs.google.com/View?id=dftx6j46_166d6r38pcs > > Does anybody have any idea about how we could tackle this issue? > I don't know if the problem is arising from MapServer or OpenLayers, so > maybe you can help me design a better test to narrow the problem down. > > I presume a lot of people are doing something similar to us, so others might > come across this issue. > > Cheers, > Mulone > > ----- > Mulone > PhD student > -- > View this message in context: http://n2.nabble.com/MapServer-OpenStreetMap-OpenLayers-Reprojection-from-Latlong-to-Mercator-a-real-nightmare-tp4753197p4753197.html > Sent from the Mapserver - User mailing list archive at Nabble.com. > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From Jukka.Rahkonen at mmmtike.fi Thu Mar 18 02:27:04 2010 From: Jukka.Rahkonen at mmmtike.fi (Rahkonen Jukka) Date: Thu, 18 Mar 2010 11:27:04 +0200 Subject: [mapserver-users] Google Mercator and +nadgrids=@null In-Reply-To: <0B6D7F516315594DBEFE58178D91BD32B7E515D2B6@exchangemm.mm.fr> References: <1268861996817-4753197.post@n2.nabble.com> <0B6D7F516315594DBEFE58178D91BD32B7E515D2B6@exchangemm.mm.fr> Message-ID: Hi, I have in my epsg file the following line for Google Mercator projection: <900913> +proj=merc +a=6378137 +b=6378137 +lat_ts=0.0 +lon_0=0.0 +x_0=0.0 +y_0=0 +k=1.0 +units=m +nadgrids=@null +no_defs I have copied the definitions from somewhere, I do not remember where. Now I noticed that http://spatialreference.org/ref/epsg/3785/proj4/ gives this proj4 string: +proj=merc +lon_0=0 +k=1 +x_0=0 +y_0=0 +a=6378137 +b=6378137 +towgs84=0,0,0,0,0,0,0 +units=m +no_defs There seems to be one difference: my line has +nadgrids=@null while the Spatialreference one has +towgs84=0,0,0,0,0,0,0 instead. Do they mean just the same thing? -Jukka Rahkonen- From schroeter at netgis.de Thu Mar 18 03:23:13 2010 From: schroeter at netgis.de (Sven Schroeter) Date: Thu, 18 Mar 2010 11:23:13 +0100 Subject: [mapserver-users] MS4W Message-ID: <76159D55F84C471E8EC7A188240A9C50@SVEN> Hi, the actual MS4W is v3.0 Beta 10 (Jan 27, 2010) Is there planned a new stable relaese in the near future? thanks Sven From simone.frigerio at univie.ac.at Thu Mar 18 03:56:37 2010 From: simone.frigerio at univie.ac.at (Simone Frigerio) Date: Thu, 18 Mar 2010 11:56:37 +0100 Subject: [mapserver-users] Unix and RGB - GRID in mapfile Message-ID: <4BA206E5.1010004@univie.ac.at> Hi, I need to manage huge file raster inside mapfile. Different kind of compression are available and I'm trying different way. Two questions on topic: 1) ECW andJPEG200 format are supported if I use win environment. Transferring on Unix environment, probably a GDAL new library has to be written, because actually it doesn't work. Is it true? 2) trying with GRID format should be interesting, especially for 1 band raster like DTM or DEM: ex.: LAYER NAME "grid" TYPE RASTER DATA "GRID/1956gridc1/w001001.adf" ... END At the end no problem, it's correctly visualize. But I have a lot of RGB raster to manage. So I if I convert in grid the result in "data" folder is: folder folderc1 folderc2 folderc3 info file.aux file.rrd Inside each folder I find w001001.adf as request to visualize. I use it and it works perfectly, but only with one band. How can I manage 3 bands in this way, to visualize correctly an RGB raster? Thanks and regards. Simone From schroete at iup.physik.uni-bremen.de Thu Mar 18 04:39:37 2010 From: schroete at iup.physik.uni-bremen.de (Heiko =?iso-8859-1?q?Schr=F6ter?=) Date: Thu, 18 Mar 2010 12:39:37 +0100 Subject: [mapserver-users] WFS limit time interval to POSTGIS Message-ID: <201003181239.37609.schroete@iup.physik.uni-bremen.de> Hello, by setting up a WFS server i need to limit the time interval for the requests to the postgis db (Millions of data points inside POSTGIS). The WMS part with time interval requests is working and i'am trying to make these data available through WFS as well. What i can find in the docs is a FILTER with a WFS Client connecting a WFS server. But this seems not to apply for DATE interval calculus. The only thing i get in the moment is the whole data set at once or the first NUMBER (here 10) of entries. Is it possible at all to limit the requested time interval to a WFS server ? i.e. something like TIME=2007-1-2/2007-1-3 Thanks and Regards Heiko LAYER EXTENT -180 -90 180 90 CONNECTIONTYPE POSTGIS NAME "TEST" PROCESSING "CLOSE_CONNECTION=DEFER" OPACITY 60 STATUS ON DUMP TRUE METADATA "wfs_title" "test" "wfs_maxfeatures" "10" "gml_featureid" "ID" ## REQUIRED "gml_include_items" "all" ## Optional (serves all attributes for layer) "gml_geometries" "rechteck" "gml_rechteck_type" "polygon" END PROJECTION "init=epsg:4326" END CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" DATA "rechteck from test_data using srid=-1 using unique datum" TYPE POLYGON SIZEUNITS meters CLASS NAME "test_class" STYLE OUTLINECOLOR 0 0 0 COLOR [farbe] END END END # Layer From jachym.cepicky at gmail.com Thu Mar 18 04:47:35 2010 From: jachym.cepicky at gmail.com (Jachym Cepicky) Date: Thu, 18 Mar 2010 12:47:35 +0100 Subject: [mapserver-users] can not compile arcsde 9.3 with mapserver 5.4 Message-ID: Hi, I'm not able to get arcsde 9.3.0 compiled with mapserver (5.4), on Linux I use ./configure --with-sde=/opt/arcsde/9.3.0/sdeexe93/ --with-sde-version='' the arcsde installation directory containes (among others) file ... libsde.so .. nut not "*.a" file or "*.h" files however, I get configure: error: "Could not find sdetype.h or libsde.a/libsde.so in /opt/arcsde/9.3.0/sdeexe93/." Any hint? Thanks Jachym -- Jachym Cepicky e-mail: jachym.cepicky gmail com URL: http://les-ejk.cz GPG: http://les-ejk.cz/pgp/JachymCepicky.pgp From igtrujillo78 at gmail.com Thu Mar 18 05:55:25 2010 From: igtrujillo78 at gmail.com (=?ISO-8859-1?Q?In=E9s_Garc=EDa?=) Date: Thu, 18 Mar 2010 13:55:25 +0100 Subject: [mapserver-users] Clasify 16 bits Geotiff Message-ID: <1ac946291003180555m7dd6e82yca432a60c1cf070e@mail.gmail.com> Hello, I need to clasity a 16 bits raster Geotiff. I am ussing the PROCESSING directive (PROCESSING "SCALE=-10,10") but it does not work. Can MapServer classify that kind of raster file? Thanks. LAYER NAME "Factor_c_abril_1998" TYPE RASTER STATUS on #PROCESSING "SCALE_1=1,255" #PROCESSING "SCALE_2=1,255" #PROCESSING "SCALE_3=1,255" PROCESSING "SCALE=1,255" #PROCESSING "SCALE_BUCKETS=2" #PROCESSING "DITHER=YES" #OFFSITE 0 0 0 #MINSCALEDENOM #MAXSCALEDENOM 2500000 DEBUG OFF DUMP TRUE PROCESSING "RASTER_QUERY_MAX_RESULT=1" TEMPLATE "C:\ms4w\apps\etc\template\general\clienteweb.html" DATA " \\169.254.22.221share\PI_2_RIESGOS\Informacion\Elaborada\06_RIESGOS_NATURALES_TECNOLOG\01_RIESGOS_NATURALES\04_DESERTIFICACION\04_FACTOR_C\Factor_c_1998\InfGeografica\InfRaster\TIFF\FC98_ABRIL.tif " METADATA "WMS_SRS" "EPSG:3034 EPSG:3035 EPSG:4230 EPSG:4258 EPSG:4267 EPSG:4269 EPSG:4324 EPSG:4326 EPSG:25828 EPSG:25829 EPSG:25830 EPSG:25831 EPSG:23028 EPSG:23029 EPSG:23030 EPSG:23031 EPSG:32628 EPSG:32629 EPSG:32630 EPSG:32631" "WMS_TITLE" "Factor de proteccion frente a la cubierta vegetal (Factor C) en Andaluc?a. Abril 1998" "WMS_ABSTRACT" "Factor de proteccion frente a la cubierta vegetal (Factor C) en Andaluc?a. Abril 1998" "WMS_FEATURE_INFO_MIME_TYPE" 'text/html' "wms_keywordlist" "xx" "wms_extent" "100396 3987114 621305 4288777" wms_include_items 'all' gml_include_items "all" gml_value_0_alias "Valor_pixel" gml_x_alias "Coordenada_X_UTM" gml_y_alias "Coordenada_Y_UTM" gml_class_alias "Clase" END #METADATA PROJECTION #"init=epsg:23030" #Proyecci?n UTM European Datum 50 Huso 30 N "init=epsg:25830" #Proyecci?n UTM ETRS89 Huso 30 N END CLASS NAME "< 100" EXPRESSION ('[pixel]' < '100') STYLE COLOR 193 247 178 END END CLASS NAME ">100" EXPRESSION ('[pixel]' >= '100') STYLE COLOR 210 232 137 END END END #layer -------------- next part -------------- An HTML attachment was scrubbed... URL: From jt at mapmedia.de Thu Mar 18 05:32:22 2010 From: jt at mapmedia.de (=?ISO-8859-1?Q?J=F6rg_Thomsen?=) Date: Thu, 18 Mar 2010 13:32:22 +0100 Subject: [mapserver-users] keyimage / getlegendgraphic Message-ID: <4BA21D56.7090304@mapmedia.de> hello, since an update from mapserver 4.x to 5.6 we have a problem with the keyimage of rasterlayers. The keyimage is unusually large, but with the old version it worked. the original imagine is 451*1949 px the keysize in the mapfile is given with > KEYSIZE 450 1950 The image wich is now delivered has a size of 472*1960px, most of this picture is white canvas, the original graphic is very small and placed at the lower left corner. Ad suggestions? Regards, J?rg -- ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Aufwind durch Wissen! Qualifizierte Open Source Schulungen bei der http://www.foss-akademie.de/ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ _________________________________________________ MapMedia Kartographie und raumbezogene Informationssysteme Gillweg 3, 14193 Berlin fon: +49 30 89 06 82-70 fax: +49 30 89 09 53-21 mail: jt at mapmedia.de net: www.mapmedia.de _________________________________________________ Gesch?ftsf?hrer: G. v. Tschirnhaus, J. Thomsen, P. Stamm Registergericht, Berlin - Amtsgericht Charlottenburg, HRB 89625, Umsatzsteuer-Identnummer: DE 813794062 From Jukka.Rahkonen at mmmtike.fi Thu Mar 18 06:23:56 2010 From: Jukka.Rahkonen at mmmtike.fi (Rahkonen Jukka) Date: Thu, 18 Mar 2010 15:23:56 +0200 Subject: [mapserver-users] Google Mercator and +nadgrids=@null In-Reply-To: <1983D43B621911479879CF0E27105F34016BC96C@edrmail01.southport.edr.cc> References: <1268861996817-4753197.post@n2.nabble.com><0B6D7F516315594DBEFE58178D91BD32B7E515D2B6@exchangemm.mm.fr> <1983D43B621911479879CF0E27105F34016BC96C@edrmail01.southport.edr.cc> Message-ID: Hi, I saw from the thread that they are not the same. This is sad because I have seen during just a few last days on various mailing lists and forums that many people are now using and advising others to use the strings from Spatialreference.org. If I understood right, this will lead to large offset. -Jukka- GTsui Gerry wrote: > in case you didn't see this Frank Warmerdam already addressed > this here: > > http://n2.nabble.com/Difference-between-nadgrids-null-and-towg > s84-0-0-0- > td4543036.html > > -----Original Message----- > From: mapserver-users-bounces at lists.osgeo.org > [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Rahkonen > Jukka > Sent: Thursday, March 18, 2010 5:27 AM > To: mapserver-users at lists.osgeo.org > Subject: [mapserver-users] Google Mercator and +nadgrids=@null > > Hi, > > I have in my epsg file the following line for Google Mercator > projection: > > <900913> +proj=merc +a=6378137 +b=6378137 +lat_ts=0.0 +lon_0=0.0 > +x_0=0.0 +y_0=0 +k=1.0 +units=m +nadgrids=@null +no_defs > > I have copied the definitions from somewhere, I do not remember where. > Now I noticed that http://spatialreference.org/ref/epsg/3785/proj4/ > gives this proj4 string: > > +proj=merc +lon_0=0 +k=1 +x_0=0 +y_0=0 +a=6378137 +b=6378137 > +towgs84=0,0,0,0,0,0,0 +units=m +no_defs > > There seems to be one difference: my line has +nadgrids=@null > while the > Spatialreference one has +towgs84=0,0,0,0,0,0,0 instead. Do they mean > just the same thing? > > -Jukka Rahkonen- > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From alewin at spatialconserve.com Thu Mar 18 06:57:48 2010 From: alewin at spatialconserve.com (Andrew Lewin) Date: Thu, 18 Mar 2010 09:57:48 -0400 Subject: [mapserver-users] Mapserver Templates Message-ID: Hi All, Are there any templates available for MapServer? Thanks, Andrew Andrew Lewin, M.Sc., Adv. Dipl. GIS President Spatial-Conserve Inc. www.spatialconserve.com Email: alewin at spatialconserve.com Tel: (905) 639-4646 Mobile: (905) 630-8441 Skype: andrew.lewin99 From warmerdam at pobox.com Thu Mar 18 07:31:00 2010 From: warmerdam at pobox.com (Frank Warmerdam) Date: Thu, 18 Mar 2010 10:31:00 -0400 Subject: [mapserver-users] Google Mercator and +nadgrids=@null In-Reply-To: References: <1268861996817-4753197.post@n2.nabble.com> <0B6D7F516315594DBEFE58178D91BD32B7E515D2B6@exchangemm.mm.fr> Message-ID: <931f8ea91003180731g48bd2e4ai6ba00a3cf220a916@mail.gmail.com> Jukka, I believe the definition on spatialreference.org is out of date. Recently 3785 generation was corrected for PROJ.4. Best regards, On Thu, Mar 18, 2010 at 5:27 AM, Rahkonen Jukka wrote: > Hi, > > I have in my epsg file the following line for Google Mercator > projection: > > <900913> +proj=merc +a=6378137 +b=6378137 +lat_ts=0.0 +lon_0=0.0 > +x_0=0.0 +y_0=0 +k=1.0 +units=m +nadgrids=@null +no_defs > > I have copied the definitions from somewhere, I do not remember where. > Now I noticed that http://spatialreference.org/ref/epsg/3785/proj4/ > gives this proj4 string: > > +proj=merc +lon_0=0 +k=1 +x_0=0 +y_0=0 +a=6378137 +b=6378137 > +towgs84=0,0,0,0,0,0,0 +units=m +no_defs > > There seems to be one difference: my line has +nadgrids=@null while the > Spatialreference one has +towgs84=0,0,0,0,0,0,0 instead. Do they mean > just the same thing? > > -Jukka Rahkonen- > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > -- ---------------------------------------+-------------------------------------- I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com light and sound - activate the windows | http://pobox.com/~warmerdam and watch the world go round - Rush | Geospatial Programmer for Rent From warmerdam at pobox.com Thu Mar 18 07:48:37 2010 From: warmerdam at pobox.com (Frank Warmerdam) Date: Thu, 18 Mar 2010 10:48:37 -0400 Subject: [mapserver-users] Clasify 16 bits Geotiff In-Reply-To: <1ac946291003180555m7dd6e82yca432a60c1cf070e@mail.gmail.com> References: <1ac946291003180555m7dd6e82yca432a60c1cf070e@mail.gmail.com> Message-ID: <931f8ea91003180748x59736b0co49f8ad4c41936aac@mail.gmail.com> In?s, I see that you have two classes for values greater and less than 100. This is fine, but if you set processing directive for scale to -10 to 10 then the classifier is unable to distinguish between values that are greater than 100 and less than 100. That is because the scaling is done before the classification. So if you want to control the scaling it should be based on what you need for the classification. If all you need to do is differentiate between <100 and >100 you could just use SCALE=-900,1100 and set NUM_BUCKETS to some small even number. Best regards, On Thu, Mar 18, 2010 at 8:55 AM, In?s Garc?a wrote: > Hello, > > I need to clasity a 16 bits raster Geotiff. I am ussing?the PROCESSING > directive (PROCESSING "SCALE=-10,10") but it does not?work. > > Can MapServer classify that kind of raster file? > ?CLASS > ?? NAME "< 100" > ??? EXPRESSION ('[pixel]' < '100') > ??? STYLE > ????? COLOR 193 247 178 > ??? END > ? END > CLASS > ?? NAME ">100" > ??? EXPRESSION ('[pixel]' >= '100') > ??? STYLE > ????? COLOR 210 232 137 > ??? END > ?END -- ---------------------------------------+-------------------------------------- I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com light and sound - activate the windows | http://pobox.com/~warmerdam and watch the world go round - Rush | Geospatial Programmer for Rent From cdhernandez at tenerife.es Thu Mar 18 08:05:14 2010 From: cdhernandez at tenerife.es (=?iso-8859-1?Q?Carmen_Delia_Hern=E1ndez_P=E9rez?=) Date: Thu, 18 Mar 2010 15:05:14 -0000 Subject: [mapserver-users] Multiples shapefiles, one LAYER Message-ID: Hello!! I need help. I?m using Mapserver and I`ve some shapefiles of the "same region" but I would like only appear as a single layer. I tried with GROUP property but I don?t want it to appear the individual layers. Use TILEINDEX does not help me because they are of the same region. I don?t know if it?s possible to do. For example I?ve some text shapefiles with different styles but I would like they were activated as a single layer. Any solution? Thanks. -------------- next part -------------- An HTML attachment was scrubbed... URL: From szekerest at gmail.com Thu Mar 18 08:24:00 2010 From: szekerest at gmail.com (Tamas Szekeres) Date: Thu, 18 Mar 2010 16:24:00 +0100 Subject: [mapserver-users] Multiples shapefiles, one LAYER In-Reply-To: References: Message-ID: Carmen, I guess you can merge multiple layers into a single layer by using the OGR virtual format described at: http://www.gdal.org/ogr/drv_vrt.html Best regards, Tamas 2010/3/18 Carmen Delia Hern?ndez P?rez > Hello!! > > > > I need help. I?m using Mapserver and I`ve some shapefiles of the ?same > region? but I would like only appear as a single layer. I tried with GROUP > property but I don?t want it to appear the individual layers. Use TILEINDEX > does not help me because they are of the same region. I don?t know if it?s > possible to do. For example I?ve some text shapefiles with different styles > but I would like they were activated as a single layer. > > > > Any solution? > > > > > > Thanks. > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From bartvde at osgis.nl Thu Mar 18 09:30:22 2010 From: bartvde at osgis.nl (Bart van den Eijnden) Date: Thu, 18 Mar 2010 17:30:22 +0100 Subject: [mapserver-users] Clasify 16 bits Geotiff In-Reply-To: <1ac946291003180555m7dd6e82yca432a60c1cf070e@mail.gmail.com> References: <1ac946291003180555m7dd6e82yca432a60c1cf070e@mail.gmail.com> Message-ID: <6A1CA6EB-28B6-432F-9890-9094A8500D5E@osgis.nl> Hi, which version are you using? see: http://trac.osgeo.org/mapserver/ticket/3174 Best regards, Bart On Mar 18, 2010, at 1:55 PM, In?s Garc?a wrote: > Hello, > > I need to clasity a 16 bits raster Geotiff. I am ussing the PROCESSING directive (PROCESSING "SCALE=-10,10") but it does not work. > > Can MapServer classify that kind of raster file? > > Thanks. > > > LAYER > NAME "Factor_c_abril_1998" > TYPE RASTER > STATUS on > #PROCESSING "SCALE_1=1,255" > #PROCESSING "SCALE_2=1,255" > #PROCESSING "SCALE_3=1,255" > PROCESSING "SCALE=1,255" > #PROCESSING "SCALE_BUCKETS=2" > #PROCESSING "DITHER=YES" > #OFFSITE 0 0 0 > > #MINSCALEDENOM > #MAXSCALEDENOM 2500000 > > DEBUG OFF > DUMP TRUE > PROCESSING "RASTER_QUERY_MAX_RESULT=1" > TEMPLATE "C:\ms4w\apps\etc\template\general\clienteweb.html" > DATA "\\169.254.22.221share\PI_2_RIESGOS\Informacion\Elaborada\06_RIESGOS_NATURALES_TECNOLOG\01_RIESGOS_NATURALES\04_DESERTIFICACION\04_FACTOR_C\Factor_c_1998\InfGeografica\InfRaster\TIFF\FC98_ABRIL.tif" > > METADATA > > "WMS_SRS" "EPSG:3034 EPSG:3035 EPSG:4230 EPSG:4258 EPSG:4267 EPSG:4269 EPSG:4324 EPSG:4326 EPSG:25828 EPSG:25829 EPSG:25830 EPSG:25831 EPSG:23028 EPSG:23029 EPSG:23030 EPSG:23031 EPSG:32628 EPSG:32629 EPSG:32630 EPSG:32631" > "WMS_TITLE" "Factor de proteccion frente a la cubierta vegetal (Factor C) en Andaluc?a. Abril 1998" > "WMS_ABSTRACT" "Factor de proteccion frente a la cubierta vegetal (Factor C) en Andaluc?a. Abril 1998" > "WMS_FEATURE_INFO_MIME_TYPE" 'text/html' > "wms_keywordlist" "xx" > "wms_extent" "100396 3987114 621305 4288777" > > > wms_include_items 'all' > gml_include_items "all" > > gml_value_0_alias "Valor_pixel" > gml_x_alias "Coordenada_X_UTM" > gml_y_alias "Coordenada_Y_UTM" > gml_class_alias "Clase" > > END #METADATA > > PROJECTION > #"init=epsg:23030" #Proyecci?n UTM European Datum 50 Huso 30 N > "init=epsg:25830" #Proyecci?n UTM ETRS89 Huso 30 N > END > > CLASS > NAME "< 100" > EXPRESSION ('[pixel]' < '100') > STYLE > COLOR 193 247 178 > END > END > CLASS > NAME ">100" > EXPRESSION ('[pixel]' >= '100') > STYLE > COLOR 210 232 137 > END > END > > END #layer > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users -------------- next part -------------- An HTML attachment was scrubbed... URL: From warmerdam at pobox.com Thu Mar 18 09:55:59 2010 From: warmerdam at pobox.com (Frank Warmerdam) Date: Thu, 18 Mar 2010 12:55:59 -0400 Subject: [mapserver-users] Unix and RGB - GRID in mapfile In-Reply-To: <4BA206E5.1010004@univie.ac.at> References: <4BA206E5.1010004@univie.ac.at> Message-ID: <931f8ea91003180955w2218e710sadcb70a05a60d049@mail.gmail.com> On Thu, Mar 18, 2010 at 6:56 AM, Simone Frigerio wrote: > Hi, > I need to manage huge file raster inside mapfile. Different kind of > compression are available and I'm trying different way. Two questions on > topic: > 1) ECW andJPEG200 format are supported if I use win environment. > Transferring on Unix environment, probably a GDAL new library has to be > written, because actually it doesn't work. Is it true? Simone, ECW and JPEG2000 support is available on Windows and Linux. However, they are optional components of the library, and depending on where you are getting your binaries they may not be included. If not you may need to rebuild yourself to include them and they do depend on external libraries. You can use "gdalinfo --format ecw" to check for a specific driver or "gdalinfo --formats" to see a list of all supported drivers in your build. > 2) trying with GRID format should be interesting, especially for 1 band > raster like DTM or DEM: > ex.: ? LAYER > NAME "grid" > TYPE RASTER > DATA "GRID/1956gridc1/w001001.adf" > ... > END > > At the end no problem, it's correctly visualize. But I have a lot of RGB > raster to manage. So I if I convert in grid the result in "data" folder is: > folder > folderc1 > folderc2 > folderc3 > info > file.aux > file.rrd > > Inside each folder I find w001001.adf as request to visualize. I use it and > it works perfectly, but only with one band. How can I manage 3 bands in this > way, to visualize correctly an RGB raster? I am not aware of direct support for treating multiple grids as a single dataset. One workaround is to create a virtual dataset referencing each of these files as a band. If you want to pursue that you could review the "virtual file tutorial" at: http://www.gdal.org/gdal_vrttut.html Best regards, -- ---------------------------------------+-------------------------------------- I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com light and sound - activate the windows | http://pobox.com/~warmerdam and watch the world go round - Rush | Geospatial Programmer for Rent From Steve.Lime at state.mn.us Thu Mar 18 10:28:21 2010 From: Steve.Lime at state.mn.us (Lime, Steve D (DNR)) Date: Thu, 18 Mar 2010 12:28:21 -0500 Subject: [mapserver-users] FOSS4G 2010 - Call for Abstracts (Updated March 2010) Message-ID: FOSS4G2010 Press Release Call for Abstract (Update March 2010) We are pleased to announce that the deadline for Abstract submissions (Regular Sessions and Academic Track) has been postponed to April 15th, 2010!! *General Sessions FOSS4G presentations are 25 minute talks, with a 5 minute question and answer session at the end. Presentations cover aspects of the use or development of open source geospatial software. Anyone can can submit a presentation proposal and take part in the conference as a speaker. All submitted abstracts will be reviewed by the members of the Scientific Committee http://2010.foss4g.org/scientific.php For more information, see the FOSS4G2010 site: http://2010.foss4g.org/presentations.php **Important dates Submission deadline (Abstract for the General or Regular Sessions) - Apr, 15th, 2010 *Academic Track The FOSS4G 2010 academic track aims to bringing together researchers, developers, users and practitioners carrying out research and development in the geospatial and the free and open source fields and willing to share original and recent research developments and experiences. The academic track will act as an inventory of current research topics, but the major goal is to promote cooperative research between OSGeo developers and the academia. The academic track is the right forum to highlight the most important research challenges and trends in the domain, and let them became the basis for an informal OSGeo research agenda. It will foster interdisciplinary discussions in all aspects of the geospatial and free and open source domains. It will be organized in a way to promote networking between the participants, to initiate and favour discussions regarding cutting-edge technologies in the field, to exchange research ideas and to promote international collaboration. **Submission guidelines All submissions to the academic track must be original unpublished work written in English. Abstracts should not exceed the 300 words limit and Full Article or Papers should not exceed the 6000 words limit. Formatting guidelines will be available soon. Submitting an abstract is mandatory to get the chance to submit and present a full article. Submitted abstracts and papers will be thoroughly reviewed by the members of the International Academic Chair and refereed for their quality, originality and relevance. **Important dates Submission deadline (Abstract for the Academic Track) - Apr, 15th, 2010 Submission deadline (Full Paper for the Academic Track) - Jul, 15th, 2010 *Upcoming milestones * 22 Feb 2010, Registration for workshop and tutorials (In Progress!!) * 15 Apr 2010, Abstract submission deadline (General Sessions and Academic Track) * 15 May 2010, Presenters notified of acceptance for talks * 15 Jun 2010, Author/Early registration deadline * 15 Jul 2010 Full article submission deadline for Academic Track * Aug 2010, Completed program available * 6-7 Sep 2010, FOSS4G Workshops * 7-9 Sep 2010, FOSS4G Presentations and Tutorials * 10 Sep 2010, FOSS4G Code Sprint -------------- next part -------------- An HTML attachment was scrubbed... URL: From julieknoll at gmail.com Thu Mar 18 10:39:51 2010 From: julieknoll at gmail.com (Julie Knoll) Date: Thu, 18 Mar 2010 12:39:51 -0500 Subject: [mapserver-users] agg support Message-ID: Hello, I am using mapserver 5.4.0 on cent os and trying to enable agg support. I tried installing the agg rpm packages and compiling mapserver with --with-agg and --with-freetype, there were no errors but agg support was still not available. Then I tried downloading the agg tarball from the anti grain website and installing that. Now when configure mapserver, it says it cannot find agg_rendering_buffer.h in /usr. What should I do now? Thanks. -------------- next part -------------- An HTML attachment was scrubbed... URL: From russell at flora.ca Thu Mar 18 11:03:59 2010 From: russell at flora.ca (Russell McOrmond) Date: Thu, 18 Mar 2010 14:03:59 -0400 (EDT) Subject: [mapserver-users] Oddball mapserver/ArcSDE issue In-Reply-To: References: Message-ID: On Tue, 16 Mar 2010, Russell McOrmond wrote: > The segmentation fault is caused by using a string which is actually null > being returned from string functions, with the null then being used as if it > were a string. > See: http://trac.osgeo.org/mapserver/ticket/2988 "Check error returns from > mapstring functions." Sorry to be responding to my own messages, but wanted to report on progress. I added in some additional error return checking, and put some suggestions into the bug listed above. I created some additional error reporting on what the reason for the iconv() failure was (see path at end of message), and now I see "An invalid multibyte sequence has been encountered in the input" in the MS_ERRORFILE. While it is great to have mapserver not core dumping, I am still wondering if anyone has ideas of where to go next. I suspect there is something invalid in the data that is causing ArcSDE to send me strings that aren't valid UTF-16 characters. I don't know enough about ArcSDE or other ESRI software to know how to validate such things. Note: Please consider patches like the one below and/or the ones in the bug for future releases of mapserver. It would be great if Mapserver would output error messages rather than core dump. --- mapstring.c-orig 2010-03-17 16:43:19.000000000 -0400 +++ mapstring.c 2010-03-18 11:54:02.000000000 -0400 @@ -1504,8 +1504,8 @@ char* msConvertWideStringToUTF8 (const wchar_t* string, const char* encoding) { #ifdef USE_ICONV - int bconvFailed = MS_TRUE; char* output = NULL; + char* errormessage = NULL; iconv_t cd = NULL; size_t nStr; size_t nInSize; @@ -1540,23 +1540,36 @@ pszUTF8 = output; pwszWide = string; nConv = iconv(cd, (char **)&pwszWide, &nInSize, &pszUTF8, &nOutSize); - if ((size_t)-1 != nConv && nOutSize != nBufferSize) - bconvFailed = MS_FALSE; + if ((size_t)-1 != nConv && nOutSize != nBufferSize) { + switch (errno) { + case E2BIG: + errormessage = "There is not sufficient room in buffer"; + break; + case EILSEQ: + errormessage = "An invalid multibyte sequence has been encountered in the input"; + break; + case EINVAL: + errormessage = "An incomplete multibyte sequence has been encountered in the input"; + break; + default: + errormessage = "Unknown"; + break; + } + msSetError(MS_MISCERR, "Unable to convert string in encoding '%s' to UTF8: %s", + "msConvertWideStringToUTF8()", + encoding,errormessage); + iconv_close(cd); + msFree(output); + return NULL; + } iconv_close(cd); } else { msSetError(MS_MISCERR, "Encoding not supported by libiconv (%s).", "msConvertWideStringToUTF8()", encoding); + msFree(output); return NULL; } - - if (bconvFailed) { - msFree(output); - output = NULL; - msSetError(MS_MISCERR, "Unable to convert string in encoding '%s' to UTF8", - "msConvertWideStringToUTF8()", - encoding); - } } else { /* we were given a NULL wide string, nothing we can do here */ return NULL; -- Russell McOrmond, Internet Consultant: Please help us tell the Canadian Parliament to protect our property rights as owners of Information Technology. Sign the petition! http://digital-copyright.ca/petition/ict/ http://KillBillC61.ca "The government, lobbied by legacy copyright holders and hardware manufacturers, can pry control over my camcorder, computer, home theatre, or portable media player from my cold dead hands!" From russell at flora.ca Thu Mar 18 11:14:21 2010 From: russell at flora.ca (Russell McOrmond) Date: Thu, 18 Mar 2010 14:14:21 -0400 (EDT) Subject: [mapserver-users] can not compile arcsde 9.3 with mapserver 5.4 In-Reply-To: References: Message-ID: On Thu, 18 Mar 2010, Jachym Cepicky wrote: > I'm not able to get arcsde 9.3.0 compiled with mapserver (5.4), on Linux > > I use > > ./configure --with-sde=/opt/arcsde/9.3.0/sdeexe93/ --with-sde-version='' You need to ArcSDE SDK, which is a separate package from the install disks. It will have the required include/ and lib/ directories that you need to have to compile mapserver against the sde library. I haven't compiled against the 9.3 SDK yet, but here is what is in the 9.2 SDK to compare: $ find sdeexe92/ -type f sdeexe92/etc/services.sde sdeexe92/lib/icu4j_3_2.jar sdeexe92/lib/libedgemt.so sdeexe92/lib/libmtchloc.so sdeexe92/lib/libsg.so sdeexe92/lib/libsdedb2srvr92.so sdeexe92/lib/concurrent.jar sdeexe92/lib/jpe92_sdk.jar sdeexe92/lib/libgsrvrora9i92.so sdeexe92/lib/libgsrvrora10g92.so sdeexe92/lib/libloceng.so sdeexe92/lib/liblocssa.so sdeexe92/lib/libpe.so sdeexe92/lib/libxerces-c.so.26.0 sdeexe92/lib/libicuuc.so.22.0 sdeexe92/lib/libsde.a sdeexe92/lib/libgsrvrdb292.so sdeexe92/lib/libsdeora9isrvr92.so sdeexe92/lib/libsde.so sdeexe92/lib/libicudata.so.22.0 sdeexe92/lib/libsdeora10gsrvr92.so sdeexe92/lib/libmtchmt.so sdeexe92/lib/libsg.a sdeexe92/lib/libpe.a sdeexe92/lib/jsde92_sdk.jar sdeexe92/lib/libsdejavautil.so sdeexe92/include/sg.h sdeexe92/include/sderaster.h sdeexe92/include/pedef.h sdeexe92/include/sdeerno.h sdeexe92/include/pef.h sdeexe92/include/sgerr.h sdeexe92/include/pe.h sdeexe92/include/sdetype.h sdeexe92/include/pe_coordsys_from_prj.h -- Russell McOrmond, Internet Consultant: Please help us tell the Canadian Parliament to protect our property rights as owners of Information Technology. Sign the petition! http://digital-copyright.ca/petition/ict/ http://KillBillC61.ca "The government, lobbied by legacy copyright holders and hardware manufacturers, can pry control over my camcorder, computer, home theatre, or portable media player from my cold dead hands!" From pramsey at cleverelephant.ca Thu Mar 18 11:33:13 2010 From: pramsey at cleverelephant.ca (Paul Ramsey) Date: Thu, 18 Mar 2010 11:33:13 -0700 Subject: [mapserver-users] Oddball mapserver/ArcSDE issue In-Reply-To: References: Message-ID: <30fe546d1003181133y53e5e279sc8de193928530f9e@mail.gmail.com> Russell, Attach your patch to a ticket (http://trac.osgeo.org/mapserver) and assign it to me (pramsey) and I'll ensure it's committed into the next patch releases and major releases. P On Thu, Mar 18, 2010 at 11:03 AM, Russell McOrmond wrote: > > On Tue, 16 Mar 2010, Russell McOrmond wrote: > >> ?The segmentation fault is caused by using a string which is actually null >> being returned from string functions, with the null then being used as if it >> were a string. >> ?See: http://trac.osgeo.org/mapserver/ticket/2988 ?"Check error returns >> from mapstring functions." > > ?Sorry to be responding to my own messages, but wanted to report on > progress. > > > ?I added in some additional error return checking, and put some suggestions > into the bug listed above. > > ?I created some additional error reporting on what the reason for the > iconv() failure was (see path at end of message), and now I see "An invalid > multibyte sequence has been encountered in the input" in the MS_ERRORFILE. > > ?While it is great to have mapserver not core dumping, I am still wondering > if anyone has ideas of where to go next. ?I suspect there is something > invalid in the data that is causing ArcSDE to send me strings that aren't > valid UTF-16 characters. ?I don't know enough about ArcSDE or other ESRI > software to know how to validate such things. > > > > Note: Please consider patches like the one below and/or the ones in the bug > for future releases of mapserver. ?It would be great if Mapserver would > output error messages rather than core dump. > > > --- mapstring.c-orig ? ?2010-03-17 16:43:19.000000000 -0400 > +++ mapstring.c 2010-03-18 11:54:02.000000000 -0400 > @@ -1504,8 +1504,8 @@ > ?char* msConvertWideStringToUTF8 (const wchar_t* string, const char* > encoding) { > ?#ifdef USE_ICONV > > - ? ?int bconvFailed = MS_TRUE; > ? ? char* output = NULL; > + ? ?char* errormessage = NULL; > ? ? iconv_t cd = NULL; > ? ? size_t nStr; > ? ? size_t nInSize; > @@ -1540,23 +1540,36 @@ > ? ? ? ? ? ?pszUTF8 = output; > ? ? ? ? ? ?pwszWide = string; > ? ? ? ? ? ?nConv = iconv(cd, (char **)&pwszWide, &nInSize, &pszUTF8, > &nOutSize); > - ? ? ? ? ? if ((size_t)-1 != nConv && ?nOutSize != nBufferSize) > - ? ? ? ? ? ? ? bconvFailed = MS_FALSE; > + ? ? ? ? ? if ((size_t)-1 != nConv && ?nOutSize != nBufferSize) { > + ? ? ? ? ? ?switch (errno) { > + ? ? ? ? ? ? ?case E2BIG: > + ? ? ? ? ? ? ? ?errormessage = "There is not sufficient room in buffer"; > + ? ? ? ? ? ? ? ?break; > + ? ? ? ? ? ? ?case EILSEQ: > + ? ? ? ? ? ? ? ?errormessage = "An invalid multibyte sequence has been > encountered in the input"; > + ? ? ? ? ? ? ? ?break; > + ? ? ? ? ? ? ?case EINVAL: > + ? ? ? ? ? ? ? ?errormessage = "An incomplete multibyte sequence has been > encountered in the input"; > + ? ? ? ? ? ? ? ?break; > + ? ? ? ? ? ? ?default: > + ? ? ? ? ? ? ? ?errormessage = "Unknown"; > + ? ? ? ? ? ? ? ?break; > + ? ? ? ? ? ?} > + ? ? ? ? ? ?msSetError(MS_MISCERR, "Unable to convert string in encoding > '%s' to UTF8: %s", > + ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? "msConvertWideStringToUTF8()", > + ? ? ? ? ? ? ? ? ? ? ? encoding,errormessage); > + ? ? ? ? ? ?iconv_close(cd); > + ? ? ? ? ? ?msFree(output); > + ? ? ? ? ? ?return NULL; > + ? ? ? ? ?} > ? ? ? ? ? ?iconv_close(cd); > ? ? ? ? } else { > ? ? ? ? ? ? msSetError(MS_MISCERR, "Encoding not supported by libiconv > (%s).", > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?"msConvertWideStringToUTF8()", > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?encoding); > + ? ? ? ? ? msFree(output); > ? ? ? ? ? ? return NULL; > ? ? ? ? } > - > - ? ? ? ?if (bconvFailed) { > - ? ? ? ? ? ?msFree(output); > - ? ? ? ? ? ?output = NULL; > - ? ? ? ? ? ?msSetError(MS_MISCERR, "Unable to convert string in encoding > '%s' to UTF8", > - ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? "msConvertWideStringToUTF8()", > - ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? encoding); > - ? ? ? ?} > ? ? } else { > ? ? ? ? /* we were given a NULL wide string, nothing we can do here */ > ? ? ? ? return NULL; > > -- > ?Russell McOrmond, Internet Consultant: > ?Please help us tell the Canadian Parliament to protect our property > ?rights as owners of Information Technology. Sign the petition! > ?http://digital-copyright.ca/petition/ict/ ? ? http://KillBillC61.ca > > ?"The government, lobbied by legacy copyright holders and hardware > ?manufacturers, can pry control over my camcorder, computer, > ?home theatre, or portable media player from my cold dead hands!" > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From russell at flora.ca Thu Mar 18 11:43:34 2010 From: russell at flora.ca (Russell McOrmond) Date: Thu, 18 Mar 2010 14:43:34 -0400 (EDT) Subject: [mapserver-users] Oddball mapserver/ArcSDE issue In-Reply-To: <30fe546d1003181133y53e5e279sc8de193928530f9e@mail.gmail.com> References: <30fe546d1003181133y53e5e279sc8de193928530f9e@mail.gmail.com> Message-ID: On Thu, 18 Mar 2010, Paul Ramsey wrote: > Russell, > Attach your patch to a ticket (http://trac.osgeo.org/mapserver) and > assign it to me (pramsey) and I'll ensure it's committed into the next > patch releases and major releases. I re-assigned http://trac.osgeo.org/mapserver/ticket/2988 to you. Hope that is what you were suggesting I do. Thank you. -- Russell McOrmond, Internet Consultant: Please help us tell the Canadian Parliament to protect our property rights as owners of Information Technology. Sign the petition! http://digital-copyright.ca/petition/ict/ http://KillBillC61.ca "The government, lobbied by legacy copyright holders and hardware manufacturers, can pry control over my camcorder, computer, home theatre, or portable media player from my cold dead hands!" From yassefa at dmsolutions.ca Thu Mar 18 12:06:41 2010 From: yassefa at dmsolutions.ca (Yewondwossen Assefa) Date: Thu, 18 Mar 2010 15:06:41 -0400 Subject: [mapserver-users] WMS TIME parameter slow In-Reply-To: <30fe546d1003110611y5c149dfeq241d4d22f49747b1@mail.gmail.com> References: <201003101622.29741.schroete@iup.physik.uni-bremen.de> <201003111039.14199.schroete@iup.physik.uni-bremen.de> <30fe546d1003110535x1f663841ia5fdcd0ea85bce84@mail.gmail.com> <201003111459.13411.schroete@iup.physik.uni-bremen.de> <30fe546d1003110611y5c149dfeq241d4d22f49747b1@mail.gmail.com> Message-ID: <4BA279C1.5010904@dmsolutions.ca> Sorry to jump late on this. The use of the date_trunc function for postgis layers (described http://mapserver.org/ogc/wms_time.html) was from what I remember to allow queries (on a timestamp field) like time=2001-01-01 expecting to get back all values of the day regardless of the time set. I have entered a bug on it (http://trac.osgeo.org/mapserver/ticket/3382) to be able to review it before the 6.0 release. regards, Paul Ramsey wrote: > Sorry, there's not much more I can offer, you've done a great job > debugging, but at the end of the day the SQL being generated by the > WMS Time module is not great. Make sure to run 'ANALYZE' on your > database so the planner has the latest stats. > > P. > > On Thu, Mar 11, 2010 at 5:59 AM, Heiko Schr?ter > wrote: > >> Am Donnerstag 11 M?rz 2010 14:35:53 schrieben Sie: >> >> Paul, >> >> thanks for staying at it. These timings i get with the variation of the theme. The second best is to cast 'datum::timestamp'. But still beeing 32times slower than just a trivial compare on the index as in 1). The slowest run is the brute force 'date_trunc' without cast 3). So to me this is a bit voodo why postgres refuses to scan the indices in proper speed in 2) and 3). >> The maximum index scan i get with 'date_trunc' is a 'Bitmap Heap Scan' on the index with scenario 2). >> Of what i have found inside the docs/google is that even when casting 'datum' inside postgres the request, here generated by MS, should or have to be casted as well which is not (at least by now). >> >> Heiko >> >> >> 1) The brute force compare: >> sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck >> && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 >> 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and (datum >= '2007-12-10' and datum <= '2007-12-11'); >> >> Total runtime: 41.018 ms >> (32 rows) >> >> Now Create Immutable Index on our play table: >> CREATE INDEX o_v20_y2007_date_trunc ON o_v20_y2007 (date_trunc('day', datum::timestamp without time zone)); >> 2) >> sc_gis=# CREATE INDEX o3_v20_y2007_date_trunc ON o3_v20_y2007 (date_trunc('day', datum::timestamp without time zone)); >> ERROR: relation "o3_v20_y2007_date_trunc" already exists >> scia_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck >> && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 >> 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum::timestamp without time zone) >= '2007-12-10' AND date_trunc('day', datum::timestamp without time zone) <= '2007-12-11')); >> >> Total runtime: 1250.679 ms >> (26 rows) >> >> 3) >> sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck >> && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 >> 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum) >= '2007-12-10' AND date_trunc('day', datum) <= '2007-12-11')); >> >> Total runtime: 2329.380 ms >> (23 rows) >> >> >>> Good job getting this far on your own! Create a SQL wrapper function >>> on top of date_trunc which *is* marked as immutable and you'll be able >>> to build a functional index on it. >>> >>> P. >>> >>> On Thu, Mar 11, 2010 at 1:39 AM, Heiko Schr?ter >>> wrote: >>> >>>> Am Mittwoch 10 M?rz 2010 16:52:28 schrieb Heiko Schr?ter: >>>> >>>> Done what has been suggested. The 'date_trunc' function forces sequential scans instead of using the indexed scans. >>>> >>>> I've tried and failed: >>>> sc_gis=# CREATE INDEX o_v20_y2007_date_trunc ON o_v20_y2007 (date_trunc('day', datum at time zone 'GMT')); >>>> ERROR: functions in index expression must be marked IMMUTABLE >>>> >>>> Probably the MS list is not the right place to ask. >>>> But may be a kind soul has some pointers to more infos. >>>> I admit that db's are not my field of experience and i'am still learning. >>>> >>>> On the other hand it would be nice to have a hint about the indexing issue inside the MS docs when using the WMS Time extension. >>>> >>>> Heiko >>>> >>>> >>>> sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck >>>> && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 >>>> 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and (datum >= '2007-12-10' and datum <= '2007-12-30'); >>>> QUERY PLAN >>>> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ >>>> Result (cost=0.00..585.37 rows=4420 width=450) (actual time=0.083..35.821 rows=5322 loops=1) >>>> -> Append (cost=0.00..541.17 rows=4420 width=450) (actual time=0.067..13.852 rows=5322 loops=1) >>>> -> Seq Scan on o3_v20 (cost=0.00..16.65 rows=1 width=55) (actual time=0.001..0.001 rows=0 loops=1) >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >>>> -> Index Scan using o3_v20_y2002_datum on o3_v20_y2002 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.012..0.012 rows=0 loops=1) >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >>>> -> Index Scan using o3_v20_y2003_datum on o3_v20_y2003 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.006..0.006 rows=0 loops=1) >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >>>> -> Index Scan using o3_v20_y2004_datum on o3_v20_y2004 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >>>> -> Index Scan using o3_v20_y2005_datum on o3_v20_y2005 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >>>> -> Index Scan using o3_v20_y2006_datum on o3_v20_y2006 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >>>> -> Index Scan using o3_v20_y2007_datum on o3_v20_y2007 o3_v20 (cost=0.00..458.27 rows=4411 width=450) (actual time=0.031..10.732 rows=5322 loops=1) >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >>>> -> Index Scan using o3_v20_y2008_datum on o3_v20_y2008 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.010..0.010 rows=0 loops=1) >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >>>> -> Index Scan using o3_v20_y2009_datum on o3_v20_y2009 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.006..0.006 rows=0 loops=1) >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >>>> -> Index Scan using o3_v20_y2010_datum on o3_v20_y2010 o3_v20 (cost=0.00..8.27 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) >>>> Total runtime: 37.760 ms >>>> (32 rows) >>>> >>>> sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck >>>> && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 >>>> 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum) >= '2007-12-10' AND date_trunc('day', datum) <= '2007-12-30')); >>>> QUERY PLAN >>>> -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- >>>> Result (cost=0.00..55305.53 rows=2873 width=450) (actual time=1368.129..2371.436 rows=5322 loops=1) >>>> -> Append (cost=0.00..55276.80 rows=2873 width=450) (actual time=1368.100..2339.593 rows=5322 loops=1) >>>> -> Seq Scan on o3_v20 (cost=0.00..20.45 rows=1 width=55) (actual time=0.001..0.001 rows=0 loops=1) >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >>>> -> Seq Scan on o3_v20_y2002 o3_v20 (cost=0.00..2228.21 rows=123 width=450) (actual time=79.684..79.684 rows=0 loops=1) >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >>>> -> Seq Scan on o3_v20_y2003 o3_v20 (cost=0.00..6587.07 rows=349 width=450) (actual time=238.174..238.174 rows=0 loops=1) >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >>>> -> Seq Scan on o3_v20_y2004 o3_v20 (cost=0.00..7417.62 rows=378 width=450) (actual time=260.250..260.250 rows=0 loops=1) >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >>>> -> Seq Scan on o3_v20_y2005 o3_v20 (cost=0.00..7328.16 rows=379 width=450) (actual time=264.246..264.246 rows=0 loops=1) >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >>>> -> Seq Scan on o3_v20_y2006 o3_v20 (cost=0.00..7299.65 rows=383 width=450) (actual time=263.991..263.991 rows=0 loops=1) >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >>>> -> Seq Scan on o3_v20_y2007 o3_v20 (cost=0.00..7642.97 rows=397 width=450) (actual time=261.744..297.122 rows=5322 loops=1) >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >>>> -> Seq Scan on o3_v20_y2008 o3_v20 (cost=0.00..8583.06 rows=439 width=450) (actual time=472.648..472.648 rows=0 loops=1) >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >>>> -> Seq Scan on o3_v20_y2009 o3_v20 (cost=0.00..6961.72 rows=361 width=450) (actual time=394.525..394.525 rows=0 loops=1) >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >>>> -> Seq Scan on o3_v20_y2010 o3_v20 (cost=0.00..1207.89 rows=63 width=450) (actual time=65.417..65.417 rows=0 loops=1) >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) >>>> Total runtime: 2374.403 ms >>>> (23 rows) >>>> >>>> >>>> >>>> >>>>> Am Mittwoch 10 M?rz 2010 16:42:02 schrieben Sie: >>>>> >>>>> Thanks for the hint. >>>>> Hm, i thought 4000 out of 4.5 Millions datasets for the whole year in 5 sec would be not that bad .... >>>>> The timing figure shall just show the huge difference between the two types of requests. >>>>> >>>>> I will follow your advice and test the db. And yes the db is indexed. >>>>> >>>>> Heiko >>>>> >>>>> >>>>>> Firstly, 2 seconds is not fast, so you have another performance troll >>>>>> beyond this one. >>>>>> >>>>>> Secondly, it's impossible to know what's going on inside the database >>>>>> without seeing the actual SQL being generated. Turn on statement >>>>>> loggging in PgSQL and extract the SQL that is being run against the >>>>>> database. Then you can put that into PgAdmin or psql and get EXPLAIN >>>>>> ANALYZE results which will tell you why there's a problem, hopefully. >>>>>> >>>>>> P. >>>>>> >>>>>> On Wed, Mar 10, 2010 at 7:22 AM, Heiko Schr?ter >>>>>> wrote: >>>>>> >>>>>>> Hello, >>>>>>> >>>>>>> using mapserv (5.6.1) with PostGIS (8.3) and accessing ten-thousands of geo locations in the PostGIS db results in very slow speed when using the WMS TIME parameter: >>>>>>> (in this example the number is about 4000 datapoints for this day, timing measurements with DEBUG OFF). >>>>>>> >>>>>>> 1) Very fast using FILTER, approx. 5 seconds: >>>>>>> .... >>>>>>> CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" >>>>>>> DATA "geocoord from xyz_ref using unique datum" >>>>>>> VALIDATION >>>>>>> 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" >>>>>>> END >>>>>>> FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" >>>>>>> .... >>>>>>> >>>>>>> 2) Very slow using WMS TIME, approx 210 and more seconds: >>>>>>> (Leaving the VALIDATION/FILTER on or leaving out 'using unique datum' doesn't change a thing) >>>>>>> ... >>>>>>> METADATA >>>>>>> "wms_timeextent" "1970-01-01/2030-12-31" >>>>>>> "wms_timeitem" "datum" >>>>>>> "wms_timedefault" "2007-12-10/2007-12-11" >>>>>>> "wms_title" "xyz_r" >>>>>>> "wms_srs" "init=epsg:-1" >>>>>>> END >>>>>>> ... >>>>>>> >>>>>>> The MS ERRORFILE is very noisy spilling out all datapoints when running 2). This does not happen when running 1). >>>>>>> Database is the same. No other changes have been made. >>>>>>> >>>>>>> Why is mapserver so slow when using the WMS TIME parameter ? >>>>>>> >>>>>>> It would be nice to stick to the "official" WMS configuration and not to introduce a "vendor specific" workaround. >>>>>>> >>>>>>> Thanks and Regards >>>>>>> Heiko >>>>>>> >>>>>>> # ###################################################################################################### >>>>>>> >>>>>>> /var/www/localhost/cgi-bin/mapserv -v >>>>>>> MapServer version 5.6.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=ICONV SUPPORTS=WMS_SERVER SUPPORTS=WFS_SERVER SUPPORTS=WCS_SERVER INPUT=EPPL7 INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE >>>>>>> >>>>>>> A complete Layer definition: >>>>>>> >>>>>>> LAYER >>>>>>> EXTENT -180 -90 180 90 >>>>>>> CONNECTIONTYPE POSTGIS >>>>>>> NAME "SACURA_REF_R" >>>>>>> PROCESSING "CLOSE_CONNECTION=DEFER" >>>>>>> OPACITY 60 >>>>>>> STATUS ON >>>>>>> METADATA >>>>>>> # "wms_timeextent" "1970-01-01/2030-12-31" >>>>>>> # "wms_timeitem" "datum" >>>>>>> # "wms_timedefault" "2007-12-10/2007-12-11" >>>>>>> "wms_title" "xyz_ref_r" >>>>>>> "wms_srs" "init=epsg:-1" >>>>>>> END >>>>>>> PROJECTION >>>>>>> "init=epsg:4326" >>>>>>> END >>>>>>> CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" >>>>>>> DATA "geocoord from xyz_ref using unique datum" >>>>>>> VALIDATION >>>>>>> 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" >>>>>>> END >>>>>>> FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" >>>>>>> >>>>>>> TYPE POLYGON >>>>>>> SIZEUNITS meters >>>>>>> CLASS >>>>>>> DEBUG OFF >>>>>>> NAME "xyz_ref_class" >>>>>>> STYLE >>>>>>> OUTLINECOLOR 0 0 0 >>>>>>> COLOR [rfarbe] >>>>>>> END >>>>>>> END >>>>>>> END # Layer >>>>>>> _______________________________________________ >>>>>>> mapserver-users mailing list >>>>>>> mapserver-users at lists.osgeo.org >>>>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users >>>>>>> >>>>>>> >>>>> _______________________________________________ >>>>> mapserver-users mailing list >>>>> mapserver-users at lists.osgeo.org >>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users >>>>> >>>>> >>>> -- >>>> ----------------------------------------------------------------------- >>>> Dipl.-Ing. Heiko Schr?ter >>>> Institute of Environmental Physics (IUP) phone: ++49-(0)421-218-62092 >>>> Institute of Remote Sensing (IFE) fax: ++49-(0)421-218-4555 >>>> University of Bremen (FB1) >>>> P.O. Box 330440 email: schroete at iup.physik.uni-bremen.de >>>> Otto-Hahn-Allee 1 >>>> 28359 Bremen >>>> Germany >>>> ----------------------------------------------------------------------- >>>> _______________________________________________ >>>> mapserver-users mailing list >>>> mapserver-users at lists.osgeo.org >>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users >>>> >>>> >> -- >> ----------------------------------------------------------------------- >> Dipl.-Ing. Heiko Schr?ter >> Institute of Environmental Physics (IUP) phone: ++49-(0)421-218-62092 >> Institute of Remote Sensing (IFE) fax: ++49-(0)421-218-4555 >> University of Bremen (FB1) >> P.O. Box 330440 email: schroete at iup.physik.uni-bremen.de >> Otto-Hahn-Allee 1 >> 28359 Bremen >> Germany >> ----------------------------------------------------------------------- >> >> > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > -- ---------------------------------------------------------------- Assefa Yewondwossen Software Analyst Email: assefa at dmsolutions.ca http://www.dmsolutions.ca/ Phone: (613) 565-5056 (ext 14) Fax: (613) 565-0925 ---------------------------------------------------------------- From j.l.h.hartmann at uva.nl Thu Mar 18 13:15:36 2010 From: j.l.h.hartmann at uva.nl (Jan Hartmann) Date: Thu, 18 Mar 2010 21:15:36 +0100 Subject: [mapserver-users] OSGeo4W setup hangs In-Reply-To: References: Message-ID: <4BA289E8.7080607@uva.nl> Hi, When I try to update my OSGeo4W installation in advanced mode from Internet, setup.exe proceeds until the package selection and hangs after that. The progress window says: "Parsing ini file "http://download.osgeo.org/osgeo4w/setup.ini... setup.ini.bz2 from http://download.osgeo.org". Can someone duplicate this problem? Jan From yassefa at dmsolutions.ca Thu Mar 18 13:20:19 2010 From: yassefa at dmsolutions.ca (Yewondwossen Assefa) Date: Thu, 18 Mar 2010 16:20:19 -0400 Subject: [mapserver-users] WFS limit time interval to POSTGIS In-Reply-To: <201003181239.37609.schroete@iup.physik.uni-bremen.de> References: <201003181239.37609.schroete@iup.physik.uni-bremen.de> Message-ID: <4BA28B03.8020101@dmsolutions.ca> Heiko Schr?ter wrote: > Hello, > > by setting up a WFS server i need to limit the time interval for the requests to the postgis db (Millions of data points inside POSTGIS). > The WMS part with time interval requests is working and i'am trying to make these data available through WFS as well. > > What i can find in the docs is a FILTER with a WFS Client connecting a WFS server. > But this seems not to apply for DATE interval calculus. > > The only thing i get in the moment is the whole data set at once or the first NUMBER (here 10) of entries. > > Is it possible at all to limit the requested time interval to a WFS server ? > i.e. something like TIME=2007-1-2/2007-1-3 > > Hi there, There is no explicit support of a TIME parameter in wfs but I believe It should be possible on a postgis layer to use the FilterEncoding to limit the request: would something like this work for you: Filter=your_time_field2007-01-02your_time_field2007-01-03 regards, > Thanks and Regards > Heiko > > > LAYER > EXTENT -180 -90 180 90 > CONNECTIONTYPE POSTGIS > NAME "TEST" > PROCESSING "CLOSE_CONNECTION=DEFER" > OPACITY 60 > STATUS ON > DUMP TRUE > METADATA > "wfs_title" "test" > "wfs_maxfeatures" "10" > "gml_featureid" "ID" ## REQUIRED > "gml_include_items" "all" ## Optional (serves all attributes for layer) > "gml_geometries" "rechteck" > "gml_rechteck_type" "polygon" > END > PROJECTION > "init=epsg:4326" > END > CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" > DATA "rechteck from test_data using srid=-1 using unique datum" > TYPE POLYGON > SIZEUNITS meters > CLASS > NAME "test_class" > STYLE > OUTLINECOLOR 0 0 0 > COLOR [farbe] > END > END > END # Layer > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > -- ---------------------------------------------------------------- Assefa Yewondwossen Software Analyst Email: assefa at dmsolutions.ca http://www.dmsolutions.ca/ Phone: (613) 565-5056 (ext 14) Fax: (613) 565-0925 ---------------------------------------------------------------- From hpbrantley at gmail.com Thu Mar 18 20:43:38 2010 From: hpbrantley at gmail.com (Huey Brantley) Date: Thu, 18 Mar 2010 22:43:38 -0500 Subject: [mapserver-users] can not compile arcsde 9.3 with mapserver 5.4 In-Reply-To: References: Message-ID: <4BA2F2EA.6020508@gmail.com> Compile it against the SDE SDK, not where you have SDE installed. My configure: ./configure \ --with-php=/usr/local \ --with-proj=/usr/local \ --with-gd=/usr/local \ --with-jpeg=/usr/local \ --with-png=/usr/local \ --with-sde=/u01/arcgis93sdk/sdeexe93/ \ --with-sde-version=93 \ --with-wfs \ --with-ogr=/usr/local/bin/gdal-config \ --with-gdal=/usr/local/bin/gdal-config \ --with-freetype \ --with-tiff \ --with-agg \ --with-curl \ --enable-debug Jachym Cepicky wrote: > Hi, > > I'm not able to get arcsde 9.3.0 compiled with mapserver (5.4), on Linux > > I use > > ./configure --with-sde=/opt/arcsde/9.3.0/sdeexe93/ --with-sde-version='' > > > the arcsde installation directory containes (among others) file > > ... > libsde.so > .. > > nut not "*.a" file or "*.h" files > > however, I get > > configure: error: "Could not find sdetype.h or libsde.a/libsde.so in > /opt/arcsde/9.3.0/sdeexe93/." > > Any hint? > > Thanks > > Jachym > From enigma2006.kishore at gmail.com Thu Mar 18 21:16:38 2010 From: enigma2006.kishore at gmail.com (Kishore Reddy) Date: Fri, 19 Mar 2010 09:46:38 +0530 Subject: [mapserver-users] 3D display of data Message-ID: <6e7b1b711003182116y69df6fe7md9ad5643bbaaf548@mail.gmail.com> Hi all, I have built a website which shows geographic data in 2D. The following is the configuration used for the website MapServer Postgresql - Data is stored with accordance with the OpenGeo standards. OpenLayers Php But the website is intended for the rural community. So I thought of displaying the data in 3D using MapServer. So can anyone please give some references? -- Kishore From barnhart.pat at gmail.com Thu Mar 18 21:30:39 2010 From: barnhart.pat at gmail.com (Pat B) Date: Thu, 18 Mar 2010 20:30:39 -0800 (PST) Subject: [mapserver-users] Re: Custom Symbology using C# MapScript and SLDs In-Reply-To: <1268754255489-4744442.post@n2.nabble.com> References: <1268754255489-4744442.post@n2.nabble.com> Message-ID: <1268973039717-4761106.post@n2.nabble.com> I've managed to get the external graphic symbols working by creating a web accessible folder for temp images and adding the following line to the code. This is mentioned in the mapscript documentation under the polygon symbolizer but it also applies to points. map.setMetaData("WMS_SLD_SYMBOL_URL", "http:///"); The well known symbols seem to be limited to square and circle on my setup but I've got versions of the others in my .sym anyway. The truetype and vector symbols however, do not appear to be supported by mapscript's generateSLD(). It'll put them in an exported mapfile and load them into a symbol set or whatever you want to do on the mapscript side but not write them to an sld (unless I'm missing something). I saw an open ticket regarding polygon symbols in my wanderings that seems to back this up. Anybody know for sure? Mapserver reads them out of the sld with no problem, it's getting them into the sld that's tricky. I hacked my way around it by putting in a dummy 'square' well known name symbol and then doing a loop to replace 'square' in the sld string with the name of the truetype or vector symbol for the various classes and layers. Gets the job done but... Well anyway, if anybody runs across this and knows a better way I'm all ears. Also, in the code from the first post, no need to load an existing map/layer, just make an empty map file and build it from scratch (new mapObj(null);) so the only stuff in there is for the customized layers. That way you don't have to worry about pre existing styles and classes from the mapfile although you do need to set the locations of the fonts, symbols, etc in the blank mapObj. So, hallelujah, if you're going down this road or doing something similar I hope this helps. -- View this message in context: http://n2.nabble.com/Custom-Symbology-using-C-MapScript-and-SLDs-tp4744442p4761106.html Sent from the Mapserver - User mailing list archive at Nabble.com. From schroete at iup.physik.uni-bremen.de Fri Mar 19 01:33:50 2010 From: schroete at iup.physik.uni-bremen.de (Heiko =?iso-8859-1?q?Schr=F6ter?=) Date: Fri, 19 Mar 2010 09:33:50 +0100 Subject: [mapserver-users] WMS TIME parameter slow In-Reply-To: <4BA279C1.5010904@dmsolutions.ca> References: <201003101622.29741.schroete@iup.physik.uni-bremen.de> <30fe546d1003110611y5c149dfeq241d4d22f49747b1@mail.gmail.com> <4BA279C1.5010904@dmsolutions.ca> Message-ID: <201003190933.50854.schroete@iup.physik.uni-bremen.de> Hello, i have setup a test db with a 'timestamp' date field (YYYY-MM-DD HH:MM:SS). Tests have been done with various request patterns i.e. leaving out the HH:MM:SS part etc. This works just fine and you allways get fast INDEXED SCANS on this. Requests with an interval to seconds is possible and fast, even within millions of data sets. So to me it looks like that you don't need 'date_trunc' at all. But as said i'am not a db/sql guru. Just two observations: 1) Postgres default is to cast the request to '::timestamp without time zone' in Version 5.3: i.e. Index Scan using bro_v32_timed_y2003_datum on bro_v32_timed_y2003 bro_v32_timed (cost=0.00..8.28 rows=1 width=8) (actual time=0.012..0.012 rows=0 loops=1) Index Cond: ((datum > '2007-12-10 10:00:00'::timestamp without time zone) AND (datum < '2007-12-10 13:00:15'::timestamp without time zone)) So it might be an idea to cast the request explicitly and not to rely on POSTGRES defaults (or let the user specify a time zone). I have done no tests with time zones set. 2) The HH:MM:SS part if present (it can be left out) needs to be regexped because POSTGRES won't accept 'HH' or 'HH:' only. A minimum of HH:M is required. Just my 2ct. I have patched MS 5.6.1 with the above for our setup and it works just fine. Thanks for working this over in MS6. Regards Heiko > Sorry to jump late on this. > > The use of the date_trunc function for postgis layers (described > http://mapserver.org/ogc/wms_time.html) was from what I remember to > allow queries (on a timestamp field) > like time=2001-01-01 expecting to get back all values of the day > regardless of the time set. I have entered a bug on it > (http://trac.osgeo.org/mapserver/ticket/3382) to be able to review it > before the 6.0 release. > > regards, > > > Paul Ramsey wrote: > > Sorry, there's not much more I can offer, you've done a great job > > debugging, but at the end of the day the SQL being generated by the > > WMS Time module is not great. Make sure to run 'ANALYZE' on your > > database so the planner has the latest stats. > > > > P. > > > > On Thu, Mar 11, 2010 at 5:59 AM, Heiko Schr?ter > > wrote: > > > >> Am Donnerstag 11 M?rz 2010 14:35:53 schrieben Sie: > >> > >> Paul, > >> > >> thanks for staying at it. These timings i get with the variation of the theme. The second best is to cast 'datum::timestamp'. But still beeing 32times slower than just a trivial compare on the index as in 1). The slowest run is the brute force 'date_trunc' without cast 3). So to me this is a bit voodo why postgres refuses to scan the indices in proper speed in 2) and 3). > >> The maximum index scan i get with 'date_trunc' is a 'Bitmap Heap Scan' on the index with scenario 2). > >> Of what i have found inside the docs/google is that even when casting 'datum' inside postgres the request, here generated by MS, should or have to be casted as well which is not (at least by now). > >> > >> Heiko > >> > >> > >> 1) The brute force compare: > >> sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck > >> && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 > >> 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and (datum >= '2007-12-10' and datum <= '2007-12-11'); > >> > >> Total runtime: 41.018 ms > >> (32 rows) > >> > >> Now Create Immutable Index on our play table: > >> CREATE INDEX o_v20_y2007_date_trunc ON o_v20_y2007 (date_trunc('day', datum::timestamp without time zone)); > >> 2) > >> sc_gis=# CREATE INDEX o3_v20_y2007_date_trunc ON o3_v20_y2007 (date_trunc('day', datum::timestamp without time zone)); > >> ERROR: relation "o3_v20_y2007_date_trunc" already exists > >> scia_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck > >> && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 > >> 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum::timestamp without time zone) >= '2007-12-10' AND date_trunc('day', datum::timestamp without time zone) <= '2007-12-11')); > >> > >> Total runtime: 1250.679 ms > >> (26 rows) > >> > >> 3) > >> sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck > >> && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 > >> 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum) >= '2007-12-10' AND date_trunc('day', datum) <= '2007-12-11')); > >> > >> Total runtime: 2329.380 ms > >> (23 rows) > >> > >> > >>> Good job getting this far on your own! Create a SQL wrapper function > >>> on top of date_trunc which *is* marked as immutable and you'll be able > >>> to build a functional index on it. > >>> > >>> P. > >>> > >>> On Thu, Mar 11, 2010 at 1:39 AM, Heiko Schr?ter > >>> wrote: > >>> > >>>> Am Mittwoch 10 M?rz 2010 16:52:28 schrieb Heiko Schr?ter: > >>>> > >>>> Done what has been suggested. The 'date_trunc' function forces sequential scans instead of using the indexed scans. > >>>> > >>>> I've tried and failed: > >>>> sc_gis=# CREATE INDEX o_v20_y2007_date_trunc ON o_v20_y2007 (date_trunc('day', datum at time zone 'GMT')); > >>>> ERROR: functions in index expression must be marked IMMUTABLE > >>>> > >>>> Probably the MS list is not the right place to ask. > >>>> But may be a kind soul has some pointers to more infos. > >>>> I admit that db's are not my field of experience and i'am still learning. > >>>> > >>>> On the other hand it would be nice to have a hint about the indexing issue inside the MS docs when using the WMS Time extension. > >>>> > >>>> Heiko > >>>> > >>>> > >>>> sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck > >>>> && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 > >>>> 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and (datum >= '2007-12-10' and datum <= '2007-12-30'); > >>>> QUERY PLAN > >>>> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ > >>>> Result (cost=0.00..585.37 rows=4420 width=450) (actual time=0.083..35.821 rows=5322 loops=1) > >>>> -> Append (cost=0.00..541.17 rows=4420 width=450) (actual time=0.067..13.852 rows=5322 loops=1) > >>>> -> Seq Scan on o3_v20 (cost=0.00..16.65 rows=1 width=55) (actual time=0.001..0.001 rows=0 loops=1) > >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > >>>> -> Index Scan using o3_v20_y2002_datum on o3_v20_y2002 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.012..0.012 rows=0 loops=1) > >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > >>>> -> Index Scan using o3_v20_y2003_datum on o3_v20_y2003 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.006..0.006 rows=0 loops=1) > >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > >>>> -> Index Scan using o3_v20_y2004_datum on o3_v20_y2004 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) > >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > >>>> -> Index Scan using o3_v20_y2005_datum on o3_v20_y2005 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) > >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > >>>> -> Index Scan using o3_v20_y2006_datum on o3_v20_y2006 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) > >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > >>>> -> Index Scan using o3_v20_y2007_datum on o3_v20_y2007 o3_v20 (cost=0.00..458.27 rows=4411 width=450) (actual time=0.031..10.732 rows=5322 loops=1) > >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > >>>> -> Index Scan using o3_v20_y2008_datum on o3_v20_y2008 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.010..0.010 rows=0 loops=1) > >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > >>>> -> Index Scan using o3_v20_y2009_datum on o3_v20_y2009 o3_v20 (cost=0.00..8.28 rows=1 width=450) (actual time=0.006..0.006 rows=0 loops=1) > >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > >>>> -> Index Scan using o3_v20_y2010_datum on o3_v20_y2010 o3_v20 (cost=0.00..8.27 rows=1 width=450) (actual time=0.005..0.005 rows=0 loops=1) > >>>> Index Cond: ((datum >= '2007-12-10'::date) AND (datum <= '2007-12-30'::date)) > >>>> Filter: (rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) > >>>> Total runtime: 37.760 ms > >>>> (32 rows) > >>>> > >>>> sc_gis=# explain analyze select "datum","farbe",encode(AsBinary(force_collection(force_2d("rechteck")),'NDR'),'hex') as geom,"datum" from o_v20 where rechteck > >>>> && GeomFromText('POLYGON((-134.90506329114 -78.2278481012662,-134.90506329114 78.2278481012663,134.90506329114 > >>>> 78.2278481012663,134.90506329114 -78.2278481012662,-134.90506329114 -78.2278481012662))',-1) and ((date_trunc('day', datum) >= '2007-12-10' AND date_trunc('day', datum) <= '2007-12-30')); > >>>> QUERY PLAN > >>>> -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- > >>>> Result (cost=0.00..55305.53 rows=2873 width=450) (actual time=1368.129..2371.436 rows=5322 loops=1) > >>>> -> Append (cost=0.00..55276.80 rows=2873 width=450) (actual time=1368.100..2339.593 rows=5322 loops=1) > >>>> -> Seq Scan on o3_v20 (cost=0.00..20.45 rows=1 width=55) (actual time=0.001..0.001 rows=0 loops=1) > >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > >>>> -> Seq Scan on o3_v20_y2002 o3_v20 (cost=0.00..2228.21 rows=123 width=450) (actual time=79.684..79.684 rows=0 loops=1) > >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > >>>> -> Seq Scan on o3_v20_y2003 o3_v20 (cost=0.00..6587.07 rows=349 width=450) (actual time=238.174..238.174 rows=0 loops=1) > >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > >>>> -> Seq Scan on o3_v20_y2004 o3_v20 (cost=0.00..7417.62 rows=378 width=450) (actual time=260.250..260.250 rows=0 loops=1) > >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > >>>> -> Seq Scan on o3_v20_y2005 o3_v20 (cost=0.00..7328.16 rows=379 width=450) (actual time=264.246..264.246 rows=0 loops=1) > >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > >>>> -> Seq Scan on o3_v20_y2006 o3_v20 (cost=0.00..7299.65 rows=383 width=450) (actual time=263.991..263.991 rows=0 loops=1) > >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > >>>> -> Seq Scan on o3_v20_y2007 o3_v20 (cost=0.00..7642.97 rows=397 width=450) (actual time=261.744..297.122 rows=5322 loops=1) > >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > >>>> -> Seq Scan on o3_v20_y2008 o3_v20 (cost=0.00..8583.06 rows=439 width=450) (actual time=472.648..472.648 rows=0 loops=1) > >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > >>>> -> Seq Scan on o3_v20_y2009 o3_v20 (cost=0.00..6961.72 rows=361 width=450) (actual time=394.525..394.525 rows=0 loops=1) > >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > >>>> -> Seq Scan on o3_v20_y2010 o3_v20 (cost=0.00..1207.89 rows=63 width=450) (actual time=65.417..65.417 rows=0 loops=1) > >>>> Filter: ((rechteck && '0103000000010000000500000035884A47F6DC60C038D93310958E53C035884A47F6DC60C03FD93310958E534035884A47F6DC60403FD93310958E534035884A47F6DC604038D93310958E53C035884A47F6DC60C038D93310958E53C0'::geometry) AND (date_trunc('day'::text, (datum)::timestamp with time zone) >= '2007-12-10 00:00:00+01'::timestamp with time zone) AND (date_trunc('day'::text, (datum)::timestamp with time zone) <= '2007-12-30 00:00:00+01'::timestamp with time zone)) > >>>> Total runtime: 2374.403 ms > >>>> (23 rows) > >>>> > >>>> > >>>> > >>>> > >>>>> Am Mittwoch 10 M?rz 2010 16:42:02 schrieben Sie: > >>>>> > >>>>> Thanks for the hint. > >>>>> Hm, i thought 4000 out of 4.5 Millions datasets for the whole year in 5 sec would be not that bad .... > >>>>> The timing figure shall just show the huge difference between the two types of requests. > >>>>> > >>>>> I will follow your advice and test the db. And yes the db is indexed. > >>>>> > >>>>> Heiko > >>>>> > >>>>> > >>>>>> Firstly, 2 seconds is not fast, so you have another performance troll > >>>>>> beyond this one. > >>>>>> > >>>>>> Secondly, it's impossible to know what's going on inside the database > >>>>>> without seeing the actual SQL being generated. Turn on statement > >>>>>> loggging in PgSQL and extract the SQL that is being run against the > >>>>>> database. Then you can put that into PgAdmin or psql and get EXPLAIN > >>>>>> ANALYZE results which will tell you why there's a problem, hopefully. > >>>>>> > >>>>>> P. > >>>>>> > >>>>>> On Wed, Mar 10, 2010 at 7:22 AM, Heiko Schr?ter > >>>>>> wrote: > >>>>>> > >>>>>>> Hello, > >>>>>>> > >>>>>>> using mapserv (5.6.1) with PostGIS (8.3) and accessing ten-thousands of geo locations in the PostGIS db results in very slow speed when using the WMS TIME parameter: > >>>>>>> (in this example the number is about 4000 datapoints for this day, timing measurements with DEBUG OFF). > >>>>>>> > >>>>>>> 1) Very fast using FILTER, approx. 5 seconds: > >>>>>>> .... > >>>>>>> CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" > >>>>>>> DATA "geocoord from xyz_ref using unique datum" > >>>>>>> VALIDATION > >>>>>>> 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" > >>>>>>> END > >>>>>>> FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" > >>>>>>> .... > >>>>>>> > >>>>>>> 2) Very slow using WMS TIME, approx 210 and more seconds: > >>>>>>> (Leaving the VALIDATION/FILTER on or leaving out 'using unique datum' doesn't change a thing) > >>>>>>> ... > >>>>>>> METADATA > >>>>>>> "wms_timeextent" "1970-01-01/2030-12-31" > >>>>>>> "wms_timeitem" "datum" > >>>>>>> "wms_timedefault" "2007-12-10/2007-12-11" > >>>>>>> "wms_title" "xyz_r" > >>>>>>> "wms_srs" "init=epsg:-1" > >>>>>>> END > >>>>>>> ... > >>>>>>> > >>>>>>> The MS ERRORFILE is very noisy spilling out all datapoints when running 2). This does not happen when running 1). > >>>>>>> Database is the same. No other changes have been made. > >>>>>>> > >>>>>>> Why is mapserver so slow when using the WMS TIME parameter ? > >>>>>>> > >>>>>>> It would be nice to stick to the "official" WMS configuration and not to introduce a "vendor specific" workaround. > >>>>>>> > >>>>>>> Thanks and Regards > >>>>>>> Heiko > >>>>>>> > >>>>>>> # ###################################################################################################### > >>>>>>> > >>>>>>> /var/www/localhost/cgi-bin/mapserv -v > >>>>>>> MapServer version 5.6.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=ICONV SUPPORTS=WMS_SERVER SUPPORTS=WFS_SERVER SUPPORTS=WCS_SERVER INPUT=EPPL7 INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE > >>>>>>> > >>>>>>> A complete Layer definition: > >>>>>>> > >>>>>>> LAYER > >>>>>>> EXTENT -180 -90 180 90 > >>>>>>> CONNECTIONTYPE POSTGIS > >>>>>>> NAME "SACURA_REF_R" > >>>>>>> PROCESSING "CLOSE_CONNECTION=DEFER" > >>>>>>> OPACITY 60 > >>>>>>> STATUS ON > >>>>>>> METADATA > >>>>>>> # "wms_timeextent" "1970-01-01/2030-12-31" > >>>>>>> # "wms_timeitem" "datum" > >>>>>>> # "wms_timedefault" "2007-12-10/2007-12-11" > >>>>>>> "wms_title" "xyz_ref_r" > >>>>>>> "wms_srs" "init=epsg:-1" > >>>>>>> END > >>>>>>> PROJECTION > >>>>>>> "init=epsg:4326" > >>>>>>> END > >>>>>>> CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" > >>>>>>> DATA "geocoord from xyz_ref using unique datum" > >>>>>>> VALIDATION > >>>>>>> 'filter' "^datum >= '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum <= '[0-9]{4}-[0-9]{2}-[0-9]{2}'" > >>>>>>> END > >>>>>>> FILTER "datum >= '2007-12-10' and datum < '2007-12-11'" > >>>>>>> > >>>>>>> TYPE POLYGON > >>>>>>> SIZEUNITS meters > >>>>>>> CLASS > >>>>>>> DEBUG OFF > >>>>>>> NAME "xyz_ref_class" > >>>>>>> STYLE > >>>>>>> OUTLINECOLOR 0 0 0 > >>>>>>> COLOR [rfarbe] > >>>>>>> END > >>>>>>> END > >>>>>>> END # Layer > >>>>>>> _______________________________________________ > >>>>>>> mapserver-users mailing list > >>>>>>> mapserver-users at lists.osgeo.org > >>>>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users > >>>>>>> > >>>>>>> > >>>>> _______________________________________________ > >>>>> mapserver-users mailing list > >>>>> mapserver-users at lists.osgeo.org > >>>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users > >>>>> From schroete at iup.physik.uni-bremen.de Fri Mar 19 01:55:40 2010 From: schroete at iup.physik.uni-bremen.de (Heiko =?iso-8859-1?q?Schr=F6ter?=) Date: Fri, 19 Mar 2010 09:55:40 +0100 Subject: [mapserver-users] WFS limit time interval to POSTGIS In-Reply-To: <4BA28B03.8020101@dmsolutions.ca> References: <201003181239.37609.schroete@iup.physik.uni-bremen.de> <4BA28B03.8020101@dmsolutions.ca> Message-ID: <201003190955.41180.schroete@iup.physik.uni-bremen.de> > Hi there, > > There is no explicit support of a TIME parameter in wfs but I believe > It should be possible on a postgis layer to use the FilterEncoding to > limit the request: would something like this work for you: > > Filter=your_time_field2007-01-02your_time_field2007-01-03 > > > regards, Thanks very much for the suggestion. It does not work that easy (of course ;-) ) but you can filter using the following converting the date to UNIX epochs first and compare the integers. Unfortunatly the WFS part of MS 5.6.1 does not handle the type 'date' for comparison or calculus. This works: http://localhost/cgi-bin/mapserv.patched/?map=/var/www/localhost/mapserver/wfs6_include.map&SERVICE=WFS&VERSION=1.0.0&REQUEST=getfeature&TYPENAME=BRO_V32_TIMED&FILTER=date_part('epoch',datum::timestamp without time zone)1191359000date_part('epoch',datum::timestamp without time zone)1191359640 Still quite ugly to mee. Is there a deeper reason for not having a time spec within WFS ? To me you usually have data points in space _and_ time. But i'am not a GEO man either (daily satellite based measurements we have). Thanks and Regards Heiko The LAYER definition is as follows. Funny enough one needs not to specify the FILTER at all ... ok, one learns something new every day: LAYER EXTENT -180 -90 180 90 CONNECTIONTYPE POSTGIS NAME "BRO_V32_TIMED" PROCESSING "CLOSE_CONNECTION=DEFER" OPACITY 60 STATUS ON DUMP TRUE METADATA "wfs_title" "bro_v32_timed" "wfs_maxfeatures" "10" "gml_featureid" "ID" ## REQUIRED "gml_include_items" "all" ## Optional (serves all attributes for layer) "gml_geometries" "rechteck" "gml_rechteck_type" "polygon" END PROJECTION "init=epsg:4326" END CONNECTION "user={BF961C25A57BA226} password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost" DATA "rechteck from bro_v32_timed using srid=-1 using unique datum" TYPE POLYGON SIZEUNITS meters CLASS NAME "bro_v32_timed_total_class" STYLE OUTLINECOLOR 0 0 0 COLOR [farbe] END END END # Layer From medvezs84 at gmail.com Fri Mar 19 02:39:12 2010 From: medvezs84 at gmail.com (Medve Zsolt) Date: Fri, 19 Mar 2010 10:39:12 +0100 Subject: [mapserver-users] Versioned queries arcSDE Message-ID: <4BA34640.7010505@gmail.com> Hy all I would like to ask for help . How can i do versioned queries? I have an Oracle database with SDE on it.Can someone post some example mapfile or code or just a discusson about the question?:) Thanks, bye From mulone at rome.com Fri Mar 19 05:49:37 2010 From: mulone at rome.com (Mulone) Date: Fri, 19 Mar 2010 04:49:37 -0800 (PST) Subject: [mapserver-users] Re: Google Mercator and +nadgrids=@null In-Reply-To: <931f8ea91003180731g48bd2e4ai6ba00a3cf220a916@mail.gmail.com> References: <1268861996817-4753197.post@n2.nabble.com> <0B6D7F516315594DBEFE58178D91BD32B7E515D2B6@exchangemm.mm.fr> <931f8ea91003180731g48bd2e4ai6ba00a3cf220a916@mail.gmail.com> Message-ID: <1269002977724-4762619.post@n2.nabble.com> UPDATE: we managed to reproject in google mercator the map on OpenLayers with this code: http://www.copypastecode.com/24724 It looks ok but when I added a transparent Google Maps layer, our geometries are shifted south by about 30km. Any idea of what might cause this issue? BTW, we didn't manage to reproject the geometries directly on MapServer, that kept crashing or generating latlon tiles. Cheers, Mulone ----- Mulone PhD student -- View this message in context: http://n2.nabble.com/MapServer-OpenStreetMap-OpenLayers-Reprojection-from-Latlong-to-Mercator-a-real-nightmare-tp4753197p4762619.html Sent from the Mapserver - User mailing list archive at Nabble.com. From Steve.Lime at state.mn.us Fri Mar 19 06:17:11 2010 From: Steve.Lime at state.mn.us (Lime, Steve D (DNR)) Date: Fri, 19 Mar 2010 08:17:11 -0500 Subject: [mapserver-users] Versioned queries arcSDE In-Reply-To: <4BA34640.7010505@gmail.com> References: <4BA34640.7010505@gmail.com> Message-ID: Not sure what you mean by versioned queries. You can do MapServer queries against a versioned SDE database. I'm doing so against SDE 9.3 backed by Oracle. I don't have access to our ESRI environment at the moment but I let you know how I mapped connection settings in ArcCatalog to MapServer CONNECTION/DATA settings first thing next week if that would help... Steve ________________________________________ From: mapserver-users-bounces at lists.osgeo.org [mapserver-users-bounces at lists.osgeo.org] On Behalf Of Medve Zsolt [medvezs84 at gmail.com] Sent: Friday, March 19, 2010 4:39 AM To: mapserver-users at lists.osgeo.org Subject: [mapserver-users] Versioned queries arcSDE Hy all I would like to ask for help . How can i do versioned queries? I have an Oracle database with SDE on it.Can someone post some example mapfile or code or just a discusson about the question?:) Thanks, bye _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users From russell at flora.ca Fri Mar 19 07:14:38 2010 From: russell at flora.ca (Russell McOrmond) Date: Fri, 19 Mar 2010 10:14:38 -0400 Subject: [mapserver-users] Versioned queries arcSDE In-Reply-To: <4BA34640.7010505@gmail.com> References: <4BA34640.7010505@gmail.com> Message-ID: <4BA386CE.1020802@flora.ca> Medve Zsolt wrote: > Hy all > > I would like to ask for help . How can i do versioned queries? I have an > Oracle database with SDE on it.Can someone post some example mapfile or > code or just a discusson about the question?:) I've never done versioned queries, but noticed mention of it in the DATA string as the last parameter. http://mapserver.org/input/vector/arcsde.html "SDE.DEFAULT - As of MapServer 4.2, you can query against a specific version of the layer. SDE supports multi-user editing with versions. If a layer has been Registered with the GeoDatabase and Registered as Versioned (ArcGIS terms), MapServer can query against specified versions of those edits. If not specified, SDE.DEFAULT will be used for all queries." > > Thanks, bye > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users -- Russell McOrmond, Internet Consultant: Please help us tell the Canadian Parliament to protect our property rights as owners of Information Technology. Sign the petition! http://www.digital-copyright.ca/petition/ict/ "The government, lobbied by legacy copyright holders and hardware manufacturers, can pry my camcorder, computer, home theatre, or portable media player from my cold dead hands!" From sb.ray at hotmail.com Fri Mar 19 07:24:58 2010 From: sb.ray at hotmail.com (sunny74) Date: Fri, 19 Mar 2010 06:24:58 -0800 (PST) Subject: [mapserver-users] getting Feature Info data directly from .shp files Message-ID: <1269008698458-4763187.post@n2.nabble.com> Dear Friends, I want to get the Feature Info data directly from .shp files i.e shape files. Previously I had put all data into the database (postgres) then ran queries on the DB and the data returned is shown in a pop up. But now I want to get all the column information of all the layers by directly firing query on the individual .shp files. How to do it? Pls give me a working example. Thanks for your replies. -- View this message in context: http://n2.nabble.com/getting-Feature-Info-data-directly-from-shp-files-tp4763187p4763187.html Sent from the Mapserver - User mailing list archive at Nabble.com. From bfraser at geoanalytic.com Fri Mar 19 07:28:58 2010 From: bfraser at geoanalytic.com (Brent Fraser) Date: Fri, 19 Mar 2010 08:28:58 -0600 Subject: [mapserver-users] 3D display of data In-Reply-To: <6e7b1b711003182116y69df6fe7md9ad5643bbaaf548@mail.gmail.com> References: <6e7b1b711003182116y69df6fe7md9ad5643bbaaf548@mail.gmail.com> Message-ID: <4BA38A2A.9060806@geoanalytic.com> Kishore, Can you be more specific? Did you mean display of: - contours (isolines of height with labels) - shaded terrain (see GDAL's gdal_dem utility to create) - perspective viewing of terrain (mapserver can't do this) Best Regards, Brent Fraser Kishore Reddy wrote: > Hi all, > > I have built a website which shows geographic data in 2D. The > following is the configuration used for the website > > MapServer > Postgresql - Data is stored with accordance with the OpenGeo standards. > OpenLayers > Php > > But the website is intended for the rural community. So I thought of > displaying the data in 3D using MapServer. > So can anyone please give some references? > > -- > Kishore > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From boolean10001 at yahoo.com Fri Mar 19 08:45:08 2010 From: boolean10001 at yahoo.com (Carlos Ruiz) Date: Fri, 19 Mar 2010 08:45:08 -0700 (PDT) Subject: [mapserver-users] Multiples shapefiles, one LAYER In-Reply-To: References: <439315.45940.qm@web38202.mail.mud.yahoo.com> Message-ID: <587798.46886.qm@web38206.mail.mud.yahoo.com> Conociendo m?s a fondo tu situaci?n, pudiera ser que exista una alternativa si en vez de archivos SHP hicieras uso de bases de datos relacionales como PostgreSQL, MySQL u Oracle. Mi idea consiste en que cada propietario integrara su informaci?n en una base de datos, en donde podr?an actualizar cuando quisieran. T? por tu parte, creas una vista en la que unes (JOIN) las diferentes tablas de cada propietario, si y solo si la representaci?n geometrica es la misma. Ya solo generas un archivo MAP con una sola capa haciendo referencia a la vista. Yo en lo personal trabajo con PostgreSQL+PostGIS y ha resultado una excelente opci?n. Con af?n de que conozcas un poco m?s de mi proyecto y veas si existe alguna relaci?n hasta cierto punto en lo que est?s trabajando, te hago llegar el siguiente v?nculo: http://www.postgis.org/documentation/casestudies/sitel/ Saludos ! IC Carlos Ruiz ________________________________ From: Carmen Delia Hern?ndez P?rez To: Carlos Ruiz Sent: Fri, March 19, 2010 2:15:25 AM Subject: RE: [mapserver-users] Multiples shapefiles, one LAYER Hola!! S?, lo de fusionar los shapefiles en uno previamente es la soluci?n que ya hab?a pensado. En el caso de capas de la misma topolog?a me servir?a, lo que quer?a es ver si no ten?a que hacer esa fusi?n previa y mantener los distintos shp ya que son ficheros que no son creados por m? y as? conservo la estructura original que me hacen llegar. Pero bueno, me parece que optar? finalmente por esta opci?n. Muchas gracias. Saludos. De:Carlos Ruiz [mailto:boolean10001 at yahoo.com] Enviado el: jueves, 18 de marzo de 2010 15:52 Para: Carmen Delia Hern?ndez P?rez Asunto: Re: [mapserver-users] Multiples shapefiles, one LAYER Carmen, Es imposible que quieras manejar m?ltiples archivos SHP y tratarlos como una sola capa. Primeramente, por la representaci?n, tal vez, algunas de las capas se representan con puntos y otras con l?neas, por lo que la estructura de la simbolog?a es distinta. Si todas las capas tienen la misma representaci?n y los mismos atributos, por qu? no pensar en fusionarlas en un solo archivo SHP ? Saludos desde M?xico IC Carlos Ruiz ________________________________ From:Carmen Delia Hern?ndez P?rez To: mapserver-users at lists.osgeo.org Sent: Thu, March 18, 2010 9:05: 14 AM Subject: [mapserver-users] Multiples shapefiles, one LAYER Hello!! I need help. I?m using Mapserver and I`ve some shapefiles of the ?same region? but I would like only appear as a single layer. I tried with GROUP property but I don?t want it to appear the individual layers. Use TILEINDEX does not help me because they are of the same region. I don?t know if it?s possible to do. For example I?ve some text shapefiles with different styles but I would like they were activated as a single layer. Any solution? Thanks. -------------- next part -------------- An HTML attachment was scrubbed... URL: From jiangtianscarlett at hotmail.com Fri Mar 19 08:53:06 2010 From: jiangtianscarlett at hotmail.com (Scarlett Jiang) Date: Fri, 19 Mar 2010 23:53:06 +0800 Subject: [mapserver-users] QGIS MapServer Export error Message-ID: Dear All, I have encountered a problem while trying to export map files from QGIS using "MapServer Export" plugin. The mapfile that I got back cannot be viewed using shp2img utilities. I got an error saying : "msLoadMap(): Regular expression error. MS_DEFAULT_MAPFILE_PATTERN validation failed. msEvalRegex(): Regular expression error. String failed expression test. " In addition, when I tried displaying the mapfile obtained from QGIS through openlayers, I got blank gray images. I have also tried removing all the layer info in the mapfile, but still got the same error. However, if I write a mapfile by myself, then the shp2img utility works fine. Is there any problem with the QGIS MapServer Export plugin? Or have I done anything wrong? Thanks in advance! Scarlett _________________________________________________________________ Hotmail: Trusted email with Microsoft?s powerful SPAM protection. https://signup.live.com/signup.aspx?id=60969 -------------- next part -------------- An HTML attachment was scrubbed... URL: From bea at ixsea.com Fri Mar 19 09:55:06 2010 From: bea at ixsea.com (=?ISO-8859-1?Q?Beno=EEt_Andrieu?=) Date: Fri, 19 Mar 2010 17:55:06 +0100 Subject: [mapserver-users] 3D display of data In-Reply-To: <4BA38A2A.9060806@geoanalytic.com> References: <6e7b1b711003182116y69df6fe7md9ad5643bbaaf548@mail.gmail.com> <4BA38A2A.9060806@geoanalytic.com> Message-ID: <4BA3AC6A.9010901@ixsea.com> Hi ! > - perspective viewing of terrain (mapserver can't do this) I don't totally agree with this. ;) I have been able to use mapserver with WorldWind Java in order to display a raster layer on terrain. And both (raster and terrain) were served by mapserver. What, I think, is not possible (and perhaps what you mean) is to have mapserver render the terrain model given a custom viewpoint and serve the result to openlayers. I think there were some discussion about this some times ago... Regards, Beno?t Andrieu Le 19/03/2010 15:28, Brent Fraser a ?crit : > Kishore, > > Can you be more specific? Did you mean display of: > > - contours (isolines of height with labels) > - shaded terrain (see GDAL's gdal_dem utility to create) > - perspective viewing of terrain (mapserver can't do this) > > Best Regards, > Brent Fraser > > Kishore Reddy wrote: >> Hi all, >> >> I have built a website which shows geographic data in 2D. The >> following is the configuration used for the website >> >> MapServer >> Postgresql - Data is stored with accordance with the OpenGeo standards. >> OpenLayers >> Php >> >> But the website is intended for the rural community. So I thought of >> displaying the data in 3D using MapServer. >> So can anyone please give some references? >> >> -- >> Kishore >> _______________________________________________ >> mapserver-users mailing list >> mapserver-users at lists.osgeo.org >> http://lists.osgeo.org/mailman/listinfo/mapserver-users >> > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From asoares1 at gmail.com Fri Mar 19 11:21:45 2010 From: asoares1 at gmail.com (Alexandre Soares) Date: Fri, 19 Mar 2010 14:21:45 -0400 Subject: [mapserver-users] Map file xsl transformation and regular expressions Message-ID: Hi, When I transform my xml map file to a map file, my expressions that contain a regular expression (the same is true for filters) are rendered with double quotes (because the stylesheet has the quote="1" param for those templates). Is there an intended way to achieve this? I know I could modify the stylesheet to not quote those elements and then quote-wrap my value if I need them (in case of string comparison). Thank you! -------------- next part -------------- An HTML attachment was scrubbed... URL: From aboudreault at mapgears.com Fri Mar 19 11:49:54 2010 From: aboudreault at mapgears.com (Alan Boudreault) Date: Fri, 19 Mar 2010 14:49:54 -0400 Subject: [mapserver-users] Map file xsl transformation and regular expressions In-Reply-To: References: Message-ID: <201003191449.54473.aboudreault@mapgears.com> Alexandre, you are right, if the expression is an regular expression, it shouldn't be quoted. I think the only solution would be to add an attribute in the xml schema, that will specify if the expression is an regular expression of not. Something like: In this case, the xsl transformation would not quote it. I take a note on that and should fix this in the next few days. Thanks for reporting! Alan On March 19, 2010 02:21:45 pm Alexandre Soares wrote: > Hi, > > When I transform my xml map file to a map file, my expressions that contain > a regular expression (the same is true for filters) are rendered with > double quotes (because the stylesheet has the quote="1" param for those > templates). > > Is there an intended way to achieve this? I know I could modify the > stylesheet to not quote those elements and then quote-wrap my value if I > need them (in case of string comparison). > > Thank you! > -- Alan Boudreault Mapgears http://www.mapgears.com From asoares1 at gmail.com Fri Mar 19 11:59:17 2010 From: asoares1 at gmail.com (Alexandre Soares) Date: Fri, 19 Mar 2010 14:59:17 -0400 Subject: [mapserver-users] Map file xsl transformation and regular expressions In-Reply-To: <201003191449.54473.aboudreault@mapgears.com> References: <201003191449.54473.aboudreault@mapgears.com> Message-ID: The symbol attribute (which does not get quoted by default) causes a problem if the value references a stmbol's name. I think it could also benefit from your fix. Thank you! On Fri, Mar 19, 2010 at 2:49 PM, Alan Boudreault wrote: > Alexandre, you are right, if the expression is an regular expression, it > shouldn't be quoted. I think the only solution would be to add an attribute > in > the xml schema, that will specify if the expression is an regular > expression > of not. Something like: > > > > In this case, the xsl transformation would not quote it. I take a note on > that > and should fix this in the next few days. > > Thanks for reporting! > Alan > > On March 19, 2010 02:21:45 pm Alexandre Soares wrote: > > Hi, > > > > When I transform my xml map file to a map file, my expressions that > contain > > a regular expression (the same is true for filters) are rendered with > > double quotes (because the stylesheet has the quote="1" param for those > > templates). > > > > Is there an intended way to achieve this? I know I could modify the > > stylesheet to not quote those elements and then quote-wrap my value if I > > need them (in case of string comparison). > > > > Thank you! > > > > -- > Alan Boudreault > Mapgears > http://www.mapgears.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From dmorissette at mapgears.com Fri Mar 19 12:28:49 2010 From: dmorissette at mapgears.com (Daniel Morissette) Date: Fri, 19 Mar 2010 15:28:49 -0400 Subject: [mapserver-users] Map file xsl transformation and regular expressions In-Reply-To: <201003191449.54473.aboudreault@mapgears.com> References: <201003191449.54473.aboudreault@mapgears.com> Message-ID: <4BA3D071.6040108@mapgears.com> Alan Boudreault wrote: > Alexandre, you are right, if the expression is an regular expression, it > shouldn't be quoted. I think the only solution would be to add an attribute in > the xml schema, that will specify if the expression is an regular expression > of not. Something like: > > > Since MapServer has three possible types of expressions, would it not be better to use a "type" attribute with three possible values, e.g. The default would be "constant", the only type that needs to be quoted. The logical expressions are enclosed inside (...) and should not be quoted either. Daniel -- Daniel Morissette http://www.mapgears.com/ From Weisbend at wapa.gov Fri Mar 19 13:37:49 2010 From: Weisbend at wapa.gov (Eric Weisbender) Date: Fri, 19 Mar 2010 14:37:49 -0600 Subject: [mapserver-users] html query templates Message-ID: <4BA38C3D020000DF000559E5@10.1.50.131> I am trying to calculate the sum of several numeric values returned in a query template. Is there a cgi variable for this or a way to distinguish say the first [length] of a line segment returned as apposed to subsequent [length] values returned for the same poly line shape. Eric From bea at ixsea.com Fri Mar 19 14:07:28 2010 From: bea at ixsea.com (=?ISO-8859-1?Q?Beno=EEt_Andrieu?=) Date: Fri, 19 Mar 2010 22:07:28 +0100 Subject: [mapserver-users] 3D display of data In-Reply-To: <6e7b1b711003191013k39a487f1w9ab6902d65250f6b@mail.gmail.com> References: <6e7b1b711003182116y69df6fe7md9ad5643bbaaf548@mail.gmail.com> <4BA38A2A.9060806@geoanalytic.com> <4BA3AC6A.9010901@ixsea.com> <6e7b1b711003191013k39a487f1w9ab6902d65250f6b@mail.gmail.com> Message-ID: <4BA3E790.8070304@ixsea.com> Hi ! Then, as Brent said, you should take a look at gdaldem. http://www.gdal.org/gdaldem.html Some pictures : http://research.dmsolutions.ca/?p=350 Regards, Beno?t Andrieu Le 19/03/2010 18:13, Kishore Reddy a ?crit : > What I mean to say, with the given appropriate form of data (DEM or > DTM or whatever) we can not do relief shading (perspective viewing of > terrain - to be more specific with the defined aspect ratio, slope and > direction of light source) using maservers mapengine. > > So my question is whether I can hook any 3D rendering engines / > drivers (designed for the geodatabases) into the mapengine so that > relief shading could be accomplished? > > Hope I am clear now. > > -- > Kishore > > > > On Fri, Mar 19, 2010 at 10:25 PM, Beno?t Andrieu wrote: > >> Hi ! >> >> >>> - perspective viewing of terrain (mapserver can't do this) >>> >> I don't totally agree with this. ;) >> I have been able to use mapserver with WorldWind Java in order to display a >> raster layer on terrain. >> And both (raster and terrain) were served by mapserver. >> >> What, I think, is not possible (and perhaps what you mean) is to have >> mapserver render the terrain model given a custom viewpoint and serve the >> result to openlayers. >> I think there were some discussion about this some times ago... >> >> Regards, >> >> Beno?t Andrieu >> >> Le 19/03/2010 15:28, Brent Fraser a ?crit : >> >>> Kishore, >>> >>> Can you be more specific? Did you mean display of: >>> >>> - contours (isolines of height with labels) >>> - shaded terrain (see GDAL's gdal_dem utility to create) >>> - perspective viewing of terrain (mapserver can't do this) >>> >>> Best Regards, >>> Brent Fraser >>> >>> Kishore Reddy wrote: >>> >>>> Hi all, >>>> >>>> I have built a website which shows geographic data in 2D. The >>>> following is the configuration used for the website >>>> >>>> MapServer >>>> Postgresql - Data is stored with accordance with the OpenGeo standards. >>>> OpenLayers >>>> Php >>>> >>>> But the website is intended for the rural community. So I thought of >>>> displaying the data in 3D using MapServer. >>>> So can anyone please give some references? >>>> >>>> -- >>>> Kishore >>>> _______________________________________________ >>>> mapserver-users mailing list >>>> mapserver-users at lists.osgeo.org >>>> http://lists.osgeo.org/mailman/listinfo/mapserver-users >>>> >>>> >>> _______________________________________________ >>> mapserver-users mailing list >>> mapserver-users at lists.osgeo.org >>> http://lists.osgeo.org/mailman/listinfo/mapserver-users >>> >>> >> _______________________________________________ >> mapserver-users mailing list >> mapserver-users at lists.osgeo.org >> http://lists.osgeo.org/mailman/listinfo/mapserver-users >> >> > From bthoen at gisnet.com Fri Mar 19 14:41:06 2010 From: bthoen at gisnet.com (Bill Thoen) Date: Fri, 19 Mar 2010 15:41:06 -0600 Subject: [mapserver-users] WMS For Open Street Maps for MapServer? Message-ID: <4BA3EF72.70202@gisnet.com> Can anyone tell me if there is a WMS server out there (that's working) that serves Open Street Maps data? I've searched and found some old sites that don't seem to be working now, and I found some information that talks about a MapServer solution that involves downloading several "helper" files and running things through PostGIS, but is it that complicated? Isn't there just a simple WMS server out there I could use to load US streets into a MapServer map or is this not the best way to go about it? I also tried http://services.giub.uni-bonn.de/wms?, with no luck. I couldn't even get capabilities from it. Here's one of the ones I tried. I'll post the code so if anyone sees a problem with it, please let me know? That would be helpful. But as it is, this server also doesn't appear to be working. Both of these were mentioned in search googlits, but there's not a heck of a lot out there about this. LAYER NAME osm GROUP "Roads" TYPE RASTER METADATA "wms_title" "Open Street Map" "wms_group_title" "Roads & Highways" "wms_format" "image/jpeg" "wms_srs" "EPSG:4326" "wms_name" "osm" "wms_server_version" "1.1.1" "wms_transparent" "true" END STATUS ON CONNECTIONTYPE WMS CONNECTION "http://data1.vizure.net/server/services/request.php?jname=/wms" PROJECTION "init=epsg:4326" END END TIA, - Bill Thoen -- GISnet - www.gisnet.com 1401 Walnut St., Suite C Boulder, CO 80302 303-786-9961 tel 303-443-4856 fax -------------- next part -------------- An HTML attachment was scrubbed... URL: From szekerest at gmail.com Fri Mar 19 15:00:22 2010 From: szekerest at gmail.com (Tamas Szekeres) Date: Fri, 19 Mar 2010 23:00:22 +0100 Subject: [mapserver-users] WMS For Open Street Maps for MapServer? In-Reply-To: <4BA3EF72.70202@gisnet.com> References: <4BA3EF72.70202@gisnet.com> Message-ID: You might want to try to use the GDAL WMS/TMS driver, as something like: LAYER DATA "frmt_wms_openstreetmap_tms.xml" NAME "frmt_wms_openstreetmap_tms" PROJECTION "proj=merc" "a=6378137" "b=6378137" "lat_ts=0.0" "lon_0=0.0" "x_0=0.0" "y_0=0" "k=1.0" "units=m" "nadgrids=@null" "no_defs" END STATUS ON TYPE RASTER UNITS METERS END Along with the following xml file: http://tile.openstreetmap.org/${z}/${x}/${y}.png -20037508.34 20037508.34 20037508.34 -20037508.34 18 1 1 top EPSG:900913 256 256 3 Best regards, Tamas 2010/3/19 Bill Thoen > Can anyone tell me if there is a WMS server out there (that's working) > that serves Open Street Maps data? I've searched and found some old sites > that don't seem to be working now, and I found some information that talks > about a MapServer solution that involves downloading several "helper" files > and running things through PostGIS, but is it that complicated? Isn't there > just a simple WMS server out there I could use to load US streets into a > MapServer map or is this not the best way to go about it? > > I also tried http://services.giub.uni-bonn.de/wms?, with no luck. I > couldn't even get capabilities from it. > > Here's one of the ones I tried. I'll post the code so if anyone sees a > problem with it, please let me know? That would be helpful. But as it is, > this server also doesn't appear to be working. Both of these were mentioned > in search googlits, but there's not a heck of a lot out there about this. > LAYER > NAME osm > GROUP "Roads" > TYPE RASTER > METADATA > "wms_title" "Open Street Map" > "wms_group_title" "Roads & Highways" > "wms_format" "image/jpeg" > "wms_srs" "EPSG:4326" > "wms_name" "osm" > "wms_server_version" "1.1.1" > "wms_transparent" "true" > END > STATUS ON > CONNECTIONTYPE WMS > CONNECTION > "http://data1.vizure.net/server/services/request.php?jname=/wms" > PROJECTION > "init=epsg:4326" > END > END > > TIA, > - Bill Thoen > > -- > GISnet - www.gisnet.com > 1401 Walnut St., Suite C > Boulder, CO 80302 > 303-786-9961 tel > 303-443-4856 fax > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From j.l.h.hartmann at uva.nl Sat Mar 20 04:44:39 2010 From: j.l.h.hartmann at uva.nl (Jan Hartmann) Date: Sat, 20 Mar 2010 12:44:39 +0100 Subject: [mapserver-users] WMS For Open Street Maps for MapServer? In-Reply-To: References: <4BA3EF72.70202@gisnet.com> Message-ID: <4BA4B527.2090707@uva.nl> On 2010-03-19 23:00, Tamas Szekeres wrote: > You might want to try to use the GDAL WMS/TMS driver > , as something like: > > Very interesting. How about using gdalwarp to georeference images over the Internet? Any hints how to optimise this driver, as against using file-system rasters? I tried the first example from the web-page, to retrieve an Onearth Landsat image: $ gdal_translate -of JPEG -outsize 500 250 frmt_wms_onearth_global_mosaic.xml onearth_global_mosaic.jpg ERROR 4: `frmt_wms_onearth_global_mosaic.xml' not recognised as a supported file format. Do I have to compile gdal with a WMS-option? I am still using 1.7.0.b1, and I can find no configure option for WMS there. Jan -------------- next part -------------- An HTML attachment was scrubbed... URL: From szekerest at gmail.com Sat Mar 20 05:00:16 2010 From: szekerest at gmail.com (Tamas Szekeres) Date: Sat, 20 Mar 2010 13:00:16 +0100 Subject: [mapserver-users] WMS For Open Street Maps for MapServer? In-Reply-To: <4BA4B527.2090707@uva.nl> References: <4BA3EF72.70202@gisnet.com> <4BA4B527.2090707@uva.nl> Message-ID: Jan, You should compile gdal with libcurl support in order to have the wms driver working. Best regards, Tamas 2010/3/20 Jan Hartmann > > > On 2010-03-19 23:00, Tamas Szekeres wrote: > > You might want to try to use the GDAL WMS/TMS driver, > as something like: > > > Very interesting. How about using gdalwarp to georeference images over the > Internet? Any hints how to optimise this driver, as against using > file-system rasters? > > I tried the first example from the web-page, to retrieve an Onearth Landsat > image: > > $ gdal_translate -of JPEG -outsize 500 250 > frmt_wms_onearth_global_mosaic.xml onearth_global_mosaic.jpg > ERROR 4: `frmt_wms_onearth_global_mosaic.xml' not recognised as a supported > file format. > > Do I have to compile gdal with a WMS-option? I am still using 1.7.0.b1, and > I can find no configure option for WMS there. > > Jan > -------------- next part -------------- An HTML attachment was scrubbed... URL: From dmorissette at mapgears.com Sat Mar 20 09:44:13 2010 From: dmorissette at mapgears.com (Daniel Morissette) Date: Sat, 20 Mar 2010 12:44:13 -0400 Subject: [mapserver-users] MapServer 5.6.2 released Message-ID: <4BA4FB5D.6010005@mapgears.com> The MapServer team is pleased to announce the release of MapServer version 5.6.2. No new functionality has been added. This is a maintenance release that fixes a few important issues found in 5.6.0 and 5.6.1 The list of fixes since 5.6.1 is included at the end of this message. The source code is available at: http://mapserver.org/download.html The binary distributions listed in the download page should be updated with the new release in the next few days. Version 5.6.2 (2010-03-20): --------------------------- - Check error returns from mapstring functions (#2988) - Correct mutex locking problem with rasters with no inherent georef. (#3368) - Fixed problem with isValidItem vs OGR special attributes (#3356) - Support wrap character for SVG output (#3367) - Fixed msMSSQL2008CloseConnection() to free the statement handle properly (#3244) - Fixed PHP MapScript's metadata.nextkey() that was sometimes skipping some entries on first call because the NULL arg was not properly handled (#3363) - Fixed the query handling with the MSSQL2008 driver (#3058) - Fixed swig zoomRectangle() method: the maxy in the rect object have to be < miny value (#3286) - Backport fix for SLD filters column names detection (#3052) - Backport fix for WFS OGC filters regex tests (#3289) - Fix crash with GRID layers with no classes (#3352) - Avoid memory error when building SQL bbox (#3324) - Determine PgSQL version in a more backwards compatible way (#3291) - Implemented RFC 52 LayerResultsGetShape support for OGR connection type. (#3069) - Fixed problem with the oracle driver w/FUNCTION=NONE (#3260) - Got rid of invalid warning about missing EPSG proj in WMS GetCapabilities when map has a valid EPSG proj, but layer doesn't (#2028) - Correct one pass query problems and OGC filter query (#3305) - Correct QueryByOperator (#3346) From manojmadushantha at yahoo.com Sat Mar 20 19:48:28 2010 From: manojmadushantha at yahoo.com (Manoj Madushantha) Date: Sat, 20 Mar 2010 19:48:28 -0700 (PDT) Subject: [mapserver-users] Welcome to the "mapserver-users" mailing list Message-ID: <57252.65639.qm@web113110.mail.gq1.yahoo.com> manojmadushantha at yahoo.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From dmorissette at mapgears.com Sun Mar 21 10:10:39 2010 From: dmorissette at mapgears.com (Daniel Morissette) Date: Sun, 21 Mar 2010 13:10:39 -0400 Subject: [mapserver-users] Re: MapServer 5.6.2 released In-Reply-To: <4BA4FB5D.6010005@mapgears.com> References: <4BA4FB5D.6010005@mapgears.com> Message-ID: <4BA6530F.9050805@mapgears.com> Hi everyone, An issue has been reported with PostGIS layers in 5.6.2, and I suspect most uses of postgis layers in projected coordinates (i.e. except for lat,lon in degrees) will produce a fatal error. More details here: http://trac.osgeo.org/mapserver/ticket/3324#comment:5 I will release 5.6.3 as soon as we have a confirmed fix, so I'd recommend that you wait before upgrading. Sorry about this Daniel Daniel Morissette wrote: > The MapServer team is pleased to announce the release of MapServer > version 5.6.2. > > No new functionality has been added. This is a maintenance release that > fixes a few important issues found in 5.6.0 and 5.6.1 The list of fixes > since 5.6.1 is included at the end of this message. > > The source code is available at: > > http://mapserver.org/download.html > > The binary distributions listed in the download page should be updated > with the new release in the next few days. > > > Version 5.6.2 (2010-03-20): > --------------------------- > > - Check error returns from mapstring functions (#2988) > > - Correct mutex locking problem with rasters with no inherent georef. > (#3368) > > - Fixed problem with isValidItem vs OGR special attributes (#3356) > > - Support wrap character for SVG output (#3367) > > - Fixed msMSSQL2008CloseConnection() to free the statement handle > properly (#3244) > > - Fixed PHP MapScript's metadata.nextkey() that was sometimes skipping some > entries on first call because the NULL arg was not properly handled > (#3363) > > - Fixed the query handling with the MSSQL2008 driver (#3058) > > - Fixed swig zoomRectangle() method: the maxy in the rect object have to > be < miny value (#3286) > > - Backport fix for SLD filters column names detection (#3052) > > - Backport fix for WFS OGC filters regex tests (#3289) > > - Fix crash with GRID layers with no classes (#3352) > > - Avoid memory error when building SQL bbox (#3324) > > - Determine PgSQL version in a more backwards compatible way (#3291) > > - Implemented RFC 52 LayerResultsGetShape support for OGR connection > type. (#3069) > > - Fixed problem with the oracle driver w/FUNCTION=NONE (#3260) > > - Got rid of invalid warning about missing EPSG proj in WMS GetCapabilities > when map has a valid EPSG proj, but layer doesn't (#2028) > > - Correct one pass query problems and OGC filter query (#3305) > > - Correct QueryByOperator (#3346) > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users -- Daniel Morissette http://www.mapgears.com/ From paulborodaev at gmail.com Sun Mar 21 15:31:46 2010 From: paulborodaev at gmail.com (BrainDrain) Date: Sun, 21 Mar 2010 14:31:46 -0800 (PST) Subject: [mapserver-users] ONE PASS QUERY (RFC 52) - FEATURE OR BUG? Message-ID: <1269210706677-4775048.post@n2.nabble.com> Please read carefully. 'old style' (two pass) query advantages: - in mapscript (c#) layer's query methods are CUMULATIVE (relative to other layer's queries). Query result (success/failure) has no effect on other layers when I call map.savequery. - In this case (query file contains just oid's) - I CAN create COMPLEX queries by applying different parameters and mixing query types - Query result is oid (or row index in shapefile) - it's cool for creating advanced attr. postqueries and disadvantages (insignificant): - query binary (closed) format? no output to string (only to file) - query file sensitive to layer indexes (map file cleanups/refinements/some normalization can cause query file incompatibility) - if server data changed refreshing map image by old url to cgi with queryfile parameter doesn't perform requery (need custom http handler/module) AND ONE PASS QUERY (RFC 52) advantages: - open query file format - speedup (no random access) disadvantages (huge): - layer's query methods are NOT CUMULATIVE (relative to other layer's queries). I CAN'T create COMPLEX queries (by using different attribute/spatial queries (metadata driven) for different layers)! - query result - some (shape)indexes and when I'm querying many layers in sequence I NEED TO PRESERVE QUERY FILE FOR EVERY LAYER (on success result) (!) and than on feature attributes (for some layer) demand (delayed request - its a normal behavior, for. ex I'm requesting only shape names for some layer which has results - to build results tree) I NEED to REQUERY this layer by using preserver file! DAMN! - there is no way to completely reproduce old mapscript behavior: 1. I need to determine primary key ("id") field name (for ex. search for "USING UNIQUE") - no need before! 2. I need to retrieve all attributes (put to some cache) by resultsGetShape to get right oid - it's not time saving operation - no need before! 3. I need to rerequest (!) feature attributes (or extract from custom cache) by layer.getFeature BUT for shapefiles this function implementation uses internal index (row position) - no id attribute (!) - and there is no function to get it! 4. NO WAY TO REPRODUCE COMPLEX QUERYING BY USING QUERYFILE CGI PARAMETER! (Am I right?) _________________________________________________________________________________________ To SPEED UP random access in old style querying I was able to use "IN (...)" operator (I suppose that most time critical web apps uses postgis/ms sql spatial/oracle spatial which supports it) As for pt. 4: at this time I decided to output every layer query results to postgis service table (with session_id, map_id, layer_id, class_id, feature_id, geometry of any type (should I preserve attributes in a BLOB?)) and to handle data from this layer with 3 service map file layers (point/line/polygon) which populates dynamically (copying class styles with replaced colors for highlighting + using layer filter expression + using class expressions). I can shrink service table once in a month to support old session map files/url's. But I've created web UI to update data from browser (drawing, attribute editing) - so I need to update service table entries if corresponding object was updated (if I wand to see actual selection objects) I'm Disappointed.... -- View this message in context: http://n2.nabble.com/ONE-PASS-QUERY-RFC-52-FEATURE-OR-BUG-tp4775048p4775048.html Sent from the Mapserver - User mailing list archive at Nabble.com. From paulborodaev at gmail.com Mon Mar 22 00:46:10 2010 From: paulborodaev at gmail.com (BrainDrain) Date: Sun, 21 Mar 2010 23:46:10 -0800 (PST) Subject: [mapserver-users] Re: Cannot get a PostGIS layer to render in Mapserver... In-Reply-To: <1269233292741-4776199.post@n2.nabble.com> References: <1269233292741-4776199.post@n2.nabble.com> Message-ID: <1269243970020-4776602.post@n2.nabble.com> I think you didn't not install postgis extensions correctly (You need for ex. function force_ 2d(geography)). Or your postgis version is lower than 1.3.5 (PostGIS adds support for geographic objects). -- View this message in context: http://n2.nabble.com/Cannot-get-a-PostGIS-layer-to-render-in-Mapserver-tp4776199p4776602.html Sent from the Mapserver - User mailing list archive at Nabble.com. From sb.ray at hotmail.com Mon Mar 22 02:26:39 2010 From: sb.ray at hotmail.com (sunny74) Date: Mon, 22 Mar 2010 01:26:39 -0800 (PST) Subject: [mapserver-users] mapserver not generating proper map Message-ID: <1269249999717-4776875.post@n2.nabble.com> Hi, I am generating a simple map but mapserver is not generating a proper map. In fact initially it produced a proper one but after that due to code changes or some other reason started producing this one. My code to call mapserver is: and my map file is: # Map file created from QGIS project file D:/QGIS/newwr.qgs # Edit this file to customize for your map interface # (Created with PyQgis MapServer Export plugin) MAP NAME newwr.map # Map image size SIZE 600 600 UNITS dd EXTENT 67.440106 17.379867 78.390250 25.122977 FONTSET 'D:\ms4w\Apache\cgi-bin\Shape\font.txt' PROJECTION 'proj=longlat' 'ellps=WGS84' 'datum=WGS84' 'no_defs' '' END # Background color for the map canvas -- change as desired IMAGECOLOR 192 192 192 IMAGEQUALITY 95 IMAGETYPE gif OUTPUTFORMAT NAME GIF DRIVER 'GD/gif' MIMETYPE 'image/gif' #IMAGEMODE PC256 EXTENSION 'gif' END # Legend LEGEND IMAGECOLOR 255 255 255 STATUS ON KEYSIZE 18 12 LABEL TYPE BITMAP SIZE MEDIUM COLOR 0 0 89 END END # Web interface definition. Only the template parameter # is required to display a map. See MapServer documentation WEB # Set IMAGEPATH to the path where MapServer should # write its output. IMAGEPATH '/tmp/' # Set IMAGEURL to the url that points to IMAGEPATH # as defined in your web server configuration IMAGEURL '/tmp/' # WMS server settings METADATA 'wms_title' 'newwr.map' 'wms_onlineresource' 'http://my.host.com/cgi-bin/mapserv?map=wms.map&' 'wms_srs' 'EPSG:4326' END #Scale range at which web interface will operate # Template and header/footer settings # Only the template parameter is required to display a map. See MapServer documentation END LAYER NAME 'STATE' TYPE POLYGON DATA 'D:\ms4w\Apache\cgi-bin\Shape\STATE.shp' METADATA 'wms_title' 'STATE' END STATUS DEFAULT TRANSPARENCY 100 PROJECTION 'proj=longlat' 'ellps=WGS84' 'datum=WGS84' 'no_defs' '' END CLASS NAME 'STATE' STYLE SYMBOL 0 SIZE 2 OUTLINECOLOR 0 0 0 COLOR 255 255 127 END END END LAYER NAME 'WaterBody' TYPE POLYGON DATA 'D:\ms4w\Apache\cgi-bin\Shape\WaterBody.shp' METADATA But when my map comes up it is having a BBOX size of 256 * 256. the url of the generated map is as follows: http://172.16.0.144:9000/cgi-bin/mapserv.exe?MAP=Shape%2Fnewwr1.map&LAYERS=STATE&FORMAT=png&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&SRS=EPSG%3A4326&BBOX=0,-90,180,90&WIDTH=256&HEIGHT=256 Why does it happen? Is it because of some wrong openlayers code I have written or some bug? What should I do to get back to the desired size i.e 600 * 600 Thanks for your attention & efforts. -- View this message in context: http://n2.nabble.com/mapserver-not-generating-proper-map-tp4776875p4776875.html Sent from the Mapserver - User mailing list archive at Nabble.com. From paulborodaev at gmail.com Mon Mar 22 04:25:34 2010 From: paulborodaev at gmail.com (BrainDrain) Date: Mon, 22 Mar 2010 03:25:34 -0800 (PST) Subject: [mapserver-users] Re: mapserver not generating proper map In-Reply-To: <1269249999717-4776875.post@n2.nabble.com> References: <1269249999717-4776875.post@n2.nabble.com> Message-ID: <1269257134738-4777049.post@n2.nabble.com> map = new OpenLayers.Map('<%=map.ClientID%>', {tileSize: new OpenLayers.Size(600,600)}); or layer.tileSize=new OpenLayers.Size(600,600); layer.imageSize = layer.tileSize; -- View this message in context: http://n2.nabble.com/mapserver-not-generating-proper-map-tp4776875p4777049.html Sent from the Mapserver - User mailing list archive at Nabble.com. From phalguni.pal at gmail.com Mon Mar 22 06:04:53 2010 From: phalguni.pal at gmail.com (Phalguni Pal) Date: Mon, 22 Mar 2010 14:04:53 +0100 Subject: [mapserver-users] List of color combination in MapServer Message-ID: Hi friends, 1. Could you anybody tell me where can I get the list of some standard MapServer colors with color mames, like: COLOR 0 0 0 --------> Black COLOR 255 0 0 ------> Red COLOR -1 -1 -1 -------> light blue etc. 2. How to fill a hollow square with two diffetent colors (50-50%)? Thanking you. With regards, -- // Phalguni -------------- next part -------------- An HTML attachment was scrubbed... URL: From dejan.gambin at coin.hr Mon Mar 22 03:56:51 2010 From: dejan.gambin at coin.hr (Dejan Gambin) Date: Mon, 22 Mar 2010 11:56:51 +0100 Subject: [mapserver-users] Error showing tracks from gpx file Message-ID: <6E9912E5-4CFB-4A5B-8900-ED492D5E3C2D@coin.hr> Hi, I am trying to show data from gpx file using Mapserver. I can successfully show "track_points" layer but when trying with "tracks" layer, which is "multi line string" with one feature only, I get: msOGRFileNextShape(): IllegalArgumentException: point array must contain 0 or >1 elements here is the relevant part of mapfile: LAYER NAME "gpx_test" TYPE LINE STATUS DEFAULT CONNECTIONTYPE OGR CONNECTION "test.gpx" DATA "tracks" PROJECTION "init=epsg:4326" END METADATA "DESCRIPTION" "GPX Test" END CLASS Name 'Track points' OUTLINECOLOR 0 0 0 SYMBOL 'circle' SIZE 2 TEMPLATE void END # Class END thanks very much regards, dejan From aboudreault at mapgears.com Mon Mar 22 09:04:09 2010 From: aboudreault at mapgears.com (Alan Boudreault) Date: Mon, 22 Mar 2010 12:04:09 -0400 Subject: [mapserver-users] Map file xsl transformation and regular expressions In-Reply-To: References: <201003191449.54473.aboudreault@mapgears.com> Message-ID: <201003221204.09912.aboudreault@mapgears.com> Alexandre, could you test the new xsl file and see if your two issues have been fixed. You can get it via: http://trac.osgeo.org/mapserver/browser/trunk/mapserver/xmlmapfile/mapfile.xsl?format=raw I did a quick fix to integrate it in MS 5.6.3, which is supposed to be released today. expression/filter examples: 583 or 583 will be quoted. /.../ and (...) will not be quoted. symbol examples: star.gif will be quoted 32 will not be quoted Thanks, Alan On March 19, 2010 02:59:17 pm Alexandre Soares wrote: > The symbol attribute (which does not get quoted by default) causes a > problem if the value references a stmbol's name. I think it could also > benefit from your fix. > > Thank you! > On Fri, Mar 19, 2010 at 2:49 PM, Alan Boudreault > > wrote: > > Alexandre, you are right, if the expression is an regular expression, it > > shouldn't be quoted. I think the only solution would be to add an > > attribute in > > the xml schema, that will specify if the expression is an regular > > expression > > of not. Something like: > > > > > > > > In this case, the xsl transformation would not quote it. I take a note on > > that > > and should fix this in the next few days. > > > > Thanks for reporting! > > Alan > > > > On March 19, 2010 02:21:45 pm Alexandre Soares wrote: > > > Hi, > > > > > > When I transform my xml map file to a map file, my expressions that > > > > contain > > > > > a regular expression (the same is true for filters) are rendered with > > > double quotes (because the stylesheet has the quote="1" param for > > > those templates). > > > > > > Is there an intended way to achieve this? I know I could modify the > > > stylesheet to not quote those elements and then quote-wrap my value if > > > I need them (in case of string comparison). > > > > > > Thank you! > > > > -- > > Alan Boudreault > > Mapgears > > http://www.mapgears.com > -- Alan Boudreault Mapgears http://www.mapgears.com From woodbri at swoodbridge.com Mon Mar 22 10:08:21 2010 From: woodbri at swoodbridge.com (Stephen Woodbridge) Date: Mon, 22 Mar 2010 12:08:21 -0500 Subject: [mapserver-users] List of color combination in MapServer In-Reply-To: References: Message-ID: <4BA7A405.8040809@swoodbridge.com> Phalguni Pal wrote: > Hi friends, > > 1. Could you anybody tell me where can I get the list of some standard > MapServer colors with color mames, like: > > COLOR 0 0 0 --------> Black > COLOR 255 0 0 ------> Red > COLOR -1 -1 -1 -------> light blue These are standard RGB values for colors, except -1 -1 -1 means no color so what ever is already displayed will not be over written. You can also use syntax like: COLOR "#000000" COLOR "#FF0000" etc. > etc. > 2. How to fill a hollow square with two diffetent colors (50-50%)? http://mapserver.org/documentation.html Specificaly look at: # Cartographic Symbol Construction with MapServer # Symbology Examples -Steve W > Thanking you. > With regards, > > -- > // Phalguni > > > ------------------------------------------------------------------------ > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users From jasonbeverage at gmail.com Mon Mar 22 09:10:54 2010 From: jasonbeverage at gmail.com (Jason Beverage) Date: Mon, 22 Mar 2010 12:10:54 -0400 Subject: [mapserver-users] Memory Leaks with Python Mapscript? Message-ID: <2c4bbbeb1003220910r1c10f980l56cf564c89473967@mail.gmail.com> Hi all, I'm using Python mapscript to generate map tiles similar to the way that TileCache does and I think I'm running into some memory leaks. I'm generating my mapObj and layerObj on the fly based on contents of our database. If I let my seed process run for a very long time, the memory use seems to grow and grow. I've seen recommendations on the TileCache page to avoid using Mapscript b/c of memory leaks and even a note on the mapserver users list saying that the Python bindings "tend to leak like a sieve". (http://www.mail-archive.com/mapserver-users at lists.osgeo.org/msg05821.html). My process is pretty simple, create a new mapObj, add some layerObj's to it, draw the image, and repeate. I'm using MapServer/MapScript 5.6.1 and GDAL 1.6.3. If anyone has any tips to avoid leaking mem it would be much appreciated! Thanks, Jason From dmorissette at mapgears.com Mon Mar 22 09:53:41 2010 From: dmorissette at mapgears.com (Daniel Morissette) Date: Mon, 22 Mar 2010 12:53:41 -0400 Subject: [mapserver-users] List of color combination in MapServer In-Reply-To: <4BA7A405.8040809@swoodbridge.com> References: <4BA7A405.8040809@swoodbridge.com> Message-ID: <4BA7A095.3000502@mapgears.com> Stephen Woodbridge wrote: > Phalguni Pal wrote: >> Hi friends, >> >> 1. Could you anybody tell me where can I get the list of some standard >> MapServer colors with color mames, like: >> >> COLOR 0 0 0 --------> Black >> COLOR 255 0 0 ------> Red >> COLOR -1 -1 -1 -------> light blue > > These are standard RGB values for colors, except -1 -1 -1 means no color > so what ever is already displayed will not be over written. > > You can also use syntax like: > > COLOR "#000000" > COLOR "#FF0000" > See also: http://en.wikipedia.org/wiki/Web_colors Daniel -- Daniel Morissette http://www.mapgears.com/ From jt at mapmedia.de Mon Mar 22 09:55:23 2010 From: jt at mapmedia.de (=?ISO-8859-1?Q?J=F6rg_Thomsen?=) Date: Mon, 22 Mar 2010 17:55:23 +0100 Subject: [mapserver-users] keyimage / getlegendgraphic Message-ID: <4BA7A0FB.80708@mapmedia.de> huhu, does really nobody have an idea how to solve this? :( > since an update from mapserver 4.x to 5.6 we have a problem with the > keyimage of rasterlayers. The keyimage is unusually large, but with > the old version it worked. > > the original imagine is 451*1949 px the keysize in the mapfile is > given with >> KEYSIZE 450 1950 > > The image which is now delivered has a size of 472*1960px, most of > this picture is white canvas, the original graphic is very small and > placed at the lower left corner. > > Any suggestions? I found an older post meanwhile, so I am not the only one having this problem: http://lists.osgeo.org/pipermail/mapserver-users/2009-December/063947.html Regards, J?rg From asoares1 at gmail.com Mon Mar 22 11:56:16 2010 From: asoares1 at gmail.com (Alexandre Soares) Date: Mon, 22 Mar 2010 14:56:16 -0400 Subject: [mapserver-users] Map file xsl transformation and regular expressions In-Reply-To: <201003221204.09912.aboudreault@mapgears.com> References: <201003191449.54473.aboudreault@mapgears.com> <201003221204.09912.aboudreault@mapgears.com> Message-ID: Hi Alan, I found one small bug: the default value of expressionType complex type is 'CONSTANT'. However, the stylesheet will only quote if the value of the attribute is equal to 'CONSTANT', which is not if you don't supply a value for this attribute. All other cases seem to work fine. That is, 583 will not be quoted with the current stylesheet. Thanks! On Mon, Mar 22, 2010 at 12:04 PM, Alan Boudreault wrote: > Alexandre, could you test the new xsl file and see if your two issues have > been fixed. You can get it via: > > http://trac.osgeo.org/mapserver/browser/trunk/mapserver/xmlmapfile/mapfile.xsl?format=raw > > I did a quick fix to integrate it in MS 5.6.3, which is supposed to be > released today. > > expression/filter examples: > 583 or > 583 > will be quoted. > /.../ and > (...) will not be quoted. > > symbol examples: > star.gif will be quoted > 32 will not be quoted > > Thanks, > Alan > > On March 19, 2010 02:59:17 pm Alexandre Soares wrote: > > The symbol attribute (which does not get quoted by default) causes a > > problem if the value references a stmbol's name. I think it could also > > benefit from your fix. > > > > Thank you! > > On Fri, Mar 19, 2010 at 2:49 PM, Alan Boudreault > > > > wrote: > > > Alexandre, you are right, if the expression is an regular expression, > it > > > shouldn't be quoted. I think the only solution would be to add an > > > attribute in > > > the xml schema, that will specify if the expression is an regular > > > expression > > > of not. Something like: > > > > > > > > > > > > In this case, the xsl transformation would not quote it. I take a note > on > > > that > > > and should fix this in the next few days. > > > > > > Thanks for reporting! > > > Alan > > > > > > On March 19, 2010 02:21:45 pm Alexandre Soares wrote: > > > > Hi, > > > > > > > > When I transform my xml map file to a map file, my expressions that > > > > > > contain > > > > > > > a regular expression (the same is true for filters) are rendered with > > > > double quotes (because the stylesheet has the quote="1" param for > > > > those templates). > > > > > > > > Is there an intended way to achieve this? I know I could modify the > > > > stylesheet to not quote those elements and then quote-wrap my value > if > > > > I need them (in case of string comparison). > > > > > > > > Thank you! > > > > > > -- > > > Alan Boudreault > > > Mapgears > > > http://www.mapgears.com > > > > -- > Alan Boudreault > Mapgears > http://www.mapgears.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From aboudreault at mapgears.com Mon Mar 22 12:17:27 2010 From: aboudreault at mapgears.com (Alan Boudreault) Date: Mon, 22 Mar 2010 15:17:27 -0400 Subject: [mapserver-users] Map file xsl transformation and regular expressions In-Reply-To: References: <201003221204.09912.aboudreault@mapgears.com> Message-ID: <201003221517.27191.aboudreault@mapgears.com> It's fixed. The new xslt will be in MapServer 5.6.3. Thanks, Alan On March 22, 2010 02:56:16 pm Alexandre Soares wrote: > Hi Alan, > > I found one small bug: the default value of expressionType complex type is > 'CONSTANT'. However, the stylesheet will only quote if the value of the > attribute is equal to 'CONSTANT', which is not if you don't supply a value > for this attribute. All other cases seem to work fine. That > is, 583 will not be quoted with the current > stylesheet. > > Thanks! > > On Mon, Mar 22, 2010 at 12:04 PM, Alan Boudreault > > wrote: > > Alexandre, could you test the new xsl file and see if your two issues > > have been fixed. You can get it via: > > > > http://trac.osgeo.org/mapserver/browser/trunk/mapserver/xmlmapfile/mapfil > >e.xsl?format=raw > > > > I did a quick fix to integrate it in MS 5.6.3, which is supposed to be > > released today. > > > > expression/filter examples: > > 583 or > > 583 > > will be quoted. > > /.../ and > > (...) will not be quoted. > > > > symbol examples: > > star.gif will be quoted > > 32 will not be quoted > > > > Thanks, > > Alan > > > > On March 19, 2010 02:59:17 pm Alexandre Soares wrote: > > > The symbol attribute (which does not get quoted by default) causes a > > > problem if the value references a stmbol's name. I think it could also > > > benefit from your fix. > > > > > > Thank you! > > > On Fri, Mar 19, 2010 at 2:49 PM, Alan Boudreault > > > > > > wrote: > > > > Alexandre, you are right, if the expression is an regular expression, > > > > it > > > > > > shouldn't be quoted. I think the only solution would be to add an > > > > attribute in > > > > the xml schema, that will specify if the expression is an regular > > > > expression > > > > of not. Something like: > > > > > > > > > > > > > > > > In this case, the xsl transformation would not quote it. I take a > > > > note > > > > on > > > > > > that > > > > and should fix this in the next few days. > > > > > > > > Thanks for reporting! > > > > Alan > > > > > > > > On March 19, 2010 02:21:45 pm Alexandre Soares wrote: > > > > > Hi, > > > > > > > > > > When I transform my xml map file to a map file, my expressions that > > > > > > > > contain > > > > > > > > > a regular expression (the same is true for filters) are rendered > > > > > with double quotes (because the stylesheet has the quote="1" param > > > > > for those templates). > > > > > > > > > > Is there an intended way to achieve this? I know I could modify the > > > > > stylesheet to not quote those elements and then quote-wrap my value > > > > if > > > > > > > I need them (in case of string comparison). > > > > > > > > > > Thank you! > > > > > > > > -- > > > > Alan Boudreault > > > > Mapgears > > > > http://www.mapgears.com > > > > -- > > Alan Boudreault > > Mapgears > > http://www.mapgears.com > -- Alan Boudreault Mapgears http://www.mapgears.com From sb.ray at hotmail.com Mon Mar 22 12:31:20 2010 From: sb.ray at hotmail.com (sunny74) Date: Mon, 22 Mar 2010 11:31:20 -0800 (PST) Subject: [mapserver-users] Re: mapserver not generating proper map In-Reply-To: <1269257134738-4777049.post@n2.nabble.com> References: <1269249999717-4776875.post@n2.nabble.com> <1269257134738-4777049.post@n2.nabble.com> Message-ID: <1269286280502-4779918.post@n2.nabble.com> Hi BrainDrain, Thanks for your reply. Your solution doesn't work. the code relating to the info control is the culprit. It started giving errors, then I commented it but after that the map was not getting displayed. Finally after a lot of effort I got the map but with problems stated earlier. After applying your code I find that the background is occupying 600 * 600 but the actual layers are coming small even though magnification level is 6 or more. I think it is Openlayer 2.8 which is causing the problem.So I need to go back to OL2.7. But then is it possible to hav Get Feature Info in 2.7 from shape files? If you know how to do it pls send code across. -- View this message in context: http://n2.nabble.com/mapserver-not-generating-proper-map-tp4776875p4779918.html Sent from the Mapserver - User mailing list archive at Nabble.com. From paulborodaev at gmail.com Mon Mar 22 13:57:30 2010 From: paulborodaev at gmail.com (BrainDrain) Date: Mon, 22 Mar 2010 12:57:30 -0800 (PST) Subject: [mapserver-users] Re: mapserver not generating proper map In-Reply-To: <1269286280502-4779918.post@n2.nabble.com> References: <1269249999717-4776875.post@n2.nabble.com> <1269257134738-4777049.post@n2.nabble.com> <1269286280502-4779918.post@n2.nabble.com> Message-ID: <1269291450348-4780393.post@n2.nabble.com> If layer hasn't tilesSize/imageSize options it copies from map.baseLayer/map Did you set tileSize for map and every layer? What do you mean background (it's just a one layer)? I'm using OL 2.8 for a long time with raster base layers and transparent vector layer (both from mapserver) and I have no problems. OL getURL function result independent from level both for wms and mapserver layers -- View this message in context: http://n2.nabble.com/mapserver-not-generating-proper-map-tp4776875p4780393.html Sent from the Mapserver - User mailing list archive at Nabble.com. From yassefa at dmsolutions.ca Mon Mar 22 14:10:33 2010 From: yassefa at dmsolutions.ca (Yewondwossen Assefa) Date: Mon, 22 Mar 2010 17:10:33 -0400 Subject: [mapserver-users] keyimage / getlegendgraphic In-Reply-To: <4BA7A0FB.80708@mapmedia.de> References: <4BA7A0FB.80708@mapmedia.de> Message-ID: <4BA7DCC9.2040109@dmsolutions.ca> J?rg, bug related to this is http://trac.osgeo.org/mapserver/ticket/3398. It should be fixed in trunk regards, J?rg Thomsen wrote: > huhu, > > does really nobody have an idea how to solve this? :( > >> since an update from mapserver 4.x to 5.6 we have a problem with the >> keyimage of rasterlayers. The keyimage is unusually large, but with >> the old version it worked. >> >> the original imagine is 451*1949 px the keysize in the mapfile is >> given with >>> KEYSIZE 450 1950 >> >> The image which is now delivered has a size of 472*1960px, most of >> this picture is white canvas, the original graphic is very small and >> placed at the lower left corner. >> >> Any suggestions? > > I found an older post meanwhile, so I am not the only one having this > problem: > http://lists.osgeo.org/pipermail/mapserver-users/2009-December/063947.html > > > Regards, J?rg > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > -- ---------------------------------------------------------------- Assefa Yewondwossen Software Analyst Email: assefa at dmsolutions.ca http://www.dmsolutions.ca/ Phone: (613) 565-5056 (ext 14) Fax: (613) 565-0925 ---------------------------------------------------------------- From szekerest at gmail.com Mon Mar 22 16:30:52 2010 From: szekerest at gmail.com (Tamas Szekeres) Date: Tue, 23 Mar 2010 00:30:52 +0100 Subject: [mapserver-users] ONE PASS QUERY (RFC 52) - FEATURE OR BUG? In-Reply-To: <1269210706677-4775048.post@n2.nabble.com> References: <1269210706677-4775048.post@n2.nabble.com> Message-ID: Hi, I second to these concerns, absolutely. With regards to RFC 52 there have been a couple of breaking changes in MapServer 5.6 which prevents me from upgrading to this version in my existing projects. I've already tried to ring the bell in this topic with a couple of posts (see below), but it seems the use case described here (as keeping long term mapObj references) is not widely used and falls ouside of the general area of interest; http://n2.nabble.com/Ready-for-5-6-2-td4743344.html#a4746772 http://n2.nabble.com/OGR-single-pass-query-issues-was-Ready-for-5-6-2-td4753764.html By raising up your issues below I've studied RFC 52again to see the objectives, and it seems we are getting out of the sync with the current implementation at the drivers. In my understanding with the original approach the driver should: 1. Retain the result set of the queries at the layer (ie. in the layerinfo structure) until the layer is open and no subsequent whichShapes is called to 'invalidate' the query. 2. Provide such index in shapeObj which would allow to retieve in a subsequent resultsGetShape within the result set. 3. Retain the random access behaviour (getShape) for backward compatibility in parallel to resultsGetShape. Since the RFC doesn't contain explicit note about the opposite, the drivers should also: 4. Preserve the behaviour of keeping separate set of results for separate layer instances. In this regard a query on one layer should not invalidate the results for a different layer instance of the same driver. 5. Creating a clone of a layer should provide to use a separate query (by keeping the results intact on the original layer). This would be essential for msDrawQueryLayer to work when drawing the background before the highlighted features. 6. Using a drawQuery should not invalidate the results of a previous query. 7. Drawing the map should not invalidate the results of a previous query. Further notes: To provide correct implementations at the drivers it seems we should provide a bit more information for the driver to distinguish between the purpose of a query. For example whichShapes should take an additional parameter (querymode) with the following predefined values: MS_QUERY_SEQUENTIAL: The returned shapes will be retrieved by nextShape (no subsequent (result)getshape will happen). This would be used by the normal drawing operations. MS_QUERY_RANDOM: The results would be retrieved by nextShape. The driver would provide oid-s as feature indexes to support to retrieve the features by the original (2 pass) behaviour (getShape). No features are retained at the driver for further access. MS_QUERY_PRESERVE: The results would be retrieved by nextShape and resultsGetShape. The drivers should store the result set at the layer for further retrieval (1 pass). The features retrieved by MS_QUERY_PRESERVE should be kept in a separate location either in layerinfo or in a separate structure (a queryinfo for example). The latter would provide the isolate the results from the layer opened state. MS_QUERY_SEQUENTIAL or MS_QUERY_RANDOM should not invalidate the results in queryinfo. We should also provide the user with an option to select between the default of MS_QUERY_RANDOM/MS_QUERY_PRESERVE at layer level. Probably a layer processing option would be sufficient. Best regards, Tamas 2010/3/21 BrainDrain > > Please read carefully. > 'old style' (two pass) query > advantages: > - in mapscript (c#) layer's query methods are CUMULATIVE (relative to other > layer's queries). Query result (success/failure) has no effect on other > layers when I call map.savequery. > - In this case (query file contains just oid's) - I CAN create COMPLEX > queries by applying different parameters and mixing query types > - Query result is oid (or row index in shapefile) - it's cool for creating > advanced attr. postqueries > and disadvantages (insignificant): > - query binary (closed) format? no output to string (only to file) > - query file sensitive to layer indexes (map file cleanups/refinements/some > normalization can cause query file incompatibility) > - if server data changed refreshing map image by old url to cgi with > queryfile parameter doesn't perform requery (need custom http > handler/module) > AND ONE PASS QUERY (RFC 52) > advantages: > - open query file format > - speedup (no random access) > disadvantages (huge): > - layer's query methods are NOT CUMULATIVE (relative to other layer's > queries). I CAN'T create COMPLEX queries (by using different > attribute/spatial queries (metadata driven) for different layers)! > - query result - some (shape)indexes and when I'm querying many layers in > sequence I NEED TO PRESERVE QUERY FILE FOR EVERY LAYER (on success result) > (!) and than on feature attributes (for some layer) demand (delayed request > - its a normal behavior, for. ex I'm requesting only shape names for some > layer which has results - to build results tree) I NEED to REQUERY this > layer by using preserver file! DAMN! > - there is no way to completely reproduce old mapscript behavior: > 1. I need to determine primary key ("id") field name (for ex. search for > "USING UNIQUE") - no need before! > 2. I need to retrieve all attributes (put to some cache) by > resultsGetShape to get right oid - it's not time saving operation - no need > before! > 3. I need to rerequest (!) feature attributes (or extract from custom > cache) by layer.getFeature BUT for shapefiles this function implementation > uses internal index (row position) - no id attribute (!) - and there is no > function to get it! > 4. NO WAY TO REPRODUCE COMPLEX QUERYING BY USING QUERYFILE CGI PARAMETER! > (Am I right?) > > _________________________________________________________________________________________ > To SPEED UP random access in old style querying I was able to use "IN > (...)" > operator (I suppose that most time critical web apps uses postgis/ms sql > spatial/oracle spatial which supports it) > As for pt. 4: > at this time I decided to output every layer query results to postgis > service table (with session_id, map_id, layer_id, class_id, feature_id, > geometry of any type (should I preserve attributes in a BLOB?)) and to > handle data from this layer with 3 service map file layers > (point/line/polygon) which populates dynamically (copying class styles with > replaced colors for highlighting + using layer filter expression + using > class expressions). I can shrink service table once in a month to support > old session map files/url's. > But I've created web UI to update data from browser (drawing, attribute > editing) - so I need to update service table entries if corresponding > object > was updated (if I wand to see actual selection objects) > > I'm Disappointed.... > -- > View this message in context: > http://n2.nabble.com/ONE-PASS-QUERY-RFC-52-FEATURE-OR-BUG-tp4775048p4775048.html > Sent from the Mapserver - User mailing list archive at Nabble.com. > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > -------------- next part -------------- An HTML attachment was scrubbed... URL: From dmorissette at mapgears.com Mon Mar 22 17:33:25 2010 From: dmorissette at mapgears.com (Daniel Morissette) Date: Mon, 22 Mar 2010 20:33:25 -0400 Subject: [mapserver-users] MapServer 5.6.3 released (obsoletes 5.6.2) Message-ID: <4BA80C55.4010906@mapgears.com> The MapServer team announces the release of MapServer version 5.6.3. This release obsoletes 5.6.2 which was announced only two days ago. Unfortunately, two issues introduced in 5.6.2 made that release unusable for several use cases involving PostGIS and SDE layers, prompting us to issue a new release with those fixes. The list of fixes since in 5.6.2 and 5.6.3 is included at the end of this message. The source code is available at: http://mapserver.org/download.html The binary distributions listed in the download page should be updated with the new release in the next few days. Version 5.6.3 (2010-03-22): --------------------------- - Fixed problem with PostGIS SQL bbox introduced in 5.6.2 (#3324) - Fix backwards handling of iconv errors (w/ SDE) introduced in 5.6.2 (#2988) - Fixed XML transformation issues with expressions and symbols (#3397) Version 5.6.2 (2010-03-20): --------------------------- - Check error returns from mapstring functions (#2988) - Correct mutex locking problem with rasters with no inherent georef. (#3368) - Fixed problem with isValidItem vs OGR special attributes (#3356) - Support wrap character for SVG output (#3367) - Fixed msMSSQL2008CloseConnection() to free the statement handle properly (#3244) - Fixed PHP MapScript's metadata.nextkey() that was sometimes skipping some entries on first call because the NULL arg was not properly handled (#3363) - Fixed the query handling with the MSSQL2008 driver (#3058) - Fixed swig zoomRectangle() method: the maxy in the rect object have to be < miny value (#3286) - Backport fix for SLD filters column names detection (#3052) - Backport fix for WFS OGC filters regex tests (#3289) - Fix crash with GRID layers with no classes (#3352) - Avoid memory error when building SQL bbox (#3324) - Determine PgSQL version in a more backwards compatible way (#3291) - Implemented RFC 52 LayerResultsGetShape support for OGR connection type. (#3069) - Fixed problem with the oracle driver w/FUNCTION=NONE (#3260) - Got rid of invalid warning about missing EPSG proj in WMs GetCapabilities when map has a valid EPSG proj, but layer doesn't (#2028) - Correct one pass query problems and OGC filter query (#3305) - Correct QueryByOperator (#3346) From warmerdam at pobox.com Mon Mar 22 20:16:14 2010 From: warmerdam at pobox.com (Frank Warmerdam) Date: Mon, 22 Mar 2010 23:16:14 -0400 Subject: [mapserver-users] ONE PASS QUERY (RFC 52) - FEATURE OR BUG? In-Reply-To: References: <1269210706677-4775048.post@n2.nabble.com> Message-ID: <4BA8327E.6030900@pobox.com> Tamas Szekeres wrote: > In my understanding with the original approach the driver should: > > 1. Retain the result set of the queries at the layer (ie. in the > layerinfo structure) until the layer is open and no subsequent > whichShapes is called to 'invalidate' the query. Tamas, Your point here is that the query result should live until invalidated by another whichShapes, right? I would agree with that, but draw on a layer does do a whichShapes, right? So a draw is expected to invalidate a query, right? > 2. Provide such index in shapeObj which would allow to retieve in a > subsequent resultsGetShape within the result set. ok > 3. Retain the random access behaviour (getShape) for backward > compatibility in parallel to resultsGetShape. ok > Since the RFC doesn't contain explicit note about the opposite, the > drivers should also: > > 4. Preserve the behaviour of keeping separate set of results for > separate layer instances. In this regard a query on one layer should not > invalidate the results for a different layer instance of the same driver. This seems to be a lot to expect. We go to significant effort with the connection pooling to allow reuse of a connection for different layers, and in effect in many drivers this connection also carries a bunch of context with it. Certainly in the case of OGR an OGRLayer retains a concept of current query result, but it can be invalidated by lots of operations other than ResetReading() and GetNextFeature(). I would imagine this is true to a greater or lesser to other drivers that pool connections. > 5. Creating a clone of a layer should provide to use a separate query > (by keeping the results intact on the original layer). This would be > essential for msDrawQueryLayer to work when drawing the background > before the highlighted features. This is also quite impractical for some implementations - certainly for OGR. > 6. Using a drawQuery should not invalidate the results of a previous query. I don't know much about drawQuery but it does seem plausible to ask that drawQuery should not invalidate the query it is drawing. > 7. Drawing the map should not invalidate the results of a previous query. But drawing maps uses the feature access machinery like whichShapes doesn't it? How can we expect map drawing not to invalidate a query? In retrospect, I'm not all that confident that we really considered the impact of RFC 52 on use cases such as those you raise. I certainly didn't understand these impacts. What is less clear to me is where to go from here. RFC 52 was put in place because the old approach was giving terrible performance in some cases. But if we put the expectations you list into place there is no way it can be made fast on OGR short of maintaining distinct OGRDataset instances for each query in addition to the one used to draw the layer. This could cause various performance and resource problems. Best regards, -- ---------------------------------------+-------------------------------------- I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com light and sound - activate the windows | http://pobox.com/~warmerdam and watch the world go round - Rush | Geospatial Programmer for Rent From info at laudontech.com Mon Mar 22 20:57:49 2010 From: info at laudontech.com (mapper99) Date: Mon, 22 Mar 2010 19:57:49 -0800 (PST) Subject: [mapserver-users] Re: Cannot get a PostGIS layer to render in Mapserver... In-Reply-To: <1269243970020-4776602.post@n2.nabble.com> References: <1269233292741-4776199.post@n2.nabble.com> <1269243970020-4776602.post@n2.nabble.com> Message-ID: <1269316669681-4782272.post@n2.nabble.com> I am running PostGIS 1.5 for PostgreSQL 8.4. It appears the force_2d function is available: -- Function: force_2d(geometry) -- DROP FUNCTION force_2d(geometry); CREATE OR REPLACE FUNCTION force_2d(geometry) RETURNS geometry AS '$libdir/postgis-1.5', 'LWGEOM_force_2d' LANGUAGE 'c' IMMUTABLE STRICT COST 1; ALTER FUNCTION force_2d(geometry) OWNER TO postgres; Is there any other way to test this? -- View this message in context: http://n2.nabble.com/Cannot-get-a-PostGIS-layer-to-render-in-Mapserver-tp4776199p4782272.html Sent from the Mapserver - User mailing list archive at Nabble.com. From Steve.Lime at state.mn.us Mon Mar 22 21:21:43 2010 From: Steve.Lime at state.mn.us (Lime, Steve D (DNR)) Date: Mon, 22 Mar 2010 23:21:43 -0500 Subject: [mapserver-users] ONE PASS QUERY (RFC 52) - FEATURE OR BUG? In-Reply-To: <4BA8327E.6030900@pobox.com> References: <1269210706677-4775048.post@n2.nabble.com> , <4BA8327E.6030900@pobox.com> Message-ID: I think we're in need of a RFC 52a. Clearly the compound query handling the old approach afforded is of value to a group of users and that wasn't accounted for in the initial RFC. The work around Assefa had to do with WFS and a certain subset of OGC filters at the sprint is evidence that the approach was even used in the core code (I wasn't aware of that at the time). We (in 5.6.3) developed a work around that retains two sets of indexes one suitable for random access and one for a specific result set (e.g. cursor). It uses the already present tileindex property of a shapeObj to store the latter. I think we can have the best of both here by storing the two indexes and potentially we can revert to a single getShape() function in MapScript and revive the old queryfile format as a option as well. Just needs to be planned for now that the full impacts are better understood. Steve ________________________________________ From: mapserver-users-bounces at lists.osgeo.org [mapserver-users-bounces at lists.osgeo.org] On Behalf Of Frank Warmerdam [warmerdam at pobox.com] Sent: Monday, March 22, 2010 10:16 PM To: Tamas Szekeres Cc: mapserver-users at lists.osgeo.org; BrainDrain Subject: Re: [mapserver-users] ONE PASS QUERY (RFC 52) - FEATURE OR BUG? Tamas Szekeres wrote: > In my understanding with the original approach the driver should: > > 1. Retain the result set of the queries at the layer (ie. in the > layerinfo structure) until the layer is open and no subsequent > whichShapes is called to 'invalidate' the query. Tamas, Your point here is that the query result should live until invalidated by another whichShapes, right? I would agree with that, but draw on a layer does do a whichShapes, right? So a draw is expected to invalidate a query, right? > 2. Provide such index in shapeObj which would allow to retieve in a > subsequent resultsGetShape within the result set. ok > 3. Retain the random access behaviour (getShape) for backward > compatibility in parallel to resultsGetShape. ok > Since the RFC doesn't contain explicit note about the opposite, the > drivers should also: > > 4. Preserve the behaviour of keeping separate set of results for > separate layer instances. In this regard a query on one layer should not > invalidate the results for a different layer instance of the same driver. This seems to be a lot to expect. We go to significant effort with the connection pooling to allow reuse of a connection for different layers, and in effect in many drivers this connection also carries a bunch of context with it. Certainly in the case of OGR an OGRLayer retains a concept of current query result, but it can be invalidated by lots of operations other than ResetReading() and GetNextFeature(). I would imagine this is true to a greater or lesser to other drivers that pool connections. > 5. Creating a clone of a layer should provide to use a separate query > (by keeping the results intact on the original layer). This would be > essential for msDrawQueryLayer to work when drawing the background > before the highlighted features. This is also quite impractical for some implementations - certainly for OGR. > 6. Using a drawQuery should not invalidate the results of a previous query. I don't know much about drawQuery but it does seem plausible to ask that drawQuery should not invalidate the query it is drawing. > 7. Drawing the map should not invalidate the results of a previous query. But drawing maps uses the feature access machinery like whichShapes doesn't it? How can we expect map drawing not to invalidate a query? In retrospect, I'm not all that confident that we really considered the impact of RFC 52 on use cases such as those you raise. I certainly didn't understand these impacts. What is less clear to me is where to go from here. RFC 52 was put in place because the old approach was giving terrible performance in some cases. But if we put the expectations you list into place there is no way it can be made fast on OGR short of maintaining distinct OGRDataset instances for each query in addition to the one used to draw the layer. This could cause various performance and resource problems. Best regards, -- ---------------------------------------+-------------------------------------- I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com light and sound - activate the windows | http://pobox.com/~warmerdam and watch the world go round - Rush | Geospatial Programmer for Rent _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users From pramsey at cleverelephant.ca Mon Mar 22 21:25:06 2010 From: pramsey at cleverelephant.ca (Paul Ramsey) Date: Mon, 22 Mar 2010 21:25:06 -0700 Subject: [mapserver-users] ONE PASS QUERY (RFC 52) - FEATURE OR BUG? In-Reply-To: References: <1269210706677-4775048.post@n2.nabble.com> <4BA8327E.6030900@pobox.com> Message-ID: <30fe546d1003222125i403064faq3758d20bf9b85626@mail.gmail.com> Is it better to back out to the old behaviour or would defining a filter object that allows complex query logic meet the need in a more direct way? (Ie, is running multiple queries a feature or a workaround for an even older limitation?) P. On Mon, Mar 22, 2010 at 9:21 PM, Lime, Steve D (DNR) wrote: > I think we're in need of a RFC 52a. Clearly the compound query handling the old approach afforded is of value to a group of users and that wasn't accounted for in the initial RFC. The work around Assefa had to do with WFS and a certain subset of OGC filters at the sprint is evidence that the approach was even used in the core code (I wasn't aware of that at the time). We (in 5.6.3) developed a work around that retains two sets of indexes one suitable for random access and one for a specific result set (e.g. cursor). It uses the already present tileindex property of a shapeObj to store the latter. I think we can have the best of both here by storing the two indexes and potentially we can revert to a single getShape() function in MapScript and revive the old queryfile format as a option as well. Just needs to be planned for now that the full impacts are better understood. > > Steve > ________________________________________ > From: mapserver-users-bounces at lists.osgeo.org [mapserver-users-bounces at lists.osgeo.org] On Behalf Of Frank Warmerdam [warmerdam at pobox.com] > Sent: Monday, March 22, 2010 10:16 PM > To: Tamas Szekeres > Cc: mapserver-users at lists.osgeo.org; BrainDrain > Subject: Re: [mapserver-users] ONE PASS QUERY (RFC 52) - FEATURE OR BUG? > > Tamas Szekeres wrote: >> In my understanding with the original approach the driver should: >> >> 1. Retain the result set of the queries at the layer (ie. in the >> layerinfo structure) until the layer is open and no subsequent >> whichShapes is called to 'invalidate' the query. > > Tamas, > > Your point here is that the query result should live until > invalidated by another whichShapes, right? ?I would agree with > that, but draw on a layer does do a whichShapes, right? ?So a > draw is expected to invalidate a query, right? > >> 2. Provide such index in shapeObj which would allow to retieve in a >> subsequent resultsGetShape within the result set. > > ok > >> 3. Retain the random access behaviour (getShape) for backward >> compatibility in parallel to resultsGetShape. > > ok > >> Since the RFC doesn't contain explicit note about the opposite, the >> drivers should also: >> >> 4. Preserve the behaviour of keeping separate set of results for >> separate layer instances. In this regard a query on one layer should not >> invalidate the results for a different layer instance of the same driver. > > This seems to be a lot to expect. ?We go to significant effort with > the connection pooling to allow reuse of a connection for different > layers, and in effect in many drivers this connection also carries > a bunch of context with it. ?Certainly in the case of OGR an > OGRLayer retains a concept of current query result, but it can > be invalidated by lots of operations other than ResetReading() and > GetNextFeature(). ?I would imagine this is true to a greater or > lesser to other drivers that pool connections. > >> 5. Creating a clone of a layer should provide to use a separate query >> (by keeping the results intact on the original layer). This would be >> essential for msDrawQueryLayer to work when drawing the background >> before the highlighted features. > > This is also quite impractical for some implementations - certainly > for OGR. > >> 6. Using a drawQuery should not invalidate the results of a previous query. > > I don't know much about drawQuery but it does seem plausible to ask > that drawQuery should not invalidate the query it is drawing. > >> 7. Drawing the map should not invalidate the results of a previous query. > > But drawing maps uses the feature access machinery like whichShapes > doesn't it? ?How can we expect map drawing not to invalidate a query? > > In retrospect, I'm not all that confident that we really considered > the impact of RFC 52 on use cases such as those you raise. ?I > certainly didn't understand these impacts. ?What is less clear to > me is where to go from here. ?RFC 52 was put in place because the > old approach was giving terrible performance in some cases. > But if we put the expectations you list into place there is no > way it can be made fast on OGR short of maintaining distinct > OGRDataset instances for each query in addition to the one used to > draw the layer. ?This could cause various performance and > resource problems. > > Best regards, > -- > ---------------------------------------+-------------------------------------- > I set the clouds in motion - turn up ? | Frank Warmerdam, warmerdam at pobox.com > light and sound - activate the windows | http://pobox.com/~warmerdam > and watch the world go round - Rush ? ?| Geospatial Programmer for Rent > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From paulborodaev at gmail.com Tue Mar 23 00:29:42 2010 From: paulborodaev at gmail.com (BrainDrain) Date: Mon, 22 Mar 2010 23:29:42 -0800 (PST) Subject: [mapserver-users] Re: ONE PASS QUERY (RFC 52) - FEATURE OR BUG? In-Reply-To: References: <1269210706677-4775048.post@n2.nabble.com> Message-ID: <1269329382576-4782807.post@n2.nabble.com> Tamas, thanks for your great analysis and support) I'm looking into future with hope and optimism, expecting voting for combining (switching between) methods (somehow). I suppose that good perfomance (including query drawing/processing) requirement implies choosing proper, optimized data access driver. I'm using Intergraph GeoMedia for 5-6 years: it works fine with ms sql without any spatial extensions and perfomance is very good. Profiler says that app takes only oid's and geometries (envelopes can be preserved) first and than retrieves attributes by querying using "IN (...)" operator. -- View this message in context: http://n2.nabble.com/ONE-PASS-QUERY-RFC-52-FEATURE-OR-BUG-tp4775048p4782807.html Sent from the Mapserver - User mailing list archive at Nabble.com. From paulborodaev at gmail.com Tue Mar 23 00:37:44 2010 From: paulborodaev at gmail.com (BrainDrain) Date: Mon, 22 Mar 2010 23:37:44 -0800 (PST) Subject: [mapserver-users] Re: Cannot get a PostGIS layer to render in Mapserver... In-Reply-To: <1269316669681-4782272.post@n2.nabble.com> References: <1269233292741-4776199.post@n2.nabble.com> <1269243970020-4776602.post@n2.nabble.com> <1269316669681-4782272.post@n2.nabble.com> Message-ID: <1269329864250-4782840.post@n2.nabble.com> force_2d(GEOGRAPHY)? -- View this message in context: http://n2.nabble.com/Cannot-get-a-PostGIS-layer-to-render-in-Mapserver-tp4776199p4782840.html Sent from the Mapserver - User mailing list archive at Nabble.com. From olt at omniscale.de Tue Mar 23 01:17:51 2010 From: olt at omniscale.de (Oliver Tonnhofer) Date: Tue, 23 Mar 2010 09:17:51 +0100 Subject: [mapserver-users] [ANN] MapProxy - new caching proxy for geospatial data Message-ID: Hello, This is a one-time post to announce the MapProxy project, an open source proxy for geospatial data. MapProxy caches, accelerates and transforms data from existing map servers. It is a middle-man between existing web map servers (like MapServer or GeoServer) and clients. All existing web and desktop GIS applications can be used, but also modern clients like OpenLayers and GoogleEarth. The project started late 2008 and is now available as Open Source. It is actively developed and supported by Omniscale and is released under the GNU AGPL License 3.0. The project is looking for developers and users. Features: - Accelerate WMS servers - Serve WMS/TMS/KML requests - Reproject data on-the-fly - Add watermarks/attribution - many more It is written in Python and should run on all major platforms. For more information, please come to http://mapproxy.org/ Thank you, Oliver -- Oliver Tonnhofer Omniscale - Dominik Helle, Oliver Tonnhofer GbR Nadorster Str. 60, 26123 Oldenburg Tel: +49(0)441/9392774-2 (Fax: 9) From ml at lingner.eu Tue Mar 23 07:14:22 2010 From: ml at lingner.eu (Lars Lingner) Date: Tue, 23 Mar 2010 15:14:22 +0100 Subject: [mapserver-users] compiling error current trunk and --with-wfs Message-ID: <4BA8CCBE.1060206@lingner.eu> Hello, with current trunk (r9997) I'm getting ./libmapserver.a(mapwfs.o): In function `msWFSGetCapabilities': mapwfs.c:(.text+0x57cd): undefined reference to `msOWSCommonNegotiateVersion' ./configure --with-ogr --with-proj --with-gdal --with-wfs Its compiling successfull when using ./configure --with-ogr --with-proj --with-gdal With 5.6.3. I couldn't reproduce the problem. I'm using a debian system. Can someone confirm this problem? Should I file a ticket? Lars From ml at operation-damocles.net Sat Mar 20 05:24:58 2010 From: ml at operation-damocles.net (Benjamin V.) Date: Sat, 20 Mar 2010 13:24:58 +0100 Subject: [mapserver-users] Mapserver for indoor maps Message-ID: <4BA4BE9A.2000208@operation-damocles.net> Hello there, I'm currently involved in a project where I used the OpenLayers framework to display a set of wireless nodes (as features) on a google maps layer. What I'm trying to achieve now is to do the same for an indoor testbed where I only have a "map" of the floor as a raster image (png). I want to serve this through mapserver using an arbitrary extent (I don't care much about meaningful lon/lat-values) on a single layer which I then want to integrate using an OpenLayers.Layer.MapServer I've been looking through a lot of tutorials to get an idea of how to place a raster image somewhere on a layer but couldn't find any solution that does what I need. Basically, starting off with something like this in a map file - what would I have to add to achieve what I had in mind: MAP ... LAYER NAME indoor TYPE RASTER DATA indoor_map.png STATUS DEFAULT ... END ... END Best regards, Benjamin Vahl From trindade.dev at gmail.com Tue Mar 23 05:46:55 2010 From: trindade.dev at gmail.com (Alexandre Trindade) Date: Tue, 23 Mar 2010 09:46:55 -0300 Subject: [mapserver-users] ERROR getFeature with SqlServer 2008 in layer TYPE POINT Message-ID: Hi, I have a problem when try to run the getFeature on LAYER TYPE POINT with SqlServer 2008 on Mapserver 5.6.1. On browser appears this error messages : 500 Internal Server Error any suggestions? thanks -- Alexandre Trindade PHP Programmer -------------- next part -------------- An HTML attachment was scrubbed... URL: From pramsey at cleverelephant.ca Tue Mar 23 10:56:16 2010 From: pramsey at cleverelephant.ca (Paul Ramsey) Date: Tue, 23 Mar 2010 10:56:16 -0700 Subject: [mapserver-users] Re: Cannot get a PostGIS layer to render in Mapserver... In-Reply-To: <1269329864250-4782840.post@n2.nabble.com> References: <1269233292741-4776199.post@n2.nabble.com> <1269243970020-4776602.post@n2.nabble.com> <1269316669681-4782272.post@n2.nabble.com> <1269329864250-4782840.post@n2.nabble.com> Message-ID: <30fe546d1003231056te360733m684151cc9daac11f@mail.gmail.com> I wonder if you upgraded from an older PostGIS and the upgrade did not include the geog->geom casts. What should happen (and what did happen when I tested Mapserver/geog support) was that where geog functions weren't defined, the casting behavior made things "work right". P. On Tue, Mar 23, 2010 at 12:37 AM, BrainDrain wrote: > > force_2d(GEOGRAPHY)? > -- > View this message in context: http://n2.nabble.com/Cannot-get-a-PostGIS-layer-to-render-in-Mapserver-tp4776199p4782840.html > Sent from the Mapserver - User mailing list archive at Nabble.com. > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From yassefa at dmsolutions.ca Tue Mar 23 11:06:30 2010 From: yassefa at dmsolutions.ca (Yewondwossen Assefa) Date: Tue, 23 Mar 2010 14:06:30 -0400 Subject: [mapserver-users] compiling error current trunk and --with-wfs In-Reply-To: <4BA8CCBE.1060206@lingner.eu> References: <4BA8CCBE.1060206@lingner.eu> Message-ID: <4BA90326.9060302@dmsolutions.ca> I am looking into this. Bug related to this is http://trac.osgeo.org/mapserver/ticket/3282 Lars Lingner wrote: > Hello, > > with current trunk (r9997) I'm getting > > ./libmapserver.a(mapwfs.o): In function `msWFSGetCapabilities': > mapwfs.c:(.text+0x57cd): undefined reference to > `msOWSCommonNegotiateVersion' > > ./configure --with-ogr --with-proj --with-gdal --with-wfs > > Its compiling successfull when using > > ./configure --with-ogr --with-proj --with-gdal > > > With 5.6.3. I couldn't reproduce the problem. I'm using a debian system. > > Can someone confirm this problem? Should I file a ticket? > > > Lars > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > -- ---------------------------------------------------------------- Assefa Yewondwossen Software Analyst Email: assefa at dmsolutions.ca http://www.dmsolutions.ca/ Phone: (613) 565-5056 (ext 14) Fax: (613) 565-0925 ---------------------------------------------------------------- From pramsey at cleverelephant.ca Tue Mar 23 11:10:33 2010 From: pramsey at cleverelephant.ca (Paul Ramsey) Date: Tue, 23 Mar 2010 11:10:33 -0700 Subject: [mapserver-users] Re: Cannot get a PostGIS layer to render in Mapserver... In-Reply-To: <30fe546d1003231056te360733m684151cc9daac11f@mail.gmail.com> References: <1269233292741-4776199.post@n2.nabble.com> <1269243970020-4776602.post@n2.nabble.com> <1269316669681-4782272.post@n2.nabble.com> <1269329864250-4782840.post@n2.nabble.com> <30fe546d1003231056te360733m684151cc9daac11f@mail.gmail.com> Message-ID: <30fe546d1003231110t40a3742ep9804b75fdb428133@mail.gmail.com> No, the problem is baked into PostGIS. http://trac.osgeo.org/postgis/ticket/269 Which invalidates my earlier "it just works!" finding for mapserver+geography. Great. http://blog.cleverelephant.ca/2009/11/geography-and-mapserver.html Or perhaps there's something about the earlier version of Mapserver you have that is interacting in a different way than the version I tested, since my blog post is from after the change was committed. Anyhow, you can work around it by defining explicitly casted versions of the functions you are missing: create function force_2d(geography) returns geometry as 'select force_2d(geometry($1))' language 'sql' immutable strict; P. On Tue, Mar 23, 2010 at 10:56 AM, Paul Ramsey wrote: > I wonder if you upgraded from an older PostGIS and the upgrade did not > include the geog->geom casts. What should happen (and what did happen > when I tested Mapserver/geog support) was that where geog functions > weren't defined, the casting behavior made things "work right". > > P. > > On Tue, Mar 23, 2010 at 12:37 AM, BrainDrain wrote: >> >> force_2d(GEOGRAPHY)? >> -- >> View this message in context: http://n2.nabble.com/Cannot-get-a-PostGIS-layer-to-render-in-Mapserver-tp4776199p4782840.html >> Sent from the Mapserver - User mailing list archive at Nabble.com. >> _______________________________________________ >> mapserver-users mailing list >> mapserver-users at lists.osgeo.org >> http://lists.osgeo.org/mailman/listinfo/mapserver-users >> > From szekerest at gmail.com Tue Mar 23 12:21:08 2010 From: szekerest at gmail.com (Tamas Szekeres) Date: Tue, 23 Mar 2010 20:21:08 +0100 Subject: [mapserver-users] ERROR getFeature with SqlServer 2008 in layer TYPE POINT In-Reply-To: References: Message-ID: Alexandre, I would suggest you to upgrade to Mapserver 5.6.3 since there have been a couple of changes with regards to the query processing in the MSSQL 2008 driver. Best regards, Tamas 2010/3/23 Alexandre Trindade > Hi, > > I have a problem when try to run the getFeature on LAYER TYPE POINT with > SqlServer 2008 on Mapserver 5.6.1. > > On browser appears this error messages : 500 Internal Server Error > > any suggestions? > > thanks > > > -- > Alexandre Trindade > > PHP Programmer > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From szekerest at gmail.com Tue Mar 23 13:35:37 2010 From: szekerest at gmail.com (Tamas Szekeres) Date: Tue, 23 Mar 2010 21:35:37 +0100 Subject: [mapserver-users] ONE PASS QUERY (RFC 52) - FEATURE OR BUG? In-Reply-To: <4BA8327E.6030900@pobox.com> References: <1269210706677-4775048.post@n2.nabble.com> <4BA8327E.6030900@pobox.com> Message-ID: 2010/3/23 Frank Warmerdam > > 4. Preserve the behaviour of keeping separate set of results for separate >> layer instances. In this regard a query on one layer should not invalidate >> the results for a different layer instance of the same driver. >> > > This seems to be a lot to expect. We go to significant effort with > the connection pooling to allow reuse of a connection for different > layers, and in effect in many drivers this connection also carries > a bunch of context with it. Certainly in the case of OGR an > OGRLayer retains a concept of current query result, but it can > be invalidated by lots of operations other than ResetReading() and > GetNextFeature(). I would imagine this is true to a greater or > lesser to other drivers that pool connections. > > Frank, It may be driver dependent, but I'm tending to think we should open up a new connection/session/dataset whatever, for those queries which would retain the results at the driver, corresponding to a particular result set stored at layer level. This is not the case for those queries where the results are not retained (like drawing the layers / background) and the connection pool approach could continue be used in these cases. That's why I suggested an additional parameter in whichShapes to define the purpose of the query. > > 5. Creating a clone of a layer should provide to use a separate query (by >> keeping the results intact on the original layer). This would be essential >> for msDrawQueryLayer to work when drawing the background before the >> highlighted features. >> > > This is also quite impractical for some implementations - certainly > for OGR. > > I'm quite unsure how msDrawQueryLayer would ever work with OGR then. In this case, MS_HILITE would require to draw the entire layer first and then the highlighted shapes from the result set. Drawing the entire layer (regardless of whether it's happening on a clone) would reset the spatialfilter on the driver with the same connection, and a subsequent resultsGetShape would fail to retrieve the same features. > > In retrospect, I'm not all that confident that we really considered > the impact of RFC 52 on use cases such as those you raise. I > certainly didn't understand these impacts. What is less clear to > me is where to go from here. RFC 52 was put in place because the > old approach was giving terrible performance in some cases. > This is really a good question ;-) RFC 52 is out in the stable branch and prevents from a number of users to upgrade (we don't know the exact number though). Leaving this version as it stands would bring in more people involved in this version of the API, while we foresee some API change shortly. I think our best chance would be to provide the original version at the drivers in parallel to the current that means: both getShape and layerGetShape should work properly. This should probably be controlled by a layer processing option at driver level. It would be reasonable to switch the defaults to the 2 pass approach in the stable branch, while the users could eventually override this in their mapfiles. But if we put the expectations you list into place there is no > way it can be made fast on OGR short of maintaining distinct > OGRDataset instances for each query in addition to the one used to > draw the layer. This could cause various performance and > resource problems. > > While I don't exactly see the performance impacts, it may require a bit more memory for sure. However since we intend to reuse the results of a query it would definitely imply to store the corresponding reference of the OGRDataset during the time interval when a subsequent access to the query may happen. I'm also hesitant to think that the 1pass option is better for all OGR data sources in all cases. Having a couple of test scripts to see the performance difference of the same query with these 2 methods would be helpful. Best regards, Tamas -------------- next part -------------- An HTML attachment was scrubbed... URL: From frippe12573 at hotmail.com Tue Mar 23 14:34:09 2010 From: frippe12573 at hotmail.com (frippe12573) Date: Tue, 23 Mar 2010 13:34:09 -0800 (PST) Subject: [mapserver-users] cgi variables error Message-ID: <1269380049336-4787351.post@n2.nabble.com> Hi to all, i'm working around to pass variables to cgi-mapserver, in particulary now i'm trying to pass one ID of one item in one layer, i'm trying with this string: http://myserveraddress/cgi-bin/mapserv?map=/path/to/my/file.map/file.map&mode=itemquery&qlayer=mylayeri&qitem=id&qstring=5740001 i recived this error message: prepare_database(): Query error. Error declaring cursor: ERROR: argument of AND must be type boolean, not type integer With query string: DECLARE mycursor BINARY CURSOR FOR SELECT "id"::text,asbinary(force_collection(force_2d(the_geom)),'NDR'),oid::text from mylayer WHERE (5740001) and (the_geom && setSRID( 'BOX3D(5 35,20 50)'::BOX3D,-1) ) Why i had it? How i can solve? Reguards Eugenio -- View this message in context: http://n2.nabble.com/cgi-variables-error-tp4787351p4787351.html Sent from the Mapserver - User mailing list archive at Nabble.com. From SansonR at asurequality.com Tue Mar 23 16:55:07 2010 From: SansonR at asurequality.com (Robert Sanson) Date: Wed, 24 Mar 2010 12:55:07 +1300 Subject: [mapserver-users] Mapserver for indoor maps In-Reply-To: <4BA4BE9A.2000208@operation-damocles.net> References: <4BA4BE9A.2000208@operation-damocles.net> Message-ID: <4BAA0BAB.379F.0037.0@asurequality.com> Hi Benjamin You need to establish some coordinate reference system to use. Could be metres, starting with 0,0 in the south-west corner of your floor. The raster should haev a world file associated with it (with a .pgw extension) that establishes the location of the centre of the top left (north west) pixel. the Map file and OpenLayers will have to know the extents of your floor in your coordinate system. regards, Robert >>> "Benjamin V." 21/03/2010 1:24 a.m. >>> Hello there, I'm currently involved in a project where I used the OpenLayers framework to display a set of wireless nodes (as features) on a google maps layer. What I'm trying to achieve now is to do the same for an indoor testbed where I only have a "map" of the floor as a raster image (png). I want to serve this through mapserver using an arbitrary extent (I don't care much about meaningful lon/lat-values) on a single layer which I then want to integrate using an OpenLayers.Layer.MapServer I've been looking through a lot of tutorials to get an idea of how to place a raster image somewhere on a layer but couldn't find any solution that does what I need. Basically, starting off with something like this in a map file - what would I have to add to achieve what I had in mind: MAP ... LAYER NAME indoor TYPE RASTER DATA indoor_map.png STATUS DEFAULT ... END ... END Best regards, Benjamin Vahl _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ------------------------------------------------------------------ The contents of this email are confidential to AsureQuality. If you have received this communication in error please notify the sender immediately and delete the message and any attachments. The opinions expressed in this email are not necessarily those of AsureQuality. This message has been scanned for known viruses before delivery. AsureQuality supports the Unsolicited Electronic Messages Act 2007. If you do not wish to receive similar communications in future, please notify the sender of this message. ------------------------------------------------------------------ This message has been scanned for malware by SurfControl plc. www.surfcontrol.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From info at laudontech.com Tue Mar 23 22:18:49 2010 From: info at laudontech.com (mapper99) Date: Tue, 23 Mar 2010 21:18:49 -0800 (PST) Subject: [mapserver-users] Cannot get my layer to render via WMS... Message-ID: <1269407929269-4789195.post@n2.nabble.com> Here is a map file I have: MAP NAME "WMSTEST" EXTENT -91.409324 40.696301 -90.942253 41.074178 SIZE 800 600 IMAGECOLOR 255 255 255 PROJECTION "init=epsg:4326" END WEB IMAGEPATH "/ms4w/tmp/ms_tmp/" IMAGEURL "/ms_tmp/" METADATA "wms_title" "WMS Test Server" ##required "wms_onlineresource" "http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&" ##required "wms_srs" "EPSG:4326" ##recommended END END LAYER NAME "test" EXTENT -91.409324 40.696301 -90.942253 41.074178 METADATA "wms_title" "TestLayer" ##required END PROJECTION "init=epsg:4326" ##recommended END STATUS ON TYPE POLYGON CONNECTIONTYPE POSTGIS CONNECTION "host=127.0.0.1 port=5432 dbname=MarkGIS user=postgres password=theguy" DATA "geog FROM test USING SRID=4326 USING UNIQUE gid" CLASSITEM 'cousubfp00' CLASS NAME 'default' EXPRESSION '' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 106 72 44 END END CLASS NAME 'cousubfp00 = 90207' EXPRESSION '90207' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 130 86 84 END END CLASS NAME 'cousubfp00 = 90401' EXPRESSION '90401' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 160 64 74 END END CLASS NAME 'cousubfp00 = 90813' EXPRESSION '90813' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 137 230 122 END END CLASS NAME 'cousubfp00 = 90887' EXPRESSION '90887' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 84 173 118 END END CLASS NAME 'cousubfp00 = 90888' EXPRESSION '90888' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 149 106 236 END END CLASS NAME 'cousubfp00 = 91347' EXPRESSION '91347' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 31 170 38 END END CLASS NAME 'cousubfp00 = 91401' EXPRESSION '91401' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 64 29 27 END END CLASS NAME 'cousubfp00 = 92010' EXPRESSION '92010' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 176 211 126 END END CLASS NAME 'cousubfp00 = 92112' EXPRESSION '92112' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 116 167 107 END END CLASS NAME 'cousubfp00 = 92906' EXPRESSION '92906' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 164 26 212 END END CLASS NAME 'cousubfp00 = 92924' EXPRESSION '92924' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 94 224 133 END END CLASS NAME 'cousubfp00 = 93390' EXPRESSION '93390' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 246 101 186 END END CLASS NAME 'cousubfp00 = 94080' EXPRESSION '94080' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 161 96 208 END END CLASS NAME 'cousubfp00 = 94203' EXPRESSION '94203' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 218 17 190 END END CLASS NAME 'cousubfp00 = 94488' EXPRESSION '94488' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 93 61 209 END END CLASS NAME 'cousubfp00 = 94658' EXPRESSION '94658' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 200 70 144 END END CLASS NAME 'cousubfp00 = 94803' EXPRESSION '94803' STYLE SYMBOL 0 OUTLINECOLOR 0 0 0 COLOR 45 32 194 END END CLASS OUTLINECOLOR 32 32 32 END END END If I use this URL: http://localhost:8080/cgi-bin/mapserv.exe?map=/ms4w/apps/tutorial/mapfiles/testwms.map&layer=test&mode=map The map draws fine. If I try and consume this map via a WMS client like QGIS, the data does not draw. GetCapabilities appears to be fine: http://localhost:8080/cgi-bin/mapserv.exe?map=/ms4w/apps/tutorial/mapfiles/testwms.map&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetCapabilities returns: ]> OGC:WMS WMS Test Server application/vnd.ogc.wms_xml image/gif image/png image/png; mode=24bit image/jpeg image/vnd.wap.wbmp image/tiff image/svg+xml text/plain application/vnd.ogc.gml text/xml image/gif image/png image/png; mode=24bit image/jpeg image/vnd.wap.wbmp text/xml application/vnd.ogc.se_xml application/vnd.ogc.se_inimage application/vnd.ogc.se_blank WMSTEST WMS Test Server EPSG:4326 test TestLayer EPSG:4326 But nothing draws in the map? What am I doing wrong here? -- View this message in context: http://n2.nabble.com/Cannot-get-my-layer-to-render-via-WMS-tp4789195p4789195.html Sent from the Mapserver - User mailing list archive at Nabble.com. From yves.jacolin at camptocamp.com Wed Mar 24 02:24:01 2010 From: yves.jacolin at camptocamp.com (Yves Jacolin) Date: Wed, 24 Mar 2010 10:24:01 +0100 Subject: [mapserver-users] WMS GetFeatureInfo on a WFS layer Message-ID: <585370c51003240224x35d08eb5raf24791c019907d9@mail.gmail.com> Hi, I added a WFS layer in my mapfile and I am using MapServer as a WMS server. I would like to send a GetFeatureInfo request on this WFS layer but I always get a "Search return no result" as answer. Is it possible to request such layer? I get same problem with an OGR connection (mapInfo file). Does the problem could occur only with a polyline feature if we click always too far of the feature? Or the problem occur from the WFS service? The WFS service I want to request in my WMS service is http://carto.ecologie.gouv.fr/MEDD/wms.php?service_idx=17W&map=sacarte.map Thanks in advance for your help, Y. -- Yves Jacolin Responsable Formation et Support Camptocamp France SAS Savoie Technolac, BP 352 73377 Le Bourget du Lac Cedex Tel : + 33 (0)4 79 26 57 97 http://www.camptocamp.com yves.jacolin at camptocamp.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From peter.hopfgartner at r3-gis.com Wed Mar 24 03:38:49 2010 From: peter.hopfgartner at r3-gis.com (Peter Hopfgartner) Date: Wed, 24 Mar 2010 11:38:49 +0100 Subject: [mapserver-users] PHP MapScript: shape->classindex is always 0 Message-ID: <4BA9EBB9.5040803@r3-gis.com> Hello As I interpreted this, classindex should point to the right class of the instantiated shape. Unfortunatly, classindex is always 0. As a test I have a LAYER with 2 classes, CLASS NAME 'class1' EXPRESSION (([class] eq 1)) STYLE SYMBOL "circle" SIZE 7.0 OUTLINECOLOR 0 0 0 COLOR 0 128 0 END END CLASS NAME 'class2' EXPRESSION (([class] eq 2)) STYLE SYMBOL "circle" SIZE 7.0 OUTLINECOLOR 0 0 0 COLOR 0 0 128 END END In the PostGIS database are 4 point, 2 with class=1 and 2 with class=2, the generated map image shows the expected colors. The following script: getLayerByName('test'); $status = $layer->open(); $status = $layer->whichShapes($map->extent); while ($shape = $layer->nextShape()) { echo "index: {$shape->index}\tclassindex: {$shape->classindex}\n"; } $layer->close(); ?> the following output: index: 0 classindex: 0 index: 1 classindex: 0 index: 2 classindex: 0 index: 3 classindex: 0 which is not what I expected. Am I missing something obvious or is this a MapServer bug? Regards, Peter -- Dott. Peter Hopfgartner R3 GIS Srl - GmbH Via Johann Kravogl-Str. 2 I-39012 Meran/Merano (BZ) Email: peter.hopfgartner at r3-gis.com Tel. : +39 0473 494949 Fax : +39 0473 069902 www : http://www.r3-gis.com XING : http://www.xing.com/go/invita/8917535 From Steve.Lime at state.mn.us Wed Mar 24 05:31:35 2010 From: Steve.Lime at state.mn.us (Lime, Steve D (DNR)) Date: Wed, 24 Mar 2010 07:31:35 -0500 Subject: [mapserver-users] ONE PASS QUERY (RFC 52) - FEATURE OR BUG? In-Reply-To: <30fe546d1003222125i403064faq3758d20bf9b85626@mail.gmail.com> References: <1269210706677-4775048.post@n2.nabble.com> <4BA8327E.6030900@pobox.com> , <30fe546d1003222125i403064faq3758d20bf9b85626@mail.gmail.com> Message-ID: I think that would probably eliminate the WFS issues we saw in 5.6 where OGC filters didn't map cleanly to a core query as we'd essentially be adding a new and more flexible core query. I'm not so sure that it would address a common use case for old behavior. For example, it seems that folks like to start with a core query against a number of layers (e.g. find me all restaurants, bars, and coffee shops within a certain bbox) and then they (through subsequent UI interactions) augment that original set of results by adding or removing features in a number of layers based on new queries, often a point query. I think that would be very hard to manage through a single filter. It's easy to do, however, via a list of feature IDs. I still think adding a filterObj and a msLayerWhichShapesFiltered() is a good idea and want to see this in 6.0. In addition, I was thinking that: 1) we could use shapeindex to hold a global feature ID (OID, row id, etc...), and tileindex (for non-tiled shapefile/raster layers) to hold a result set specific row id 2) driver specific version of msLayerNextShape(...) would set shapeindex and optionally tileindex (for example, the shapefile driver would only set the former, postgis would set both) 3) driver specific versions of msLayerGetShape(...) would be charged with making the decision on doing either a random access query (select ... where oid=x) or leveraging the existing result set based on the passed tileIndex (msLayerResultsGetShape(...) goes away) 4) resurrect the old query file writer (in addition to the new one). That code wrote the shapeindex and tileindex but we'd only cache the tileindex for tiled shapefile/raster layers 5) resurrect the old query file reader and it would load a query in a state that wouldn't have the tileindexes so old, slow processing would result for RDBMS layers Knowing when the result set processing (e.g. via WFS, templates and query maps) should set things up for old vs. new is a bit tricky. Right now there's a flag set in the result cache that I believe only the GML writer respects. It shows that it's possible to support both worlds though. That flag could trigger old/new file IO and result cache processing. I need to resolve this with the parallel discussion Tamas and Frank were having. My 2 cents anyway... Steve ________________________________________ From: mapserver-users-bounces at lists.osgeo.org [mapserver-users-bounces at lists.osgeo.org] On Behalf Of Paul Ramsey [pramsey at cleverelephant.ca] Sent: Monday, March 22, 2010 11:25 PM To: Lime, Steve D (DNR) Cc: mapserver-users at lists.osgeo.org; BrainDrain Subject: Re: [mapserver-users] ONE PASS QUERY (RFC 52) - FEATURE OR BUG? Is it better to back out to the old behaviour or would defining a filter object that allows complex query logic meet the need in a more direct way? (Ie, is running multiple queries a feature or a workaround for an even older limitation?) P. On Mon, Mar 22, 2010 at 9:21 PM, Lime, Steve D (DNR) wrote: > I think we're in need of a RFC 52a. Clearly the compound query handling the old approach afforded is of value to a group of users and that wasn't accounted for in the initial RFC. The work around Assefa had to do with WFS and a certain subset of OGC filters at the sprint is evidence that the approach was even used in the core code (I wasn't aware of that at the time). We (in 5.6.3) developed a work around that retains two sets of indexes one suitable for random access and one for a specific result set (e.g. cursor). It uses the already present tileindex property of a shapeObj to store the latter. I think we can have the best of both here by storing the two indexes and potentially we can revert to a single getShape() function in MapScript and revive the old queryfile format as a option as well. Just needs to be planned for now that the full impacts are better understood. > > Steve > ________________________________________ > From: mapserver-users-bounces at lists.osgeo.org [mapserver-users-bounces at lists.osgeo.org] On Behalf Of Frank Warmerdam [warmerdam at pobox.com] > Sent: Monday, March 22, 2010 10:16 PM > To: Tamas Szekeres > Cc: mapserver-users at lists.osgeo.org; BrainDrain > Subject: Re: [mapserver-users] ONE PASS QUERY (RFC 52) - FEATURE OR BUG? > > Tamas Szekeres wrote: >> In my understanding with the original approach the driver should: >> >> 1. Retain the result set of the queries at the layer (ie. in the >> layerinfo structure) until the layer is open and no subsequent >> whichShapes is called to 'invalidate' the query. > > Tamas, > > Your point here is that the query result should live until > invalidated by another whichShapes, right? I would agree with > that, but draw on a layer does do a whichShapes, right? So a > draw is expected to invalidate a query, right? > >> 2. Provide such index in shapeObj which would allow to retieve in a >> subsequent resultsGetShape within the result set. > > ok > >> 3. Retain the random access behaviour (getShape) for backward >> compatibility in parallel to resultsGetShape. > > ok > >> Since the RFC doesn't contain explicit note about the opposite, the >> drivers should also: >> >> 4. Preserve the behaviour of keeping separate set of results for >> separate layer instances. In this regard a query on one layer should not >> invalidate the results for a different layer instance of the same driver. > > This seems to be a lot to expect. We go to significant effort with > the connection pooling to allow reuse of a connection for different > layers, and in effect in many drivers this connection also carries > a bunch of context with it. Certainly in the case of OGR an > OGRLayer retains a concept of current query result, but it can > be invalidated by lots of operations other than ResetReading() and > GetNextFeature(). I would imagine this is true to a greater or > lesser to other drivers that pool connections. > >> 5. Creating a clone of a layer should provide to use a separate query >> (by keeping the results intact on the original layer). This would be >> essential for msDrawQueryLayer to work when drawing the background >> before the highlighted features. > > This is also quite impractical for some implementations - certainly > for OGR. > >> 6. Using a drawQuery should not invalidate the results of a previous query. > > I don't know much about drawQuery but it does seem plausible to ask > that drawQuery should not invalidate the query it is drawing. > >> 7. Drawing the map should not invalidate the results of a previous query. > > But drawing maps uses the feature access machinery like whichShapes > doesn't it? How can we expect map drawing not to invalidate a query? > > In retrospect, I'm not all that confident that we really considered > the impact of RFC 52 on use cases such as those you raise. I > certainly didn't understand these impacts. What is less clear to > me is where to go from here. RFC 52 was put in place because the > old approach was giving terrible performance in some cases. > But if we put the expectations you list into place there is no > way it can be made fast on OGR short of maintaining distinct > OGRDataset instances for each query in addition to the one used to > draw the layer. This could cause various performance and > resource problems. > > Best regards, > -- > ---------------------------------------+-------------------------------------- > I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com > light and sound - activate the windows | http://pobox.com/~warmerdam > and watch the world go round - Rush | Geospatial Programmer for Rent > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ mapserver-users mailing list mapserver-users at lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users From jmckenna at gatewaygeomatics.com Wed Mar 24 07:28:19 2010 From: jmckenna at gatewaygeomatics.com (Jeff McKenna) Date: Wed, 24 Mar 2010 10:28:19 -0400 Subject: [mapserver-users] Cannot get my layer to render via WMS... In-Reply-To: <1269407929269-4789195.post@n2.nabble.com> References: <1269407929269-4789195.post@n2.nabble.com> Message-ID: <4BAA2183.90504@gatewaygeomatics.com> mapper99 wrote: > Here is a map file I have: > > MAP > > NAME "WMSTEST" > EXTENT -91.409324 40.696301 -90.942253 41.074178 > SIZE 800 600 > IMAGECOLOR 255 255 255 > > PROJECTION > "init=epsg:4326" > END > > WEB > IMAGEPATH "/ms4w/tmp/ms_tmp/" > IMAGEURL "/ms_tmp/" > METADATA > "wms_title" "WMS Test Server" ##required > "wms_onlineresource" > "http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&" ##required > "wms_srs" "EPSG:4326" ##recommended > END > END > > > LAYER > NAME "test" > EXTENT -91.409324 40.696301 -90.942253 41.074178 > METADATA > "wms_title" "TestLayer" ##required > END > > PROJECTION > "init=epsg:4326" ##recommended > END > > STATUS ON > TYPE POLYGON > CONNECTIONTYPE POSTGIS > CONNECTION "host=127.0.0.1 port=5432 dbname=MarkGIS user=postgres > password=theguy" > DATA "geog FROM test USING SRID=4326 USING UNIQUE gid" > > CLASSITEM 'cousubfp00' > CLASS > NAME 'default' > EXPRESSION '' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 106 72 44 > END > END > CLASS > NAME 'cousubfp00 = 90207' > EXPRESSION '90207' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 130 86 84 > END > END > CLASS > NAME 'cousubfp00 = 90401' > EXPRESSION '90401' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 160 64 74 > END > END > CLASS > NAME 'cousubfp00 = 90813' > EXPRESSION '90813' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 137 230 122 > END > END > CLASS > NAME 'cousubfp00 = 90887' > EXPRESSION '90887' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 84 173 118 > END > END > CLASS > NAME 'cousubfp00 = 90888' > EXPRESSION '90888' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 149 106 236 > END > END > CLASS > NAME 'cousubfp00 = 91347' > EXPRESSION '91347' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 31 170 38 > END > END > CLASS > NAME 'cousubfp00 = 91401' > EXPRESSION '91401' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 64 29 27 > END > END > CLASS > NAME 'cousubfp00 = 92010' > EXPRESSION '92010' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 176 211 126 > END > END > CLASS > NAME 'cousubfp00 = 92112' > EXPRESSION '92112' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 116 167 107 > END > END > CLASS > NAME 'cousubfp00 = 92906' > EXPRESSION '92906' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 164 26 212 > END > END > CLASS > NAME 'cousubfp00 = 92924' > EXPRESSION '92924' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 94 224 133 > END > END > CLASS > NAME 'cousubfp00 = 93390' > EXPRESSION '93390' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 246 101 186 > END > END > CLASS > NAME 'cousubfp00 = 94080' > EXPRESSION '94080' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 161 96 208 > END > END > CLASS > NAME 'cousubfp00 = 94203' > EXPRESSION '94203' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 218 17 190 > END > END > CLASS > NAME 'cousubfp00 = 94488' > EXPRESSION '94488' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 93 61 209 > END > END > CLASS > NAME 'cousubfp00 = 94658' > EXPRESSION '94658' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 200 70 144 > END > END > CLASS > NAME 'cousubfp00 = 94803' > EXPRESSION '94803' > STYLE > SYMBOL 0 > OUTLINECOLOR 0 0 0 > COLOR 45 32 194 > END > END > CLASS > OUTLINECOLOR 32 32 32 > END > END > > END > > If I use this URL: > > http://localhost:8080/cgi-bin/mapserv.exe?map=/ms4w/apps/tutorial/mapfiles/testwms.map&layer=test&mode=map > > The map draws fine. If I try and consume this map via a WMS client like > QGIS, the data does not draw. GetCapabilities appears to be fine: > > http://localhost:8080/cgi-bin/mapserv.exe?map=/ms4w/apps/tutorial/mapfiles/testwms.map&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetCapabilities > > returns: > > > "http://schemas.opengis.net/wms/1.1.1/WMS_MS_Capabilities.dtd" > [ > > ]> > > > > > > > OGC:WMS > WMS Test Server > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&"/> > > > > > > > > application/vnd.ogc.wms_xml > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&"/> > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&"/> > > > > > image/gif > image/png > image/png; mode=24bit > image/jpeg > image/vnd.wap.wbmp > image/tiff > image/svg+xml > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&"/> > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&"/> > > > > > text/plain > application/vnd.ogc.gml > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&"/> > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&"/> > > > > > text/xml > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&"/> > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&"/> > > > > > image/gif > image/png > image/png; mode=24bit > image/jpeg > image/vnd.wap.wbmp > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&"/> > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&"/> > > > > > text/xml > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&"/> > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&"/> > > > > > > application/vnd.ogc.se_xml > application/vnd.ogc.se_inimage > application/vnd.ogc.se_blank > > > RemoteWFS="0"/> > > WMSTEST > WMS Test Server > EPSG:4326 > maxy="41.0742" /> > minx="-91.4093" miny="40.6963" maxx="-90.9423" > maxy="41.0742" /> > > test > TestLayer > EPSG:4326 > maxx="3.40282e+038" maxy="3.40282e+038" /> > minx="-3.40282e+038" miny="-3.40282e+038" > maxx="3.40282e+038" maxy="3.40282e+038" /> > > > > > > > But nothing draws in the map? What am I doing wrong here? > > I think the step you are missing is to verify that your GetMap request works. (manually generate a GetMap URL and try that in a browser, like you did for your GetCapabilities request). Once you verify that that manual GetMap works, then you should try to access your WMS layers in various WMS clients (like QGIS). -jeff -- Jeff McKenna MapServer Consulting and Training Services http://www.gatewaygeomatics.com/ From Jukka.Rahkonen at mmmtike.fi Wed Mar 24 06:56:25 2010 From: Jukka.Rahkonen at mmmtike.fi (Rahkonen Jukka) Date: Wed, 24 Mar 2010 15:56:25 +0200 Subject: [mapserver-users] Cannot get my layer to render via WMS... In-Reply-To: <4BAA2183.90504@gatewaygeomatics.com> References: <1269407929269-4789195.post@n2.nabble.com> <4BAA2183.90504@gatewaygeomatics.com> Message-ID: Hi, There is something odd here but I really can't figure out what. One thing is that you do not need EXTENT at LAYER level as you do now. I wonder if it is related to that GetCapabilities gives odd extents to the layer "test" as can be seen: > > test > > TestLayer > > EPSG:4326 > > > maxx="3.40282e+038" maxy="3.40282e+038" /> > > > minx="-3.40282e+038" miny="-3.40282e+038" > > maxx="3.40282e+038" maxy="3.40282e+038" /> Strange extents for EPSG:4326 projection, aren't they? What is "geog" used in the DATA line doing? DATA "geog FROM test USING SRID=4326 USING UNIQUE gid" -Jukka Rahkonen- > -----Alkuper?inen viesti----- > L?hett?j?: mapserver-users-bounces at lists.osgeo.org > [mailto:mapserver-users-bounces at lists.osgeo.org] Puolesta Jeff McKenna > L?hetetty: 24. maaliskuuta 2010 16:28 > Vastaanottaja: mapserver-users at lists.osgeo.org > Aihe: Re: [mapserver-users] Cannot get my layer to render via WMS... > > mapper99 wrote: > > Here is a map file I have: > > > > MAP > > > > NAME "WMSTEST" > > EXTENT -91.409324 40.696301 -90.942253 41.074178 > > SIZE 800 600 > > IMAGECOLOR 255 255 255 > > > > PROJECTION > > "init=epsg:4326" > > END > > > > WEB > > IMAGEPATH "/ms4w/tmp/ms_tmp/" > > IMAGEURL "/ms_tmp/" > > METADATA > > "wms_title" "WMS Test Server" ##required > > "wms_onlineresource" > > > "http://localhost:8080/cgi-bin/mapserv.exe?map=testwms.map&" > ##required > > "wms_srs" "EPSG:4326" ##recommended > > END > > END > > > > > > LAYER > > NAME "test" > > EXTENT -91.409324 40.696301 -90.942253 41.074178 > > METADATA > > "wms_title" "TestLayer" ##required > > END > > > > PROJECTION > > "init=epsg:4326" ##recommended > > END > > > > STATUS ON > > TYPE POLYGON > > CONNECTIONTYPE POSTGIS > > CONNECTION "host=127.0.0.1 port=5432 dbname=MarkGIS > user=postgres > > password=theguy" > > DATA "geog FROM test USING SRID=4326 USING UNIQUE gid" > > > > CLASSITEM 'cousubfp00' > > CLASS > > NAME 'default' > > EXPRESSION '' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 106 72 44 > > END > > END > > CLASS > > NAME 'cousubfp00 = 90207' > > EXPRESSION '90207' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 130 86 84 > > END > > END > > CLASS > > NAME 'cousubfp00 = 90401' > > EXPRESSION '90401' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 160 64 74 > > END > > END > > CLASS > > NAME 'cousubfp00 = 90813' > > EXPRESSION '90813' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 137 230 122 > > END > > END > > CLASS > > NAME 'cousubfp00 = 90887' > > EXPRESSION '90887' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 84 173 118 > > END > > END > > CLASS > > NAME 'cousubfp00 = 90888' > > EXPRESSION '90888' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 149 106 236 > > END > > END > > CLASS > > NAME 'cousubfp00 = 91347' > > EXPRESSION '91347' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 31 170 38 > > END > > END > > CLASS > > NAME 'cousubfp00 = 91401' > > EXPRESSION '91401' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 64 29 27 > > END > > END > > CLASS > > NAME 'cousubfp00 = 92010' > > EXPRESSION '92010' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 176 211 126 > > END > > END > > CLASS > > NAME 'cousubfp00 = 92112' > > EXPRESSION '92112' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 116 167 107 > > END > > END > > CLASS > > NAME 'cousubfp00 = 92906' > > EXPRESSION '92906' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 164 26 212 > > END > > END > > CLASS > > NAME 'cousubfp00 = 92924' > > EXPRESSION '92924' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 94 224 133 > > END > > END > > CLASS > > NAME 'cousubfp00 = 93390' > > EXPRESSION '93390' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 246 101 186 > > END > > END > > CLASS > > NAME 'cousubfp00 = 94080' > > EXPRESSION '94080' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 161 96 208 > > END > > END > > CLASS > > NAME 'cousubfp00 = 94203' > > EXPRESSION '94203' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 218 17 190 > > END > > END > > CLASS > > NAME 'cousubfp00 = 94488' > > EXPRESSION '94488' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 93 61 209 > > END > > END > > CLASS > > NAME 'cousubfp00 = 94658' > > EXPRESSION '94658' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 200 70 144 > > END > > END > > CLASS > > NAME 'cousubfp00 = 94803' > > EXPRESSION '94803' > > STYLE > > SYMBOL 0 > > OUTLINECOLOR 0 0 0 > > COLOR 45 32 194 > > END > > END > > CLASS > > OUTLINECOLOR 32 32 32 > > END > > END > > > > END > > > > If I use this URL: > > > > > http://localhost:8080/cgi-bin/mapserv.exe?map=/ms4w/apps/tutor ial/mapfiles/testwms.map&layer=test&mode=map > > > > The map draws fine. If I try and consume this map via a > WMS client like > > QGIS, the data does not draw. GetCapabilities appears to be fine: > > > > > http://localhost:8080/cgi-bin/mapserv.exe?map=/ms4w/apps/tutor ial/mapfiles/testwms.map&SERVICE=WMS&VERSION=1.1.1> &REQUEST=GetCapabilities > > > > returns: > > > > > > > "http://schemas.opengis.net/wms/1.1.1/WMS_MS_Capabilities.dtd" > > [ > > > > ]> > > > > > > > > > > > > > > OGC:WMS > > WMS Test Server > > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=test wms.map&"/> > > > > > > > > > > > > > > > > application/vnd.ogc.wms_xml > > > > > > xmlns:xlink="http://www.w3.org/1999/xlink" > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=test wms.map&"/> > > xmlns:xlink="http://www.w3.org/1999/xlink" > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=test wms.map&"/> > > > > > > > > > > image/gif > > image/png > > image/png; mode=24bit > > image/jpeg > > image/vnd.wap.wbmp > > image/tiff > > image/svg+xml > > > > > > xmlns:xlink="http://www.w3.org/1999/xlink" > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=test wms.map&"/> > > xmlns:xlink="http://www.w3.org/1999/xlink" > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=test wms.map&"/> > > > > > > > > > > text/plain > > application/vnd.ogc.gml > > > > > > xmlns:xlink="http://www.w3.org/1999/xlink" > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=test wms.map&"/> > > xmlns:xlink="http://www.w3.org/1999/xlink" > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=test wms.map&"/> > > > > > > > > > > text/xml > > > > > > xmlns:xlink="http://www.w3.org/1999/xlink" > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=test wms.map&"/> > > xmlns:xlink="http://www.w3.org/1999/xlink" > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=test wms.map&"/> > > > > > > > > > > image/gif > > image/png > > image/png; mode=24bit > > image/jpeg > > image/vnd.wap.wbmp > > > > > > xmlns:xlink="http://www.w3.org/1999/xlink" > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=test wms.map&"/> > > xmlns:xlink="http://www.w3.org/1999/xlink" > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=test wms.map&"/> > > > > > > > > > > text/xml > > > > > > xmlns:xlink="http://www.w3.org/1999/xlink" > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=test wms.map&"/> > > xmlns:xlink="http://www.w3.org/1999/xlink" > > > xlink:href="http://localhost:8080/cgi-bin/mapserv.exe?map=test wms.map&"/> > > > > > > > > > > > > application/vnd.ogc.se_xml > > application/vnd.ogc.se_inimage > > application/vnd.ogc.se_blank > > > > > > UserStyle="1" > > RemoteWFS="0"/> > > > > WMSTEST > > WMS Test Server > > EPSG:4326 > > maxx="-90.9423" > > maxy="41.0742" /> > > > minx="-91.4093" miny="40.6963" maxx="-90.9423" > > maxy="41.0742" /> > > > > test > > TestLayer > > EPSG:4326 > > > maxx="3.40282e+038" maxy="3.40282e+038" /> > > > minx="-3.40282e+038" miny="-3.40282e+038" > > maxx="3.40282e+038" maxy="3.40282e+038" /> > > > > > > > > > > > > > > But nothing draws in the map? What am I doing wrong here? > > > > > > I think the step you are missing is to verify that your > GetMap request > works. (manually generate a GetMap URL and try that in a > browser, like > you did for your GetCapabilities request). Once you verify that that > manual GetMap works, then you should try to access your WMS layers in > various WMS clients (like QGIS). > > -jeff > > > > -- > Jeff McKenna > MapServer Consulting and Training Services > http://www.gatewaygeomatics.com/ > > > _______________________________________________ > mapserver-users mailing list > mapserver-users at lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/mapserver-users > From julieknoll at gmail.com Wed Mar 24 07:22:35 2010 From: julieknoll at gmail.com (Julie Knoll) Date: Wed, 24 Mar 2010 09:22:35 -0500 Subject: [mapserver-users] help with AGG support Message-ID: Hi, I have installed packages for agg-2.5 and agg-devel-2.5 on our server. Compling mapserver using ./configure --with-php=/usr/include/php --with-postgis --with-proj --with-geos --with-freetype --with-agg=/usr works fine. However make returns the following errors. Could someone please help? The server is CentOS 5.4 /usr/include/agg2/agg_pixfmt_rgba.h:1637: error: no type named ?row_data? in ?class mapserv_row_ptr_cache? /usr/include/agg2/agg_pixfmt_rgba.h:1675: error: no type named ?row_data? in ?class mapserv_row_ptr_cache? mapagg.cpp: In member function ?void AGGMapserverRenderer::renderEllipse(double, double, double, double, double, agg::rgba8&, agg::rgba8&, double)?: mapagg.cpp:299: error: ?class agg::path_storage? has no member named ?transform? mapagg.cpp: In function ?void msCircleDrawShadeSymbolAGG(symbolSetObj*, imageObj*, pointObj*, double, styleObj*, double)?: mapagg.cpp:1077: error: ?class agg::path_storage? has no member named ?transform? mapagg.cpp:1101: error: ?class agg::path_storage? has no member named ?transform? mapagg.cpp:1144: error: ?class agg::path_storage? has no member named ?transform? mapagg.cpp:1177: error: ?class agg::path_storage? has no member named ?transform? mapagg.cpp: In function ?void msDrawMarkerSymbolAGG(symbolSetObj*, imageObj*, pointObj*, styleObj*, double)?: mapagg.cpp:1300: error: ?class agg::path_storage? has no member named ?transform? mapagg.cpp: In function ?void drawPolylineMarkers(imageObj*, shapeObj*, symbolSetObj*, styleObj*, double)?: mapagg.cpp:1426: error: ?class agg::path_storage? has no member named ?transform? mapagg.cpp:1427: error: ?class agg::path_storage? has no member named ?transform? mapagg.cpp:1428: error: ?class agg::path_storage? has no member named ?transform? mapagg.cpp: In function ?void msDrawLineSymbolAGG(symbolSetObj*, imageObj*, shapeObj*, styleObj*, double)?: mapagg.cpp:1713: error: ?class agg::path_storage? has no member named ?transform? mapagg.cpp: In function ?void msDrawShadeSymbolAGG(symbolSetObj*, imageObj*, shapeObj*, styleObj*, double)?: mapagg.cpp:1831: error: ?class agg::path_storage? has no member named ?transform? mapagg.cpp:1878: error: ?class agg::path_storage? has no member named ?transform? mapagg.cpp:1926: error: ?class agg::path_storage? has no member named ?transform? make: *** [mapagg.o] Error 1 Thanks -------------- next part -------------- An HTML attachment was scrubbed... URL: From aboudreault at mapgears.com Wed Mar 24 07:52:17 2010 From: aboudreault at mapgears.com (Alan Boudreault) Date: Wed, 24 Mar 2010 10:52:17 -0400 Subject: [mapserver-users] help with AGG support In-Reply-To: References: Message-ID: <201003241052.17841.aboudreault@mapgears.com> Julie, what mapserver version are you using? AGG is already included in mapserver 5.6.x source. Just compile with "--with-agg" option. I'm not sure MS has been tested with agg 2.5. Alan On March 24, 2010 10:22:35 am Julie Knoll wrote: > Hi, > > I have installed packages for agg-2.5 and agg-devel-2.5 on our server. > Compling mapserver using ./configure --with-php=/usr/include/php > --with-postgis --with-proj --with-geos --with-freetype --with-agg=/usr > works fine. However make returns the following errors. Could someone > please help? The server is CentOS 5.4 > > /usr/include/agg2/agg_pixfmt_rgba.h:1637: error: no type named ?row_data? > in ?class mapserv_row_ptr_cache? > /usr/include/agg2/agg_pixfmt_rgba.h:1675: error: no type named ?row_data? > in ?class mapserv_row_ptr_cache? > mapagg.cpp: In member function ?void > AGGMapserverRenderer::renderEllipse(double, double, double, double, double, > agg::rgba8&, agg::rgba8&, double)?: > mapagg.cpp:299: error: ?class agg::path_storage? has no member named > ?transform? > mapagg.cpp: In function ?void msCircleDrawShadeSymbolAGG(symbolSetObj*, > imageObj*, pointObj*, double, styleObj*, double)?: > mapagg.cpp:1077: error: ?class agg::path_storage? has no member named > ?transform? > mapagg.cpp:1101: error: ?class agg::path_storage? has no member named > ?transform? > mapagg.cpp:1144: error: ?class agg::path_storage? has no member named > ?transform? > mapagg.cpp:1177: error: ?class agg::path_storage? has no member named > ?transform? > mapagg.cpp: In function ?void msDrawMarkerSymbolAGG(symbolSetObj*, > imageObj*, pointObj*, styleObj*, double)?: > mapagg.cpp:1300: error: ?class agg::path_storage? has no member named > ?transform? > mapagg.cpp: In function ?void drawPolylineMarkers(imageObj*, shapeObj*, > symbolSetObj*, styleObj*, double)?: > mapagg.cpp:1426: error: ?class agg::path_storage? has no member named > ?transform? > mapagg.cpp:1427: error: ?class agg::path_storage? has no member named > ?transform? > mapagg.cpp:1428: error: ?class agg::path_storage? has no member named > ?transform? > mapagg.cpp: In function ?void msDrawLineSymbolAGG(symbolSetObj*, imageObj*, > shapeObj*, styleObj*, double)?: > mapagg.cpp:1713: error: ?class agg::path_storage? has no member named > ?transform? > mapagg.cpp: In function ?void msDrawShadeSymbolAGG(symbolSetObj*, > imageObj*, shapeObj*, styleObj*, double)?: > mapagg.cpp:1831: error: ?class agg::path_storage? has no member named > ?transform? > mapagg.cpp:1878: error: ?class agg::path_storage? has no member named > ?transform? > mapagg.cpp:1926: error: ?class agg::path_storage? has no member named > ?transform? > make: *** [mapagg.o] Error 1 > > Thanks > -- Alan Boudreault Mapgears http://www.mapgears.com From julieknoll at gmail.com Wed Mar 24 08:04:23 2010 From: julieknoll at gmail.com (Julie Knoll) Date: Wed, 24 Mar 2010 10:04:23 -0500 Subject: [mapserver-users] help with AGG support In-Reply-To: <201003241052.17841.aboudreault@mapgears.com> References: <201003241052.17841.aboudreault@mapgears.com> Message-ID: Actually we are using version 5.4. I just tried compiling 5.6.3 and got a new set of errors on make (non-related to agg) mapstring.c: In function ?msConvertWideStringToUTF8?: mapstring.c:1542: warning: dereferencing type-punned pointer will break strict-aliasing rules mapstring.c:1544: error: ?errno? undeclared (first use in this function) mapstring.c:1544: error: (Each undeclared identifier is reported only once mapstring.c:1544: error: for each function it appears in.) mapstring.c:1545: error: ?E2BIG? undeclared (first use in this function) mapstring.c:1548: error: ?EILSEQ? undeclared (first use in this function) mapstring.c:1551: error: ?EINVAL? undeclared (first use in this function) make: *** [mapstring.o] Error 1 I then tried version 5.6.1 which compiled and installed perfectly, but when trying to actually draw a map, it reported an error with my postgis layer: [Wed Mar 24 09:49:48 2010].943741 msPostGISLayerGetItems(): Query error. Error (ERROR: column "box" does not exist LINE 1: ...om geom_cassidi_states where the_geom && setsrid(!BOX!,4269)... ^ ) executing SQL: select * from (select the_geom, state_name, gid from geom_cassidi_states where the_geom && setsrid(!BOX!,4269)) as foo where false limit 0 so not sure what to do now ... On Wed, Mar 24, 2010 at 9:52 AM, Alan Boudreault wrote: > Julie, what mapserver version are you using? AGG is already included in > mapserver 5.6.x source. Just compile with "--with-agg" option. I'm not sure > MS > has been tested with agg 2.5. > > Alan > > On March 24, 2010 10:22:35 am Julie Knoll wrote: > > Hi, > > > > I have installed packages for agg-2.5 and agg-devel-2.5 on our server. > > Compling mapserver using ./configure --with-php=/usr/include/php > > --with-postgis --with-proj --with-geos --with-freetype --with-agg=/usr > > works fine. However make returns the following errors. Could someone > > please help? The server is CentOS 5.4 > > > > /usr/include/agg2/agg_pixfmt_rgba.h:1637: error: no type named ?row_data? > > in ?class mapserv_row_ptr_cache? > > /usr/include/agg2/agg_pixfmt_rgba.h:1675: error: no type named ?row_data? > > in ?class mapserv_row_ptr_cache? > > mapagg.cpp: In member function ?void > > AGGMapserverRenderer::renderEllipse(double, double, double, double, > double, > > agg::rgba8&, agg::rgba8&, double)?: > > mapagg.cpp:299: error: ?class agg::path_storage? has no member named > > ?transform? > > mapagg.cpp: In function ?void msCircleDrawShadeSymbolAGG(symbolSetObj*, > > imageObj*, pointObj*, double, styleObj*, double)?: > > mapagg.cpp:1077: error: ?class agg::path_storage? has no member named > > ?transform? > > mapagg.cpp:1101: error: ?class agg::path_storage? has no member named > > ?transform? > > mapagg.cpp:1144: error: ?class agg::path_storage? has no member named > > ?transform? > > mapagg.cpp:1177: error: ?class agg::path_storage? has no member named > > ?transform? > > mapagg.cpp: In function ?void msDrawMarkerSymbolAGG(symbolSetObj*, > > imageObj*, pointObj*, styleObj*, double)?: > > mapagg.cpp:1300: error: ?class agg::path_storage? has no member named > > ?transform? > > mapagg.cpp: In function ?void drawPolylineMarkers(imageObj*, shapeObj*, > > symbolSetObj*, styleObj*, double)?: > > mapagg.cpp:1426: error: ?class agg::path_storage? has no member named > > ?transform? > > mapagg.cpp:1427: error: ?class agg::path_storage? has no member named > > ?transform? > > mapagg.cpp:1428: error: ?class agg::path_storage? has no member named > > ?transform? > > mapagg.cpp: In function ?void msDrawLineSymbolAGG(symbolSetObj*, > imageObj*, > > shapeObj*, styleObj*, double)?: > > mapagg.cpp:1713: error: ?class agg::path_storage? has no member named > > ?transform? > > mapagg.cpp: In function ?void msDrawShadeSymbolAGG(symbolSetObj*, > > imageObj*, shapeObj*, styleObj*, double)?: > > mapagg.cpp:1831: error: ?class agg::path_storage? has no member named > > ?transform? > > mapagg.cpp:1878: error: ?class agg::path_storage? has no member named > > ?transform? > > mapagg.cpp:1926: error: ?class agg::path_storage? has no member named > > ?transform? > > make: *** [mapagg.o] Error 1 > > > > Thanks > > > > -- > Alan Boudreault > Mapgears > http://www.mapgears.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From kobben at itc.nl Wed Mar 24 08:07:28 2010 From: kobben at itc.nl (=?iso-8859-1?Q?Barend_K=F6bben?=) Date: Wed, 24 Mar 2010 16:07:28 +0100 Subject: [mapserver-users] WMS GetFeatureInfo on a WFS layer In-Reply-To: <585370c51003240224x35d08eb5raf24791c019907d9@mail.gmail.com> Message-ID: