Ok well, got a big update here. I was able to switch it back to a 256x256 WMS tiled layer. My problem was that the symbols were being clipped, however, by using the openlayers "gutter" property, I was able to fix this problem. I am using a 1.0 ratio, and the tiles seem to be loading in much faster, and with a gutter value of 32 the clipping is completely gone. <br>
<br>For those that don't know, the gutter parameter is one that is a property of the OpenLayers.Layer class. This is the description:<br><br>{Integer} Determines the width (in pixels) of the gutter around image
tiles to ignore. By setting this property to a non-zero value, images
will be requested that are wider and taller than the tile size by a
value of 2 x gutter. This allows artifacts of rendering at tile edges
to be ignored. Set a gutter value that is equal to half the size of
the widest symbol that needs to be displayed. Defaults to zero.
Non-tiled layers always have zero gutter.<br><br>I am going to see if my client is satisfied with the speed, and I will continue trying different things to optimize, obviously if anyone has any suggestions they are welcome =). Thanks a lot for the help so far everyone.<br>
<br>-Adam<br><br><div class="gmail_quote">On Mon, May 3, 2010 at 7:52 PM, Lime, Steve D (DNR) <span dir="ltr"><<a href="mailto:Steve.Lime@state.mn.us">Steve.Lime@state.mn.us</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
How big are (and how many) the images requested by OL? You've been through so many changes I'm not sure exactly what configuration you're using:<br>
<br>
- tiled vs. untiled?<br>
- layer ratio setting?<br>
<div class="im"><br>
Steve<br>
________________________________________<br>
From: <a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a> [<a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a>] On Behalf Of Adam Eskreis [<a href="mailto:aeskreis@gmail.com">aeskreis@gmail.com</a>]<br>
</div>Sent: Monday, May 03, 2010 6:23 PM<br>
To: Rahkonen Jukka<br>
<div class="im">Cc: <a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a><br>
Subject: Re: [mapserver-users] Re: WMS and tiles cutting off<br>
<br>
</div><div class="im">Thank you for the advice Jukka. I tried just running shp2img. The results are almost instant. I also tried using my client with the symbols turned off, and the result was about half the load time. So I guess from this we can assume that there is a certain amount of overhead that openlayers is giving me, as well the symbols are causing some overhead. The only thing is, what to do? I can't sacrifice any more quality on my symbols (whcih are 8 bit png images) and openlayers as far as I know is the best client out there.<br>
<br>
Things are starting to look grim<br>
<br>
</div><div class="im">On Mon, May 3, 2010 at 2:44 PM, Rahkonen Jukka <<a href="mailto:Jukka.Rahkonen@mmmtike.fi">Jukka.Rahkonen@mmmtike.fi</a><mailto:<a href="mailto:Jukka.Rahkonen@mmmtike.fi">Jukka.Rahkonen@mmmtike.fi</a>>> wrote:<br>
Hi,<br>
<br>
If the query is optimized then try to find out real bottle neck. I believe that first step would be to throw away your client and test with shp2img and by having DEBUG 5 with all your layers. If you believe that the reason is due to symbols, then have a try by commenting out all the symbols you will soon know it for sure. I have not played with symbols myself but I can imagine that some sort of symbols are faster to render than others (truetype/pixmap/inline).<br>
<br>
-Jukka Rahkonen-<br>
<br>
<br>
<br>
Adam Eskreis wrote:<br>
<br>
> Thank you for the response David.<br>
<br>
> I have optimized the query all I can. I have optimized the query to the<br>
point that even with all categories selected, the query has a run time of 52<br>
ms. I can only assume that the issue lies with the generation of the<br>
images. I will try to run it without the "IN" part of the query, but I<br>
can't imagine that it'st he problem. I think the problem is that there are<br>
a large number of symbols that need to be generated, and it's taking<br>
mapserver a long time to load them in. Also, yes I have indexes on all<br>
columns that I am calling in, and yes, they are all using the same SRS. I<br>
am still trying a few more things, but I don't think it's the database query<br>
that's causing the problem.<br>
<br>
<br>
> On Fri, Apr 30, 2010 at 9:37 AM, Fawcett, David (MPCA) <<br>
</div><div class="im"><a href="mailto:David.Fawcett@state.mn.us">David.Fawcett@state.mn.us</a><mailto:<a href="mailto:David.Fawcett@state.mn.us">David.Fawcett@state.mn.us</a>>> wrote:<br>
<br>
>> Adam,<br>
><br>
><br>
><br>
>> It sounds like you have boiled the issue down to too much of a time lag<br>
> between the time the query is executed and the image appears in the client.<br>
><br>
><br>
><br>
><br>
>> Is it taking a long time for MapServer to draw the image, or is it the<br>
> delivery of the image to the requesting machine and subsequent placement in<br>
> the client?<br>
><br>
><br>
><br>
>> If it is taking MapServer a long time, maybe there are some more data<br>
> optimizations that you can do. Is there a better way to structure your<br>
> data, can you do any pre-processing? Is it all in the same SRS, got<br>
> attribute and spatial indexes? I have used the SQL IN for some apps with<br>
> reasonable performance, but in the last 6 months or so, there were some<br>
> posts on this list comparing the use of IN to a layer (or class?) filter.<br>
> The latter solution was significantly faster.<br>
><br>
><br>
><br>
>> If it is taking a long time to get to the client, then that is likely an<br>
> infrastructure issue on either end.<br>
><br>
><br>
><br>
>> If you want some more help digging in more deeply, post some more stats and<br>
> mapfile snippets.<br>
><br>
><br>
><br>
>> David.<br>
><br>
><br>
><br>
</div>> *From:* <a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a>> [mailto:<br>
> <a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a>>] *On Behalf Of *Adam Eskreis<br>
<div class="im">> *Sent:* Thursday, April 29, 2010 4:24 PM<br>
> *To:* Lime, Steve D (DNR)<br>
</div>> *Cc:* <a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a>><br>
<div class="im">><br>
> *Subject:* Re: [mapserver-users] Re: WMS and tiles cutting off<br>
><br>
><br>
><br>
</div><div class="im">> I tried doing ratio:1 unfortunately it doesn't seem like enough of a<br>
> performance increase. Separate layers for each category is an option,<br>
> however, there are over a hundred categories, and any combination of<br>
> categories can be on at any given time, so this could prove to have<br>
> performance issues of it's own. However, I thank you guys Steve and Kaipi<br>
> for your advice. I think I am just going to go back to my old method, which<br>
> was using php mapscript to generate the tiles, then each time the user<br>
> selected new categories, purge the cache and remake the mapfile. It's not<br>
> the ideal solution but it seems to be the only one.<br>
><br>
> Thanks again,<br>
><br>
> -Adam<br>
><br>
> On Thu, Apr 29, 2010 at 3:50 PM, Lime, Steve D (DNR) <<br>
</div><div class="im">> <a href="mailto:Steve.Lime@state.mn.us">Steve.Lime@state.mn.us</a><mailto:<a href="mailto:Steve.Lime@state.mn.us">Steve.Lime@state.mn.us</a>>> wrote:<br>
><br>
</div><div class="im">> Note that by default I believe openlayers will request an image that is<br>
> *much* larger than what is visible. Setting the layers (OL) ratio:1 makes it<br>
> the same size as the view port and that can speed up rendering considerably.<br>
><br>
> Alternatively you could create a separate set of tiles for each category I<br>
> suppose and switch OL layers as necessary...<br>
><br>
><br>
> Steve<br>
><br>
> ________________________________________<br>
</div><div class="im">> From: <a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a>> [<br>
> <a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a>>] On Behalf Of Adam Eskreis [<br>
> <a href="mailto:aeskreis@gmail.com">aeskreis@gmail.com</a><mailto:<a href="mailto:aeskreis@gmail.com">aeskreis@gmail.com</a>>]<br>
><br>
</div><div class="im">> Sent: Thursday, April 29, 2010 2:25 PM<br>
><br>
</div><div class="im">> To: <a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a>><br>
> Subject: Re: [mapserver-users] Re: WMS and tiles cutting off<br>
><br>
</div><div class="im">> Ok, I just gave an untiled layer a try, unfortunately though, due to the<br>
> large amount of symbols being displayed on the screen, there is about a 2<br>
> second delay every time the map is panned. My client will most certainly<br>
> find this unacceptable. I have tried using smaller images, but I cannot<br>
> sacrifice any more quality. I believe my database query to be as optimized<br>
> as it can be (has about 50 ms runtime, I honestly don't think I can get it<br>
> any lower than that).<br>
><br>
> If these are the only options, is there something else besides WMS that you<br>
> all would recommend using to solve this issue?<br>
><br>
> Thanks,<br>
> -Adam<br>
><br>
> On Thu, Apr 29, 2010 at 2:54 PM, Lime, Steve D (DNR) <<br>
</div><div class="im">> <a href="mailto:Steve.Lime@state.mn.us">Steve.Lime@state.mn.us</a><mailto:<a href="mailto:Steve.Lime@state.mn.us">Steve.Lime@state.mn.us</a>><mailto:<a href="mailto:Steve.Lime@state.mn.us">Steve.Lime@state.mn.us</a><mailto:<a href="mailto:Steve.Lime@state.mn.us">Steve.Lime@state.mn.us</a>>>> wrote:<br>
> So use two layers. One for the background, use tilecache for that. Then use<br>
> an untiled wms/mapserver layer for the overlayed points. - Steve<br>
> ________________________________________<br>
><br>
</div>> From: <a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a>><mailto:<br>
<div class="im">> <a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a>>> [<br>
</div>> <a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a>><mailto:<br>
<div class="im">> <a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users-bounces@lists.osgeo.org">mapserver-users-bounces@lists.osgeo.org</a>>>] On Behalf Of Adam Eskreis [<br>
</div>> <a href="mailto:aeskreis@gmail.com">aeskreis@gmail.com</a><mailto:<a href="mailto:aeskreis@gmail.com">aeskreis@gmail.com</a>><mailto:<a href="mailto:aeskreis@gmail.com">aeskreis@gmail.com</a><mailto:<a href="mailto:aeskreis@gmail.com">aeskreis@gmail.com</a>>>]<br>
<div class="im">><br>
> Sent: Thursday, April 29, 2010 1:24 PM<br>
><br>
</div>> To: <a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a>><mailto:<a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a>><br>
<div class="im">> ><br>
><br>
> Subject: Re: [mapserver-users] Re: WMS and tiles cutting off<br>
><br>
> I have thought about using tilecache with metatiling, however there is a<br>
> caveat about this map that i forgot to mention in my main post, and it has<br>
> to do with that "categories" parameter. Basically, each point/symbol on the<br>
> map has an associated category in the database backend. I am using<br>
> mapserver/WMS parameters to change the categories which are called. Each<br>
> time the user selects a category, only the points in that category are<br>
> shown. My query in the mapfile looks something like thi:<br>
><br>
> SELECT point_geom,gid,symbol,angle FROM mapdata WHERE category<br>
> IN(%CATEGORIES%)";<br>
><br>
> And each time the user changes the categories, I use openlayers to merge<br>
> new parameters, and input the new category values that should be used. Is<br>
> tilecache still useable if I have a system like this set up?<br>
><br>
> Thanks,<br>
> -Adam<br>
><br>
> On Thu, Apr 29, 2010 at 6:14 AM, kaipi <<a href="mailto:mapcollect@gmx.net">mapcollect@gmx.net</a><mailto:<a href="mailto:mapcollect@gmx.net">mapcollect@gmx.net</a>><mailto:<br>
</div>> <a href="mailto:mapcollect@gmx.net">mapcollect@gmx.net</a><mailto:<a href="mailto:mapcollect@gmx.net">mapcollect@gmx.net</a>>><mailto:<a href="mailto:mapcollect@gmx.net">mapcollect@gmx.net</a><mailto:<a href="mailto:mapcollect@gmx.net">mapcollect@gmx.net</a>><mailto:<a href="mailto:mapcollect@gmx.net">mapcollect@gmx.net</a><mailto:<a href="mailto:mapcollect@gmx.net">mapcollect@gmx.net</a>>>>><br>
<div><div></div><div class="h5">> wrote:<br>
><br>
> Hi,<br>
><br>
> you can use <a href="http://tilecache.org/" target="_blank">http://tilecache.org/</a> Tilecache with the option metatiling<br>
> enabled. With metatiling enabled Tilecache will fetch larger tiles (eg.<br>
> 4096x4096) from Mapserver and will cut them into smaller tiles (eg.<br>
> 256x256). It will also increase performance because Mapserver does not need<br>
> to render tiles when they are already in cache.<br>
><br>
> kaipi<br>
> --<br>
> View this message in context:<br>
> <a href="http://osgeo-org.1803224.n2.nabble.com/WMS-and-tiles-cutting-off-tp4978418p4979280.html" target="_blank">http://osgeo-org.1803224.n2.nabble.com/WMS-and-tiles-cutting-off-tp4978418p4979280.html</a><br>
> Sent from the Mapserver - User mailing list archive at Nabble.com.<br>
> _______________________________________________<br>
> mapserver-users mailing list<br>
><br>
> <a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a>><mailto:<a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a>><br>
> ><mailto:<a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a>><mailto:<br>
> <a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a><mailto:<a href="mailto:mapserver-users@lists.osgeo.org">mapserver-users@lists.osgeo.org</a>>>><br>
><br>
> <a href="http://lists.osgeo.org/mailman/listinfo/mapserver-users" target="_blank">http://lists.osgeo.org/mailman/listinfo/mapserver-users</a><br>
><br>
><br>
><br>
<br>
<br>
<br>
<br>
</div></div></blockquote></div><br>