[mapserver-dev] Re: Large Shape File Performance

Steve Lime Steve.Lime at dnr.state.mn.us
Mon Apr 21 13:39:19 EDT 2008


Excellent! Any chance Brock could run his test suite? Will try here with some mid-size shapefiles
(e.g. thousands of polygons).

Steve

>>> On 4/21/2008 at 12:25 PM, in message
<30fe546d0804211025h16103005p3374dc7e0cbb2cd9 at mail.gmail.com>, "Paul Ramsey"
<pramsey at cleverelephant.ca> wrote:
> All, I have added another patch which addresses scanning the bitmap
> status structure more efficiently. Here's the results for the two
> patches.
> 
> Two performance patches at:
> http://trac.osgeo.org/mapserver/ticket/2282 
> 
> Summary:
> 
> Performance patches radically improved the selective case and
> left the un-selective case in reasonable shape.
> 
> Definitions of tests:
> 
> o Indexed: Render 20 features of 1.8M, using an index scan to only
>  pull the features needed from the SHP file.  Tests the selective
> data access case.
> o Unindexed: Render 20 features of 1.8M, using no index. Forces
> bounds from every feature to be read.  Tests the un-selective
> data access case
> 
> Mapserver 5.0
> 
>   Indexed: 164ms
>   Unindexed: 990ms
> 
> Mapserver SVN + SHX Patch
> 
>   Indexed: 48ms
>   Unindexed: 1015ms
> 
> Mapserver SVN + Bitmap Patch
> 
>   Indexed: 143ms
>   Unindexed: 975ms
> 
> Mapserver SVN + Bitmap Patch + SVN Patch
> 
>   Indexed: 28ms
>   Unindexed: 991ms
> 
> 
> On Sat, Apr 19, 2008 at 9:40 AM, Paul Ramsey <pramsey at cleverelephant.ca> 
> wrote:
>> All,
>>
>>  I've done a patch that seems to improve the large shape file
>>  performance while not overly affecting the standard performance. I am
>>  interested in folks trying it out on their own systems and seeing if
>>  the timings are better for them. Also in people who do file
>>  creation/writing with mapscript confirming I haven't broken that
>>  functionality.
>>
>>  Patch attached to ticket: http://trac.osgeo.org/mapserver/ticket/2282 
>>
>>  Thanks,
>>
>>  Paul
>>
> _______________________________________________
> mapserver-dev mailing list
> mapserver-dev at lists.osgeo.org 
> http://lists.osgeo.org/mailman/listinfo/mapserver-dev



More information about the mapserver-dev mailing list