[mapguide-users] MapGuide and GDAL Provider Stability and Performance Initiative

Trevor Wekel trevor_wekel at otxsystems.com
Thu Dec 31 13:41:49 EST 2009 

Hello MapGuide Users,

Based on various posting to mapguide-users, it looks as though we still have stability and performance issues with MapGuide Open Source 2.1 and the GDAL Provider.  After some discussion with the PSC and other community members on the mapguide-internals list, I have decided to take on MapGuide/GDAL stability and performance as an initiative.

Based on my previous experience with raster in MapGuide 6.5 and MapGuide Enterprise, and some previous discussions on the mapguide-internals list, this project has the potential to be a fairly long endeavour.  A stable and scalable MapGuide/GDAL solution will likely take man weeks of effort.

I plan to use a phased approach for this initiative.  The first phase will be test environment setup and initial analysis into the reported instability with MapGuide/GDAL.  This will provide the community with more detailed information on the root cause(s).  Using this information, the development community can determine the next steps towards achieving a stable and scalable MapGuide/GDAL solution.

The Project Steering Committee does not currently have funding to support this initiative.  As a result, I am formally requesting funding directly from the community.  If you are interested in supporting this initiative, please donate via my initiatives page at http://www.otxsystems.com/community-initiatives.html

Thank you for your support,
Trevor Wekel


-----Original Message-----
From: mapguide-users-bounces at lists.osgeo.org [mailto:mapguide-users-bounces at lists.osgeo.org] On Behalf Of Andy Morsell
Sent: December 27, 2009 10:29 PM
To: 'MapGuide Users Mail List'
Subject: RE: [mapguide-users] [MGOS 2.1]few map with Ecw, need restart mapguide service

Trevor,
What would it require, in terms of funding, to have you spend enough time
examining the provider and problems to come up with an approach and labor
estimate to improve it?  Maybe we can collectively raise enough money from
contributors to fund the functional specifications determination and then
see if we can fund the full project after.

Thanks,

Andy Morsell, P.E.
Spatial Integrators, Inc.
47° 46' N 116° 49' W
www.SpatialGIS.com

-----Original Message-----
From: mapguide-users-bounces at lists.osgeo.org
[mailto:mapguide-users-bounces at lists.osgeo.org] On Behalf Of Trevor Wekel
Sent: Sunday, December 27, 2009 9:15 PM
To: MapGuide Users Mail List
Subject: RE: [mapguide-users] [MGOS 2.1]few map with Ecw, need restart
mapguide service


Just as a point of reference, I have been involved with MapGuide and raster
since the MapGuide 6.x days.  Stable multi-threaded performance is difficult
to achieve due to the sheer number of third party libraries involved.  From
what I recall, Autodesk spent at least two developer months in the last
release getting the Autodesk Raster Provider to the stable and relatively
scalable state it is in currently.

This is not an easy task.  Each file format has to tested, analysed, and
fixed separately because the underlying "codec" libraries are all different
and come from different vendors.  In other words, stability with TIFF data
does not guarantee stability with ECW or MrSID.  In some cases, the vendor
libraries may not be 100% thread safe.  MapGuide is a heavily multi-threaded
application.  If there is a thread safety problem, it is almost guaranteed
that MapGuide will trip over it at some point.

This makes testing and validation especially painful.  I would consider a 24
hour load test on a 4 core machine to be a bare minimum test run for
stability.  8+ cores would be preferable.

I personally like working on raster integration in MapGuide.  However, I
also have enough background to know that it can be a bit of a black hole as
far as development resources go.  Hopefully we as a community can raise
enough funds through Project Sponsorship to pay a developer to bury his head
in the raster provider for a couple of months.

Thanks,
Trevor

-----Original Message-----
From: mapguide-users-bounces at lists.osgeo.org
[mailto:mapguide-users-bounces at lists.osgeo.org] On Behalf Of Jason Birch
Sent: December 27, 2009 6:47 PM
To: MapGuide Users Mail List
Subject: Re: [mapguide-users] [MGOS 2.1]few map with Ecw, need restart
mapguide service

It has been pretty decent for me with tiled, overviewed GeoTiffs and
connection cache disabled...

Folks, this is a known problem, but unless someone steps up to fix it,
it is unlikely to get resolved.  ADSK has a proprietary raster
provider, so don't have a vested interest in diagnosing and fixing
this problem.

As I see it, there are two options: wait and hope someone steps in and
fixes it, or pay someone with the experience and ability (Trevor,
Haris, maybe Frank, Kenneth, UV, maybe others) to do it.

Raster in MGOS has been a pain point for at least two releases, so I
wouldn't hold my breath on the first option...

Jason

On 2009-12-27, isca <mapguide2007 at gmail.com> wrote:
>
> It seems the GDAL provider still acts very unstable under MGOS 2.1. There
> has
> been logged a ticket for this. Refer to #1196 MapGuide unresponsive using
> GDAL provider.
>
>
> lunab54 wrote:
>>
>> I make another experience
>>
>> i get an old unused windows 2003 server and i installed MapGuide 2.1 with
>> ecw support
>>
>> miracle ! mapguide with gdal ecw layer run well like service (not debug
>> mode)
>>
>> so i copied the c:\program Files\osgeo\mapguide on the new 2003 server
>> that not run with ecw layer
>>
>> and it's always the same thing : Gdal turn around and the mapguide log
>> said :
>>
>> <2009-12-21T17:46:58> 	4160	Ajax Viewer	127.0.0.1
Administrator
>>  Error: Failed to stylize layer: LAYER_ECW_DEBUG
>>         Cannot create any more connections to the OSGeo.Gdal FDO
provider.
>>  StackTrace:
>>   - MgMappingUtil.StylizeLayers() line 776 file
>> c:\osgeo\mapguide_21\mgdev\server\src\services\mapping\MappingUtil.cpp

>>
>> so now i think there is missing something on this system but what ?
>>
>> help...
>>
>>
>
> --
> View this message in context:
>
http://n2.nabble.com/MGOS-2-1-few-map-with-Ecw-need-restart-mapguide-service
-tp4177077p4221048.html
> Sent from the MapGuide Users mailing list archive at Nabble.com.
> _______________________________________________
> mapguide-users mailing list
> mapguide-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/mapguide-users
>
_______________________________________________
mapguide-users mailing list
mapguide-users at lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapguide-users



_______________________________________________
mapguide-users mailing list
mapguide-users at lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapguide-users

More information about the mapguide-users mailing list