[mapguide-users] MapGuide and GDAL Provider Stability and Performance Initiative

Tue Jan 5 02:57:37 EST 2010

I just chipped in $100, thanks for organizing this Trevor

if everyone who would like to have reliable GDAL did this,
we can reach the target pretty easily. hint :)

z

2010/1/1 Trevor Wekel <trevor_wekel at otxsystems.com>:
> Hello MapGuide Users,
>
> Based on various posting to mapguide-users, it looks as though we still have stability and performance issues with MapGuide Open Source 2.1 and the GDAL Provider.  After some discussion with the PSC and other community members on the mapguide-internals list, I have decided to take on MapGuide/GDAL stability and performance as an initiative.
>
> Based on my previous experience with raster in MapGuide 6.5 and MapGuide Enterprise, and some previous discussions on the mapguide-internals list, this project has the potential to be a fairly long endeavour.  A stable and scalable MapGuide/GDAL solution will likely take man weeks of effort.
>
> I plan to use a phased approach for this initiative.  The first phase will be test environment setup and initial analysis into the reported instability with MapGuide/GDAL.  This will provide the community with more detailed information on the root cause(s).  Using this information, the development community can determine the next steps towards achieving a stable and scalable MapGuide/GDAL solution.
>
> The Project Steering Committee does not currently have funding to support this initiative.  As a result, I am formally requesting funding directly from the community.  If you are interested in supporting this initiative, please donate via my initiatives page at http://www.otxsystems.com/community-initiatives.html
>
> Thank you for your support,
> Trevor Wekel
>
>
> -----Original Message-----
> From: mapguide-users-bounces at lists.osgeo.org [mailto:mapguide-users-bounces at lists.osgeo.org] On Behalf Of Andy Morsell
> Sent: December 27, 2009 10:29 PM
> To: 'MapGuide Users Mail List'
> Subject: RE: [mapguide-users] [MGOS 2.1]few map with Ecw, need restart mapguide service
>
> Trevor,
> What would it require, in terms of funding, to have you spend enough time
> examining the provider and problems to come up with an approach and labor
> estimate to improve it?  Maybe we can collectively raise enough money from
> contributors to fund the functional specifications determination and then
> see if we can fund the full project after.
>
> Thanks,
>
> Andy Morsell, P.E.
> Spatial Integrators, Inc.
> 47° 46' N 116° 49' W
> www.SpatialGIS.com
>
> -----Original Message-----
> From: mapguide-users-bounces at lists.osgeo.org
> [mailto:mapguide-users-bounces at lists.osgeo.org] On Behalf Of Trevor Wekel
> Sent: Sunday, December 27, 2009 9:15 PM
> To: MapGuide Users Mail List
> Subject: RE: [mapguide-users] [MGOS 2.1]few map with Ecw, need restart
> mapguide service
>
>
> Just as a point of reference, I have been involved with MapGuide and raster
> since the MapGuide 6.x days.  Stable multi-threaded performance is difficult
> to achieve due to the sheer number of third party libraries involved.  From
> what I recall, Autodesk spent at least two developer months in the last
> release getting the Autodesk Raster Provider to the stable and relatively
> scalable state it is in currently.
>
> This is not an easy task.  Each file format has to tested, analysed, and
> fixed separately because the underlying "codec" libraries are all different
> and come from different vendors.  In other words, stability with TIFF data
> does not guarantee stability with ECW or MrSID.  In some cases, the vendor
> libraries may not be 100% thread safe.  MapGuide is a heavily multi-threaded
> application.  If there is a thread safety problem, it is almost guaranteed
> that MapGuide will trip over it at some point.
>
> This makes testing and validation especially painful.  I would consider a 24
> hour load test on a 4 core machine to be a bare minimum test run for
> stability.  8+ cores would be preferable.
>
> I personally like working on raster integration in MapGuide.  However, I
> also have enough background to know that it can be a bit of a black hole as
> far as development resources go.  Hopefully we as a community can raise
> enough funds through Project Sponsorship to pay a developer to bury his head
> in the raster provider for a couple of months.
>
> Thanks,
> Trevor
>
> -----Original Message-----
> From: mapguide-users-bounces at lists.osgeo.org
> [mailto:mapguide-users-bounces at lists.osgeo.org] On Behalf Of Jason Birch
> Sent: December 27, 2009 6:47 PM
> To: MapGuide Users Mail List
> Subject: Re: [mapguide-users] [MGOS 2.1]few map with Ecw, need restart
> mapguide service
>
> It has been pretty decent for me with tiled, overviewed GeoTiffs and
> connection cache disabled...
>
> Folks, this is a known problem, but unless someone steps up to fix it,
> it is unlikely to get resolved.  ADSK has a proprietary raster
> provider, so don't have a vested interest in diagnosing and fixing
> this problem.
>
> As I see it, there are two options: wait and hope someone steps in and
> fixes it, or pay someone with the experience and ability (Trevor,
> Haris, maybe Frank, Kenneth, UV, maybe others) to do it.
>
> Raster in MGOS has been a pain point for at least two releases, so I
> wouldn't hold my breath on the first option...
>
> Jason
>
> On 2009-12-27, isca <mapguide2007 at gmail.com> wrote:
>>
>> It seems the GDAL provider still acts very unstable under MGOS 2.1. There
>> has
>> been logged a ticket for this. Refer to #1196 MapGuide unresponsive using
>> GDAL provider.
>>
>>
>> lunab54 wrote:
>>>
>>> I make another experience
>>>
>>> i get an old unused windows 2003 server and i installed MapGuide 2.1 with
>>> ecw support
>>>
>>> miracle ! mapguide with gdal ecw layer run well like service (not debug
>>> mode)
>>>
>>> so i copied the c:\program Files\osgeo\mapguide on the new 2003 server
>>> that not run with ecw layer
>>>
>>> and it's always the same thing : Gdal turn around and the mapguide log
>>> said :
>>>
>>> <2009-12-21T17:46:58>        4160    Ajax Viewer     127.0.0.1
> Administrator
>>>  Error: Failed to stylize layer: LAYER_ECW_DEBUG
>>>         Cannot create any more connections to the OSGeo.Gdal FDO
> provider.
>>>  StackTrace:
>>>   - MgMappingUtil.StylizeLayers() line 776 file
>>> c:\osgeo\mapguide_21\mgdev\server\src\services\mapping\MappingUtil.cpp
>
>>>
>>> so now i think there is missing something on this system but what ?
>>>
>>> help...
>>>
>>>
>>
>> --
>> View this message in context:
>>
> http://n2.nabble.com/MGOS-2-1-few-map-with-Ecw-need-restart-mapguide-service
> -tp4177077p4221048.html
>> Sent from the MapGuide Users mailing list archive at Nabble.com.
>> _______________________________________________
>> mapguide-users mailing list
>> mapguide-users at lists.osgeo.org
>> http://lists.osgeo.org/mailman/listinfo/mapguide-users
>>
> _______________________________________________
> mapguide-users mailing list
> mapguide-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/mapguide-users
>
>
>
> _______________________________________________
> mapguide-users mailing list
> mapguide-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/mapguide-users
>
>
> _______________________________________________
> mapguide-users mailing list
> mapguide-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/mapguide-users
>

-- 
Zac Spitzer
Solution Architect / Director
Ennoble Consultancy Australia
http://www.ennoble.com.au
http://zacster.blogspot.com
+61 405 847 168