Map file with 35,000+ Lines... management issue

[Bob Basques]

Espen,

What if any are the performance hits with this approach?  Is the Mapfile assembled before any sort of reading if it is attempted, and it's simply the opening of the additional files that affect the performance?

I do have a system like this in place, but it's for some rather simple looking cartography and it works well with a request handler (Not GeoMoose) that assembles the INCLUDE chunk upon request to build the MAPFILE on the fly for the MapSERVER CGI request, this is real borderline DataBase stuff too, as it's really getting close to the point of putting it into a DB instead of keeping in FLAT files.

This applies to my previous message too about the abundance of layers in our applications.  It would be far easier to build a Webified version of a MAPFILE builder, that still maintained the option(s) of letting each data custodian handle their own cartography for example.

This would certainly be a way of removing the some of the MAPFILE complexities from the average data custodians.  It's something we have been thinking about doing as a module for GeoMoose for example.  Just haven't got it all quite figured out completely yet.   There are some other similar systems for this too that I need to review first as well.  But in the interest of getting the MAPFILE smaller and more manageable . .  .  :c)

bobb





Bob Basques
GIS Systems Developer
City of Saint Paul, MN

GISmo 
Powered by
GeoMOOSE




>>> Espen Isaksen <espen.isaksen at GMAIL.COM> wrote:

Thanks! Don't know how I missed that one...

Espen

On 23/01/2008, Kralidis,Tom [Burlington] <Tom.Kralidis at ec.gc.ca> wrote:
>
>
>
> > -----Original Message-----
> > From: UMN MapServer Users List
> > [mailto:MAPSERVER-USERS at LISTS.UMN.EDU] On Behalf Of Espen Isaksen
> > Sent: 23 January, 2008 2:26 PM
> > To: MAPSERVER-USERS at LISTS.UMN.EDU
> > Subject: Re: [UMN_MAPSERVER-USERS] Map file with 35,000+
> > Lines... management issue
> >
> > Regarding this, is it possible to "include" a map file inside
> > another map file?
> >
>
> One can do just this with the INCLUDE directive.  See
> http://mapserver.gis.umn.edu/docs/reference/mapfile/Include
>
> ..Tom
>
>
> > Espen
> >
> > On 23/01/2008, Fawcett, David <David.Fawcett at state.mn.us> wrote:
> > > Everything is a performance issue, the question is, 'Is the
> > > performance acceptable to you?'...
> > >
> > > You have built a pretty massive map file.  I would look at
> > stripping
> > > it down to only what is needed for a particular application.
> > >
> > > For questions about how to improve performance, you may
> > want to look at:
> > > http://mapserver.gis.umn.edu/docs/howto/mapfiletuning
> > >
> > > David.
> > >
> > > -----Original Message-----
> > > From: UMN MapServer Users List
> > [mailto:MAPSERVER-USERS at LISTS.UMN.EDU]
> > > On Behalf Of riteshambastha
> > > Sent: Wednesday, January 23, 2008 12:59 PM
> > > To: MAPSERVER-USERS at LISTS.UMN.EDU
> > > Subject: Re: [UMN_MAPSERVER-USERS] Map file with 35,000+ Lines...
> > > management issue
> > >
> > >
> > > Thanks Rich,
> > >
> > > Yeah, even I am trying to solve this issue by separating
> > the huge map
> > > file with smaller chunks of many map files. Am bit confused
> > if it will
> > > lead to performance issues.
> > >
> > > Warm Regards,
> > > Ritz
> > >
> > >
> > >
> > > rich.fromm wrote:
> > > >
> > > >
> > > > riteshambastha wrote:
> > > >>
> > > >> I have developed a map file with more than 35,000 Lines.
> > > >>
> > > >> Please throw some lights over writing map files by
> > following best
> > > >> practices.
> > > >>
> > > >
> > > > Have you considered more than one map file, depending on the
> > > > circumstances, each one a bit smaller, rather than one
> > huge map file?
> > > >
> > > > It's hard to say how appropriate that may or may not be without
> > > > knowing more about your circumstances, but that's what I have.
> > > >
> > > > - Rich
> > > >
> > > >
> > >
> > > --
> > > View this message in context:
> > >
> > http://www.nabble.com/Map-file-with-35%2C000%2B-Lines...-management-is
> > > su
> > > e-tp15048892p15048905.html
> > > Sent from the Mapserver - User mailing list archive at Nabble.com.
> > >
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/mapserver-users/attachments/20080123/5967882e/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 11946 bytes
Desc: not available
URL: <http://lists.osgeo.org/pipermail/mapserver-users/attachments/20080123/5967882e/attachment.gif>