[mapguide-users] SDF load problems

Wed Mar 22 19:06:33 EST 2006

Regarding "This would be OK if there was an easy way to know where in
the repository that feature source is created when it is initially
defined.", do this experiment:

1)       Name your source data something unique (ex: myUniqueFile.sdf)

2)       Load it using Studio.

3)       On the server, recursively search the Repository folder under
the server installation for the data file (ex: myUniqueFile.sdf).

As long as you don't change the feature source wrapping the data file,
the location of the resource data file on the server won't change. You
can directly update the data file there on the server in the future. 

(DISCLAIMER: This hack bypasses the API. If the resource repository
implementation changes, this might break the hack. Be warned. )

Also, to get a feel for the repository API, try using the html forms
from in your browser
(http://<server_name>/mapguide/mapagent/index.html). It's an easy way
get a look into the resources being created with the Studio load
procedures.

Ed

  _____  

From: Andy Morsell [mailto:amorsell at spatialgis.com] 
Sent: Wednesday, March 22, 2006 6:43 PM
To: users at mapguide.osgeo.org
Subject: RE: [mapguide-users] SDF load problems

I haven't tried it.  I'm sure it would work fine, but it seems like an
awful lot of work to take a Shape file and copy it from one network
location to another (the repository)......... And what about those 1 GB
Shape files?  It's a lot of package and data shuffling to keep your
repository data in synch with the source data.  I would like to be able
to point the repository location to reference the source data in my
chosen network location.  Sort of like MapGuide 6.5 UDL files, but you
could still retain the managed data aspect.  

In the case of converting your source to SDF+, some of us would rather
use FME scripts to update the SDF files in the repository.  This would
be OK if there was an easy way to know where in the repository that
feature source is created when it is initially defined.

Andy 

  _____  

From: Edward Zimmerman [mailto:edward.zimmerman at autodesk.com] 
Sent: Wednesday, March 22, 2006 3:29 PM
To: users at mapguide.osgeo.org
Subject: RE: [mapguide-users] SDF load problems

Regarding "Many of us will want to update our data through external
processes", has anyone tried to write some code which does the
following?

1)       Use the Studio Load API to create the package locally from the
latest source data.

2)       Copy the resulting package file into the Package directory on
the server.

3)       Use the MGOS Admin service API to apply this updated package.

Would this meet most of your needs to update the source flat file data
wrapped by FeatureSource resources?

Thanks,

Ed

  _____  

From: Andy Morsell [mailto:amorsell at spatialgis.com] 
Sent: Wednesday, March 22, 2006 6:03 PM
To: users at mapguide.osgeo.org
Subject: RE: [mapguide-users] SDF load problems

Sorry, I should have clarified that my rant pertains to flat files only.
Database connections will be direct to their source.

Andy 

  _____  

From: Butler, Juan P [mailto:jpbutler at co.pinellas.fl.us] 
Sent: Wednesday, March 22, 2006 2:46 PM
To: users at mapguide.osgeo.org
Subject: RE: [mapguide-users] SDF load problems

Wow.  So you're saying that if and when a provider for Oracle Spatial
comes along, we won't be able to define the connection to the database
and have the data come directly from that connection?   It basically
dumps the data (that point in time) into a repository that resides in on
the MG server?   

Can someone from Autodesk comment on this?   

Juan Butler - Senior Programmer/Analyst
GIS Applications
Pinellas County Information Systems
jpbutler at pinellascounty.org

  _____  

From: Andy Morsell [mailto:amorsell at spatialgis.com] 
Sent: Wednesday, March 22, 2006 5:37 PM
To: users at mapguide.osgeo.org
Subject: RE: [mapguide-users] SDF load problems

This is where using a managed data structure is a detriment, in my
opinion.  Many of us will want to update our data through external
processes and there is no easy way to just copy files into the
repository or point to an existing network location.  I think this is
going to become a much bigger problem as people put these systems into
production and realize that they have to "load" their data into
repositories.  It's also going to be a large problem for keeping data up
to date with ongoing system maintenance.  Scheduled process are going to
be a necessity to ensure that the data in the repository is in synch
with the source data.  And, in the case of large source datasets, the
entire dataset will have to be reloaded as there is no incremental
update method. 

I believe (but have not yet done this) that the Studio API is going to
have to be used to load these resources, not the server API.

Andy Morsell, P.E. 
Spatial Integrators, Inc. 
http://www.SpatialGIS.com 

  _____  

From: Joel Carranza [mailto:jec at gatekeeper.com] 
Sent: Wednesday, March 22, 2006 2:17 PM
To: users at mapguide.osgeo.org
Subject: RE: [mapguide-users] SDF load problems

Ahhh. I see, I misunderstood the use of "Packages" and didn't think too
look there.   Thank you. It is working fine now. 

I have noticed that imported SDFs are processed (into SDF v3, I
believe). Is it currently possible to import SDF data sources into the
repository without using Studio at all, just using the server API? Is it
possible to create your own Packages using the server API?  I would be
interested in doing this for our migration tools. 

Joel Carranza
Gatekeeper Systems
626-449-3070 x114

  _____  

From: Jason Birch [mailto:Jason.Birch at nanaimo.ca] 
Sent: Wednesday, March 22, 2006 1:42 PM
To: users at mapguide.osgeo.org
Subject: RE: [mapguide-users] SDF load problems

It looks like it's too big.  You'll probably have to "Package" the data
and upload it to the server manually, then bring it in via the site
Admin web app.

Jason

  _____  

From: Joel Carranza [mailto:jec at gatekeeper.com] 
Sent: Wednesday, March 22, 2006 13:39
To: users at mapguide.osgeo.org
Subject: [mapguide-users] SDF load problems

I am trying to load a 225 MB SDF file using MapGuide studio. I have
tried any number of different options and they all seem to fail. The
process crunches for a while, and then says "Communicating with server"
and the progress bars fills to 100% .  Eventually, an error dialog is
popped that says "Unable to complete request to site. Connection lost". 

The apache logs showed the following. None of the other logs reported
anything of interest that I could see. 

[Wed Mar 22 13:33:54 2006] [warn] FastCGI: (dynamic) server "C:/Program
Files/MapGuideOpenSource/WebServerExtensions/www/mapagent/MapAgent.exe"
restarted (pid 5284)

[Wed Mar 22 13:34:00 2006] [warn] FastCGI: scheduled the restart of the
last (dynamic) server "C:/Program
Files/MapGuideOpenSource/WebServerExtensions/www/mapagent/MapAgent.exe"
process: reached dynamicMaxClassProcs (10)

[Wed Mar 22 13:34:00 2006] [warn] FastCGI: (dynamic) server "C:/Program
Files/MapGuideOpenSource/WebServerExtensions/www/mapagent/MapAgent.exe"
restarted (pid 6008)

[Wed Mar 22 13:34:21 2006] [warn] FastCGI: (dynamic) server "C:/Program
Files/MapGuideOpenSource/WebServerExtensions/www/mapagent/MapAgent.exe"
(pid 5540) terminated with exit with status '0'

[Wed Mar 22 13:34:38 2006] [warn] FastCGI: (dynamic) server "C:/Program
Files/MapGuideOpenSource/WebServerExtensions/www/mapagent/MapAgent.exe"
(pid 6008) termination signaled

[Wed Mar 22 13:34:39 2006] [warn] FastCGI: (dynamic) server "C:/Program
Files/MapGuideOpenSource/WebServerExtensions/www/mapagent/MapAgent.exe"
(pid 6008) terminated with exit with status '0'

Anyone have any ideas about what is going on? 

Joel Carranza
Gatekeeper Systems
626-449-3070 x114 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.osgeo.org/pipermail/mapguide_users/attachments/20060322/c331faa8/attachment.html