[mapserver-users] Layer with over 6000 shapefiles

[EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE]

That's the default output for Global Mapper when exporting vector data as
gridded shapefiles.  Maybe they need to add an option to create all
shapefiles with the same attributes for a single export job? 

-----Original Message-----
From: mapserver-users-bounces at lists.osgeo.org
[mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Stephen
Woodbridge
Sent: Wednesday, January 29, 2014 11:38 AM
To: mapserver-users at lists.osgeo.org
Subject: Re: [mapserver-users] Layer with over 6000 shapefiles

On 1/29/2014 1:27 PM, EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE wrote:
> The Tile4ms utility is kicking out an error on some of the larger 
> shape files, saying the .dbf doesn't match the file.  Whatever that 
> means.  I can still load the "bad" shapefiles in Global Mapper, and 
> they appear to be

This error means that the columns in the dbf files that you are adding to
the tileindex do not all have the same attribute columns. This is caused by
the columns being just different, in names, widths, or order of columns.

Mapserver opens the first file that it gets a hit on and then expects ALL
other files to have identical DBF structures because of the way it access
data in the files.

-Steve W

> correct.  I'm reprocessing the data now to cut down on the number of
files.
> I should end up with a 48x16 grid covering the whole world.  Hopefully 
> I can get that working with an index and speed things up when 
> displaying this layer.
>
>
> -----Original Message-----
> From: mapserver-users-bounces at lists.osgeo.org
> [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Stephen 
> Woodbridge
> Sent: Wednesday, January 29, 2014 9:46 AM
> To: mapserver-users at lists.osgeo.org
> Subject: Re: [mapserver-users] Layer with over 6000 shapefiles
>
> On 1/29/2014 11:37 AM, Jeff McKenna wrote:
>> On 1/29/2014, 12:32 PM, EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE
wrote:
>>> Hi,
>>> Is there a way to add a layer that points to 6000 some odd shapefiles?
> I've created a set of contour files for the whole world, and when I 
> had the info in a single shapefile it was about 260GBs.  Mapserver 
> would serve it up, but performance was horrible.  I now have the set 
> broken up into about
> 6000 separate shapefiles, but don't know how to address that in a 
> single layer.  I tried using gdaltindex, to create a single index file 
> that points to all the other shapefiles, but I get an error saying the 
> shapefiles are an unsupported type.  Is there some other way to create 
> an index that Mapserver can use to point to this many shapefiles?
>>> Thanks,
>>> James
>>>
>>
>> You can use the MapServer "tile4ms" utility 
>> (http://mapserver.org/utilities/tile4ms.html).  There are some good 
>> examples on that page for you to follow.
>
> Check the results from tile4ms with shpdump and make sure that you 
> dont have all null shapes. I have run into this on Ubuntu. I believe 
> in both the packages and compiling for source. I haven't had time to 
> run down what the issues are.
>
> -Steve
>
> _______________________________________________
> mapserver-users mailing list
> mapserver-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>
>
>
> _______________________________________________
> mapserver-users mailing list
> mapserver-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>

_______________________________________________
mapserver-users mailing list
mapserver-users at lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 6912 bytes
Desc: not available
URL: <http://lists.osgeo.org/pipermail/mapserver-users/attachments/20140129/27ec3f07/attachment-0001.bin>