[gdal-dev] Fastest vector format for combining shapefiles

[Peter J Halls]

Jukka,

     it depends upon what your desired result is.  If you just want to replicate 
maps, the answer might differ from seeking to work with the information 
contained within the maps.  Either way, if your data is going to exceed 6GB, you 
probably ought to be looking to one of the DBMS solutions, PostGRES (underlying 
PostGIS) or Oracle.  That would give an added benefit that your data are 
accessible from a wide variety of tools.

Best wishes,

Peter

Jukka Rahkonen wrote:
> Hi,
> 
> I am combining some GIS data where each layer is divided to around thousand
> separare shapefiles by mapsheets. Now I would like to store all the 35000
> shapefiles to something that is more easy to handle. At first pushing each layer
> to own Spatialite database feeled perfect, but I have problems with one layer
> which has rather lot of data. Appending shapefiles one by one to Spatialite
> database gets too slow after the database file has reached a size of around 6
> gigabytes. Up till 3-4 gigabyte file size appending data to Spatialite is pretty
> fast and because it is a database I guess I will use that for small layers.  But
> what might be the fastest vector format that ogr supports to collect the big
> layer (thousand shapefiles with total size of about 10 gigabytes) together?  I
> would prefer some file based format because data goes to long-time storage, but
> I can use Oracle or PostGIS in between if it is faster to do the conversion in
> two steps.  What is recommended? Shapefiles, MapInfo tab, Oracle, PostGIS or
> something else?
> 
> -Jukka Rahkonen-
> 
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/gdal-dev

-- 
--------------------------------------------------------------------------------
Peter J Halls, GIS Advisor, University of York
Telephone: 01904 433806     Fax: 01904 433740
Snail mail: Computing Service, University of York, Heslington, York YO10 5DD
This message has the status of a private and personal communication
--------------------------------------------------------------------------------