[Qgis-user] Limit to Geodatabase File Size?

[Even Rouault]

On mercredi 8 mars 2017 12:46:54 CET Parker, Jonathon wrote:
> Even,
> 
> Thanks for the quick turn around.  How do I get the bug fix?  Do I download
> and install 2.18.4 or is there an easier way to get the bug fix?

You'll need to wait for the fix to land in an official GDAL release, so not immediately.

Or you can use the today's gdal-dev daily build from OSGeo4W that must have the fix, but you'll
need to convert the file to something else before with ogr2ogr
For example:
ogr2ogr -f GPKG tlgdb_2016_a_us_edges.gpkg tlgdb_2016_a_us_edges.gdb -lco SPATIAL_INDEX=NO

The SPATIAL_INDEX=NO option is due to my experimentation. There's a strong performance issue
when creating a SQLite spatial index on such a big table. Which is a bit sad given that it would
be the most useful in that situation...

> 
> Jonathon
> 
> On Tue, Mar 7, 2017 at 9:38 PM, Even Rouault <even.rouault at spatialys.com>
> 
> wrote:
> > On mardi 7 mars 2017 14:30:13 CET Parker, Jonathon wrote:
> > > New user to QGIS here. Went through some tutorials, had ESRI experience
> > 
> > in
> > 
> > > distance past. Starting a demonstration project using data from the US
> > > 
> > > Census Bureau https://www.census.gov/geo/maps-data/data/tiger.html
> > > 
> > > 
> > > 
> > > I successfully added shapefiles and small geodatabases
> > > 
> > > ftp://ftp2.census.gov/geo/tiger/TGRGDB16// as layers. When I tried the
> > > 
> > > same process with a large geodatabase (tlgdb_2016_a_us_edges.gdb), it
> > > did
> > > 
> > > not render. The feature count was reported as 0. I contacted the US
> > 
> > Census
> > 
> > > bureau and they verified it was not corrupted and worked on ESRI
> > 
> > products.
> > 
> > > Is there a size limit that prevents QGIS from working with large files?
> > > 
> > > The table in the geodatabase is 13GB.
> > 
> > I've downloaded the file and reproduced the issue. The OGR OpenFileGDB
> > driver had a bug in the particular situation where the attribute
> > description section of the .gdbtable is beyond the 4 GB offset. I've just
> > fixed it per
> > 
> > https://trac.osgeo.org/gdal/ticket/6830
> > 
> > 
> > 
> > The feature count now reported is ~68 million and it displays fine in QGIS
> > (against the fixed GDAL version)
> > 
> > 
> > 
> > Best regards,
> > 
> > 
> > 
> > Even
> > 
> > 
> > 
> > --
> > 
> > Spatialys - Geospatial professional services
> > 
> > http://www.spatialys.com


-- 
Spatialys - Geospatial professional services
http://www.spatialys.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/qgis-user/attachments/20170308/adfaeb5a/attachment.html>