[GRASS-user] Memory problems with v.in.ogr

[Markus Metz]

On Fri, Nov 26, 2010 at 3:14 AM, Pierre Roudier
<pierre.roudier at gmail.com> wrote:
> Dear list,
>
> I am trying to load a pretty big shapefile on GRASS (6Mb +, 211621
> features)  using v.in.ogr, but each attempt fails at the 'break
> boundaries'' stage (at 98%!):
>
> GRASS 7.0.svn (NZTM2000):~ > v.in.ogr
> dsn=~/Documents/DATA/LCDB2/ni_nzmg.shp out=ni_lcdb2 --o
> Projection of input dataset and current location appear to match
> Layer: ni_nzmg
> Counting polygons for 211621 features...
> Importing map 211621 features...
>  100%
> -----------------------------------------------------
> Building topology for vector map <ni_lcdb2_tmp at ni>...
> Registering primitives...
> 334611 primitives registered
> 18459167 vertices registered
> Number of nodes: 211681
> Number of primitives: 334611
> Number of points: 0
> Number of lines: 0
> Number of boundaries: 334611
> Number of centroids: 0
> Number of areas: -
> Number of isles: -
> -----------------------------------------------------
> WARNING: Cleaning polygons, result is not guaranteed!
> -----------------------------------------------------
> Break polygons:
>  100%
>  100%
> -----------------------------------------------------
> Remove duplicates:
>  100%
> -----------------------------------------------------
> Break boundaries:
> ERROR: G_calloc: unable to allocate 50 * 8 bytes of memory at
>       allocation.c:82
>
> The shp loads without any problems on QGIS.
>

> OS: Opensuse 11.3, with 7Gb RAM.
Is this a 64 bit OS?

I have previously successfully imported larger shapefiles, more than
double in size: >400,000 areas, >40 million vertices, peak memory
consumption was close to 4GB. The import of your shapefile would
approximately require about 2GB of memory, which should not be a
problem with 7GB available, as long as it's all 64 bit and not 32 bit.

Markus M