[GRASS-dev] [GRASS GIS] #494: break in importing and cleaning very large vector datasets

[GRASS GIS]

#494: break in importing and cleaning very large vector datasets
---------------------+------------------------------------------------------
  Reporter:  gisboa  |       Owner:  grass-dev@…              
      Type:  defect  |      Status:  reopened                 
  Priority:  major   |   Milestone:  6.4.0                    
 Component:  Vector  |     Version:  6.4.0 RCs                
Resolution:          |    Keywords:  vector import clean build
  Platform:  All     |         Cpu:  All                      
---------------------+------------------------------------------------------
Changes (by dido):

  * status:  closed => reopened
  * resolution:  worksforme =>


Comment:

 Same issue was observed on a large (282 MB shapefile) containing ~350 000
 polygons.
 A dump from the output window:


 Layer: BGM_Polygons_L0

 Counting polygons for 358823 features...


 Importing map 358823 features...

 -----------------------------------------------------
 ...
 483699 primitives registered

 17237143 vertices registered

 Number of nodes: 414562

 Number of primitives: 483699

 Number of points: 0

 Number of lines: 0

 Number of boundaries: 483699

 Number of centroids: 0

 Number of areas: -

 Number of isles: -

 -----------------------------------------------------

 Cleaning polygons, result is not guaranteed!

 -----------------------------------------------------

 Snap boundaries (threshold = 1.000e-005):


 G_realloc: unable to allocate 155760024 bytes at snap.c:155
 Finished with error

 System is Win7x64 with 16G of RAM. RAM usage reported was ~4.3G at max,
 dropped down to ~2.6G, then the error popped-up. Progress was at ~70%.

 This was seen first on a QGIS 2.2.0 Valmiera, same behavior was seen on
 1.8.0 Lisboa.

-- 
Ticket URL: <https://trac.osgeo.org/grass/ticket/494#comment:4>
GRASS GIS <http://grass.osgeo.org>