[GRASS-user] v.select disjoint operation. Grass 7.8.2

[Markus Metz]

Hi Chris,

this " ERROR: Unable to seek: Invalid argument" is a strange error because
v.select uses exactly the same functions to seek and read data as the
modules you used to produce the input vectors for v.select.

You have already listed the commands leading to the error, could you also
provide the input files file.json, file2.gpkg for debugging?

Best,

Markus M


On Thu, May 20, 2021 at 6:39 PM Christopher Lloyd via grass-user <
grass-user at lists.osgeo.org> wrote:

> Hi Markus, Thanks for your reply - sure. In current and previous
> successful runs of the disjoint operation in v.select I have input
> shapefile subsets of up to 2 GB in file size (file size just the shp file
> extension itself - not dbf etc.). Shapefiles of 2.5 GB size failed and had
> to be split. These correspond to 10,659,000 features and 12,159,000
> features respectively. I don't believe that the error is linked to any
> intrinsic limitation of the shapefile format as I also receive the same
> error when I input to Grass the (unsplit) polygon datasets in geojson or
> geopackage format.
>
> Best wishes, Chris
>
> On Thursday, 20 May 2021, 16:48:14 BST, Markus Neteler <neteler at osgeo.org>
> wrote:
>
>
> Hi Chris,
>
> On Thu, May 20, 2021 at 2:00 PM Christopher Lloyd
> <chrislloyd2 at yahoo.co.uk> wrote:
> >
> > Hi Markus, Having split my input data into smaller sized shp files,
> these now process fine using v.select. So clearly the problem that I had
> lies with some file size limitation with the v.select 'disjoint' algorithm
> - also failing with one input file prior using the v.extract algorithm. The
> original (large) input files input to grass ok using v.in.ogr,
>
> The vector limit is as follows:
>
>
> https://grasswiki.osgeo.org/wiki/GRASS_GIS_Performance#Large_vector_data_processing
> --> In all GRASS versions, the limit with topology is at time 2^31 - 1
> (about 2 billion) features per vector map.
>
>
> > but then failed when using v.select. Might you be able to indicate the
> file size limitation for the v.select algorithm and the reasons for this?
> Thanks.
>
>
> This said, perhaps v.select lacks a proper declaration?
>
> Could you tell us how many vector features per map you are dealing
> with (say: those which work and those which fail)?
>
> Best wishes, Markus
>
> _______________________________________________
> grass-user mailing list
> grass-user at lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/grass-user
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/grass-user/attachments/20210520/d839c1e3/attachment.html>