[postgis-users] postgis-users Digest, Vol 217, Issue 17

Freddy Gonthier freddy.gonthier at gmail.com
Tue Mar 24 02:16:38 PDT 2020


DBase III 1 milliard d'enregistrements par fichier ;

Le lun. 23 mars 2020 à 20:03, <postgis-users-request at lists.osgeo.org> a
écrit :

> Send postgis-users mailing list submissions to
>         postgis-users at lists.osgeo.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
>         https://lists.osgeo.org/mailman/listinfo/postgis-users
> or, via email, send a message with subject or body 'help' to
>         postgis-users-request at lists.osgeo.org
>
> You can reach the person managing the list at
>         postgis-users-owner at lists.osgeo.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of postgis-users digest..."
>
>
> Today's Topics:
>
>    1. Re: query a certain row from a table. (Willem     Hoffmans) (Willem)
>    2. Re: query a certain row from a table. (Willem Hoffmans)
>       (john polo)
>    3. Re: query a certain row from a table. (Paul Ramsey)
>    4. Re: query a certain row from a table. (Martin Davis)
>    5. Re: query a certain row from a table. (Paul Ramsey)
>    6. Re: postgis-users Digest, Vol 217, Issue 15 (Freddy Gonthier)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Mon, 23 Mar 2020 10:12:21 +0100
> From: Willem <info at ruimtemaatwerk.nl>
> To: postgis-users at lists.osgeo.org
> Subject: Re: [postgis-users] query a certain row from a table. (Willem
>         Hoffmans)
> Message-ID: <43cc4dcf-b918-3bb1-17ad-5798c2baf8a5 at ruimtemaatwerk.nl>
> Content-Type: text/plain; charset="utf-8"; Format="flowed"
>
>
> I'm pretty sure it's the limitations of the Shapefile (or, more
> precisely, the underlying .dbf format) that gives the error.
> Those .dbf files can only contain 2GB of data, see also:
>
> https://en.wikipedia.org/wiki/Shapefile
>
> So ask yourself the question: why export to shapefile? Try Geopackage,
> for instance, it's better, without those limitations.
>
> On Mar 20, 2020, at 11:36 PM, john polo <jpolo at mail.usf.edu
> <mailto:jpolo at mail.usf.edu>> wrote:
>
> Hi,
>
> I'm trying to export a table of points to a shapefile. The table has
> over 8,000,000 rows. I'm using PostGIS 3.0 and PostGIS Shapefile
> Import/Export Manager on Windows 10. When I try to run the export, I
> keep getting this error:
>
> Error: record 3329432 could not be created
>
> I'm not sure how to handle this. My first impulse is find the offending
> row, but I don't know the SQL for such a query. Is there something I
> need to write in a WHERE clause or a different clause to get a specific
> row?
>
>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <
> http://lists.osgeo.org/pipermail/postgis-users/attachments/20200323/24c1459e/attachment-0001.html
> >
>
> ------------------------------
>
> Message: 2
> Date: Mon, 23 Mar 2020 06:24:32 -0700
> From: john polo <jpolo at mail.usf.edu>
> To: postgis-users at lists.osgeo.org
> Subject: Re: [postgis-users] query a certain row from a table. (Willem
>         Hoffmans)
> Message-ID: <0b36910b-9469-2fe1-ef85-63aa10d72dbc at mail.usf.edu>
> Content-Type: text/plain; charset="utf-8"; Format="flowed"
>
> Thanks, Willem. I'll try that instead.
>
> best regards,
>
> John
>
> On 3/23/2020 2:12 AM, Willem wrote:
> >
> > I'm pretty sure it's the limitations of the Shapefile (or, more
> > precisely, the underlying .dbf format) that gives the error.
> > Those .dbf files can only contain 2GB of data, see also:
> >
> > https://en.wikipedia.org/wiki/Shapefile
> >
> > So ask yourself the question: why export to shapefile? Try Geopackage,
> > for instance, it's better, without those limitations.
> >
> > On Mar 20, 2020, at 11:36 PM, john polo <jpolo at mail.usf.edu
> > <mailto:jpolo at mail.usf.edu>> wrote:
> > Hi,
> >
> > I'm trying to export a table of points to a shapefile. The table has
> > over 8,000,000 rows. I'm using PostGIS 3.0 and PostGIS Shapefile
> > Import/Export Manager on Windows 10. When I try to run the export, I
> > keep getting this error:
> >
> > Error: record 3329432 could not be created
> >
> > I'm not sure how to handle this. My first impulse is find the offending
> > row, but I don't know the SQL for such a query. Is there something I
> > need to write in a WHERE clause or a different clause to get a specific
> row?
> >
> >
> > _______________________________________________
> > postgis-users mailing list
> > postgis-users at lists.osgeo.org
> > https://lists.osgeo.org/mailman/listinfo/postgis-users
>
> --
> Enlightenment is ego's ultimate disappointment.
> -Chogyam Trungpa
>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <
> http://lists.osgeo.org/pipermail/postgis-users/attachments/20200323/0b0e420f/attachment-0001.html
> >
>
> ------------------------------
>
> Message: 3
> Date: Mon, 23 Mar 2020 08:30:01 -0700
> From: Paul Ramsey <pramsey at cleverelephant.ca>
> To: PostGIS Users Discussion <postgis-users at lists.osgeo.org>
> Subject: Re: [postgis-users] query a certain row from a table.
> Message-ID: <7AFC7B1F-919D-4DAD-99AC-94E2E4DF3D6B at cleverelephant.ca>
> Content-Type: text/plain;       charset=us-ascii
>
> Challenge accepted!!!!
>
> pramsey=# select st_isvalid(st_makepoint('NaN'::float8,1));
> NOTICE:  Invalid Coordinate at or near point nan 1
>  st_isvalid
> ------------
>  f
> (1 row)
>
>
>
>
> > On Mar 21, 2020, at 10:51 PM, Martin Davis <mtnclimb at gmail.com> wrote:
> >
> > Not surprising - I'm not sure it's possible to make an invalid point.
> >
> > On Sat, Mar 21, 2020 at 10:07 PM john polo <jpolo at mail.usf.edu> wrote:
> > I used
> >
> > SELECT "SAMPLING_EVENT_IDENTIFIER" FROM p_loc.ebird_sel_spt
> > WHERE ST_IsValid(geom) is false
> > ;
> >
> > No rows are returned.
> >
> >
> >
> > On 3/21/2020 4:13 PM, Alexander Gataric wrote:
> >> Write a query using predicate
> >>
> >> ST_IsValid(geom_column) is false
> >>
> >> Get BlueMail for Android
> >> On Mar 21, 2020, at 10:06 AM, John Polo <jpolo at mail.usf.edu> wrote:
> >> They are stored as Point. One per row.
> >>
> >>
> >>
> >> On Saturday, March 21, 2020, Alexander Gataric < gataric at usa.net>
> wrote:
> >> What format are the points stored in? Point, multipoint? How many
> points per row?
> >>
> >> Get BlueMail for Android
> >> On Mar 20, 2020, at 11:36 PM, john polo < jpolo at mail.usf.edu> wrote:
> >> Hi,
> >>
> >> I'm trying to export a table of points to a shapefile. The table has
> >> over 8,000,000 rows. I'm using PostGIS 3.0 and PostGIS Shapefile
> >> Import/Export Manager on Windows 10. When I try to run the export, I
> >> keep getting this error:
> >>
> >> Error: record 3329432 could not be created
> >>
> >> I'm not sure how to handle this. My first impulse is find the offending
> >> row, but I don't know the SQL for such a query. Is there something I
> >> need to write in a WHERE clause or a different clause to get a specific
> row?
> >>
> >>
> >>
> >> postgis-users mailing list
> >>
> >> postgis-users at lists.osgeo.org
> >> https://lists.osgeo.org/mailman/listinfo/postgis-users
> >>
> >>
> >> _______________________________________________
> >> postgis-users mailing list
> >>
> >> postgis-users at lists.osgeo.org
> >> https://lists.osgeo.org/mailman/listinfo/postgis-users
> > --
> > Enlightenment is ego's ultimate disappointment.
> > -Chogyam Trungpa
> >
> > _______________________________________________
> > postgis-users mailing list
> > postgis-users at lists.osgeo.org
> > https://lists.osgeo.org/mailman/listinfo/postgis-users
> > _______________________________________________
> > postgis-users mailing list
> > postgis-users at lists.osgeo.org
> > https://lists.osgeo.org/mailman/listinfo/postgis-users
>
>
>
> ------------------------------
>
> Message: 4
> Date: Mon, 23 Mar 2020 09:54:15 -0700
> From: Martin Davis <mtnclimb at gmail.com>
> To: PostGIS Users Discussion <postgis-users at lists.osgeo.org>
> Subject: Re: [postgis-users] query a certain row from a table.
> Message-ID:
>         <CAK2ens2-Xs7d=
> Bw83L35GZ9j2GwpVRiefBqt6tXwD-5mQ1Ovdg at mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Ah yes, good point!
>
> On Mon, Mar 23, 2020 at 8:30 AM Paul Ramsey <pramsey at cleverelephant.ca>
> wrote:
>
> > Challenge accepted!!!!
> >
> > pramsey=# select st_isvalid(st_makepoint('NaN'::float8,1));
> > NOTICE:  Invalid Coordinate at or near point nan 1
> >  st_isvalid
> > ------------
> >  f
> > (1 row)
> >
> >
> >
> >
> > > On Mar 21, 2020, at 10:51 PM, Martin Davis <mtnclimb at gmail.com> wrote:
> > >
> > > Not surprising - I'm not sure it's possible to make an invalid point.
> > >
> > > On Sat, Mar 21, 2020 at 10:07 PM john polo <jpolo at mail.usf.edu> wrote:
> > > I used
> > >
> > > SELECT "SAMPLING_EVENT_IDENTIFIER" FROM p_loc.ebird_sel_spt
> > > WHERE ST_IsValid(geom) is false
> > > ;
> > >
> > > No rows are returned.
> > >
> > >
> > >
> > > On 3/21/2020 4:13 PM, Alexander Gataric wrote:
> > >> Write a query using predicate
> > >>
> > >> ST_IsValid(geom_column) is false
> > >>
> > >> Get BlueMail for Android
> > >> On Mar 21, 2020, at 10:06 AM, John Polo <jpolo at mail.usf.edu> wrote:
> > >> They are stored as Point. One per row.
> > >>
> > >>
> > >>
> > >> On Saturday, March 21, 2020, Alexander Gataric < gataric at usa.net>
> > wrote:
> > >> What format are the points stored in? Point, multipoint? How many
> > points per row?
> > >>
> > >> Get BlueMail for Android
> > >> On Mar 20, 2020, at 11:36 PM, john polo < jpolo at mail.usf.edu> wrote:
> > >> Hi,
> > >>
> > >> I'm trying to export a table of points to a shapefile. The table has
> > >> over 8,000,000 rows. I'm using PostGIS 3.0 and PostGIS Shapefile
> > >> Import/Export Manager on Windows 10. When I try to run the export, I
> > >> keep getting this error:
> > >>
> > >> Error: record 3329432 could not be created
> > >>
> > >> I'm not sure how to handle this. My first impulse is find the
> offending
> > >> row, but I don't know the SQL for such a query. Is there something I
> > >> need to write in a WHERE clause or a different clause to get a
> specific
> > row?
> > >>
> > >>
> > >>
> > >> postgis-users mailing list
> > >>
> > >> postgis-users at lists.osgeo.org
> > >> https://lists.osgeo.org/mailman/listinfo/postgis-users
> > >>
> > >>
> > >> _______________________________________________
> > >> postgis-users mailing list
> > >>
> > >> postgis-users at lists.osgeo.org
> > >> https://lists.osgeo.org/mailman/listinfo/postgis-users
> > > --
> > > Enlightenment is ego's ultimate disappointment.
> > > -Chogyam Trungpa
> > >
> > > _______________________________________________
> > > postgis-users mailing list
> > > postgis-users at lists.osgeo.org
> > > https://lists.osgeo.org/mailman/listinfo/postgis-users
> > > _______________________________________________
> > > postgis-users mailing list
> > > postgis-users at lists.osgeo.org
> > > https://lists.osgeo.org/mailman/listinfo/postgis-users
> >
> > _______________________________________________
> > postgis-users mailing list
> > postgis-users at lists.osgeo.org
> > https://lists.osgeo.org/mailman/listinfo/postgis-users
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <
> http://lists.osgeo.org/pipermail/postgis-users/attachments/20200323/fa68ecd5/attachment-0001.html
> >
>
> ------------------------------
>
> Message: 5
> Date: Mon, 23 Mar 2020 09:54:50 -0700
> From: Paul Ramsey <pramsey at cleverelephant.ca>
> To: PostGIS Users Discussion <postgis-users at lists.osgeo.org>
> Subject: Re: [postgis-users] query a certain row from a table.
> Message-ID: <CB8820B0-9DAF-40A4-8232-3263ED7345E3 at cleverelephant.ca>
> Content-Type: text/plain;       charset=us-ascii
>
> Very punny
>
> > On Mar 23, 2020, at 9:54 AM, Martin Davis <mtnclimb at gmail.com> wrote:
> >
> > Ah yes, good point!
> >
> > On Mon, Mar 23, 2020 at 8:30 AM Paul Ramsey <pramsey at cleverelephant.ca>
> wrote:
> > Challenge accepted!!!!
> >
> > pramsey=# select st_isvalid(st_makepoint('NaN'::float8,1));
> > NOTICE:  Invalid Coordinate at or near point nan 1
> >  st_isvalid
> > ------------
> >  f
> > (1 row)
> >
> >
> >
> >
> > > On Mar 21, 2020, at 10:51 PM, Martin Davis <mtnclimb at gmail.com> wrote:
> > >
> > > Not surprising - I'm not sure it's possible to make an invalid point.
> > >
> > > On Sat, Mar 21, 2020 at 10:07 PM john polo <jpolo at mail.usf.edu> wrote:
> > > I used
> > >
> > > SELECT "SAMPLING_EVENT_IDENTIFIER" FROM p_loc.ebird_sel_spt
> > > WHERE ST_IsValid(geom) is false
> > > ;
> > >
> > > No rows are returned.
> > >
> > >
> > >
> > > On 3/21/2020 4:13 PM, Alexander Gataric wrote:
> > >> Write a query using predicate
> > >>
> > >> ST_IsValid(geom_column) is false
> > >>
> > >> Get BlueMail for Android
> > >> On Mar 21, 2020, at 10:06 AM, John Polo <jpolo at mail.usf.edu> wrote:
> > >> They are stored as Point. One per row.
> > >>
> > >>
> > >>
> > >> On Saturday, March 21, 2020, Alexander Gataric < gataric at usa.net>
> wrote:
> > >> What format are the points stored in? Point, multipoint? How many
> points per row?
> > >>
> > >> Get BlueMail for Android
> > >> On Mar 20, 2020, at 11:36 PM, john polo < jpolo at mail.usf.edu> wrote:
> > >> Hi,
> > >>
> > >> I'm trying to export a table of points to a shapefile. The table has
> > >> over 8,000,000 rows. I'm using PostGIS 3.0 and PostGIS Shapefile
> > >> Import/Export Manager on Windows 10. When I try to run the export, I
> > >> keep getting this error:
> > >>
> > >> Error: record 3329432 could not be created
> > >>
> > >> I'm not sure how to handle this. My first impulse is find the
> offending
> > >> row, but I don't know the SQL for such a query. Is there something I
> > >> need to write in a WHERE clause or a different clause to get a
> specific row?
> > >>
> > >>
> > >>
> > >> postgis-users mailing list
> > >>
> > >> postgis-users at lists.osgeo.org
> > >> https://lists.osgeo.org/mailman/listinfo/postgis-users
> > >>
> > >>
> > >> _______________________________________________
> > >> postgis-users mailing list
> > >>
> > >> postgis-users at lists.osgeo.org
> > >> https://lists.osgeo.org/mailman/listinfo/postgis-users
> > > --
> > > Enlightenment is ego's ultimate disappointment.
> > > -Chogyam Trungpa
> > >
> > > _______________________________________________
> > > postgis-users mailing list
> > > postgis-users at lists.osgeo.org
> > > https://lists.osgeo.org/mailman/listinfo/postgis-users
> > > _______________________________________________
> > > postgis-users mailing list
> > > postgis-users at lists.osgeo.org
> > > https://lists.osgeo.org/mailman/listinfo/postgis-users
> >
> > _______________________________________________
> > postgis-users mailing list
> > postgis-users at lists.osgeo.org
> > https://lists.osgeo.org/mailman/listinfo/postgis-users
> > _______________________________________________
> > postgis-users mailing list
> > postgis-users at lists.osgeo.org
> > https://lists.osgeo.org/mailman/listinfo/postgis-users
>
>
>
> ------------------------------
>
> Message: 6
> Date: Mon, 23 Mar 2020 17:56:26 +0100
> From: Freddy Gonthier <freddy.gonthier at gmail.com>
> To: postgis-users at lists.osgeo.org
> Subject: Re: [postgis-users] postgis-users Digest, Vol 217, Issue 15
> Message-ID:
>         <CABDF1V0OaNFyB=
> yH1fC-mFrU7DRrjgNxV1LRYM3Rdv4wCZrpAQ at mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> SELECT *
> FROM
>   (SELECT *,
>           row_number() OVER () AS NumLigne
>      FROM TaTable
>   ) AS TaTableAvecNumLigne
> WHERE NumLigne = 3329432;
>
> Le sam. 21 mars 2020 à 20:01, <postgis-users-request at lists.osgeo.org> a
> écrit :
>
> > Send postgis-users mailing list submissions to
> >         postgis-users at lists.osgeo.org
> >
> > To subscribe or unsubscribe via the World Wide Web, visit
> >         https://lists.osgeo.org/mailman/listinfo/postgis-users
> > or, via email, send a message with subject or body 'help' to
> >         postgis-users-request at lists.osgeo.org
> >
> > You can reach the person managing the list at
> >         postgis-users-owner at lists.osgeo.org
> >
> > When replying, please edit your Subject line so it is more specific
> > than "Re: Contents of postgis-users digest..."
> >
> >
> > Today's Topics:
> >
> >    1. query a certain row from a table. (john polo)
> >    2. Re: query a certain row from a table. (Alexander Gataric)
> >    3. Re: query a certain row from a table. (John Polo)
> >
> >
> > ----------------------------------------------------------------------
> >
> > Message: 1
> > Date: Fri, 20 Mar 2020 21:35:21 -0700
> > From: john polo <jpolo at mail.usf.edu>
> > To: PostGIS Users Discussion <postgis-users at lists.osgeo.org>
> > Subject: [postgis-users] query a certain row from a table.
> > Message-ID: <d05371ca-fcf0-d3e7-c85f-42f144a9132a at mail.usf.edu>
> > Content-Type: text/plain; charset=utf-8; format=flowed
> >
> > Hi,
> >
> > I'm trying to export a table of points to a shapefile. The table has
> > over 8,000,000 rows. I'm using PostGIS 3.0 and PostGIS Shapefile
> > Import/Export Manager on Windows 10. When I try to run the export, I
> > keep getting this error:
> >
> > Error: record 3329432 could not be created
> >
> > I'm not sure how to handle this. My first impulse is find the offending
> > row, but I don't know the SQL for such a query. Is there something I
> > need to write in a WHERE clause or a different clause to get a specific
> > row?
> >
> > --
> > Enlightenment is ego's ultimate disappointment.
> > -Chogyam Trungpa
> >
> >
> >
> > ------------------------------
> >
> > Message: 2
> > Date: Sat, 21 Mar 2020 02:36:24 -0500
> > From: Alexander Gataric <gataric at usa.net>
> > To: PostGIS Users Discussion <postgis-users at lists.osgeo.org>
> > Subject: Re: [postgis-users] query a certain row from a table.
> > Message-ID: <5c4820aa-f60d-4b7e-9ca1-45da6a8d416a at usa.net>
> > Content-Type: text/plain; charset="utf-8"
> >
> > What format are the points stored in? Point, multipoint? How many points
> > per row?
> >
> > ⁣Get BlueMail for Android ​
> >
> > On Mar 20, 2020, 11:36 PM, at 11:36 PM, john polo <jpolo at mail.usf.edu>
> > wrote:
> > >Hi,
> > >
> > >I'm trying to export a table of points to a shapefile. The table has
> > >over 8,000,000 rows. I'm using PostGIS 3.0 and PostGIS Shapefile
> > >Import/Export Manager on Windows 10. When I try to run the export, I
> > >keep getting this error:
> > >
> > >Error: record 3329432 could not be created
> > >
> > >I'm not sure how to handle this. My first impulse is find the offending
> > >
> > >row, but I don't know the SQL for such a query. Is there something I
> > >need to write in a WHERE clause or a different clause to get a specific
> > >row?
> > >
> > >--
> > >Enlightenment is ego's ultimate disappointment.
> > >-Chogyam Trungpa
> > >
> > >_______________________________________________
> > >postgis-users mailing list
> > >postgis-users at lists.osgeo.org
> > >https://lists.osgeo.org/mailman/listinfo/postgis-users
> > -------------- next part --------------
> > An HTML attachment was scrubbed...
> > URL: <
> >
> http://lists.osgeo.org/pipermail/postgis-users/attachments/20200321/b1b44f20/attachment-0001.html
> > >
> >
> > ------------------------------
> >
> > Message: 3
> > Date: Sat, 21 Mar 2020 08:06:34 -0700
> > From: John Polo <jpolo at mail.usf.edu>
> > To: PostGIS Users Discussion <postgis-users at lists.osgeo.org>
> > Subject: Re: [postgis-users] query a certain row from a table.
> > Message-ID:
> >         <
> > CALTSVX9DsHew5rm2kbxjTQjDYo11Y9b_xHpy8D7Pm+pSsCB-ww at mail.gmail.com>
> > Content-Type: text/plain; charset="utf-8"
> >
> > They are stored as Point. One per row.
> >
> >
> >
> > On Saturday, March 21, 2020, Alexander Gataric <gataric at usa.net> wrote:
> >
> > > What format are the points stored in? Point, multipoint? How many
> points
> > > per row?
> > >
> > > Get BlueMail for Android <http://www.bluemail.me/r?b=15824>
> > > On Mar 20, 2020, at 11:36 PM, john polo <jpolo at mail.usf.edu> wrote:
> > >>
> > >> Hi,
> > >>
> > >> I'm trying to export a table of points to a shapefile. The table has
> > >> over 8,000,000 rows. I'm using PostGIS 3.0 and PostGIS Shapefile
> > >> Import/Export Manager on Windows 10. When I try to run the export, I
> > >> keep getting this error:
> > >>
> > >> Error: record 3329432 could not be created
> > >>
> > >> I'm not sure how to handle this. My first impulse is find the
> offending
> > >> row, but I don't know the SQL for such a query. Is there something I
> > >> need to write in a WHERE clause or a different clause to get a
> specific
> > row?
> > >>
> > >>
> > -------------- next part --------------
> > An HTML attachment was scrubbed...
> > URL: <
> >
> http://lists.osgeo.org/pipermail/postgis-users/attachments/20200321/3c2986ce/attachment-0001.html
> > >
> >
> > ------------------------------
> >
> > Subject: Digest Footer
> >
> > _______________________________________________
> > postgis-users mailing list
> > postgis-users at lists.osgeo.org
> > https://lists.osgeo.org/mailman/listinfo/postgis-users
> >
> > ------------------------------
> >
> > End of postgis-users Digest, Vol 217, Issue 15
> > **********************************************
> >
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <
> http://lists.osgeo.org/pipermail/postgis-users/attachments/20200323/d8941043/attachment-0001.html
> >
>
> ------------------------------
>
> Subject: Digest Footer
>
> _______________________________________________
> postgis-users mailing list
> postgis-users at lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/postgis-users
>
> ------------------------------
>
> End of postgis-users Digest, Vol 217, Issue 17
> **********************************************
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/postgis-users/attachments/20200324/4f73b269/attachment.html>


More information about the postgis-users mailing list