[Qgis-user] Import of Large CSV File

[Grant Boxer]

Hi Chris,

That worked! I used the command line as you suggested and I then needed to
create a table from points to get the locations registered. Thanks.

There is probably a way to do that on the import - I will need to do a
little research.

Cheers Grant
Perth WA

-----Original Message-----
From: Chris Crook <ccrook at linz.govt.nz> 
Sent: Wednesday, 17 April 2019 2:26 AM
To: Grant Boxer <boxerg at iinet.net.au>
Subject: RE: [Qgis-user] Import of Large CSV File

Hi Grant

That is probably pushing the delimited text provider ... it doesn't import
the CSV file, it reads it directly.  So even if it did load it would be very
slow to use for any sort of searching, zooming, feature selection etc.  I'd
suggest turning into some sort of database format, for example geopackage
(which is just another file - it doesn't need a database server).  You could
do that with the ogr2ogr.  The ogr2ogr command line would be something like

ogr2ogr -f GPKG mydata.gpkg mydata.csv

It would probably need some other options depending on the content of the
CSV file and the coordinate reference system.

Cheers
Chris
________________________________________
From: Qgis-user [qgis-user-bounces at lists.osgeo.org] on behalf of Grant Boxer
[boxerg at iinet.net.au]
Sent: 16 April 2019 20:07
To: qgis-user at lists.osgeo.org
Subject: [Qgis-user] Import of Large CSV File

I have a 2.5 GB csv file which contains 9 fields and 17,167,595 records.
QGIS does not seem to be able to import this using the "Delimited Text"
option. Any suggestions?

Regards Grant

Grant Boxer
Perth, Western Australia


________________________________

This message contains information, which may be in confidence and may be
subject to legal privilege. If you are not the intended recipient, you must
not peruse, use, disseminate, distribute or copy this message. If you have
received this message in error, please notify us immediately (Phone 0800 665
463 or info at linz.govt.nz) and destroy the original message. LINZ accepts no
responsibility for changes to this email, or for any attachments, after its
transmission from LINZ. Thank You.