<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div dir="ltr"></div><div dir="ltr">Hi,</div><div dir="ltr"><br></div><div dir="ltr">That can work up well to a million lines. That does work well for smaller files. If the file come from Excel, it will have a tendency of adding extra empty columns in cells that have been erased. Notepad++ will get you farther and GVim even more but these are simple texte editor. If the error something like a empty row or commas in a texte field that add row, you will most likely never find it. That’s how I got into Python. The simple ideas in Python is to count the row of each line in a comma separated or space sep file and to make sure each x and y fields are actually floats and to print out the first few problem line.That will find most errors In a LiDAR file anyway.</div><div dir="ltr"><br></div><div dir="ltr">Nicolas</div><div dir="ltr"><br>Le 16 avr. 2019 à 08:43, <<a href="mailto:b.j.kobben@utwente.nl">b.j.kobben@utwente.nl</a>> <<a href="mailto:b.j.kobben@utwente.nl">b.j.kobben@utwente.nl</a>> a écrit :<br><br></div><blockquote type="cite"><div dir="ltr">
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Georgia;
panose-1:2 4 5 2 5 4 5 2 3 3;}
@font-face
{font-family:"Times New Roman \(Body CS\)";
panose-1:2 11 6 4 2 2 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle18
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Georgia",serif;
font-variant:normal !important;
color:windowtext;
text-transform:none;
mso-contextual-alternates:no;
font-weight:normal;
font-style:normal;
text-decoration:none none;
vertical-align:baseline;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style>
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-GB" style="font-size:12.0pt;font-family:"Georgia",serif">simple test is also to check if the file can be imported in Excel or OpenOffice spreadsheet...<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:12.0pt;font-family:"Georgia",serif"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-family:"Georgia",serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Georgia",serif">--<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Georgia",serif">Barend Köbben<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:12.0pt;font-family:"Georgia",serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:12.0pt;font-family:"Georgia",serif"><o:p> </o:p></span></p>
<div>
<div>
<p class="MsoNormal">On 16/04/2019, 14:11, "Qgis-user on behalf of Nicolas Cadieux" <<a href="mailto:qgis-user-bounces@lists.osgeo.org">qgis-user-bounces@lists.osgeo.org</a> on behalf of
<a href="mailto:nicolas.cadieux@archeotec.ca">nicolas.cadieux@archeotec.ca</a>> wrote:<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Hi,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">If Even’s solution does not work, the file is probably problematic. You probably have missing or corrupted line. I have seen crashes were comma separated lines are mixed with space separated lines, or with files or different row length.
Did the file work in the past?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Solution would would be to look at each line and count the field with a python script. I could help if the file is really important. If it was downloaded, try downloading the file again. What are the symptoms? Crashes? Can’t see all
the line? These are points I imagine?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Nicolas<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
Le 16 avr. 2019 à 04:06, Grant Boxer <<a href="mailto:boxerg@iinet.net.au">boxerg@iinet.net.au</a>> a écrit :<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">I have a 2.5 GB csv file which contains 9 fields and 17,167,595 records. QGIS does not seem to be able to import this using the “Delimited Text” option. Any suggestions?<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Regards Grant<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-AU">Grant Boxer</span><o:p></o:p></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-AU">Perth, Western Australia</span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">_______________________________________________<br>
Qgis-user mailing list<br>
<a href="mailto:Qgis-user@lists.osgeo.org">Qgis-user@lists.osgeo.org</a><br>
List info: <a href="https://lists.osgeo.org/mailman/listinfo/qgis-user">https://lists.osgeo.org/mailman/listinfo/qgis-user</a><br>
Unsubscribe: <a href="https://lists.osgeo.org/mailman/listinfo/qgis-user">https://lists.osgeo.org/mailman/listinfo/qgis-user</a><o:p></o:p></p>
</div>
</blockquote>
</div>
</div></blockquote></body></html>