<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Arial","sans-serif";
color:blue;
font-weight:normal;
font-style:normal;
text-decoration:none none;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-GB link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:blue'>I’ve had a whole range of similar problems with a large database of publically entered records from many countries, it contains all sorts of strange characters (in many languages) including most characters you’d think of as possibilities for column separators. Rather a nightmare to tidy up and analyse, end up stripping out loads of different characters just to get it to read by spreadsheet and gis. Ideally there might be some completely different separator that could easily be edited in to show the columns and keep most of the commas and other characters within the columns but the big issue is how to do that editing in the first place to correctly identify the columns or easily allow moving of text between columns if an automatic import gets it wrong.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:blue'>I have sorted most of it out now, in my case, by long laborious means but if someone could come up with a good way of dealing with this kind of messy file (entered by general public in many countries so with potentially unpredictable strange characters) that would be very useful. Just before you say you should have been much more restrictive on the web input, we were fairly restrictive but still need to allow quite a range of possible inputs in free text in any language.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:blue'><o:p> </o:p></span></p><p class=MsoNormal><b><span lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> John Callahan [mailto:john.callahan@udel.edu] <br><b>Sent:</b> 21 June 2011 00:36<br><b>To:</b> tech@wildintellect.com<br><b>Cc:</b> qgis-user<br><b>Subject:</b> Re: [Qgis-user] Delimited text plugin with fields containing commas<o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal style='margin-bottom:12.0pt'>You're correct. That way probably would be the preferred work-around. <br><br>- John<br><br><br><o:p></o:p></p><div><p class=MsoNormal>On Mon, Jun 20, 2011 at 5:18 PM, Alex Mandel <<a href="mailto:tech_dev@wildintellect.com">tech_dev@wildintellect.com</a>> wrote:<o:p></o:p></p><p class=MsoNormal>I agree quotes should work but I've found many parsers to not follow the<br>expectation on this. As for semicolons I only meant as the delimiter<br>leaving the commas inside your text. That way you can tell the parser<br>that ; is the separator between records.<br><br>Thanks,<br><span style='color:#888888'>Alex</span><o:p></o:p></p><div><div><p class=MsoNormal><br>On 06/20/2011 01:04 PM, John Callahan wrote:<br>> I use semi-colons when I can but have run into situations where commas are<br>> necessary, such as names of places. I agree with the work-around and I've<br>> done that before. As long as quotes (") are included around the values, it<br>> should work, and I believe it was working for a while.<br>><br>> - John<br>><br>> ***********************************<br>> John Callahan, Research Scientist<br>> Delaware Geological Survey<br>> University of Delaware<br>> URL: <a href="http://www.dgs.udel.edu" target="_blank">http://www.dgs.udel.edu</a><br>> *******************************<br>><br>><br>> On Mon, Jun 20, 2011 at 3:59 PM, Alex Mandel <<a href="mailto:tech_dev@wildintellect.com">tech_dev@wildintellect.com</a>>wrote:<br>><br>>> On 06/20/2011 12:35 PM, John Callahan wrote:<br>>>> Has anyone seen this problem with the Delimited Text plugin? I am seeing<br>>>> this in today's download of QGIS 1.7 standalone on Windows, and on a<br>>> recent<br>>>> install through OSGeo4W of 1.8-trunk.<br>>>><br>>>> "Delimited text" plugin doesn't allow to load csv file with field with<br>>>> commas<br>>>> <a href="http://hub.qgis.org/issues/2208" target="_blank">http://hub.qgis.org/issues/2208</a><br>>>><br>>>> - John<br>>><br>>> I have had that problem before, with lots csv import tools (not just<br>>> qgis). Are you using commas to separate the values too? I usually have<br>>> much better success changing that to ; or |<br>>> so instead of "2","test,test","1"<br>>> "2";"test,test";"1"<br>>><br>>> Easiest way to swap out the delimiter is to use OpenOffice/LibreOffice<br>>> and change it when saving.<br>>><br>>> Thanks,<br>>> Alex<br>>> _______________________________________________<br>>> Qgis-user mailing list<br>>> <a href="mailto:Qgis-user@lists.osgeo.org">Qgis-user@lists.osgeo.org</a><br>>> <a href="http://lists.osgeo.org/mailman/listinfo/qgis-user" target="_blank">http://lists.osgeo.org/mailman/listinfo/qgis-user</a><br>>><br>><br><br>_______________________________________________<br>Qgis-user mailing list<br><a href="mailto:Qgis-user@lists.osgeo.org">Qgis-user@lists.osgeo.org</a><br><a href="http://lists.osgeo.org/mailman/listinfo/qgis-user" target="_blank">http://lists.osgeo.org/mailman/listinfo/qgis-user</a><o:p></o:p></p></div></div></div><p class=MsoNormal><o:p> </o:p></p></div><font face="monospace"><br>
-- <br>
The Open University is incorporated by Royal Charter (RC 000391), an exempt charity in England & Wales and a charity registered in Scotland (SC 038302).</font></body></html>