[postgis-users] character encoding problems

[Clay, Bruce]

I trying to learn more about natural language processing and language translation
 
I have installed the English version of WordNet in Postgres without any problems.  I downloaded dictionaries from a varity of site such as are used in OpenOffice / WinEdt.
 
When I try to build a table from several of the different languages I get the following error
 
ERROR:  invalid byte sequence for encoding "UTF8": 0x82
 
I checked the encoding and it is indeed set up for Unicode-8.  I tried to create databases using a variety of other encoding types such as WIN1252 and others and I got the same error message from all of them except SQL_ASCII.
 
When I created the database using SQL_ASCII I recieved the warning that the database could only store 7 bit data.  When I loaded the data in this database I did not have any errors and when I look at the data it seems to be the same as in the original text file.
 
Is there a "proper" encoding type that I should use to load the word lists so they can interoperate with the WordNet dataset that happily uses the UTF8 encoding?
 
Bruce
 



This message and any enclosures are intended only for the addressee.  Please  
notify the sender by email if you are not the intended recipient.  If you are  
not the intended recipient, you may not use, copy, disclose, or distribute this  
message or its contents or enclosures to any other person and any such actions  
may be unlawful.  Ball reserves the right to monitor and review all messages  
and enclosures sent to or from this email address.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/postgis-users/attachments/20111129/8072c57c/attachment.html>