[gdal-dev] unicode support in GDAL

[Even Rouault]

**
Claudiu,

OGR supports unicode strings, and expect/outputs in UTF-8 as the pivot 
encoding. See https://gdal.org/development/rfc/rfc23_ogr_unicode.html 
for details
For shapefiles on writing, you'll need to pass the ENCODING=UTF-8 layer 
creation option (see 
https://gdal.org/drivers/vector/shapefile.html#layer-creation-options), 
or at another value that is compatible of cyrillic characters (CP1251 e.g.)

Demo (in UTF-8 console)

$ cat cyrillic.csv
id,txt
1,"Привет"

$ ogr2ogr cyrillic.shp cyrillic.csv -lco ENCODING=CP1251

$ ogrinfo cyrillic.dbf -al -q

Layer name: cyrillic
Metadata:
   DBF_DATE_LAST_UPDATE=2021-08-12
OGRFeature(cyrillic):0
   id (String) = 1
   txt (String) = Привет


Even

Le 12/08/2021 à 17:54, Claudiu Cochior via gdal-dev a écrit :
>
> Hello everybody,
>
> I have a question related to Unicode strings in GDAL
>
> We are using GDAL 3.0.4 and at some point we would like to write to 
> shapefile a string that contains Russian characters. To give you some 
> context, we are in C++, we created a OGRFeature and we want to set a 
> field to the string that contains the Russian characters. My machine 
> is in English and the language for non-unicode programs is set to 
> English. I didn’t find in the GDAL doc a definitive answer if GDAL 
> support Unicode strings for filed values. As a test I converted the 
> System::String to UTF-8 but the shape file displays only ? for the 
> characters. If I change the language for non-unicode programs to 
> Russian then I can safely extract the ANSI string and give it to the 
> SetField method and the result is OK.
>
> So, does GDAL supports unicede field string values somehow?
>
> Thanks,
>
> Claudiu
>
>
> ------------------------------------------------------------------------
>
>
> This email, including any attachments, may contain confidential and/or 
> proprietary information intended only for the use of the recipient. If 
> you are not the intended recipient, any distribution, copying, or use 
> of this email or its attachments is prohibited. If you received this 
> email in error, please reply to the sender immediately and delete this 
> message and any copies.
>
> /Bentley Systems has taken all reasonable steps to ensure that this 
> communication is free from viruses, data corruption, and unauthorized 
> alteration. Bentley Systems does not accept liability for any damages 
> that may be incurred as a result of this or any communication by email/
>
>
>
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/gdal-dev

-- 
http://www.spatialys.com
My software is free, but my time generally not.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20210812/54033e40/attachment-0001.html>