[GRASS-dev] [GRASS GIS] #3781: v.in.geonames - fails in winGRASS7.7 (python3)

[GRASS GIS]

#3781: v.in.geonames - fails in winGRASS7.7 (python3)
---------------------+--------------------------
  Reporter:  hellik  |      Owner:  grass-dev@…
      Type:  defect  |     Status:  new
  Priority:  normal  |  Milestone:  7.8.0
 Component:  Python  |    Version:  svn-trunk
Resolution:          |   Keywords:  python3, py3
       CPU:  x86-64  |   Platform:  MSWindows
---------------------+--------------------------

Comment (by hellik):

 Replying to [ticket:3781 hellik]:
 > tested with
 >
 > {{{
 > System Info
 > GRASS version: 7.7.svn
 > GRASS SVN revision: r74150M
 > Build date: 2019-03-05
 > Build platform: x86_64-w64-mingw32
 > GDAL: 2.4.0
 > PROJ.4: 5.2.0
 > GEOS: 3.7.0
 > SQLite: 3.26.0
 > Python: 3.7.0
 > wxPython: 4.0.3
 > Platform: Windows-10-10.0.17763-SP0 (OSGeo4W)
 > }}}
 >
 > v.in.geonames fails with
 >
 > {{{
 > v.in.geonames input=D:\data\private\presentation\lernwerkstatt\AT\AT.txt
 output=at_out
 > Traceback (most recent call last):
 >   File
 > "C:\OSGEO4~1\apps\grass\grass77/scripts/v.in.geonames.py",
 > line 150, in <module>
 >     main()
 >   File
 > "C:\OSGEO4~1\apps\grass\grass77/scripts/v.in.geonames.py",
 > line 67, in main
 >     num_places = sum(1 for _ in f)
 >   File
 > "C:\OSGEO4~1\apps\grass\grass77/scripts/v.in.geonames.py",
 > line 67, in <genexpr>
 >     num_places = sum(1 for _ in f)
 >   File "C:\OSGEO4~1\apps\Python37\lib\encodings\cp1252.py",
 > line 23, in decode
 >     return
 > codecs.charmap_decode(input,self.errors,decoding_table)[0]
 > UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d
 > in position 3815: character maps to <undefined>
 > }}}

 same data set works with

 {{{
 GRASS version: 7.6.0
 GRASS SVN revision: r73958
 Build date: 2019-01-17
 Build platform: x86_64-w64-mingw32
 GDAL: 2.4.0
 PROJ.4: 5.2.0
 GEOS: 3.7.0
 SQLite: 3.26.0
 Python: 2.7.14
 wxPython: 2.8.12.1
 Platform: Windows-10-10.0.17763 (OSGeo4W)
 }}}

 {{{
 v.in.geonames input=D:\data\private\presentation\lernwerkstatt\AT\AT.txt
 output=at2
 Converting 51995 place names...
 Scanning input for column types...
 Number of columns: 19
 Number of rows: 51995
 WARNING: Column number 13 <admin3code> defined as string has only integer
 values
 WARNING: Column number 14 <admin4code> defined as string has only integer
 values
 Importing points...
 Populating table...
 Building topology for vector map <at2 at data>...
 Registering primitives...
 (Wed Mar 06 22:25:18 2019) Command finished (9 sec)
 }}}

-- 
Ticket URL: <https://trac.osgeo.org/grass/ticket/3781#comment:1>
GRASS GIS <https://grass.osgeo.org>