[GeoNode-users] Wrong encoding after uploading shapefile (shp)

Athanasios Fotis tfotis at draxis.gr
Fri Jul 12 01:52:39 PDT 2019


Hi,

Issue created https://github.com/GeoNode/geonode/issues/4635

If you need further information for solving this, please let me know.

Thank you again for your support

Thanasis

On Fri, 12 Jul 2019 at 10:38, Alessio Fabiani <
alessio.fabiani at geo-solutions.it> wrote:

> P.S.: in the meantime, I would ask if you could create an issue on the
> GeoNode GitHub issue tracker reporting the problem. That would be
> very helpful to keep track of our discussions.
>
> Il giorno ven 12 lug 2019 alle ore 09:36 Alessio Fabiani <
> alessio.fabiani at geo-solutions.it> ha scritto:
>
>> Hi Athanasios,
>> we are already investigating on this issue.
>> It seems like the GeoServer Importer already supports charset encoding,
>> so, in case this is confirmed, we will have to update the GeoNode APIs in
>> order to correctly set the charset when creating the session.
>>
>> Hopefully in a week or so we will be able to fix this.
>>
>>
>> Il giorno ven 12 lug 2019 alle ore 09:20 Athanasios Fotis <
>> tfotis at draxis.gr> ha scritto:
>>
>>> Hi Alessio,
>>>
>>> Perfect. That worked. Thank you!
>>>
>>> So, is this is a known issue with Geoserver's importer plugin? Should i
>>> send them an email in their list or create an issue in their tracker?
>>>
>>> Best,
>>>
>>> Thanasis
>>>
>>> On Thu, 11 Jul 2019 at 17:41, Alessio Fabiani <
>>> alessio.fabiani at geo-solutions.it> wrote:
>>>
>>>> Hi Athanasios,
>>>> try maybe to change the UPLOADER method back to REST, it seems like the
>>>> GeoServer Importer has some issues with the character encoding
>>>>
>>>>
>>>> http://osgeo-org.1560.x6.nabble.com/JIRA-GEOS-9073-Encoding-issues-with-the-importer-plugin-td5389529.html
>>>>
>>>>
>>>>
>>>> In order to set the uploader method to geoserver.rest you can either
>>>> set the environment variable
>>>>
>>>> DEFAULT_BACKEND_UPLOADER=geonode.rest
>>>>
>>>> Or override the UPLOADER setting in your settings file
>>>>
>>>> UPLOADER = {
>>>> 'BACKEND': 'geonode.rest',
>>>> 'OPTIONS': {
>>>> 'TIME_ENABLED': False,
>>>> 'MOSAIC_ENABLED': False,
>>>> },
>>>> 'SUPPORTED_CRS': [
>>>> 'EPSG:4326',
>>>> 'EPSG:3785',
>>>> 'EPSG:3857',
>>>> 'EPSG:32647',
>>>> 'EPSG:32736'
>>>> ],
>>>> 'SUPPORTED_EXT': [
>>>> '.shp',
>>>> '.csv',
>>>> '.kml',
>>>> '.kmz',
>>>> '.json',
>>>> '.geojson',
>>>> '.tif',
>>>> '.tiff',
>>>> '.geotiff',
>>>> '.gml',
>>>> '.xml'
>>>> ]
>>>> }
>>>>
>>>>
>>>> Il giorno gio 11 lug 2019 alle ore 11:03 Athanasios Fotis <
>>>> tfotis at draxis.gr> ha scritto:
>>>>
>>>>> Hi,
>>>>>
>>>>> Thank you very much for your input.
>>>>>
>>>>> Unfortunately, it doesn't seem to work for my installation.
>>>>> [image: popup.png]
>>>>>
>>>>> I have tried setting JAVA_OPTS and CATALINA_OPTS like you suggested
>>>>> but the encoding is still not working correctly. It seems that it is not
>>>>> properly stored in the database.
>>>>> I even tried different values for -Dfile.encoding (UTF8 and UTF-8).
>>>>>
>>>>> The installation is pretty straightforward, a git clone of the repo at
>>>>> https://github.com/GeoNode/geonode and then a `docker-compose up -d`.
>>>>>
>>>>> Any other ideas of what to look for or how to debug this?
>>>>>
>>>>> Best regards,
>>>>>
>>>>> Thanasis
>>>>>
>>>>> On Tue, 9 Jul 2019 at 17:33, Alessio Fabiani <
>>>>> alessio.fabiani at geo-solutions.it> wrote:
>>>>>
>>>>>> Hi,
>>>>>> most probably it depends by wrong Java settings on GeoServer.
>>>>>>
>>>>>> I tested your file on my own local instance and it looks fine to me
>>>>>> (using UTF-8)
>>>>>>
>>>>>> [image: image.png]
>>>>>>
>>>>>>
>>>>>> I had to start the JVM with the following settings:
>>>>>>
>>>>>> JAVA_OPTS= .... -Djavax.servlet.request.encoding=UTF-8 -Dfile.encoding=UTF-8
>>>>>>
>>>>>> set CATALINA_OPTS=-Dfile.encoding="UTF-8"
>>>>>>
>>>>>>
>>>>>> Il giorno mar 9 lug 2019 alle ore 15:39 Athanasios Fotis <
>>>>>> tfotis at draxis.gr> ha scritto:
>>>>>>
>>>>>>> Hi all,
>>>>>>>
>>>>>>> I am trying to upload a shapefile to Geonode but the encoding of the
>>>>>>> features isn't correctly recognized. I don't get any error messages
>>>>>>> whatsoever and i can see that the layer is created successfully. But when i
>>>>>>> click on a feature to get the info, the data is shown in the wrong encoding.
>>>>>>>
>>>>>>> The geonode version is 2.10rc5 and the same issue happens in both a
>>>>>>> local dockerized  installation as well as the master demo one at
>>>>>>> http://master.demo.geonode.org/.
>>>>>>>
>>>>>>> Attached is the shapefile in question (although the same happens
>>>>>>> with many others that i have, non-english).
>>>>>>>
>>>>>>> Best regards,
>>>>>>>
>>>>>>> Thanasis
>>>>>>> _______________________________________________
>>>>>>> geonode-users mailing list
>>>>>>> geonode-users at lists.osgeo.org
>>>>>>> https://lists.osgeo.org/mailman/listinfo/geonode-users
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> ==
>>>>>>
>>>>>> GeoServer Professional Services from the experts! Visit
>>>>>> http://goo.gl/it488V for more information.
>>>>>> ==
>>>>>> Ing. Alessio Fabiani
>>>>>>
>>>>>> @alfa7691
>>>>>> Founder/Technical Lead
>>>>>>
>>>>>>
>>>>>> GeoSolutions S.A.S.
>>>>>> Via di Montramito 3/A - 55054  Massarosa (LU) - Italy
>>>>>> phone: +39 0584 962313
>>>>>> fax:     +39 0584 1660272
>>>>>> mob:   +39 331 6233686
>>>>>>
>>>>>>
>>>>>> http://www.geo-solutions.it
>>>>>> http://twitter.com/geosolutions_it
>>>>>> -------------------------------------------------------
>>>>>>
>>>>>> Con riferimento alla normativa sul trattamento dei dati personali
>>>>>> (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”),
>>>>>> si precisa che ogni circostanza inerente alla presente email (il suo
>>>>>> contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è
>>>>>> riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il
>>>>>> messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra
>>>>>> operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
>>>>>>
>>>>>>
>>>>>> This email is intended only for the person or entity to which it is
>>>>>> addressed and may contain information that is privileged, confidential or
>>>>>> otherwise protected from disclosure. We remind that - as provided by
>>>>>> European Regulation 2016/679 “GDPR” - copying, dissemination or use of this
>>>>>> e-mail or the information herein by anyone other than the intended
>>>>>> recipient is prohibited. If you have received this email by mistake, please
>>>>>> notify us immediately by telephone or e-mail.
>>>>>>
>>>>> _______________________________________________
>>>>> geonode-users mailing list
>>>>> geonode-users at lists.osgeo.org
>>>>> https://lists.osgeo.org/mailman/listinfo/geonode-users
>>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> ==
>>>>
>>>> GeoServer Professional Services from the experts! Visit
>>>> http://goo.gl/it488V for more information.
>>>> ==
>>>> Ing. Alessio Fabiani
>>>>
>>>> @alfa7691
>>>> Founder/Technical Lead
>>>>
>>>>
>>>> GeoSolutions S.A.S.
>>>> Via di Montramito 3/A - 55054  Massarosa (LU) - Italy
>>>> phone: +39 0584 962313
>>>> fax:     +39 0584 1660272
>>>> mob:   +39 331 6233686
>>>>
>>>>
>>>> http://www.geo-solutions.it
>>>> http://twitter.com/geosolutions_it
>>>> -------------------------------------------------------
>>>>
>>>> Con riferimento alla normativa sul trattamento dei dati personali (Reg.
>>>> UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si
>>>> precisa che ogni circostanza inerente alla presente email (il suo
>>>> contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è
>>>> riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il
>>>> messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra
>>>> operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
>>>>
>>>>
>>>> This email is intended only for the person or entity to which it is
>>>> addressed and may contain information that is privileged, confidential or
>>>> otherwise protected from disclosure. We remind that - as provided by
>>>> European Regulation 2016/679 “GDPR” - copying, dissemination or use of this
>>>> e-mail or the information herein by anyone other than the intended
>>>> recipient is prohibited. If you have received this email by mistake, please
>>>> notify us immediately by telephone or e-mail.
>>>>
>>> _______________________________________________
>>> geonode-users mailing list
>>> geonode-users at lists.osgeo.org
>>> https://lists.osgeo.org/mailman/listinfo/geonode-users
>>>
>>
>>
>> --
>>
>> ==
>>
>> GeoServer Professional Services from the experts! Visit
>> http://goo.gl/it488V for more information.
>> ==
>> Ing. Alessio Fabiani
>>
>> @alfa7691
>> Founder/Technical Lead
>>
>>
>> GeoSolutions S.A.S.
>> Via di Montramito 3/A - 55054  Massarosa (LU) - Italy
>> phone: +39 0584 962313
>> fax:     +39 0584 1660272
>> mob:   +39 331 6233686
>>
>>
>> http://www.geo-solutions.it
>> http://twitter.com/geosolutions_it
>> -------------------------------------------------------
>>
>> Con riferimento alla normativa sul trattamento dei dati personali (Reg.
>> UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si
>> precisa che ogni circostanza inerente alla presente email (il suo
>> contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è
>> riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il
>> messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra
>> operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
>>
>>
>> This email is intended only for the person or entity to which it is
>> addressed and may contain information that is privileged, confidential or
>> otherwise protected from disclosure. We remind that - as provided by
>> European Regulation 2016/679 “GDPR” - copying, dissemination or use of this
>> e-mail or the information herein by anyone other than the intended
>> recipient is prohibited. If you have received this email by mistake, please
>> notify us immediately by telephone or e-mail.
>>
>
>
> --
>
> ==
>
> GeoServer Professional Services from the experts! Visit
> http://goo.gl/it488V for more information.
> ==
> Ing. Alessio Fabiani
>
> @alfa7691
> Founder/Technical Lead
>
>
> GeoSolutions S.A.S.
> Via di Montramito 3/A - 55054  Massarosa (LU) - Italy
> phone: +39 0584 962313
> fax:     +39 0584 1660272
> mob:   +39 331 6233686
>
>
> http://www.geo-solutions.it
> http://twitter.com/geosolutions_it
> -------------------------------------------------------
>
> Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE
> 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si
> precisa che ogni circostanza inerente alla presente email (il suo
> contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è
> riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il
> messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra
> operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
>
>
> This email is intended only for the person or entity to which it is
> addressed and may contain information that is privileged, confidential or
> otherwise protected from disclosure. We remind that - as provided by
> European Regulation 2016/679 “GDPR” - copying, dissemination or use of this
> e-mail or the information herein by anyone other than the intended
> recipient is prohibited. If you have received this email by mistake, please
> notify us immediately by telephone or e-mail.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/geonode-users/attachments/20190712/92abef0d/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 368271 bytes
Desc: not available
URL: <http://lists.osgeo.org/pipermail/geonode-users/attachments/20190712/92abef0d/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: popup.png
Type: image/png
Size: 260981 bytes
Desc: not available
URL: <http://lists.osgeo.org/pipermail/geonode-users/attachments/20190712/92abef0d/attachment-0003.png>


More information about the geonode-users mailing list