[GeoNode-users] FW: Cannot upload layers

Stefano.LUONI at ext.ec.europa.eu Stefano.LUONI at ext.ec.europa.eu
Tue Dec 19 06:41:06 PST 2017


Yes, I already checked that this file could be processed by GeoServer. If I try to load it directly from GeoServer, SRS are detected (EPSG:21892), as well as bounds and the layer can be published.
I don't understand why GeoServer should not be able to read the file.

This file is just an example, but I get an upload error from Tomcat for shape files too.

________________________________
From: Alessio Fabiani [alessio.fabiani at geo-solutions.it]
Sent: 19 December 2017 15:18
To: LUONI Stefano (JRC-ISPRA-EXT)
Cc: GeoSolutions - JAI; geonode-users
Subject: Re: [GeoNode-users] FW: Cannot upload layers

Ah but "bogota" is a GeoTIFF or something? Is it gridded data or vectorial data?

>From the logs it looks like GeoNode tries to create a Coverage Store and GeoServer somehow is not able to read the file.

It could be worth trying to ingest the file directly on GeoServer in order to understand if the server is able to recognize it or not. Maybe it needs some GDAL pre-processing in order to be correctly managed by GeoServer.



Regards,

Alessio Fabiani

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
==

Ing. Alessio Fabiani

@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
Italy
phone: +39 0584 962313
fax:     +39 0584 1660272
mob:   +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility  for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

On Tue, Dec 19, 2017 at 3:02 PM, <Stefano.LUONI at ext.ec.europa.eu<mailto:Stefano.LUONI at ext.ec.europa.eu>> wrote:
Please, find the log attached to this email.

Thank you Alessio!

________________________________
From: Alessio Fabiani [alessio.fabiani at geo-solutions.it<mailto:alessio.fabiani at geo-solutions.it>]
Sent: 19 December 2017 14:51
To: LUONI Stefano (JRC-ISPRA-EXT)
Cc: GeoSolutions - JAI; geonode-users

Subject: Re: [GeoNode-users] FW: Cannot upload layers

Yes it is really strange.

Can you try to configure the GeoServer log level to verbose and send to me the "geoserver.log" file ?


Regards,

Alessio Fabiani

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
==

Ing. Alessio Fabiani

@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
Italy
phone: +39 0584 962313<tel:0584%20962313>
fax:     +39 0584 1660272<tel:0584%20166%200272>
mob:   +39 331 6233686<tel:331%20623%203686>

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility  for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

On Tue, Dec 19, 2017 at 2:48 PM, <Stefano.LUONI at ext.ec.europa.eu<mailto:Stefano.LUONI at ext.ec.europa.eu>> wrote:
Yes, all database configs are correct; I followed the guide in the link you posted and I also have a PostGIS store correctly enabled in GeoServer, using those credentials.

I have the same versions of Geonode and Geoserver (and Postgre sql as well) on a local development machine and everything works fine there. I have issues on this other machine, where I'm using Apache (on port 80) with WSGI daemon and Tomcat, instead of server on port 8000 and Jetty that come with the basic development installation.
I also moved the Geoserver data directory to a custom /data/geoserver-data, after copying all contents of the original folder into the new one.
I also set 777 permissions on both uploaded/layers of Geonode and GeoServer data directory, just to be sure that the problem was not there.
So, I guess something is wrong with Tomcat configurations, but I don't know what (I also followed all guides I found, by the way).

________________________________
From: Alessio Fabiani [alessio.fabiani at geo-solutions.it<mailto:alessio.fabiani at geo-solutions.it>]
Sent: 19 December 2017 14:31
To: LUONI Stefano (JRC-ISPRA-EXT)
Cc: geonode-users
Subject: Re: [GeoNode-users] FW: Cannot upload layers

Did you correctly configured the database passwords and connection params on settings.py or local_settings.py ?

Try to give a look here also

http://training.geonode.geo-solutions.it/002_install_and_admin/002_geonode_install/create_geonode_db.html


Regards,

Alessio Fabiani

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
==

Ing. Alessio Fabiani

@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A<https://maps.google.com/?q=Via+di+Montramito+3/A+%0D+55054+%C2%A0Massarosa&entry=gmail&source=g>
55054 <https://maps.google.com/?q=Via+di+Montramito+3/A+%0D+55054+%C2%A0Massarosa&entry=gmail&source=g>  Massarosa<https://maps.google.com/?q=Via+di+Montramito+3/A+%0D+55054+%C2%A0Massarosa&entry=gmail&source=g> (LU)
Italy
phone: +39 0584 962313<tel:0584%20962313>
fax:     +39 0584 1660272<tel:0584%20166%200272>
mob:   +39 331 6233686<tel:331%20623%203686>

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility  for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

On Tue, Dec 19, 2017 at 2:20 PM, <Stefano.LUONI at ext.ec.europa.eu<mailto:Stefano.LUONI at ext.ec.europa.eu>> wrote:
My issue is still unresolved and I don't know how to deeply debug it.
I get errors while trying to upload both shape files and raster files; the only difference is that the process blocks at different points, since I already have a PostGIS data store in GeoServer that would be used for shape files.

Apparently, Geonode is unable to create a store into GeoServer. This is an extract of Apache error log.

[Tue Dec 19 07:04:02.118664<tel:02%20118664> 2017] [wsgi:error] [pid 4932:tid 140059365070592]   File "/home/luonist/risk_data_hub/my_venv/local/lib/python2.7/site-packages/geoserver/catalog.py", line 555, in _create_coveragestore
[Tue Dec 19 07:04:02.118685<tel:02%20118685> 2017] [wsgi:error] [pid 4932:tid 140059365070592]     raise UploadError(response)
[Tue Dec 19 07:04:02.118707<tel:02%20118707> 2017] [wsgi:error] [pid 4932:tid 140059365070592] UploadError: Could not save the layer bogota, there was an upload error: <!DOCTYPE html><html><head><title>Apache Tomcat/8.0.32 (Ubuntu) - Error report</title><style type="text/css">H1 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;} H2 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;} H3 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;} BODY {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;} B {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} P {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A {color : black;}A.name {color : black;}.line {height: 1px; background-color: #525D76; border: none;}</style> </head><body><h1>HTTP Status 403 - Access is denied</h1><div class="line"></div><p><b>type</b> Status report</p><p><b>message</b> <u>Access is denied</u></p><p><b>description</b> <u>Access to the specified resource has been forbidden.</u></p><hr class="line"><h3>Apache Tomcat/8.0.32 (Ubuntu)</h3></body></html>

>From GeoServer logs, I only find an error that comes later, when it looks for a store that should have been created before (if I understand correctly):

2017-12-19 13:04:02,014 ERROR [geoserver.rest] - No such datastore: geonode,bogota
2017-12-19 13:04:02,016 ERROR [geoserver.rest] -
org.geoserver.rest.RestletException

2017-12-19 13:04:02,050 ERROR [geoserver.rest] - No such coverage store: geonode,bogota
2017-12-19 13:04:02,051 ERROR [geoserver.rest] -
org.geoserver.rest.RestletException

2017-12-19 13:04:02,080 ERROR [geoserver.rest] - No such wms store: geonode,bogota
2017-12-19 13:04:02,080 ERROR [geoserver.rest] -
org.geoserver.rest.RestletException

I'm using Geonode 2.7.4, GeoServer 2.10 (taken from http://build.geonode.org/geoserver/latest/), Apache 2.4, Tomcat 8, OpenJDK 1.8.0_151

Thank you very much,

Stefano

________________________________
From: geonode-users [geonode-users-bounces at lists.osgeo.org<mailto:geonode-users-bounces at lists.osgeo.org>] on behalf of Stefano.LUONI at ext.ec.europa.eu<mailto:Stefano.LUONI at ext.ec.europa.eu> [Stefano.LUONI at ext.ec.europa.eu<mailto:Stefano.LUONI at ext.ec.europa.eu>]
Sent: 18 December 2017 09:50
To: alessio.fabiani at geo-solutions.it<mailto:alessio.fabiani at geo-solutions.it>
Cc: geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>

Subject: Re: [GeoNode-users] Cannot upload layers

Hi Alessio,

yes, the GeoServer WAR file came with the development installation (paver setup); I then moved the WAR file into Tomcat directory, in order to replace Jetty with Tomcat as container for GeoServer. I'm already using the Geonode authentication on GeoServer, though.

________________________________
From: Alessio Fabiani [alessio.fabiani at geo-solutions.it<mailto:alessio.fabiani at geo-solutions.it>]
Sent: 13 December 2017 18:16
To: LUONI Stefano (JRC-ISPRA-EXT)
Cc: geonode-users
Subject: Re: [GeoNode-users] Cannot upload layers

Are you using one of the GeoServer WARs and DataDir prepared for GeoNode?

http://build.geonode.org/geoserver/latest/


Regards,

Alessio Fabiani

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
==

Ing. Alessio Fabiani

@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A<https://maps.google.com/?q=Via+di+Montramito+3/A+%0D+55054+%C2%A0Massarosa&entry=gmail&source=g>
55054 <https://maps.google.com/?q=Via+di+Montramito+3/A+%0D+55054+%C2%A0Massarosa&entry=gmail&source=g>  Massarosa<https://maps.google.com/?q=Via+di+Montramito+3/A+%0D+55054+%C2%A0Massarosa&entry=gmail&source=g> (LU)
Italy
phone: +39 0584 962313<tel:0584%20962313>
fax:     +39 0584 1660272<tel:0584%20166%200272>
mob:   +39 331 6233686<tel:331%20623%203686>

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility  for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

On Wed, Dec 13, 2017 at 6:04 PM, <Stefano.LUONI at ext.ec.europa.eu<mailto:Stefano.LUONI at ext.ec.europa.eu>> wrote:
Hi,

I'm facing this issue: whenever I try to upload a layer (both shape file or raster), I receive a 403 error (Access is denied) from Tomcat.



Error code (403) from GeoServer:

HTTP Status 403 - Access is denied

type Status report

message Access is denied

description Access to the specified resource has been forbidden.

________________________________
Apache Tomcat/8.0.32 (Ubuntu)


I'm working on a custom installation of Geonode v.2.7.4 on Ubuntu 16.04. I replaced Jetty with Tomcat8 as container for Geoserver, which is 2.10-SNAPSHOT.


In Geoserver logs, I can find these errors:


ERROR [org.geoserver.rest] - No such coverage store: geonode,geonode_data

ERROR [org.geoserver.rest] -
org.geoserver.rest.RestletException

ERROR [org.geoserver.rest] - No such wms store: geonode,geonode_data

ERROR [org.geoserver.rest] -
org.geoserver.rest.RestletException


>From Apache logs, I see that there is an exception thrown by


my_venv/local/lib/python2.7/site-packages/geoserver/catalog.py", line 249, in save

(headers['status'], body))

FailedRequestError: Error code (403) from GeoServer


Postgre sql is working correctly and I already configured and enabled a "datastore" PostGIS store in Geoserver.


I followed all instructions about custom installation of Geonode (http://docs.geonode.org/en/master/tutorials/admin/install/custom_install.html) and advanced security (http://docs.geonode.org/en/master/tutorials/admin/geoserver_geonode_security/).


I checked that files exist in the "uploaded" directory under Geonode folder.


I don't know what to do further to debug this issue.


Can you help me?


Thank you very much,


Stefano

_______________________________________________
geonode-users mailing list
geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>
https://lists.osgeo.org/mailman/listinfo/geonode-users



_______________________________________________
geonode-users mailing list
geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>
https://lists.osgeo.org/mailman/listinfo/geonode-users




_______________________________________________
geonode-users mailing list
geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>
https://lists.osgeo.org/mailman/listinfo/geonode-users


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/geonode-users/attachments/20171219/5620bc5d/attachment-0001.html>


More information about the geonode-users mailing list