[GeoNode-devel] error during layer upload with master

Paolo Corti pcorti at gmail.com
Fri Sep 27 13:15:19 PDT 2019


Hey Alessio
yes, this is the same road I was thinking of. Note that the CI fails
right now (GeoServer integration tests).
In any case I'd suggest to have the _max_tries variable configurable
(maybe in settings.UPLOADER['OPTIONS']). Right now its value (100) is
too much as the process would hang 100 seconds if something weird
happens.
Thanks a lot for helping with this :)
Paolo

On Fri, Sep 27, 2019 at 11:37 AM Alessio Fabiani
<alessio.fabiani at geo-solutions.it> wrote:
>
> @Paolo Corti it looks like this is caused by a timing issue on signals.
> I found a possible solution by waiting for the layer on GeoServer catalog to be fully configured.
>
> This might also solve the https://github.com/GeoNode/geonode/issues/4827 problem.
>
> Tentative fix here https://github.com/GeoNode/geonode/pull/4960
>
>
> Il giorno mer 25 set 2019 alle ore 10:04 Alessio Fabiani <alessio.fabiani at geo-solutions.it> ha scritto:
>>
>> That's weird, I cannot reproduce this issue currently by using master branch.
>>
>> Can you maybe send me a snapshot of your local_settings / environment?
>>
>> Are you using the UPLOADER REST or IMPORTER method?
>>
>> Maybe check that you have the latest geoserver-restconfig lib. Try to uninstall it, and completely cleanup site-packages, and reinstall the latest.
>>
>>
>> Il giorno mar 24 set 2019 alle ore 22:18 Paolo Corti <pcorti at gmail.com> ha scritto:
>>>
>>> Hi Alessio
>>> in my case the process is failing because layer.store is empty when we
>>> run gs_catalog.get_resource at geoserver.signals [1]. This cause
>>> gs_resource to be None.
>>> I am using a PostGIS datastore as the backend. This was working
>>> properly a few commits ago.
>>> Hope this helps to diagnose the issue
>>> cheers
>>> Paolo
>>>
>>> [1] https://github.com/GeoNode/geonode/blob/master/geonode/geoserver/signals.py#L144
>>>
>>> On Tue, Sep 24, 2019 at 11:22 AM Alessio Fabiani
>>> <alessio.fabiani at geo-solutions.it> wrote:
>>> >
>>> > Any hint on how to reproduce this?
>>> >
>>> > Do you have a special configuration / deployment?
>>> >
>>> > Il giorno mar 24 set 2019 alle ore 17:08 Paolo Corti <pcorti at gmail.com> ha scritto:
>>> >>
>>> >> This is what I currently see if I upload a layer:
>>> >>
>>> >> >>> Step 10. Creating Django record for [public_violence_1ja_2]
>>> >> There isn't a geoserver resource for this layer: public_violence_1ja_2
>>> >> Traceback (most recent call last):
>>> >>   File "/home/ubuntu/wm-2.10.x/env/local/lib/python2.7/site-packages/kombu/utils/scheduling.py",
>>> >> line 56, in get
>>> >>     return self.fun(resource, callback, **kwargs)
>>> >>   File "/home/ubuntu/wm-2.10.x/env/local/lib/python2.7/site-packages/kombu/transport/virtual/base.py",
>>> >> line 405, in _get_and_deliver
>>> >>     message = self._get(queue)
>>> >>   File "/home/ubuntu/wm-2.10.x/env/local/lib/python2.7/site-packages/kombu/transport/memory.py",
>>> >> line 27, in _get
>>> >>     return self._queue_for(queue).get(block=False)
>>> >>   File "/usr/lib/python2.7/Queue.py", line 165, in get
>>> >>     raise Empty
>>> >> Empty
>>> >>
>>> >> The layer is anyway created in GeoNode and GeoServer, but is not
>>> >> rendered in layer preview and initial extent is wrong. Should I file a
>>> >> ticket?
>>> >>
>>> >> thanks
>>> >> Paolo
>>> >>
>>> >>
>>> >> --
>>> >> Paolo Corti
>>> >> Geospatial software developer
>>> >> web: http://www.paolocorti.net
>>> >> twitter: @capooti
>>> >> skype: capooti
>>> >> #drt3jc1
>>> >> _______________________________________________
>>> >> geonode-devel mailing list
>>> >> geonode-devel at lists.osgeo.org
>>> >> https://lists.osgeo.org/mailman/listinfo/geonode-devel
>>> >
>>> >
>>> >
>>> > --
>>> >
>>> > ==
>>> >
>>> > GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
>>> > ==
>>> > Ing. Alessio Fabiani
>>> >
>>> > @alfa7691
>>> > Founder/Technical Lead
>>> >
>>> >
>>> > GeoSolutions S.A.S.
>>> > Via di Montramito 3/A - 55054  Massarosa (LU) - Italy
>>> > phone: +39 0584 962313
>>> > fax:     +39 0584 1660272
>>> > mob:   +39 331 6233686
>>> >
>>> >
>>> > http://www.geo-solutions.it
>>> > http://twitter.com/geosolutions_it
>>> > -------------------------------------------------------
>>> >
>>> > Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
>>> >
>>> >
>>> > This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
>>>
>>>
>>>
>>> --
>>> Paolo Corti
>>> Geospatial software developer
>>> web: http://www.paolocorti.net
>>> twitter: @capooti
>>> skype: capooti
>>> #drt3jc1
>>
>>
>>
>> --
>>
>> ==
>>
>> GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
>> ==
>> Ing. Alessio Fabiani
>>
>> @alfa7691
>> Founder/Technical Lead
>>
>>
>> GeoSolutions S.A.S.
>> Via di Montramito 3/A - 55054  Massarosa (LU) - Italy
>> phone: +39 0584 962313
>> fax:     +39 0584 1660272
>> mob:   +39 331 6233686
>>
>>
>> http://www.geo-solutions.it
>> http://twitter.com/geosolutions_it
>> -------------------------------------------------------
>>
>> Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
>>
>>
>> This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
>
>
>
> --
>
> ==
>
> GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
> ==
> Ing. Alessio Fabiani
>
> @alfa7691
> Founder/Technical Lead
>
>
> GeoSolutions S.A.S.
> Via di Montramito 3/A - 55054  Massarosa (LU) - Italy
> phone: +39 0584 962313
> fax:     +39 0584 1660272
> mob:   +39 331 6233686
>
>
> http://www.geo-solutions.it
> http://twitter.com/geosolutions_it
> -------------------------------------------------------
>
> Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
>
>
> This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.



-- 
Paolo Corti
Geospatial software developer
web: http://www.paolocorti.net
twitter: @capooti
skype: capooti
#drt3jc1


More information about the geonode-devel mailing list