[GeoNode-users] R: R: migration suggestions

Eugenio Trumpy frippe12573 at hotmail.com
Wed Apr 1 05:46:08 PDT 2020


Dear Rizky,

yes, the map client doesn't render the layer (the thumbnail yes).
And of course I checked the geoserver 'Layer preview' page: there each layer works fine.

Any other idea?

Best,

Eugenio

________________________________
Da: Rizky Maulana Nugraha <rizky at kartoza.com>
Inviato: mercoledì 1 aprile 2020 07:38
A: Eugenio Trumpy <frippe12573 at hotmail.com>
Cc: Toni Schönbuchner <toni.schoenbuchner at csgis.de>; geonode-users <geonode-users at lists.osgeo.org>
Oggetto: Re: [GeoNode-users] R: migration suggestions

Dear Eugenio,


> However, updatelayers doesn't produce any
update and although I'm able to see the layers, in the layer maps and in the
maps I cannot see the data (both raster and vector).

Do you mean the map client doesn't render the layer/thumbnail?
Have you already check from using GeoServer layer preview page that GeoServer itself can render the layer?
Geonode retrieve layer feature data and images from GeoServer, so if it doesn't render, check that GeoServer is able to render the layer.


Regards,
Rizky Maulana Nugraha

On Tue, 31 Mar 2020 at 06:07, Eugenio Trumpy <frippe12573 at hotmail.com<mailto:frippe12573 at hotmail.com>> wrote:
Hi Toni and all,

I made some steps forward in the migration process.
By using directly the settings.py file I'm able to connect to the right db,
and I was even able to run successfully python manage.py migrate.
The latter produced an increasing of table in the db an geonode now
see all my layers and maps. However, updatelayers doesn't produce any
update and although I'm able to see the layers, in the layer maps and in the
maps I cannot see the data (both raster and vector).
Do you know the reasons?
In the settings file I set the postgresql geonode_data db
as well as the geoserver URL.

Any hints?

Best regards,

Eugenio

________________________________
Da: Toni Schönbuchner <toni.schoenbuchner at csgis.de<mailto:toni.schoenbuchner at csgis.de>>
Inviato: sabato 21 marzo 2020 14:30
A: Eugenio Trumpy <frippe12573 at hotmail.com<mailto:frippe12573 at hotmail.com>>
Cc: geonode-users <geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>>
Oggetto: Re: migration suggestions

Dear Eugenio,

first of all, please be prepared that a migration is not a walk in the park.
You might need some background knowledge about the db scheme and how
is everything is wired together. Further I think the whole multisites idea is not
maintained since long time and hence I would suggest that you first try to port your
data to a single site 2.10.3 instance.

You're saying them amount of tables changed after running migrate? That
is a good sign. The most interesting here is if the manage command threw errors?

Further yes, a wrong settings file could lead to a wrong database usage.
(Just rename the old and you will see ;)

In case of geonode_project you can try to set local_settings here.

https://github.com/GeoNode/geonode-project/blob/2.10.3/project_name/wsgi.py#L38


Best regards

Toni

Am 21.03.2020 um 14:20 schrieb Eugenio Trumpy <frippe12573 at hotmail.com<mailto:frippe12573 at hotmail.com>>:

Dear Toni,

thank you to have answered to mail last email.
My situation is the following:


  *   I have a geonode 2.4 running on a server 'A' configured to run as multi-site which embeds something like 120 layers, 20 maps and 3 users. In server 'A' is running ubuntu 14.04, which is obsolete.
  *   I have also server 'B' where ubuntu is at the version 18.04.
  *   I want to migrate my genode 2.4 running instance as multisites from server 'A' to 'B'.
  *   I have asked some weeks ago here in the list what would have been the best solution, consider I'm not a developer and I never used the virtualenv. I installed the 2.4 version for production.
  *   For the migration I was following some suggestions from Alessio:

  1.  Setup a new GeoServer 2.15.2 ( https://build.geo-solutions.it/geonode/geoserver/latest/geoserver-2.15.2.war )
  2.  Transfer the Data Dir from the old GeoServer to the new one (I strongly suggest to backport **only** the workspace, datasets and styles, not the security subsystem)
  3.  Setup the new GeoNode instance
  4.  Run the "updatelayers" management command (see http://docs.geonode.org/en/master/admin/mgmt_commands/index.html#management-command-updatelayers )
  5.  Update manually the missing permissions and metadata

  *   I completed step 1 with geoserver 2.16.2 - I installed the data_dir outside geoserver - and it runs fine
  *   I completed step 2 and I'm able to see all the layers I had in server 'A'
  *   I set up a fresh geonode instance, even thanks to you help. I installed geonode from GIT, so I should have the master version (2.10).
  *   Within the step 2 I restored in server 'A' the two postgresql db I had inserver 'A'
  *   Since I remembered some steps of the custom configuration I did for version 2.4 (and I never used NGINX) I configured APACHE2.
  *   Currently in server 'B' I'm able to see the geonode home page, but I cannot see my layers as well as I cannot enter as administrator.
  *   I followed you suggestions and I
  *   ALTER TABLE public.layers_layer DROP COLUMN service_id
  *   successfully
  *   and I gave the command
  *   django python manage.py migrate --fake-initial
  *   but I'm still not able to enter as administrator
  *   I realized even that the db schema apparently didn't change (e.g. I had 75 tables in the old version and I still have 75 tables in the newer version, I don't if the fields are modified instead)
  *   to have the version 2.10 running I followed your suggestion to insert my domain in the ALLOWED_HOSTS variable inside local_settings.py. I did it but it didn't work as long as I insert the same in settings.py. For this reason I'm supposing that local_settings.py is not active in some way and for the same reason it doesn't allow to connect to the db. Am I right?

Once the administrator login will be solved:

  *   I should configure this new running geonode instance for multisites - Could I restore in someway the look & feels I had in the old instance?
  *   check the authorization between geonode and geoserver

I hope this can help you to have a clearer vision of 'whats going on'...

Best regards,

Eugenio

________________________________
Da: Toni Schönbuchner <toni.schoenbuchner at csgis.de<mailto:toni.schoenbuchner at csgis.de>>
Inviato: sabato 21 marzo 2020 13:45
A: Eugenio Trumpy <frippe12573 at hotmail.com<mailto:frippe12573 at hotmail.com>>
Cc: geonode-users <geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>>
Oggetto: Re: migration suggestions

Hi Eugenio,

I would need to have a look what is going on. But yes local_settings should override settings.
The correct command for migrations is python manage.py migrate ... (instead of syncdb)

best regards

toni

Am 20.03.2020 um 19:58 schrieb Eugenio Trumpy <frippe12573 at hotmail.com<mailto:frippe12573 at hotmail.com>>:

Dear Toni,

I followed your hints.
I put the domain in the ALLOWED_HOSTS and now I visualise the home page.
Just a question, I had to put the domain the settings.py file because it didn't work in local_setting.py, why? Don't local_setting override setting.py?
Then I modify local_setting.py to set credential to access geonode db.
Then I alter the table you suggested and I run python manage.py --syncdb but the number of tables didn't change, is that correct?
The geonode home page is visualised but I'm not able to enter with the old administrator credential.
I presume there is no connection with the db. Should I use again setting.py instead of local_setting.py?

Thanks in advance,

Eugenio

________________________________
Da: Toni Schönbuchner <toni.schoenbuchner at csgis.de<mailto:toni.schoenbuchner at csgis.de>>
Inviato: giovedì 19 marzo 2020 20:37
A: Eugenio Trumpy <frippe12573 at hotmail.com<mailto:frippe12573 at hotmail.com>>
Cc: geonode-users <geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>>
Oggetto: Re: migration suggestions

Dear Eugenio,


>        • I set the wgsi module in apache2. The geonode is served now with the 'allowed_hosts' error. I think the issue could be related to the settings. In the 2.4 version I remember I set SITE_URL, should I set something similar even in this version?

Allowed hosts is a security mechanism by Django  to define Domains that serve your instance.
https://docs.djangoproject.com/en/3.0/ref/settings/#allowed-hosts

To overcome an 504 error you can add something like

ALLOWED_HOSTS = ['localhost' '127.0.0.1' 'your domain.com<http://domain.com/>']

to your settings.py or local_settings.p However, we all more and more avoid touching the settings file and try to configure everything
with environment variables. So with a manual setup you can try to add it to your uwsgi config:
https://docs.geonode.org/en/master/install/core/index.html#serving-geonode-geoserver-via-nginx

>        • I created a geonode postgresql empty db, while I restored the backup from that I was using in 2.4 version. How I should populate with the new data-schema the geonode metadata db? I remember there was the command python manage.py --syncdb, does still exist? I tried but I got error.

I'm unsure If I correctly understand. But the rough flow looks like:

        • Export your geonode 2.4 Database
        • Import it to a fresh Database
        • Be sure to correctly set permissions for your User
        • Change your settings.py for using the new database and in case the correct user
        • Fix some inconsistency within your new database. Run f.e. with pgadmin or by psql from console
                • ALTER TABLE public.layers_layer DROP COLUMN service_id
        • Run the migrations, this should update your database scheme from 2.4 to 2.10
                • DJANGO_SETTINGS_MODULE=YOURGEONODE.local_settings django python manage.py migrate --fake-initial

You will need to change those commands to fit your setup further run into errors here and
there but hopefully this steps help you to find out of the forest.

Cheers,

Toni


-----------------------------------------------
CSGIS

-----------------------------------------------
Spinnereistraße 7
Halle 18 04179 Leipzig
-----------------------------------------------
Web             https://csgis.de<https://csgis.de/>
-----------------------------------------------

Hinweis gemäß § 33 BDSG
Daten der Verfahrensbeteiligten werden gespeichert. Dieses Dokument ist ausschließlich für den
Adressaten bestimmt. Der Inhalt der E-Mail ist vertraulich. Falls Sie diese E-Mail versehentlich
erhalten haben, rufen Sie uns unter obiger Rufnummer umgehend an und löschen Sie diese Nachricht
von Ihrem Computer. Jegliche Art von Reproduktionen, Verbreitung, Vervielfältigung, Veränderung,
Verteilung und/oder Veröffentlichung dieser E-Mail ist verboten.

_______________________________________________
geonode-users mailing list
geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>
https://lists.osgeo.org/mailman/listinfo/geonode-users


--
Rizky Maulana Nugraha
Software Developer - Kartoza
rizky at kartoza.com<mailto:rizky at kartoza.com>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/geonode-users/attachments/20200401/cfb570db/attachment-0001.html>


More information about the geonode-users mailing list