[GeoNode-users] Poor performance GeoNode

Wed Sep 13 22:46:24 PDT 2017

Hi Ana

Great soundtrack! 😃

Have you seeded the cache for all your layers?

http(s)://<yourHostName>/geoserver/gwc/rest/seed/<layerName>

Tip: make this task easier and more prominent by adding the option under Edit Layer for admin users (see commit 38a1931<https://github.com/UNSW-CFRC/geonode/commit/38a1931a71b381973d6ca769d2bf8c893a0a1a06> on my repo):

[cid:image003.jpg at 01D32D70.9DCE81E0]

Regards
Jonathan

From: geonode-users [mailto:geonode-users-bounces at lists.osgeo.org] On Behalf Of John Jediny
Sent: Thursday, 14 September 2017 7:45 AM
To: Ana Boljevic <ana.boljevic at cedis.me>
Cc: Alessio Fabiani <alessio.fabiani at geo-solutions.it>; geonode-users at lists.osgeo.org
Subject: Re: [GeoNode-users] Poor performance GeoNode

Are you running it on a cloud service provider or in-house? this seems like a network latency issue at first watch. Can you share the specs of the operating systems/machines (e.g. VM/containers) being used for total CPU/RAM/Network?

On Fri, Sep 8, 2017 at 3:11 AM, Ana Boljevic <ana.boljevic at cedis.me<mailto:ana.boljevic at cedis.me>> wrote:
Hi Alessio,

Please receive screen video recording link, so you can see by yourself what do we mean by "Poor Performance".
https://www.dropbox.com/s/2ai2n8764p1ny9n/2017-09-08-08-38-33.flv?dl=0
This recording was taken during of heavy map rendering of 4 clients. We have 144 vector layers and 2 external WMS layers (behaviour is the same when we don't use WMS layers. In video link, we have used only local vector layers, not external WMS layers). We are not experienced enough to know what does cause the issue (GeoNode or GeoServer).
Please reveive one typical kml layer in the attachment.
Regards,

Ana Boljevic
--
________________________________
From: Alessio Fabiani [alessio.fabiani at geo-solutions.it<mailto:alessio.fabiani at geo-solutions.it>]
Sent: Thursday, September 07, 2017 4:21 PM
To: Ana Boljevic
Cc: John Jediny; Angelos Tzotsos; geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>

Subject: Re: [GeoNode-users] Poor performance GeoNode

Can you please better explain what you mean with "Map Performance" exactly?

Getting the list of layers or rendering the map?

Also, how many layers you have and which type (vectorial / raster) ?

Are you able to identify performance issues? Those are on GeoNode or GeoServer?

In the first case it is certainly an issue of your HTTP Server configuration (and most probably the proxy module), in the second case it could be an issue of data not correctly processed.

Regards,

Alessio Fabiani

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
==

Ing. Alessio Fabiani

@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
Italy
phone: +39 0584 962313<tel:+39%200584%20962313>
fax:     +39 0584 1660272<tel:+39%200584%20166%200272>
mob:   +39 331 6233686<tel:+39%20331%20623%203686>

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility  for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

On Thu, Sep 7, 2017 at 8:54 AM, Ana Boljevic <ana.boljevic at cedis.me<mailto:ana.boljevic at cedis.me>> wrote:
Hi Angelos and John,
Let me explain one more time, our performance issue. We have done fresh Geonode 2.6.2 installation (standard deployment), give VM 24GB RAM and 12 CPU. After installation, we have done:
1) Replace OpenJVM with OracleJVM
2) We've increased the JVM memory by adding into /etc/default/tomcat7
JAVA_OPTS="-Xmx12288M -Xms12288M -XX:MaxPermSize=1024M -XX:CompileCommand=exclude,net/sf/saxon/event/ReceivingContentHandler.startEvent"
3) Enable Native JAI and Native JAI ImageIO
4) Enable Tile caching into External PostgreSQL database

Additionally, we have tried the following:
1) In /etc/tomcat7/server.xml added maxThreads="50":

  <Connector port="8080" protocol="HTTP/1.1"
               connectionTimeout="20000"
               URIEncoding="UTF-8"
               redirectPort="8443" maxThreads="50"/>
2) In /etc/apache2/mods-enabled/mpm_event.conf

try to change conf parameters with no results:
<IfModule mpm_event_module>
        StartServers                     2
        MinSpareThreads          25
        MaxSpareThreads          75
        ThreadLimit                      64
        ThreadsPerChild          25
        MaxRequestWorkers         150
        MaxConnectionsPerChild   0
</IfModule>

Still, when 4-5 clients try to render maps, performance radically decrease and geonode become unresponsive.
Do you have any idea how to increse performance ?
Best regards,
Ana Boljevic
--

________________________________
From: John Jediny [john.jediny at gmail.com<mailto:john.jediny at gmail.com>]
Sent: Saturday, September 02, 2017 3:32 AM
To: Angelos Tzotsos
Cc: Ana Boljevic; geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>
Subject: Re: [GeoNode-users] Poor performance GeoNode
apache2 mod_wsgi needs tuning. Add workers and up memory limits per worker

On Fri, Sep 1, 2017 at 3:56 PM, Angelos Tzotsos <gcpp.kalxas at gmail.com<mailto:gcpp.kalxas at gmail.com>> wrote:
You need to add more workers on your WSGI server.

Best,
Angelos

On 08/29/2017 11:43 AM, Ana Boljevic wrote:

Dear Geonode Community,

We have installed fresh Geonode v2.6.2 on Ubuntu Server 16.04. In order to speed up system, we gave Geonode 24GB of RAM and 12 CPU. Unfortulnally, performance are still poor. Apart from basic installation (standard, not developement deployment) we have done:

1) Replace OpenJVM with OracleJVM (see attachment geoserver.png)

2) We've increased the JVM memory by adding into /etc/default/tomcat7

JAVA_OPTS="-Djava.awt.headless=true -Xms6144m -Xmx6144m -XX:+UseParallelOldGC -XX:+UseParallelGC -XX:NewRatio=2 -XX:+AggressiveOpts -Xrs -XX:PerfDataSamplingInterval=500 -XX:MaxPermSize=512m"

3) Enable Native JAI and Native JAI ImageIO

4) Enable Tile caching into External PostgreSQL database

For some reason, Server is not consuming memory no mater how many clients are requesting maps. There is always more than 16GB free memory (attachment free.jpg).

If you can give as any hint, idea or help, we would be thankful.

Regards,

Ana Boljevic

--

_______________________________________________

geonode-users mailing list

geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>

https://lists.osgeo.org/mailman/listinfo/geonode-users

--

Angelos Tzotsos, PhD

Charter Member

Open Source Geospatial Foundation

http://users.ntua.gr/tzotsos

_______________________________________________
geonode-users mailing list
geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>
https://lists.osgeo.org/mailman/listinfo/geonode-users

--
Cell: 973-931-0580<tel:(973)%20931-0580>

_______________________________________________
geonode-users mailing list
geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>
https://lists.osgeo.org/mailman/listinfo/geonode-users

--
Cell: 973-931-0580
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/geonode-users/attachments/20170914/a1605ec4/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.jpg
Type: image/jpeg
Size: 14657 bytes
Desc: image003.jpg
URL: <http://lists.osgeo.org/pipermail/geonode-users/attachments/20170914/a1605ec4/attachment-0001.jpg>