[GeoNode-users] java heap size error uploading shapefile

Tue Jul 12 23:12:15 PDT 2016

Hi Simone

Smaller shapefiles are uploaded in the same way fine and are successful, it appears to be larger files that are problematic.

From: Simone Dalmasso [mailto:simone.dalmasso at gmail.com]
Sent: Wednesday, 13 July 2016 4:08 PM
To: Chris Jones <Chris.Jones at sunshinecoast.qld.gov.au>
Cc: Alessio Fabiani <alessio.fabiani at geo-solutions.it>; Daniel Berry <dberry at boundlessgeo.com>; geonode-users at lists.osgeo.org
Subject: Re: [GeoNode-users] java heap size error uploading shapefile

Hi, i see this in the logs "ERROR: relation "planpsvec_zones" does not exist" it looks like there is a database configuration issue and geoserver can't access it or is accessing another database different from the one you imported the data.is<http://data.is> that possible?

2016-07-13 8:02 GMT+02:00 Chris Jones <Chris.Jones at sunshinecoast.qld.gov.au<mailto:Chris.Jones at sunshinecoast.qld.gov.au>>:
Hi Alessio/Dan

I made the java changes as suggested and it appears to get a bit further. I now get this error:

An exception occurred loading data to PostGIS- java.lang.RuntimeException: java.io.IOException: Error occured calculating bounds for planpsvec_zones

Dan - To answer your questions in the previous email

Geoserver is running on jetty
Geonode is apache

Both are Ubuntu EC2 instances sitting behind AWS load balancers.

I have attached the geoserver log file, logging is currently to production_logging. I can amend this if it will provide you more information but it gets pretty large in size quickly.

I have imported the data into postigs database with the import extension on the server fine, so the data appears to be ok.

Thanks

Chris

From: alessio.fabiani at gmail.com<mailto:alessio.fabiani at gmail.com> [mailto:alessio.fabiani at gmail.com<mailto:alessio.fabiani at gmail.com>] On Behalf Of Alessio Fabiani
Sent: Wednesday, 13 July 2016 3:30 AM
To: Daniel Berry <dberry at boundlessgeo.com<mailto:dberry at boundlessgeo.com>>
Cc: Chris Jones <Chris.Jones at sunshinecoast.qld.gov.au<mailto:Chris.Jones at sunshinecoast.qld.gov.au>>; geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>
Subject: Re: [GeoNode-users] java heap size error uploading shapefile

Hi Chris,
it is a bit strange the fact that you are getting a heap OOM error, as Daniel already said, it would be very useful to take a look at some logs in order to get some more info on the issue.

In any case, if you upgraded the available memory on your server you should also update the JVM Options.

If I understood correctly you now have about 8Gb RAM available, so maybe could be helpful to set the options like follows:

JAVA_OPTS="-Xms1024m -Xmx4096m -XX:MaxPermSize=1024m"

NOTE: maybe 4Gb is too much for your needs, it depends on your specific use case. You can also try with 2048m.

Best Regards,
Alessio Fabiani.

==
GeoServer Professional Services from the experts!
Visit http://goo.gl/it488V for more information.
==

Ing. Alessio Fabiani
@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
Italy
phone: +39 0584 962313<tel:%2B39%200584%20962313>
fax:     +39 0584 1660272<tel:%2B39%200584%201660272>
mob:   +39 331 6233686<tel:%2B39%20331%206233686>

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility  for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

---------------------------------------------------------------------

On Tue, Jul 12, 2016 at 6:25 PM, Daniel Berry <dberry at boundlessgeo.com<mailto:dberry at boundlessgeo.com>> wrote:
Chris,

Is it possible to send any logs? Also what is your configuration:

Proxy Server - Apache/NGINX
Application Server - Tomcat/Jetty/JBOSS

Respectfully,
Dan

On Mon, Jul 11, 2016 at 7:27 PM, Chris Jones <Chris.Jones at sunshinecoast.qld.gov.au<mailto:Chris.Jones at sunshinecoast.qld.gov.au>> wrote:
Hi all

I’m trying to upload a 200mb shapefile from Geonode into a RDS postgis database and keep getting a java heap size error. I have a separate EC2 instance running geoserver and have increased the instance to
T2 large so have 8gb RAM. Geoserver has no other layers and is not in production so it’s not being heavily used at all.

I’ve also tested different settings for the java heap size (see below). This is what it’s currently set to. I have increased these settings but the error persists.

JAVA_OPTS="-Xms1024m -Xmx1024m -XX:MaxPermSize=512m"

Can anyone advise what to try next?? Is there a limitation on shapefile size??

Any help would be greatly appreciated.

Thanks
Chris
Chris Jones | Geospatial Analyst
Geospatial & Asset Systems
Information Communications Technology Services | Sunshine Coast Council
Phone:  07 5475 8717
Email:  Chris.Jones at Sunshinecoast.qld.gov.au<mailto:Chris.Jones at Sunshinecoast.qld.gov.au>
Address:  Locked Bag 72 Sunshine Coast Mail Centre QLD 4560.
Website:  http://maps.sunshinecoast.qld.gov.au/MyMaps
P Please consider the environment before printing this email

_______________________________________________
geonode-users mailing list
geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>
http://lists.osgeo.org/mailman/listinfo/geonode-users

--
Daniel Berry
Senior Software Engineer | Boundless
dberry at boundlessgeo.com<mailto:dberry at boundlessgeo.com>
512-468-3946<tel:512-468-3946> (cell)
@boundlessgeo

[https://docs.google.com/a/boundlessgeo.com/uc?id=0B_qVH4CJ8mXOa3E1YUNySzN2d00&export=download]

_______________________________________________
geonode-users mailing list
geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>
http://lists.osgeo.org/mailman/listinfo/geonode-users

_______________________________________________
geonode-users mailing list
geonode-users at lists.osgeo.org<mailto:geonode-users at lists.osgeo.org>
http://lists.osgeo.org/mailman/listinfo/geonode-users

--
Simone
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/geonode-users/attachments/20160713/a52658e7/attachment-0001.html>