[GeoNode-users] java heap size error uploading shapefile

Wed Jul 13 01:27:43 PDT 2016

My best guess is that a session timeout somehow does not allow to transfer
the whole file to GeoServer.

You can try to check if in the geoserver datadir/uploads is present the
shapefile. If *yes* than it is possible that GeoServer is not able to read
or process the shapefile.

The bigger one has the same projection of the smaller ones?

Also, maybe you can try to use the "Importer Mode" instead of the default
"Rest" one.

Best Regards,
Alessio Fabiani.

==
GeoServer Professional Services from the experts!
Visit http://goo.gl/it488V for more information.
==

Ing. Alessio Fabiani
@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
Italy
phone: +39 0584 962313
fax:     +39 0584 1660272
mob:   +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility  for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.

---------------------------------------------------------------------

On Wed, Jul 13, 2016 at 8:12 AM, Chris Jones <
Chris.Jones at sunshinecoast.qld.gov.au> wrote:

> Hi Simone
>
>
>
> Smaller shapefiles are uploaded in the same way fine and are successful,
> it appears to be larger files that are problematic.
>
>
>
> *From:* Simone Dalmasso [mailto:simone.dalmasso at gmail.com]
> *Sent:* Wednesday, 13 July 2016 4:08 PM
> *To:* Chris Jones <Chris.Jones at sunshinecoast.qld.gov.au>
> *Cc:* Alessio Fabiani <alessio.fabiani at geo-solutions.it>; Daniel Berry <
> dberry at boundlessgeo.com>; geonode-users at lists.osgeo.org
>
> *Subject:* Re: [GeoNode-users] java heap size error uploading shapefile
>
>
>
> Hi, i see this in the logs "ERROR: relation "planpsvec_zones" does not
> exist" it looks like there is a database configuration issue and geoserver
> can't access it or is accessing another database different from the one you
> imported the data.is that possible?
>
>
>
> 2016-07-13 8:02 GMT+02:00 Chris Jones <
> Chris.Jones at sunshinecoast.qld.gov.au>:
>
> Hi Alessio/Dan
>
>
>
> I made the java changes as suggested and it appears to get a bit further.
> I now get this error:
>
>
>
> An exception occurred loading data to PostGIS- java.lang.RuntimeException:
> java.io.IOException: Error occured calculating bounds for planpsvec_zones
>
>
>
> Dan - To answer your questions in the previous email
>
>
>
> Geoserver is running on jetty
>
> Geonode is apache
>
>
>
> Both are Ubuntu EC2 instances sitting behind AWS load balancers.
>
>
>
> I have attached the geoserver log file, logging is currently to
> production_logging. I can amend this if it will provide you more
> information but it gets pretty large in size quickly.
>
>
>
> I have imported the data into postigs database with the import extension
> on the server fine, so the data appears to be ok.
>
>
>
> Thanks
>
>
>
> Chris
>
>
>
>
>
> *From:* alessio.fabiani at gmail.com [mailto:alessio.fabiani at gmail.com] *On
> Behalf Of *Alessio Fabiani
> *Sent:* Wednesday, 13 July 2016 3:30 AM
> *To:* Daniel Berry <dberry at boundlessgeo.com>
> *Cc:* Chris Jones <Chris.Jones at sunshinecoast.qld.gov.au>;
> geonode-users at lists.osgeo.org
> *Subject:* Re: [GeoNode-users] java heap size error uploading shapefile
>
>
>
> Hi Chris,
>
> it is a bit strange the fact that you are getting a heap OOM error, as
> Daniel already said, it would be very useful to take a look at some logs in
> order to get some more info on the issue.
>
>
>
> In any case, if you upgraded the available memory on your server you
> should also update the JVM Options.
>
>
>
> If I understood correctly you now have about 8Gb RAM available, so maybe
> could be helpful to set the options like follows:
>
>
>
>
>
> JAVA_OPTS="-Xms1024m -Xmx*4096*m -XX:MaxPermSize=*1024*m"
>
>
>
> NOTE: maybe 4Gb is too much for your needs, it depends on your specific
> use case. You can also try with 2048m.
>
>
> Best Regards,
>
> Alessio Fabiani.
>
>
>
> ==
>
> GeoServer Professional Services from the experts!
>
> Visit http://goo.gl/it488V for more information.
>
> ==
>
>
>
> Ing. Alessio Fabiani
>
> @alfa7691
>
> Founder/Technical Lead
>
>
>
> GeoSolutions S.A.S.
>
> Via di Montramito 3/A
>
> 55054  Massarosa (LU)
>
> Italy
>
> phone: +39 0584 962313
>
> fax:     +39 0584 1660272
>
> mob:   +39 331 6233686
>
>
>
> http://www.geo-solutions.it
>
> http://twitter.com/geosolutions_it
>
>
>
> -------------------------------------------------------
>
>
>
> *AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*
>
> Le informazioni contenute in questo messaggio di posta elettronica e/o
> nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
> loro utilizzo è consentito esclusivamente al destinatario del messaggio,
> per le finalità indicate nel messaggio stesso. Qualora riceviate questo
> messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
> darcene notizia via e-mail e di procedere alla distruzione del messaggio
> stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
> divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
> utilizzarlo per finalità diverse, costituisce comportamento contrario ai
> principi dettati dal D.Lgs. 196/2003.
>
>
>
> The information in this message and/or attachments, is intended solely for
> the attention and use of the named addressee(s) and may be confidential or
> proprietary in nature or covered by the provisions of privacy act
> (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
> Code).Any use not in accord with its purpose, any disclosure, reproduction,
> copying, distribution, or either dissemination, either whole or partial, is
> strictly forbidden except previous formal approval of the named
> addressee(s). If you are not the intended recipient, please contact
> immediately the sender by telephone, fax or e-mail and delete the
> information in this message that has been received in error. The sender
> does not give any warranty or accept liability as the content, accuracy or
> completeness of sent messages and accepts no responsibility  for changes
> made after they were sent or for other risks which arise as a result of
> e-mail transmission, viruses, etc.
>
> ---------------------------------------------------------------------
>
>
>
> On Tue, Jul 12, 2016 at 6:25 PM, Daniel Berry <dberry at boundlessgeo.com>
> wrote:
>
> Chris,
>
>
>
> Is it possible to send any logs? Also what is your configuration:
>
>
>
> Proxy Server - Apache/NGINX
>
> Application Server - Tomcat/Jetty/JBOSS
>
>
>
> Respectfully,
>
> Dan
>
>
>
> On Mon, Jul 11, 2016 at 7:27 PM, Chris Jones <
> Chris.Jones at sunshinecoast.qld.gov.au> wrote:
>
> Hi all
>
>
>
> I’m trying to upload a 200mb shapefile from Geonode into a RDS postgis
> database and keep getting a java heap size error. I have a separate EC2
> instance running geoserver and have increased the instance to
>
> T2 large so have 8gb RAM. Geoserver has no other layers and is not in
> production so it’s not being heavily used at all.
>
>
>
> I’ve also tested different settings for the java heap size (see below).
> This is what it’s currently set to. I have increased these settings but the
> error persists.
>
>
>
> JAVA_OPTS="-Xms1024m -Xmx1024m -XX:MaxPermSize=512m"
>
>
>
> Can anyone advise what to try next?? Is there a limitation on shapefile
> size??
>
>
>
> Any help would be greatly appreciated.
>
>
>
> Thanks
>
> Chris
>
> Chris Jones | Geospatial Analyst
>
> Geospatial & Asset Systems
>
> Information Communications Technology Services | Sunshine Coast Council
>
> *Phone:  07 5475 8717*
> *Email: * *Chris.Jones at Sunshinecoast.qld.gov.au
> <Chris.Jones at Sunshinecoast.qld.gov.au>*
> *Address: * Locked Bag 72 Sunshine Coast Mail Centre QLD 4560.
> *Website: * http://maps.sunshinecoast.qld.gov.au/MyMaps
>
> P Please consider the environment before printing this email
>
>
>
>
> _______________________________________________
> geonode-users mailing list
> geonode-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/geonode-users
>
>
>
>
>
> --
>
> *Daniel Berry*
>
> Senior Software Engineer | Boundless
>
> dberry at boundlessgeo.com
>
> 512-468-3946 (cell)
>
> @boundlessgeo
>
>
>
> _______________________________________________
> geonode-users mailing list
> geonode-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/geonode-users
>
>
>
>
> _______________________________________________
> geonode-users mailing list
> geonode-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/geonode-users
>
>
>
>
>
> --
>
> Simone
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/geonode-users/attachments/20160713/39e1208e/attachment-0001.html>