[GeoNode-users] Geonode Upload Memory Error
Stefan Steiniger
sstein at geo.uzh.ch
Wed Jul 1 07:17:11 PDT 2015
Hei,
yes it is. Perhaps something changed meanwhile? I am using GeoNode 2.0
I don't have good esxperiences uploading large files, due to webpage
feedback issues. However, I think that such large files should not
uploaded by "normal users", but rather administrators. So what I do now
is copying the large shapefiles (400-700MB) to the server (via sftp)
and then use " sudo geonode importlayers /home/myuser/xxx/". Later on I
update the meta data as normal using the web interface. The only issue I
found with that, is that I can not set the charset (having spanish data).
Huge rasters/images (50MB> ... 5GB) I also copy via ftp to a dedicated
web folder on the server (with appropriate permissions), and then use
the GeoServer interface to create a separate store and add the
resources/layers. Afterwards using geonode updatelayers --ignore-errors
--skip-geonode-registered
hth
Stefan
On 07/01/2015 11:06 AM, Miguel-Angel Manso-Callejo (UPM) wrote:
> Hi, Stefan
>
> It is strange. Because i can upload a geotif file of 178MB with the
> setting of 50 #MB and when i tryed to upload a file with 400MB appear
> the error.
>
> This is the complete log:
>
>
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> Error creating import session
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> Traceback (most recent call last):
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> File "c:/GeoNode/GeoNode\\geonode\\upload\\upload.py", line 266, in
> save_step
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> mosaic=len(spatial_files) > 1)
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> File "C:\\GeoNode\\venv\\Lib\\site-packages\\gsimporter\\client.py",
> line 95, in upload_files
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> session.upload_task(files, use_url, intial_opts)
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> File "C:\\GeoNode\\venv\\Lib\\site-packages\\gsimporter\\api.py", line
> 390, in upload_task
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> resp = self._client().post_multipart(addopts(url), files)
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> File "C:\\GeoNode\\venv\\Lib\\site-packages\\gsimporter\\client.py",
> line 250, in post_multipart
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> 'Content-Type' : 'multipart/form-data; boundary=%s' % BOUNDARY
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> File "C:\\GeoNode\\venv\\Lib\\site-packages\\gsimporter\\client.py",
> line 160, in _request
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> resp, content = self.http.request(url, method, data, headers)
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> File "C:\\GeoNode\\venv\\Lib\\site-packages\\httplib2\\__init__.py",
> line 1570, in request
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> (response, content) = self._request(conn, authority, uri, request_uri,
> method, body, headers, redirections, cachekey)
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> File "C:\\GeoNode\\venv\\Lib\\site-packages\\httplib2\\__init__.py",
> line 1317, in _request
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> (response, content) = self._conn_request(conn, request_uri, method,
> body, headers)
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> File "C:\\GeoNode\\venv\\Lib\\site-packages\\httplib2\\__init__.py",
> line 1253, in _conn_request
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> conn.request(method, request_uri, body, headers)
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> File "C:\\Python27\\Lib\\httplib.py", line 1053, in request
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> self._send_request(method, url, body, headers)
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> File "C:\\Python27\\Lib\\httplib.py", line 1093, in _send_request
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> self.endheaders(body)
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> File "C:\\Python27\\Lib\\httplib.py", line 1049, in endheaders
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> self._send_output(message_body)
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> File "C:\\Python27\\Lib\\httplib.py", line 891, in _send_output
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> msg += message_body
> [Wed Jul 01 15:52:22.098121 2015] [wsgi:error] [pid 3608:tid 1236]
> MemoryError
> [Wed Jul 01 15:52:22.176250 2015] [wsgi:error] [pid 3608:tid 1236]
> Unexpected error in upload step
> [Wed Jul 01 15:52:22.176250 2015] [wsgi:error] [pid 3608:tid 1236]
> Traceback (most recent call last):
> [Wed Jul 01 15:52:22.176250 2015] [wsgi:error] [pid 3608:tid 1236]
> File "c:/GeoNode/GeoNode\\geonode\\upload\\views.py", line 604, in view
> [Wed Jul 01 15:52:22.176250 2015] [wsgi:error] [pid 3608:tid 1236]
> resp = _steps[step](req, upload_session)
> [Wed Jul 01 15:52:22.176250 2015] [wsgi:error] [pid 3608:tid 1236]
> File "c:/GeoNode/GeoNode\\geonode\\upload\\views.py", line 257, in
> save_step_view
> [Wed Jul 01 15:52:22.176250 2015] [wsgi:error] [pid 3608:tid 1236]
> overwrite=False)
> [Wed Jul 01 15:52:22.176250 2015] [wsgi:error] [pid 3608:tid 1236]
> File "c:/GeoNode/GeoNode\\geonode\\upload\\upload.py", line 303, in
> save_step
> [Wed Jul 01 15:52:22.176250 2015] [wsgi:error] [pid 3608:tid 1236]
> raise e
> [Wed Jul 01 15:52:22.176250 2015] [wsgi:error] [pid 3608:tid 1236]
> MemoryError
>
>
> Best regards
> Miguel A
>
> El 01/07/2015 a las 15:30, Stefan Steiniger escribió:
>> Hi,
>>
>> Its possible to change the size limit in
>> /etc/geonode/local_settings.py with the entry MAX_DOCUMENT_SIZE = 100
>> # MB. Afterwards, restart Apache.
>>
>> stefan
>>
>> Am 30.06.15 um 11:11 schrieb Miguel-Angel Manso-Callejo (UPM):
>>> Dear all,
>>>
>>> I am trying to upload big size image file and one error related to
>>> Memory error appear in Apache error log file.
>>>
>>> there are any way to increase the size of file that can be uploaded?
>>> Where can i do it?
>>>
>>> Regards,
>>> Miguel A. Manso
>>>
>>>
>>> [Tue Jun 30 17:03:08.292163 2015] [wsgi:error] [pid 3768:tid 1236]
>>> Traceback (most recent call last):
>>> [Tue Jun 30 17:03:08.292163 2015] [wsgi:error] [pid 3768:tid 1236] File
>>> "c:/GeoNode/GeoNode\\geonode\\upload\\views.py", line 604, in view
>>> [Tue Jun 30 17:03:08.292163 2015] [wsgi:error] [pid 3768:tid 1236] resp
>>> = _steps[step](req, upload_session)
>>> [Tue Jun 30 17:03:08.292163 2015] [wsgi:error] [pid 3768:tid 1236] File
>>> "c:/GeoNode/GeoNode\\geonode\\upload\\views.py", line 257, in
>>> save_step_view
>>> [Tue Jun 30 17:03:08.292163 2015] [wsgi:error] [pid 3768:tid 1236]
>>> overwrite=False)
>>> [Tue Jun 30 17:03:08.292163 2015] [wsgi:error] [pid 3768:tid 1236] File
>>> "c:/GeoNode/GeoNode\\geonode\\upload\\upload.py", line 303, in
>>> save_step
>>> [Tue Jun 30 17:03:08.292163 2015] [wsgi:error] [pid 3768:tid 1236]
>>> raise e
>>> [Tue Jun 30 17:03:08.292163 2015] [wsgi:error] [pid 3768:tid 1236]
>>> MemoryError
>>> _______________________________________________
>>> geonode-users mailing list
>>> geonode-users at lists.osgeo.org
>>> http://lists.osgeo.org/cgi-bin/mailman/listinfo/geonode-users
>> _______________________________________________
>> geonode-users mailing list
>> geonode-users at lists.osgeo.org
>> http://lists.osgeo.org/cgi-bin/mailman/listinfo/geonode-users
>>
>
> _______________________________________________
> geonode-users mailing list
> geonode-users at lists.osgeo.org
> http://lists.osgeo.org/cgi-bin/mailman/listinfo/geonode-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/geonode-users/attachments/20150701/4dd351c8/attachment.html>
More information about the geonode-users
mailing list