[pgpointcloud] PGPointCloud Performance - what to optimize
Smith, Michael ERDC-CRREL-NH
Michael.Smith at usace.army.mil
Tue Sep 10 11:33:14 PDT 2013
All,
Just starting to test loading Pointcloud data to Postgres (9.2) after
doing a lot with Oracle pointcloud loading and wondering where the
opportunities are for improving performance.
For the following test file
(http://csc.noaa.gov/htdata/lidar1_z/geoid12a/data/1408/20120120_18TWM95520
0.laz), a 7.4M point file, here are my performance numbers for Postgres vs
Oracle:
Oracle (11gR2):
400 : 1m57.681s
10k : 0m42.291s
100k : 0m38.627s
Postgres 9.2
400 : 2m09.042s
10k : 1m38.626s
100k : 1m51.164s
We generally load to Oracle with block sizes of 100K points/per block
(oracle doesn't have a cost penalty for larger block sizes so we tend to
use larger block sizes). For Postgres, the recommendation has been to keep
block sizes to 400. Performance does increase a bit with larger block
sizes but not nearly as much as oracle.
I wondering now, what are the basic things I need to check/optimize for
Postgres ingestion that I'm probably not doing (or is this the currrent
limit on loading performance)?
Attached are my oracle/postgres pipelines for the curious.
Mike
--
Michael Smith
US Army Corps
Remote Sensing GIS/Center
-------------- next part --------------
A non-text attachment was scrubbed...
Name: PostgresPipe.xml
Type: application/xml
Size: 1848 bytes
Desc: PostgresPipe.xml
URL: <http://lists.osgeo.org/pipermail/pgpointcloud/attachments/20130910/4e834d8b/attachment.xml>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: OraclePipe.xml
Type: application/xml
Size: 2129 bytes
Desc: OraclePipe.xml
URL: <http://lists.osgeo.org/pipermail/pgpointcloud/attachments/20130910/4e834d8b/attachment-0001.xml>
More information about the pgpointcloud
mailing list