[pgpointcloud] PGPointCloud Performance - what to optimize

[Paul Ramsey]

We should talk a bit in detail about what the two databases are doing, same and differently. We're doing compression on load, so there's some pain there for sure. Wondering what else could be different. Talk Thurs or Fri? 
P

-- 
Paul Ramsey
http://cleverelephant.ca
http://postgis.net


On Tuesday, September 10, 2013 at 2:33 PM, Smith, Michael ERDC-CRREL-NH wrote:

> All,
> 
> Just starting to test loading Pointcloud data to Postgres (9.2) after
> doing a lot with Oracle pointcloud loading and wondering where the
> opportunities are for improving performance.
> 
> For the following test file
> (http://csc.noaa.gov/htdata/lidar1_z/geoid12a/data/1408/20120120_18TWM95520
> 0.laz), a 7.4M point file, here are my performance numbers for Postgres vs
> Oracle:
> 
> Oracle (11gR2):
> 400 : 1m57.681s
> 10k : 0m42.291s
> 100k : 0m38.627s
> 
> Postgres 9.2
> 400 : 2m09.042s
> 10k : 1m38.626s
> 100k : 1m51.164s
> 
> We generally load to Oracle with block sizes of 100K points/per block
> (oracle doesn't have a cost penalty for larger block sizes so we tend to
> use larger block sizes). For Postgres, the recommendation has been to keep
> block sizes to 400. Performance does increase a bit with larger block
> sizes but not nearly as much as oracle.
> 
> I wondering now, what are the basic things I need to check/optimize for
> Postgres ingestion that I'm probably not doing (or is this the currrent
> limit on loading performance)?
> 
> Attached are my oracle/postgres pipelines for the curious.
> 
> Mike
> 
> -- 
> Michael Smith
> 
> US Army Corps
> Remote Sensing GIS/Center
> 
> _______________________________________________
> pgpointcloud mailing list
> pgpointcloud at lists.osgeo.org (mailto:pgpointcloud at lists.osgeo.org)
> http://lists.osgeo.org/cgi-bin/mailman/listinfo/pgpointcloud
> 
> 
> Attachments: 
> - PostgresPipe.xml
> 
> - OraclePipe.xml
>