[Liblas-devel] I/O performance? -- your help requested!

[Smith, Michael ERDC-CRREL-NH]

Looks like those were bad values previously. It actually wasn¹t running.

Here are new values with it actually working. I also ran a couple of runs at
10x larger.

----------

[lidar at lidarora1 Release]$ time ./laszippertest -n 1000000
Settings:
  num_points=1000000, use_iostream=false, run_forever=false,
use_random=false, user_seed=1297098398
laszipper wrote 70000000 bytes in 0.37 seconds
SUCCESS: lasunzipper read 70000000 bytes in 0.23 seconds
laszipper wrote 38271321 bytes in 1.32 seconds
SUCCESS: lasunzipper read 38271321 bytes in 1.75 seconds
Finished 1 runs


real    0m3.697s
user    0m3.456s
sys    0m0.225s
[lidar at lidarora1 Release]$ time ./laszippertest -n 1000000
Settings:
  num_points=1000000, use_iostream=false, run_forever=false,
use_random=false, user_seed=1297098404
laszipper wrote 70000000 bytes in 0.36 seconds
SUCCESS: lasunzipper read 70000000 bytes in 0.23 seconds
laszipper wrote 38271321 bytes in 1.31 seconds
SUCCESS: lasunzipper read 38271321 bytes in 1.8 seconds
Finished 1 runs


real    0m4.650s
user    0m3.494s
sys    0m0.249s
[lidar at lidarora1 Release]$
[lidar at lidarora1 Release]$ time ./laszippertest -n 1000000
Settings:
  num_points=1000000, use_iostream=false, run_forever=false,
use_random=false, user_seed=1297098411
laszipper wrote 70000000 bytes in 0.37 seconds
SUCCESS: lasunzipper read 70000000 bytes in 0.23 seconds
laszipper wrote 38271321 bytes in 1.32 seconds
SUCCESS: lasunzipper read 38271321 bytes in 1.72 seconds
Finished 1 runs


real    0m3.685s
user    0m3.450s
sys    0m0.221s
[lidar at lidarora1 Release]$ time ./laszippertest -n 1000000 -s
Settings:
  num_points=1000000, use_iostream=true, run_forever=false,
use_random=false, user_seed=1297098419
laszipper wrote 70000000 bytes in 0.43 seconds
SUCCESS: lasunzipper read 70000000 bytes in 0.29 seconds
laszipper wrote 38271321 bytes in 1.39 seconds
SUCCESS: lasunzipper read 38271321 bytes in 1.86 seconds
Finished 1 runs


real    0m4.014s
user    0m3.701s
sys    0m0.297s
[lidar at lidarora1 Release]$ time ./laszippertest -n 1000000 -s
Settings:
  num_points=1000000, use_iostream=true, run_forever=false,
use_random=false, user_seed=1297098425
laszipper wrote 70000000 bytes in 0.42 seconds
SUCCESS: lasunzipper read 70000000 bytes in 0.31 seconds
laszipper wrote 38271321 bytes in 1.37 seconds
SUCCESS: lasunzipper read 38271321 bytes in 1.91 seconds
Finished 1 runs


real    0m4.628s
user    0m3.714s
sys    0m0.343s
[lidar at lidarora1 Release]$ time ./laszippertest -n 1000000 -s
Settings:
  num_points=1000000, use_iostream=true, run_forever=false,
use_random=false, user_seed=1297098431
laszipper wrote 70000000 bytes in 0.42 seconds
SUCCESS: lasunzipper read 70000000 bytes in 0.3 seconds
laszipper wrote 38271321 bytes in 1.38 seconds
SUCCESS: lasunzipper read 38271321 bytes in 1.87 seconds
Finished 1 runs


real    0m4.329s
user    0m3.676s
sys    0m0.336s
[lidar at lidarora1 Release]$ time ./laszippertest -n 10000000 -s
Settings:
  num_points=10000000, use_iostream=true, run_forever=false,
use_random=false, user_seed=1297098440
laszipper wrote 700000000 bytes in 4.35 seconds
SUCCESS: lasunzipper read 700000000 bytes in 3.09 seconds
laszipper wrote 381625423 bytes in 13.82 seconds
SUCCESS: lasunzipper read 381625422 bytes in 18.94 seconds
Finished 1 runs


real    0m41.589s
user    0m37.332s
sys    0m2.893s
[lidar at lidarora1 Release]$ time ./laszippertest -n 10000000
Settings:
  num_points=10000000, use_iostream=false, run_forever=false,
use_random=false, user_seed=1297098486
laszipper wrote 700000000 bytes in 3.73 seconds
SUCCESS: lasunzipper read 700000000 bytes in 2.26 seconds
laszipper wrote 381625423 bytes in 13.09 seconds
SUCCESS: lasunzipper read 381625422 bytes in 17.1 seconds
Finished 1 runs


real    0m38.447s
user    0m34.003s
sys    0m2.403s





On 2/7/11 12:02 PM, "Michael P. Gerlek" <mpg at flaxen.com> wrote:

> Your box is too fast. :-(
>  
> Could you maybe do the runs again, but with ³­n 100000000² (100x larger)?
>  
> -mpg
>  
>  
> 
> From: Smith, Michael ERDC-CRREL-NH [mailto:michael.smith at usace.army.mil]
> Sent: Saturday, February 05, 2011 4:48 AM
> To: mpg at flaxen.com; liblas-devel at lists.osgeo.org
> Subject: Re: [Liblas-devel] I/O performance? -- your help requested!
>  
> lidar at lidarora1 tmp]$ uname -a
> Linux lidarora1 2.6.32-100.0.19.el5 #1 SMP Fri Sep 17 17:51:41 EDT 2010 x86_64
> x86_64 x86_64 GNU/Linux
> 
> 2 CPU, 4cores/cpu + hyperthreading = 16 virtual cores
> 
> processor    : 15
> vendor_id    : GenuineIntel
> cpu family    : 6
> model        : 26
> model name    : Intel(R) Xeon(R) CPU           X5570  @ 2.93GHz
> stepping    : 5
> cpu MHz        : 1600.000
> cache size    : 8192 KB
> 
> 
> 
> [lidar at lidarora1 tmp]$ time laszippertest -n 1000000
> (skipping range coder test)
> laszipper1 wrote 7000000 bytes in 0.03 seconds
> laszipper2 wrote 3898142 bytes in 0.13 seconds
> SUCCESS: lasunzipper1 read 7000000 bytes in 0.02 seconds
> SUCCESS: lasunzipper2 read 3898142 bytes in 0.18 seconds
> 
> real    0m0.379s
> user    0m0.349s
> sys    0m0.029s
> [lidar at lidarora1 tmp]$ time laszippertest -n 1000000
> (skipping range coder test)
> laszipper1 wrote 7000000 bytes in 0.03 seconds
> laszipper2 wrote 3898142 bytes in 0.13 seconds
> SUCCESS: lasunzipper1 read 7000000 bytes in 0.02 seconds
> SUCCESS: lasunzipper2 read 3898142 bytes in 0.17 seconds
> 
> real    0m0.366s
> user    0m0.336s
> sys    0m0.029s
> [lidar at lidarora1 tmp]$ time laszippertest -n 1000000
> (skipping range coder test)
> laszipper1 wrote 7000000 bytes in 0.03 seconds
> laszipper2 wrote 3898142 bytes in 0.13 seconds
> SUCCESS: lasunzipper1 read 7000000 bytes in 0.02 seconds
> SUCCESS: lasunzipper2 read 3898142 bytes in 0.16 seconds
> 
> real    0m0.366s
> user    0m0.338s
> sys    0m0.026s
> [lidar at lidarora1 tmp]$ time laszippertest -n 1000000 -s
> (skipping range coder test)
> laszipper1 wrote 7000000 bytes in 0.03 seconds
> laszipper2 wrote 3898142 bytes in 0.13 seconds
> SUCCESS: lasunzipper1 read 7000000 bytes in 0.02 seconds
> SUCCESS: lasunzipper2 read 3898142 bytes in 0.16 seconds
> 
> real    0m0.364s
> user    0m0.338s
> sys    0m0.024s
> [lidar at lidarora1 tmp]$ time laszippertest -n 1000000 -s
> (skipping range coder test)
> laszipper1 wrote 7000000 bytes in 0.03 seconds
> laszipper2 wrote 3898142 bytes in 0.13 seconds
> SUCCESS: lasunzipper1 read 7000000 bytes in 0.02 seconds
> SUCCESS: lasunzipper2 read 3898142 bytes in 0.17 seconds
> 
> real    0m0.369s
> user    0m0.339s
> sys    0m0.028s
> [lidar at lidarora1 tmp]$ time laszippertest -n 1000000 -s
> (skipping range coder test)
> laszipper1 wrote 7000000 bytes in 0.03 seconds
> laszipper2 wrote 3898142 bytes in 0.13 seconds
> SUCCESS: lasunzipper1 read 7000000 bytes in 0.02 seconds
> SUCCESS: lasunzipper2 read 3898142 bytes in 0.17 seconds
> 
> real    0m0.364s
> user    0m0.335s
> sys    0m0.027s
> 
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.osgeo.org/pipermail/liblas-devel/attachments/20110207/bb9753a0/attachment-0001.html