<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Hi Moritz, Stefan (and Marcus if you’re around?)</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Every day is a new day.</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Not IOPs, Not memory, Not CPU… Hmm, how about reboot...</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><div style="font-family: Georgia; font-size: 12px;"><blockquote type="cite"><blockquote type="cite"><br>As you have suspected, I get no benefit from additional CPUs.<br></blockquote><br>Are you sure the problem is CPU-bound ?<br></blockquote></div></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">I started by testing <a href="http://v.net">v.net</a> (the maintenance module) in parallel - and observed pretty much linear scaling in performance over and above 2 parallel jobs. </div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">So I then proceeded to test v.net.distance… and sure enough, it is now scaling. Really different looking CPU performance profiles to yesterday, when it wasn’t scaling. On top, all the <a href="http://v.net">v.net</a> CPUs are humming at 50%, the other 50% used by pg processes.</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Below are some iostat profiles of the different parallel test.</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">So v.net.distance does parallelise nicely. The neatest way is to launch GNU parallel from within a single grass_batch_job. I will write up on the grass wiki in the coming 2 weeks.</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Mark</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">:-)))))</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">---------------<a href="http://V.NET">V.NET</a> ---------------</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Single job</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><a href="http://v.net">v.net</a></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">iostat 1</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><div style="margin: 0px;">TOTAL SCRIPT TIME: 284</div></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"> 15.92 0.00 35.32 0.50 0.00 48.26</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvde 18.00 8.00 744.00 8 744</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"> 20.00 0.00 34.00 0.50 0.00 45.50</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvde 9.90 0.00 633.66 0 640</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"> 22.50 0.00 35.50 0.50 0.00 41.50</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvde 9.00 0.00 592.00 0 592</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div></div><div><br></div><div><br></div><div>Two parallel jobs</div><div><a href="http://v.net">v.net</a></div><div><span style="font-family: Menlo; font-size: 11px;">iostat 1</span></div><div><span style="font-family: Menlo; font-size: 11px;">TOTAL SCRIPT TIME: 397</span></div><div><span style="font-family: Menlo; font-size: 11px;"><br></span></div><div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"> 32.16 0.00 67.84 0.00 0.00 0.00</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvde 19.00 0.00 1024.00 0 1024</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"> 39.50 0.00 60.50 0.00 0.00 0.00</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvde 19.00 0.00 912.00 0 912</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"> 35.50 0.00 64.50 0.00 0.00 0.00</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvde 16.00 0.00 1024.00 0 1024</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvdj 0.00 0.00 0.00 0 0</div></div><div><br></div><div><br></div><div><div>Four parallel jobs</div><div><a href="http://v.net">v.net</a></div><div><span style="font-family: Menlo; font-size: 11px;">iostat 1</span></div><div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">TOTAL SCRIPT TIME: 388</div></div></div><div><br></div><div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"> 32.92 0.00 67.08 0.00 0.00 0.00</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvde 31.00 0.00 1952.00 0 1952</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"> 33.83 0.00 66.17 0.00 0.00 0.00</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvde 35.00 0.00 2016.00 0 2016</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"> 32.92 0.00 67.08 0.00 0.00 0.00</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; min-height: 13px;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvde 61.00 0.00 4032.00 0 4032</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">xvdj 0.00 0.00 0.00 0 0</div></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;">---------------V.NET.DISTANCE ---------------</div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><div style="margin: 0px;">Single job</div><div style="margin: 0px;">v.net.distance</div><div style="margin: 0px;">iostat 1</div><div style="margin: 0px;"><div style="margin: 0px;">TOTAL SCRIPT TIME: 88</div></div></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><div style="margin: 0px;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px;"> 4.00 0.00 21.00 0.00 0.00 75.00</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px;">xvde 0.00 0.00 0.00 0 0</div><div style="margin: 0px;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px;"> 7.75 0.00 21.75 0.00 0.00 70.50</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px;">xvde 0.00 0.00 0.00 0 0</div><div style="margin: 0px;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px;"> 6.27 0.00 22.56 0.00 0.00 71.18</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px;">xvde 4.00 0.00 56.00 0 56</div><div style="margin: 0px;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;"><div style="margin: 0px;"><span style="font-family: Georgia; font-size: 12px;"><br></span></div><div style="margin: 0px;"><span style="font-family: Georgia; font-size: 12px;">Two parallel jobs</span></div><div style="margin: 0px;">v.net.distance</div><div style="margin: 0px;">iostat 1</div><div style="margin: 0px;"><div style="margin: 0px;"><div style="margin: 0px;">TOTAL SCRIPT TIME: 96</div></div></div></div></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><div style="margin: 0px;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px;"> 9.02 0.00 40.85 0.00 0.00 50.13</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px;">xvde 0.00 0.00 0.00 0 0</div><div style="margin: 0px;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px;"> 11.75 0.00 43.75 0.00 0.00 44.50</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px;">xvde 3.00 0.00 40.00 0 40</div><div style="margin: 0px;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px;"> 9.50 0.00 40.75 0.00 0.00 49.75</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px;">xvde 0.00 0.00 0.00 0 0</div><div style="margin: 0px;">xvdj 0.00 0.00 0.00 0 0</div><div><br></div></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><div style="margin: 0px;"><span style="font-family: Georgia; font-size: 12px;">Four parallel jobs</span></div><div style="margin: 0px;">v.net.distance</div><div style="margin: 0px;">iostat 1</div><div style="margin: 0px;"><div style="margin: 0px;"><div style="margin: 0px;"><div style="margin: 0px;">TOTAL SCRIPT TIME: 124</div></div></div></div></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><div style="margin: 0px;"><br></div><div style="margin: 0px;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px;"> 17.96 0.00 82.04 0.00 0.00 0.00</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px;">xvde 3.00 0.00 32.00 0 32</div><div style="margin: 0px;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px;"> 18.50 0.00 81.50 0.00 0.00 0.00</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px;">xvde 0.00 0.00 0.00 0 0</div><div style="margin: 0px;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px;"> 21.50 0.00 78.50 0.00 0.00 0.00</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px;">xvde 0.00 0.00 0.00 0 0</div><div style="margin: 0px;">xvdj 7.00 0.00 64.00 0 64</div></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><br></div><div style="margin: 0px; font-size: 11px; font-family: Menlo;"><div style="margin: 0px;"><span style="font-family: Georgia; font-size: 12px;">Eight parallel jobs</span></div><div style="margin: 0px;">v.net.distance</div><div style="margin: 0px;">iostat 1</div><div style="margin: 0px;"><div style="margin: 0px;"><div style="margin: 0px;"><div style="margin: 0px;"><div style="margin: 0px;">TOTAL SCRIPT TIME: 122</div></div><div style="margin: 0px;"><br></div><div style="margin: 0px;"><div style="margin: 0px;"><div style="margin: 0px;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px;"> 19.00 0.00 81.00 0.00 0.00 0.00</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px;">xvde 0.00 0.00 0.00 0 0</div><div style="margin: 0px;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px;"> 19.50 0.00 80.50 0.00 0.00 0.00</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px;">xvde 0.00 0.00 0.00 0 0</div><div style="margin: 0px;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">avg-cpu: %user %nice %system %iowait %steal %idle</div><div style="margin: 0px;"> 18.65 0.00 81.35 0.00 0.00 0.00</div><div style="margin: 0px; min-height: 13px;"><br></div><div style="margin: 0px;">Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn</div><div style="margin: 0px;">xvde 3.00 0.00 48.00 0 48</div><div style="margin: 0px;">xvdj 0.00 0.00 0.00 0 0</div><div style="margin: 0px; min-height: 13px;"><br></div></div><div style="margin: 0px;"><br></div></div></div></div></div></div></body></html>