[Benchmarking] Last minute vote: shall we switch to6600requestsrun?

[Anne-Sophie Collignon]

Hi Adrian,

I meant : publish the 3 runs of tests (csv with 2000 request, 1,2,4,8,16,32,64 threads), so not the last scripts provided by Andrea two days ago with the 3 runs is one scripts.
We keep the "initial" one, but publish the 3 runs (not only the run3, or best one...) is that make sense?

Thank you,

Anne-Sophie


-- 
Anne-Sophie Collignon
Enterprise Solutions - Project Engineer

ERDAS, SA
Quai Timmermans 14/01
4000 Liège
Belgium
Phone +32 4 364 03 69
Fax +32 4 253 47 37
Mobile +32 475 740974
Email anne-sophie.collignon at erdas.com
Web www.erdas.com



-----Original Message-----
From: benchmarking-bounces at lists.osgeo.org [mailto:benchmarking-bounces at lists.osgeo.org] On Behalf Of Adrian Custer
Sent: jeudi 2 septembre 2010 19:19
To: Performance testing of OSGeo and other web service engines.
Subject: RE: [Benchmarking] Last minute vote: shall we switch to6600requestsrun?

Hello,

On Thu, 2010-09-02 at 18:45 +0200, Anne-Sophie Collignon wrote:
> 
> What do you think about the following alternative ?
> 
> The idea is to publish the results of the 3 runs in the final
> presentation, and to provide comments on the possible differences that
> could be observed on the 3 runs results.
> 

I am confused by your proposal. You say "publish the results of the 3
runs". 

That might mean publish all three sets of runs from the newer scripts or
might mean publish only the last runs (1,2,4,8,16,32,64 threads) from
the newer scripts, I am not sure. From what I understand, Andrea's
strategy is to report only the last set of any run, with the earlier
runs intended merely to 'warm up' the server in equivalent ways, either
with the same requests or with different requests.


Also, are you saying 
  The idea is to publish {only} the ...
or 
  The idea is to publish {also} the ...
?

I am wondering mostly if I should run the first set of tests as well as
the newer set of runs.

thanks,
  --adrian

_______________________________________________
Benchmarking mailing list
Benchmarking at lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/benchmarking