[Benchmarking] Rebooting the Benchmarking effort

[Pirmin Kalberer]

Am Mittwoch, 4. September 2013, 12.36:44 schrieb Andrea Aime:
[...]
> 
> Raising the bar a bit, why not try to make this a "service" so that teams
> get
> something back in return "continuosly"?
> The idea I had in mind is, setup some server used for benchmarks, automate
> them, and allow teams to upgrade their software, and add new types of
> benchmarks, and have the latest results published somewhere.

We used Mike's server that way for "continous benchmarking" and improving QGIS 
server performance.

> 
> A presentation can be derived from that data, maybe giving it a historical
> perspective that would maybe also add fun ("until May server X was the
> fastest in this test, but then server Y got better and in August server W
> blew all of them out").
> 
> Requires quite a bit more effort, but would also allow people to keep
> on seeing how they are doing over time in a particular benchmark
> (since they are always there)
> 
> More effort, I know. Just an idea :-p

Wouldn't that be a good job for a GSoC student? We would volunteer in 
mentoring.

Regards
Pirmin

-- 
Pirmin Kalberer
Sourcepole  -  Linux & Open Source Solutions
http://www.sourcepole.com