[Benchmarking] Rebooting the Benchmarking effort

Arnulf Christl arnulf.christl at metaspatial.net
Wed Sep 4 06:02:34 PDT 2013


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 04.09.2013 14:18, Daniel Morissette wrote:
> On 13-09-04 6:28 AM, Arnulf Christl wrote:
>>
>> At the end of the presentation I would like to share a proposal how to
>> do benchmarking in the longer term. It would involve that OSGeo makes
>> the benchmark an organizational effort and specifically request for
>> benchmark sponsoring. Sponsors can then put a focus on either usability,
>> performance, cartographic output quality, or whatever else they come up
>> with (and they will). OSGeo should then invest the new funds to support
>> code sprints where we dedicate one day to benchmarking. Or maybe even
>> have a dedicated benchmark sprint before FOSS4G (just like it was in the
>> good old days anyway).
>>
>> Thoughts?
>>
> 
> As I'm sure you are well aware, for something like this to happen you
> need a champion who gets deeply involved not just in coordinating from a
> high level, but in doing the actual work and/or tasking or pestering
> others to do their bit (and in a volunteer world tasking others is not
> really an option).
> 
> Unfortunately, just proposing that "OSGeo makes the benchmark an
> organizational effort...", etc... is not going to go very far without a
> champion to do the actual work to make this happen, because as you wrote
> in another email it seems that all those who could have an interest in
> contributing to this are already too busy with their own busy-ness.
> 
> My 0.02$ (and I'd love to be proved wrong)

Ah, seems like this whole thing is starting to work now. All my earlier
mails re. *doing* the work just evaporated unseen. :-)

I am sorry that my championing did not live up to your expectations. But
honestly, I do not believe that any champion could actually get this
done in their free time. I *do* believe that this is something that an
OSGeo employee could do. In short: Funding comes through dedicated
sponsorship which is invested into someone organizing it. This can be a
low profile position not an exec like we had before. The code sprints is
where the actual work happens. Andrea suggested that the projects shoudl
also get something out of this, see his other mail.

This type of arrangement would also have the charm of actually being
able to give sponsors a very tangible ROI of their sponsorship
(something we are currently not really good at).

This will obviously need a lot of discussion on the board level I just
wanted to let the the idea fly here.

Cheers,
Arnulf

- -- 
Arnulf Christl (Executive Director)
Open Source Geospatial Software, Data and Services
http://www.metaspatial.net
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with undefined - http://www.enigmail.net/

iEYEARECAAYFAlInL2oACgkQXmFKW+BJ1b2fRQCfRDvtkDRVAkrxiqMiJ3tzCZrW
5L8AnRAvn/QXN4IDk45L30M0iYGUe/zq
=fHjB
-----END PGP SIGNATURE-----


More information about the Benchmarking mailing list