[Benchmarking] [EXTERNAL] Who shot the shootout?

Tue Sep 3 08:10:59 PDT 2013

Hi Arnulf (and others),

What do you think of using the time slot (partly) to present/discuss the 
setup of the benchmarking next year? Apparently the interest for 
benchmarking only performance has decreased, but perhaps there is more 
interest in doing a benchmark which evaluates several aspects of a WMS, 
e.g. such support of optional functionality in the WMS standard.

Best regards,

Herman Assink (deegree PSC member)

Op 3-9-2013 16:34, Arnulf Christl schreef:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Mike, Bart,
> thanks for the feedback and link.
>
> Michael Billmire,
> will you be attending the FOSS4G conference in Nottingham? Would you be
> happy to give a short summary of the talk you gave at FOSS4G NA? If not
> would you be comfortable if I presented a short summary of your results?
> - From the mail [1] it seems like you have a presentation at the ready? I
> like that you also had a look into usability and quality.
>
> Unfortunately we failed to get a full fledged benchmark organized for
> this year and are now considering what to do with the slot. But no harm
> done if you'd rather not have your findings presented elsewhere and by
> somebody you don't even know.
>
> Best regards,
> Arnuf
>
> [1] http://lists.osgeo.org/pipermail/benchmarking/2013-April/001090.html
>
>
> On 03.09.2013 16:12, Smith, Michael ERDC-CRREL-NH wrote:
>> Bart,
>>
>> I did attend but certainly don't feel comfortable presenting the results.
>>
>> Mike
>>
>> -- 
>> Michael Smith
>> US Army Corps
>> Remote Sensing GIS/Center
>>
>> From: Bart van den Eijnden <bartvde at osgis.nl <mailto:bartvde at osgis.nl>>
>> Reply-To: "Performance testing of OSGeo and other web service engines."
>> <benchmarking at lists.osgeo.org <mailto:benchmarking at lists.osgeo.org>>
>> Date: Tuesday, September 3, 2013 9:09 AM
>> To: "Performance testing of OSGeo and other web service engines."
>> <benchmarking at lists.osgeo.org <mailto:benchmarking at lists.osgeo.org>>
>> Subject: Re: [Benchmarking] [EXTERNAL] Who shot the shootout?
>>
>> Hey Arnulf,
>>
>> this is definitely not any of your fault, I find it very brave that you
>> stood up to organise this.
>>
>> Any chance someone could present this interesting abstract instead (was
>> presented at NA
>> apparently): http://lists.osgeo.org/pipermail/benchmarking/2013-April/001090.html
>>
>> @Mike did you
>> attend? http://lists.osgeo.org/pipermail/benchmarking/2013-April/001091.html
>>
>> Best regards,
>> Bart
>>
>> -- 
>> Bart van den Eijnden
>> OSGIS - http://osgis.nl
>>
>> On Sep 3, 2013, at 3:03 PM, Arnulf Christl
>> <arnulf.christl at metaspatial.net <mailto:arnulf.christl at metaspatial.net>>
>> wrote:
>>
>> Hm, this is unfortunate. Time to give up?
>>
>> How did this happen?
>>
>> I set up the page in April [1] and sent mails to all relevant lists. I
>> personally talked to Jeff (MapServer), Martin Daly (CadCorp), Markus
>> Schmidt (deegree), Andrea Aimee (GeoServer), Pirmin Kalberer (QGIS
>> Server) in the following weeks. All to no avail. There was some vague
>> interest but nobody started to move. Jeff and Andrea early in the game
>> already said that they would not be able to do much due to lots of
>> project work.
>>
>> My guess is that applies to most everybody: busy making a business. Plus
>> the interest of the projects also seems to have gone away. We have done
>> the experiment a few times, all of our software is really good, really
>> high performance systems use cached tiles anyway, so what's the point?
>> Tuning to highest performance is an individual exercise on individual
>> hardware with individual requirements and therefore almost never a
>> generic task.
>>
>> This is why I had hoped to get the interest back by broadening the scope
>> and include Desktop GIS bench marking for usability and to look into
>> cartographic quality. But neither gvSIG, gvSIG CE or QGIS projects
>> reacted - even after I contacted them personally. Our MoU'd partner ICA
>> (International Cartographic Association) was also highly interested but
>> with no follow-up. They were swamped with their own business and just
>> concluded their own bi-annual conference in Dresden.
>>
>> In July I contacted the University of Bonn. They were in general
>> interested but said that it was too little time until September and that
>> they might do something next year. Same with Hochschule Beuth in Berlin
>> and several others. This is when I sort of got a bored (that was after
>> panicking).
>>
>> I also contacted WPS benchmark team in the hope that they had some
>> success but so far have not heard back from them at all.
>>
>> I am happy to withdraw my presentation rather than stand there and make
>> the impression that I did not do my job. :-)
>>
>>
>> Now what?
>>
>> If we don't find a viable solution within two days I will notify the
>> conference organizers that we drop the slot in the closing plenary.
>>
>> Have fun,
>> Arnulf,
>>
>> [1] http://wiki.osgeo.org/index.php?title=Benchmarking_2013&action=history
>>
>> On 03.09.2013 13:12, Jeff McKenna wrote:
>>
>>
>>
>>> _______________________________________________
>>> Benchmarking mailing list
>>> Benchmarking at lists.osgeo.org <mailto:Benchmarking at lists.osgeo.org>
>>> http://lists.osgeo.org/mailman/listinfo/benchmarking
>>
>>
>> _______________________________________________
>> Benchmarking mailing list
>> Benchmarking at lists.osgeo.org
>> http://lists.osgeo.org/mailman/listinfo/benchmarking
>>
> - -- 
> Arnulf Christl (Executive Director)
> Open Source Geospatial Software, Data and Services
> http://www.metaspatial.net
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.11 (GNU/Linux)
> Comment: Using GnuPG with undefined - http://www.enigmail.net/
>
> iEYEARECAAYFAlIl81wACgkQXmFKW+BJ1b0xZwCfQFbV1b3HaaSY5NxYMCztDtCv
> OhUAoIJoj1JIAUaY3ocZZ/RW/gI6JGvF
> =KZss
> -----END PGP SIGNATURE-----
> _______________________________________________
> Benchmarking mailing list
> Benchmarking at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/benchmarking
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/benchmarking/attachments/20130903/02ca8ac0/attachment-0001.html>