<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<div class="moz-cite-prefix"><font face="Tahoma">Hi Arnulf (and others),
<br>
<br>
What do you think of using the time slot (partly) to
present/discuss the setup of the benchmarking next year?
Apparently the interest for benchmarking only performance has
decreased, but perhaps there is more interest in doing a
benchmark which evaluates several aspects of a WMS, e.g. such
support of optional functionality in the WMS standard.<br>
</font>
<div class="moz-signature"> <br>
<font size="3" color="#000000" face="Tahoma, sans-serif"> <font
size="3">Best regards</font>,<br>
<br>
</font> <font size="3" color="#000000" face="Tahoma,
sans-serif"> Herman Assink (deeg<font size="3">ree PSC me<font
size="3">mber)</font></font><br>
</font> <font size="3" color="#003399" face="Tahoma,
sans-serif"><br>
</font> </div>
Op 3-9-2013 16:34, Arnulf Christl schreef:<br>
</div>
<blockquote cite="mid:5225F35C.4030407@metaspatial.net" type="cite">
<pre wrap="">-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Mike, Bart,
thanks for the feedback and link.
Michael Billmire,
will you be attending the FOSS4G conference in Nottingham? Would you be
happy to give a short summary of the talk you gave at FOSS4G NA? If not
would you be comfortable if I presented a short summary of your results?
- From the mail [1] it seems like you have a presentation at the ready? I
like that you also had a look into usability and quality.
Unfortunately we failed to get a full fledged benchmark organized for
this year and are now considering what to do with the slot. But no harm
done if you'd rather not have your findings presented elsewhere and by
somebody you don't even know.
Best regards,
Arnuf
[1] <a class="moz-txt-link-freetext" href="http://lists.osgeo.org/pipermail/benchmarking/2013-April/001090.html">http://lists.osgeo.org/pipermail/benchmarking/2013-April/001090.html</a>
On 03.09.2013 16:12, Smith, Michael ERDC-CRREL-NH wrote:
</pre>
<blockquote type="cite">
<pre wrap="">Bart,
I did attend but certainly don't feel comfortable presenting the results.
Mike
--
Michael Smith
US Army Corps
Remote Sensing GIS/Center
From: Bart van den Eijnden <<a class="moz-txt-link-abbreviated" href="mailto:bartvde@osgis.nl">bartvde@osgis.nl</a> <a class="moz-txt-link-rfc2396E" href="mailto:bartvde@osgis.nl"><mailto:bartvde@osgis.nl></a>>
Reply-To: "Performance testing of OSGeo and other web service engines."
<<a class="moz-txt-link-abbreviated" href="mailto:benchmarking@lists.osgeo.org">benchmarking@lists.osgeo.org</a> <a class="moz-txt-link-rfc2396E" href="mailto:benchmarking@lists.osgeo.org"><mailto:benchmarking@lists.osgeo.org></a>>
Date: Tuesday, September 3, 2013 9:09 AM
To: "Performance testing of OSGeo and other web service engines."
<<a class="moz-txt-link-abbreviated" href="mailto:benchmarking@lists.osgeo.org">benchmarking@lists.osgeo.org</a> <a class="moz-txt-link-rfc2396E" href="mailto:benchmarking@lists.osgeo.org"><mailto:benchmarking@lists.osgeo.org></a>>
Subject: Re: [Benchmarking] [EXTERNAL] Who shot the shootout?
Hey Arnulf,
this is definitely not any of your fault, I find it very brave that you
stood up to organise this.
Any chance someone could present this interesting abstract instead (was
presented at NA
apparently): <a class="moz-txt-link-freetext" href="http://lists.osgeo.org/pipermail/benchmarking/2013-April/001090.html">http://lists.osgeo.org/pipermail/benchmarking/2013-April/001090.html</a>
@Mike did you
attend? <a class="moz-txt-link-freetext" href="http://lists.osgeo.org/pipermail/benchmarking/2013-April/001091.html">http://lists.osgeo.org/pipermail/benchmarking/2013-April/001091.html</a>
Best regards,
Bart
--
Bart van den Eijnden
OSGIS - <a class="moz-txt-link-freetext" href="http://osgis.nl">http://osgis.nl</a>
On Sep 3, 2013, at 3:03 PM, Arnulf Christl
<<a class="moz-txt-link-abbreviated" href="mailto:arnulf.christl@metaspatial.net">arnulf.christl@metaspatial.net</a> <a class="moz-txt-link-rfc2396E" href="mailto:arnulf.christl@metaspatial.net"><mailto:arnulf.christl@metaspatial.net></a>>
wrote:
Hm, this is unfortunate. Time to give up?
How did this happen?
I set up the page in April [1] and sent mails to all relevant lists. I
personally talked to Jeff (MapServer), Martin Daly (CadCorp), Markus
Schmidt (deegree), Andrea Aimee (GeoServer), Pirmin Kalberer (QGIS
Server) in the following weeks. All to no avail. There was some vague
interest but nobody started to move. Jeff and Andrea early in the game
already said that they would not be able to do much due to lots of
project work.
My guess is that applies to most everybody: busy making a business. Plus
the interest of the projects also seems to have gone away. We have done
the experiment a few times, all of our software is really good, really
high performance systems use cached tiles anyway, so what's the point?
Tuning to highest performance is an individual exercise on individual
hardware with individual requirements and therefore almost never a
generic task.
This is why I had hoped to get the interest back by broadening the scope
and include Desktop GIS bench marking for usability and to look into
cartographic quality. But neither gvSIG, gvSIG CE or QGIS projects
reacted - even after I contacted them personally. Our MoU'd partner ICA
(International Cartographic Association) was also highly interested but
with no follow-up. They were swamped with their own business and just
concluded their own bi-annual conference in Dresden.
In July I contacted the University of Bonn. They were in general
interested but said that it was too little time until September and that
they might do something next year. Same with Hochschule Beuth in Berlin
and several others. This is when I sort of got a bored (that was after
panicking).
I also contacted WPS benchmark team in the hope that they had some
success but so far have not heard back from them at all.
I am happy to withdraw my presentation rather than stand there and make
the impression that I did not do my job. :-)
Now what?
If we don't find a viable solution within two days I will notify the
conference organizers that we drop the slot in the closing plenary.
Have fun,
Arnulf,
[1] <a class="moz-txt-link-freetext" href="http://wiki.osgeo.org/index.php?title=Benchmarking_2013&action=history">http://wiki.osgeo.org/index.php?title=Benchmarking_2013&action=history</a>
On 03.09.2013 13:12, Jeff McKenna wrote:
</pre>
<blockquote type="cite">
<pre wrap="">_______________________________________________
Benchmarking mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Benchmarking@lists.osgeo.org">Benchmarking@lists.osgeo.org</a> <a class="moz-txt-link-rfc2396E" href="mailto:Benchmarking@lists.osgeo.org"><mailto:Benchmarking@lists.osgeo.org></a>
<a class="moz-txt-link-freetext" href="http://lists.osgeo.org/mailman/listinfo/benchmarking">http://lists.osgeo.org/mailman/listinfo/benchmarking</a>
</pre>
</blockquote>
<pre wrap="">
_______________________________________________
Benchmarking mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Benchmarking@lists.osgeo.org">Benchmarking@lists.osgeo.org</a>
<a class="moz-txt-link-freetext" href="http://lists.osgeo.org/mailman/listinfo/benchmarking">http://lists.osgeo.org/mailman/listinfo/benchmarking</a>
</pre>
</blockquote>
<pre wrap="">
- --
Arnulf Christl (Executive Director)
Open Source Geospatial Software, Data and Services
<a class="moz-txt-link-freetext" href="http://www.metaspatial.net">http://www.metaspatial.net</a>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with undefined - <a class="moz-txt-link-freetext" href="http://www.enigmail.net/">http://www.enigmail.net/</a>
iEYEARECAAYFAlIl81wACgkQXmFKW+BJ1b0xZwCfQFbV1b3HaaSY5NxYMCztDtCv
OhUAoIJoj1JIAUaY3ocZZ/RW/gI6JGvF
=KZss
-----END PGP SIGNATURE-----
_______________________________________________
Benchmarking mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Benchmarking@lists.osgeo.org">Benchmarking@lists.osgeo.org</a>
<a class="moz-txt-link-freetext" href="http://lists.osgeo.org/mailman/listinfo/benchmarking">http://lists.osgeo.org/mailman/listinfo/benchmarking</a>
</pre>
</blockquote>
<br>
</body>
</html>