<div dir="ltr">The WPS 2.0 standard is winding its way past the geoserver-devel list :)<div><br></div><div>Thus far we have made no progress on benchmark, everyone seems busy with workshops.</div></div><div class="gmail_extra"><br clear="all"><div><div dir="ltr"><div>Jody Garnett</div></div></div>
<br><br><div class="gmail_quote">On Thu, Sep 4, 2014 at 3:54 AM, Benjamin Proß <span dir="ltr"><<a href="mailto:b.pross@52north.org" target="_blank">b.pross@52north.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi all,<br>
<br>
Are there any news regarding the benchmark procedure? Or are you all busy writing comments for the WPS 2.0 candidate standard? :)<br>
<br>
Cheers,<br>
<br>
Benjamin<br>
<br>
Am <a href="tel:21.08.2014%2013" value="+12108201413" target="_blank">21.08.2014 13</a>:00, schrieb Benjamin Proß:<div class="HOEnZb"><div class="h5"><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hello Gérald, all,<br>
<br>
I am glad that you like the idea and I hope the other projects feel the same. The tests you are suggesting make sense, though I am not completely sure about the combinations with the complexdata in-/output as reference/inline xml. Complexdata output could also be requested as raw data output. Maybe we should create a table listing the combinations. I could start this and then we could choose the ones we want. We should also define the process description, so the projects can create the respective processes.<br>
<br>
Cheers,<br>
<br>
Benjamin<br>
<br>
Am <a href="tel:21.08.2014%2011" value="+12108201411" target="_blank">21.08.2014 11</a>:16, schrieb Fenoy Gerald:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hello Benjamin,<br>
I think it is a great idea to handle testings of the Execute request the way you described, by using a simple echo service.<br>
<br>
By now for synchronous requests, the tests look like the following:<br>
<br>
• Test 1: value as JSON<br>
• Test 2: value as GML<br>
• Test 3: value as reference as GML<br>
• Test 4: same as test 3, result as reference<br>
• Test 5: value as reference as GML using POST request<br>
• Test 6: same as test 5, result as reference<br>
<br>
And for asynchronous request, we have the following:<br>
<br>
• Test 1': value as reference as GML<br>
• Test 2': same as test 1, result as reference<br>
• Test 3': value as reference as GML using POST request<br>
• Test 4': same as test 3, result as reference<br>
<br>
Personally, I think that the Test 1 and Test 2 should become unique now as there is no need for parsing any value from the service itself as it will simply return the value without any treatment. So we should use only the Test 2 for our next run.<br>
<br>
I also suppose that we should multiply the number of tests as we will need to ask for each available outputs individually and all the possible combinaisons of them to also test this cases.<br>
<br>
So, I would like to propose the following updates for the tests run for both synchronous and asynchronous requests. We run each individual test 7 times: first to have only once output at a time (so 3 tests), then to test all possible combinaisons of 2 outputs names (3 tests) and finally to have all the output returned (1 test).<br>
<br>
I hope that you can confirm that I’m right thinking of this updates to the current tests.<br>
<br>
I’ve added one column to the table [1] listing all WPS team participating to write the name of the echo service when it will be available.<br>
<br>
Best regards,<br>
<br>
[1] <a href="http://wiki.osgeo.org/wiki/WPS_benchmark_2014#Available_infrastructure" target="_blank">http://wiki.osgeo.org/wiki/<u></u>WPS_benchmark_2014#Available_<u></u>infrastructure</a><br>
<br>
Le 19 août 2014 à 16:03, Benjamin Proß <<a href="mailto:b.pross@52north.org" target="_blank">b.pross@52north.org</a>> a écrit :<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Dear all,<br>
<br>
I see that there are still not all services are deployed on the test machine. I hope you guys are still on board.<br>
At 52°North we were thinking a bit about the execute tests.<br>
We do not yet have any results to compare but we think that benchmarking with "real" processes that compute something could falsify the results, as the computation in most cases is done by a underlying library (GeoTools in our case, but this could also be exchanged).<br>
So the results would be influenced by how fast the geo-computation lib would do its job. Not sure that we want that?!<br>
We also do not test whether the process really did its job (e.g. buffer the input geometry). So do we need to use "real" processes?<br>
We would propose to use an echo process that could have three inputs, Literal-, Complex- and BBoxData. The process then simply returns what it gets (input/output types would have to match).<br>
We would probably also need a asynchronous version that has a delay or something.<br>
That way we could test the input-/output handling capabilities (of all three data types) of the services and we would still test everything regarding execute that is tested right now (i.e. we would not loose functionality).<br>
Do you have any views on that?<br>
<br>
Cheers,<br>
<br>
Benjamin<br>
<br>
-- <br>
Benjamin Proß<br>
Software Engineer<br>
52°North Geoprocessing Community<br>
<br>
52°North Initiative for Geospatial Open Source Software GmbH<br>
Martin-Luther-King-Weg 24<br>
Fon: <a href="tel:%2B49-%280%29-251%E2%80%93396371-42" value="+4925139637142" target="_blank">+49-(0)-251–396371-42</a><br>
Fax: <a href="tel:%2B49-%280%29-251%E2%80%93396371-11" value="+4925139637111" target="_blank">+49-(0)-251–396371-11</a><br>
<a href="mailto:b.pross@52north.org" target="_blank">b.pross@52north.org</a><br>
<a href="http://52north.org/" target="_blank">http://52north.org/</a><br>
<br>
General Managers: Dr. Albert Remke, Dr. Andreas Wytzisk<br>
Local Court Muenster HRB 10849<br>
<br>
______________________________<u></u>_________________<br>
Wps-discuss mailing list<br>
<a href="mailto:Wps-discuss@lists.osgeo.org" target="_blank">Wps-discuss@lists.osgeo.org</a><br>
<a href="http://lists.osgeo.org/mailman/listinfo/wps-discuss" target="_blank">http://lists.osgeo.org/<u></u>mailman/listinfo/wps-discuss</a><br>
</blockquote>
<br>
<br>
Gérald Fenoy<br>
<a href="http://wiki.osgeo.org/wiki/User:Djay" target="_blank">http://wiki.osgeo.org/wiki/<u></u>User:Djay</a><br>
<br>
</blockquote>
<br>
<br>
</blockquote>
<br>
<br>
-- <br>
Benjamin Proß<br>
Software Engineer<br>
52°North Geoprocessing Community<br>
<br>
52°North Initiative for Geospatial Open Source Software GmbH<br>
Martin-Luther-King-Weg 24<br>
Fon: <a href="tel:%2B49-%280%29-251%E2%80%93396371-42" value="+4925139637142" target="_blank">+49-(0)-251–396371-42</a><br>
Fax: <a href="tel:%2B49-%280%29-251%E2%80%93396371-11" value="+4925139637111" target="_blank">+49-(0)-251–396371-11</a><br>
<a href="mailto:b.pross@52north.org" target="_blank">b.pross@52north.org</a><br>
<a href="http://52north.org/" target="_blank">http://52north.org/</a><br>
<br>
General Managers: Dr. Albert Remke, Dr. Andreas Wytzisk<br>
Local Court Muenster HRB 10849<br>
<br>
______________________________<u></u>_________________<br>
Wps-discuss mailing list<br>
<a href="mailto:Wps-discuss@lists.osgeo.org" target="_blank">Wps-discuss@lists.osgeo.org</a><br>
<a href="http://lists.osgeo.org/mailman/listinfo/wps-discuss" target="_blank">http://lists.osgeo.org/<u></u>mailman/listinfo/wps-discuss</a><br>
</div></div></blockquote></div><br></div>