<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:p="urn:schemas-microsoft-com:office:powerpoint" xmlns:a="urn:schemas-microsoft-com:office:access" xmlns:dt="uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns:s="uuid:BDC6E3F0-6DA3-11d1-A2A3-00AA00C14882" xmlns:rs="urn:schemas-microsoft-com:rowset" xmlns:z="#RowsetSchema" xmlns:b="urn:schemas-microsoft-com:office:publisher" xmlns:ss="urn:schemas-microsoft-com:office:spreadsheet" xmlns:c="urn:schemas-microsoft-com:office:component:spreadsheet" xmlns:odc="urn:schemas-microsoft-com:office:odc" xmlns:oa="urn:schemas-microsoft-com:office:activation" xmlns:html="http://www.w3.org/TR/REC-html40" xmlns:q="http://schemas.xmlsoap.org/soap/envelope/" xmlns:rtc="http://microsoft.com/officenet/conferencing" xmlns:D="DAV:" xmlns:Repl="http://schemas.microsoft.com/repl/" xmlns:mt="http://schemas.microsoft.com/sharepoint/soap/meetings/" xmlns:x2="http://schemas.microsoft.com/office/excel/2003/xml" xmlns:ppda="http://www.passport.com/NameSpace.xsd" xmlns:ois="http://schemas.microsoft.com/sharepoint/soap/ois/" xmlns:dir="http://schemas.microsoft.com/sharepoint/soap/directory/" xmlns:ds="http://www.w3.org/2000/09/xmldsig#" xmlns:dsp="http://schemas.microsoft.com/sharepoint/dsp" xmlns:udc="http://schemas.microsoft.com/data/udc" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:sub="http://schemas.microsoft.com/sharepoint/soap/2002/1/alerts/" xmlns:ec="http://www.w3.org/2001/04/xmlenc#" xmlns:sp="http://schemas.microsoft.com/sharepoint/" xmlns:sps="http://schemas.microsoft.com/sharepoint/soap/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:udcs="http://schemas.microsoft.com/data/udc/soap" xmlns:udcxf="http://schemas.microsoft.com/data/udc/xmlfile" xmlns:udcp2p="http://schemas.microsoft.com/data/udc/parttopart" xmlns:wf="http://schemas.microsoft.com/sharepoint/soap/workflow/" xmlns:dsss="http://schemas.microsoft.com/office/2006/digsig-setup" xmlns:dssi="http://schemas.microsoft.com/office/2006/digsig" xmlns:mdssi="http://schemas.openxmlformats.org/package/2006/digital-signature" xmlns:mver="http://schemas.openxmlformats.org/markup-compatibility/2006" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns:mrels="http://schemas.openxmlformats.org/package/2006/relationships" xmlns:spwp="http://microsoft.com/sharepoint/webpartpages" xmlns:ex12t="http://schemas.microsoft.com/exchange/services/2006/types" xmlns:ex12m="http://schemas.microsoft.com/exchange/services/2006/messages" xmlns:pptsl="http://schemas.microsoft.com/sharepoint/soap/SlideLibrary/" xmlns:spsl="http://microsoft.com/webservices/SharePointPortalServer/PublishedLinksService" xmlns:Z="urn:schemas-microsoft-com:" xmlns:st="" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 12 (filtered medium)">
<style>
<!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
-->
</style>
<!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=EN-US link=blue vlink=purple>
<div class=WordSection1>
<p class=MsoNormal><span style='color:#1F497D'>Hi, <o:p></o:p></span></p>
<p class=MsoNormal><span style='color:#1F497D'>I don’t know why, but it seems,
my first email is not coming….<o:p></o:p></span></p>
<p class=MsoNormal><span style='color:#1F497D'>I resent, sorry if it comes
twice…<o:p></o:p></span></p>
<p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p>
<div>
<p class=MsoNormal><span style='color:#1F497D'>Thank you,<o:p></o:p></span></p>
<p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='color:#1F497D'>Anne-Sophie<o:p></o:p></span></p>
</div>
<p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p>
<div>
<div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm'>
<p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span
style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Anne-Sophie
Collignon <br>
<b>Sent:</b> mercredi 1 septembre 2010 12:34<br>
<b>To:</b> 'benchmarking-bounces@lists.osgeo.org'<br>
<b>Subject:</b> [Benchmarking] potential caching issue ?<o:p></o:p></span></p>
</div>
</div>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal><span style='font-size:10.0pt;color:#204A87'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'>Hi All,<o:p></o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'>We would like to raise a
potential issue in the way the Jmeter tests are designed..<o:p></o:p></span></p>
<p class=MsoNormal><span lang=EN-CA style='color:#204A87'>We had the
confirmation today that the GetMap BBOX are randomly chosen (which is good) but
once chosen, these are used in the 3 runs.<o:p></o:p></span></p>
<p class=MsoNormal><span lang=EN-CA style='color:#204A87'>This means that one
single csv is used for the 3 runs.<o:p></o:p></span></p>
<p class=MsoNormal><span lang=EN-CA style='color:#204A87'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'>We have concern that some
servers can simply cache responses for subsequent runs, which would produce
unrealistic throughput results.<o:p></o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'>We understand the fact that we
have 3 runs, indeed the server needs to be initialized, but server
initialization and caching are from our point of view different topics.<o:p></o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'>We think that caching the
responses is not a realistic use-case. It would mean that we measure the
network bandwidth (caching results = sending back bytes on the wire) rather
than the real getmap performances of the servers. <o:p></o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'>At this level, we understand it
may be too late to change the test (E.g: to have the BBOX slightly different in
all 3 runs, that way, the server will be initialized but will be unable to
cache the data blocks and the results responses). <o:p></o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'><o:p> </o:p></span></p>
<p class=MsoNormal style='margin-bottom:12.0pt'><span style='color:#204A87'>What
do you think can be done to avoid this scenario? <o:p></o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'>Thank you !<o:p></o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'>Kind Regards,<o:p></o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='color:#204A87'>Ps : we are grateful for the
time spent by certain persons to provide the Jmeter tests. Our goal is not to
criticize their work, but to ensure that the produced results are fair…<b><o:p></o:p></b></span></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal><span lang=FR style='font-size:10.0pt;font-family:"Arial","sans-serif"'>--
<o:p></o:p></span></p>
<p class=MsoNormal><span lang=FR style='font-size:10.0pt;font-family:"Arial","sans-serif"'>Anne-Sophie
Collignon<o:p></o:p></span></p>
<p class=MsoNormal><span lang=FR style='font-size:10.0pt;font-family:"Arial","sans-serif"'>Enterprise
Solutions - Project Engineer<o:p></o:p></span></p>
<p class=MsoNormal><span lang=FR style='font-size:10.0pt;font-family:"Arial","sans-serif"'><o:p> </o:p></span></p>
<p class=MsoNormal><b><span lang=FR style='font-size:10.0pt;font-family:"Arial","sans-serif"'>ERDAS,
SA</span></b><span lang=FR style='font-size:9.0pt;font-family:"Arial","sans-serif";
color:#BF6428'><o:p></o:p></span></p>
<p class=MsoNormal><span lang=FR><o:p> </o:p></span></p>
<p class=MsoNormal><span lang=FR><o:p> </o:p></span></p>
<p class=MsoNormal align=center style='text-align:center'><span
style='color:#333399'>********<b>CONFIDENTIALITY NOTICE</b>********</span><span
style='font-size:12.0pt;font-family:"Times New Roman","serif";color:#333399'><o:p></o:p></span></p>
<p class=MsoNormal style='text-align:justify'><i><span style='font-size:8.0pt;
font-family:"Arial","sans-serif";color:#333399'>This email message, including
any attachments, may contain confidential information exclusively provided
for intended recipients or authorized representatives of the intended
recipients. Any dissemination of this e-mail by anyone other than an
intended recipient or authorized representatives of the intended
recipients is strictly prohibited. If you are not a named recipient
or authorized representatives of the intended recipients, you are
prohibited from any further viewing of the e-mail or any attachments or from
making any use of the e-mail or attachments. If you believe you have received
this e-mail in error, notify the sender immediately and permanently delete the
e-mail, any attachments, and all copies thereof from any drives or storage
media and destroy any printouts of the e-mail or attachments.<o:p></o:p></span></i></p>
<p class=MsoNormal><o:p> </o:p></p>
</div>
</body>
</html>