<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>On 5/24/17 2:56 PM, ElPaso wrote:<br>
</p>
<blockquote type="cite" cite="mid:592582E8.6020808@itopen.it">Il
24/05/2017 14:29, Paolo Cavallini ha scritto:
<br>
<blockquote type="cite">Il 24/05/2017 14:25, Matthias Kuhn ha
scritto:
<br>
<blockquote type="cite">I think this is still usable (qgis_bench
IIRC).
<br>
<br>
What it does: give usable measurements when executed on the
same
<br>
environment for different projects, different QGIS versions,
different
<br>
build parameters, different databases...
<br>
<br>
What it not does: produce values that are comparable when
executed on a
<br>
non-stable system like travis CI. Performance on this system
varies from
<br>
day to day and we are never sure if a code change or some
other change
<br>
on the system (hardware, software, operating system...) is
responsible
<br>
for some measured "performance regression".
<br>
</blockquote>
Thanks Matthias for reminding.
<br>
So it would be best to run it in an isolated, predictable
environment.
<br>
Would a VM do? I think we could find the resources for it, even
if this
<br>
would require having a dedicated server.
<br>
All the best.
<br>
</blockquote>
<br>
Maybe a Vagrant configuration to be run on AWS (or any other
Vagrant compatible provider).
<br>
<br>
What we probably need is something we can spin up and switch off
just for the time required for the test, that's why AWS would fit.
<br>
</blockquote>
There are some notes by Radim definitely worth reading (!!) here:<br
class="Apple-interchange-newline">
<br>
<a class="moz-txt-link-freetext" href="https://github.com/qgis/QGIS/tree/master/tests/bench">https://github.com/qgis/QGIS/tree/master/tests/bench</a><br>
<br>
<br>
I think shared environments (most VMs / AWS? / cloud solutions) are
pointless. <br>
<br>
A dedicated server might work but I'd consider even that an
adventurous project (i.e. worth trying but with no guarantee of
success ;) )<br>
<br>
Cheers<br>
<br>
<blockquote type="cite" cite="mid:592582E8.6020808@itopen.it">
<br>
<br>
Just my 2 cents.
<br>
<br>
</blockquote>
<br>
</body>
</html>