Mateusz Loskot has already set up a buildbot configuration at osgeo according to:<div><a href="http://wiki.osgeo.org/wiki/BuildBot_Configuration">http://wiki.osgeo.org/wiki/BuildBot_Configuration</a> </div><div><br></div><div>
Mapserver buildslaves has been available at <a href="http://buildbot.osgeo.org/mapserver">http://buildbot.osgeo.org/mapserver</a></div><div><br></div><div>However this config seems to be offline at the moment.</div><div><br>
</div><div>Best regards,</div><div><br></div><div>Tamas</div><div><br></div><div><br></div><div><br><br><div class="gmail_quote">2012/9/12 Alan Boudreault <span dir="ltr"><<a href="mailto:aboudreault@mapgears.com" target="_blank">aboudreault@mapgears.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">I totally agree with you guys. msautotests is in a critical state. :P<br>
<br>
I'm aware of 3 tools that seem to be popular these days:<br>
<br>
- Buildbot: self-hosted solution in python.<br>
<br>
- Jenkins: self-hosted. More complete than buildbot. Nice solution for continuous integration and regression tests.<br>
<br>
- Travis-CI: web service, current trend with opensource softwares. Seems to work very well. Nice Integration with github projects. (each commit are tested)<br>
<br>
Unfortunately, I don't know much about them at the moment. The easier for sure would be to test Travis-CI and see how it works.<br>
<br>
Alan<div class="HOEnZb"><div class="h5"><br>
<br>
On 12-09-12 07:14 AM, thomas bonfort wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
After maybe a couple beers too many with Stephan the other day we came<br>
to talk about mapserver's autotests and it's current deficiencies with<br>
respect to how we are using them.<br>
<br>
To summarize, here are the principle issues that arose:<br>
<br>
- The tests aren't run on each commit, which is understandable as it<br>
takes an additional effort to do so<br>
- We have a large number of failing tests, which can be attributed to:<br>
- the afore-mentioned reason: is a failing test a result of the last<br>
commit or was it already failing beforehand?<br>
- image comparison tests can produce false positives, due to<br>
different cpu architectures and underlying dependency libraries<br>
(namely freetype)<br>
- image and xml/gml tests can diverge depending on the compile-time<br>
configuration options that were chosen.<br>
- we've ended up in a chicken vs. egg situation where tests aren't<br>
being run because they are failing, and test fail in the long run<br>
because they are never being used/updated.<br>
<br>
To alleviate this, we'd like to set the ball rolling on these ideas:<br>
- provide a "reference" platform with a kitchen-sink (i.e. compiled<br>
with all options) mapserver instance. This could be an osgeo ad-hoc vm<br>
or a dedicated server provided by one of us or our users. (second<br>
option might be better given the limited resources available at osgeo)<br>
- go through all the current tests, make sure they pass on this<br>
reference platform, and update the expected result if not.<br>
- automatically run the whole test-suite on each commit, and provide a<br>
web-page or email alert when a test has failed. Does anyone have<br>
experience with a software solution that could provide that to us?<br>
<br>
Thoughts? It's certainly not a miracle solution as it will require<br>
acting upon when a test starts failing, however we believe that<br>
automating the runs and removing the false positives will be a nice<br>
step forward (and give more peace-of-mind to the release-manager when<br>
packaging a release :) )<br>
<br>
cheers,<br>
thomas<br>
______________________________<u></u>_________________<br>
mapserver-dev mailing list<br>
<a href="mailto:mapserver-dev@lists.osgeo.org" target="_blank">mapserver-dev@lists.osgeo.org</a><br>
<a href="http://lists.osgeo.org/mailman/listinfo/mapserver-dev" target="_blank">http://lists.osgeo.org/<u></u>mailman/listinfo/mapserver-dev</a><br>
<br>
</blockquote>
<br>
<br></div></div><span class="HOEnZb"><font color="#888888">
-- <br>
Alan Boudreault<br>
<a href="http://www.mapgears.com/" target="_blank">http://www.mapgears.com/</a></font></span><div class="HOEnZb"><div class="h5"><br>
______________________________<u></u>_________________<br>
mapserver-dev mailing list<br>
<a href="mailto:mapserver-dev@lists.osgeo.org" target="_blank">mapserver-dev@lists.osgeo.org</a><br>
<a href="http://lists.osgeo.org/mailman/listinfo/mapserver-dev" target="_blank">http://lists.osgeo.org/<u></u>mailman/listinfo/mapserver-dev</a><br>
</div></div></blockquote></div><br></div>