[Qgis-developer] Failing tests consider blockers

[Larry Shaffer]

Hi,

On Fri, Feb 14, 2014 at 9:17 AM, Etienne Tourigny
<etourigny.dev at gmail.com>wrote:

> Probably better to relax this for 2.2, but enforce it after release...
>

I'm 100% for failing unit tests being a blocker for any release. Since QGIS
is used on many platforms and versions, there does need to be some
reasonable 'cutoff' for how successful across platforms a unit test has to
be, before being consider valid. Minimum of success on recent OS versions
of the major platforms, i.e. Windows, Ubuntu, Mac?

Beyond the platforms I can test on, I would like to know who to contact for
help with other platforms.

** I propose a listing on the wiki of all core developers and any other
developer/tester who cares about unit tests, along with the platforms they
can reasonably test, and whether they are set up to compile on the
platform, or are just relying on nightlies instead.

To me, this is a very important resource, especially for devs new to the
project and trying to do pull requests with unit tests.


Another methodology would be to invest in a bunch of different CI servers
on VMs on OSGeo servers somewhere. Then, a dev could just review all
failures independent of contacting anyone else. That's a large investment
in time and resources, however.

Tim, as testing/quality assurance guy, what are your suggestions?


Regards,

Larry



> On Fri, Feb 14, 2014 at 2:00 PM, Jürgen E. <jef at norbit.de> wrote:
>
>> Hi Radim,
>>
>> On Fri, 14. Feb 2014 at 14:10:25 +0100, Radim Blazek wrote:
>> > I am suggesting to consider all failing tests as blockers.
>>
>> Suddenly?  The tests have been broken for ages (see [1]) and nobody seems
>> to
>> really care.
>>
>>
>> Jürgen
>>
>>
>> [1] see http://dash.orfeo-toolbox.org/index.php?project=QGIS
>>
>> --
>> Jürgen E. Fischer         norBIT GmbH               Tel.
>> +49-4931-918175-31
>> Dipl.-Inf. (FH)           Rheinstraße 13            Fax.
>> +49-4931-918175-50
>> Software Engineer         D-26506 Norden
>> http://www.norbit.de
>> QGIS PSC member (RM)      Germany                      IRC: jef on
>> FreeNode
>>
>> --
>> norBIT Gesellschaft fuer Unternehmensberatung und Informationssysteme mbH
>> Rheinstrasse 13, 26506 Norden
>> GF: Jelto Buurman, HR: Amtsgericht Emden, HRB 5502
>>
>> _______________________________________________
>> Qgis-developer mailing list
>> Qgis-developer at lists.osgeo.org
>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>>
>
>
> _______________________________________________
> Qgis-developer mailing list
> Qgis-developer at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/qgis-developer/attachments/20140214/6b87f785/attachment.html>