[Qgis-developer] rendering tests, what's the latest approach ?

[Nyall Dawson]

On 15 November 2015 at 01:55, Sandro Santilli <strk at keybit.net> wrote:
> On Sat, Nov 14, 2015 at 08:14:39PM +1100, Nyall Dawson wrote:
>> On 13 November 2015 at 02:48, Sandro Santilli <strk at keybit.net> wrote:
>
>> > To be honest, I like the idea of rendering tests. I know they are
>> > fragile in their current incarnation, but being a graphical
>> > application having tests actually check what the user would see
>> > is a good way to catch many issues.
>>
>> I personally think we've reached a good level of stability with the
>> rendering tests. They now perform consistently across all platforms
>> (passing when they should and failing when they shouldn't). So I'm
>> keen to hear any thoughts on why you think these are still fragile?
>
> CDash shows many failures here (check 2.8.3-* builds):
> http://dash.orfeo-toolbox.org/index.php?project=QGIS
>
> All of them are rendering-based tests.
>
> I'm sure the recent introduction of masks helps with that, but
> it is evidently not easy enough to use.

Ah. There's an easy answer for that - all the rendering test related
improvements landed in QGIS 2.10, and have not been backported to 2.8.
I started to do this at one stage, but in the end it's a considerable
amount of work which I couldn't find time to complete.

Nyall