[QGIS-Developer] Flaky tests

[Matthias Kuhn]

Hi Even,

Yes, despite things settling again I experienced the same/similar issues.
I can confirm the issues with the spatialite and the locator test.

I am in favor of disabling (parts of) these, since they do more damage
than good in their current state. This will be much appreciated

To avoid this, someone will need to step up and express the requirement
to keep a certain test active for further debugging. In this case it
will be a requirement that an immediate commit follows by "someone" that
will provide more debug information the next time the test fails and
therefore justify leaving it active.

Meanwhile I started with killing any test depending on remote services
in the PyQgsFileDownloader.
https://github.com/qgis/QGIS/pull/5581

Matthias

On 11/09/2017 04:24 PM, Even Rouault wrote:
> Hi,
> 
>  
> 
> I've had a hard time today with a pull request that changed only some
> python test code, but failures occuring in totally unrelated tests. I
> had to restart Travis-CI 5 times before it was green. Had similar issue
> with another PR
> 
>  
> 
> The various failures I got :
> 
>  
> 
> 3 times:
> 
> 359 - PyQgsFileDownloader (Failed)
> 
>  
> 
> https://dash.orfeo-toolbox.org/testDetails.php?test=63062502&build=297409
> 
> https://dash.orfeo-toolbox.org/testDetails.php?test=63061688&build=297402
> 
> https://dash.orfeo-toolbox.org/testDetails.php?test=63061722&build=297403
> 
>  
> 
> 1 times:
> 
> 316 - PyQgsRulebasedRenderer (Failed)
> 
>  
> 
> https://dash.orfeo-toolbox.org/testDetails.php?test=63061748&build=297404
> 
>  
> 
>  
> 
> 1 times:
> 
> 372 - PyQgsServerWMS (Failed)
> 
>  
> 
> https://dash.orfeo-toolbox.org/testDetails.php?test=63061792&build=297405
> 
>  
> 
> 1 times:
> 
> 328 - PyQgsSpatialiteProvider (Failed)
> 
>  
> 
> https://dash.orfeo-toolbox.org/testDetails.php?test=63061783&build=297405
> 
>  
> 
>  
> 
> 1 times:
> 
> PyQgsLocator:
> 
>  
> 
> https://dash.orfeo-toolbox.org/testDetails.php?test=61670866&build=297397
> 
>  
> 
>  
> 
> Anybody already experimented this ?
> 
>  
> 
> Even
> 
>  
> 
> -- 
> 
> Spatialys - Geospatial professional services
> 
> http://www.spatialys.com
> 
> 
> 
> _______________________________________________
> QGIS-Developer mailing list
> QGIS-Developer at lists.osgeo.org
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
>