[QGIS-Developer] compare failing/succeeding CI builds (how to?)

[Nyall Dawson]

On Wed, 18 Mar 2020 at 04:31, Sandro Santilli <strk at kbt.io> wrote:
>
> My long-standing PR about preventing testsuite run from changing
> files in source tree is currently having a Travis failure which
> seems to start with:
>
>     ProcessingQgisAlgorithmsTestPt3
>
> Trying to understand what's going wrong with that test I see a lot
> of warnings/errors being printed, like:
>
>   GEOS exception: IllegalArgumentException: Points of LinearRing do not form a closed linestring
>   ...
>   ERROR 6: EPSG PCS/GCS code 7992 not found in EPSG support files.  Is this a valid EPSG coordinate system?

These warnings are expected -- the tests include a lot of non-valid
data (for testing purposes!)

>
> And eventually the actual failure printed in yellow:
>
>         FAIL: test_algorithms:20
>         'Find projection', {'algorithm': 'qgis:findprojection', 'name': 'Find projectio (__main__.TestQgisAlgorithms3)
>         ----------------------------------------------------------------------
>         Traceback (most recent call last):
>                 File "/root/QGIS/python/plugins/processing/tests/AlgorithmsTestBase.py", line 154, in check_algorithm
>                         self.check_results(results, context, parameters, defs['results'])
>                 File "/root/QGIS/python/plugins/processing/tests/AlgorithmsTestBase.py", line 333, in check_results
>                         self.assertLayersEqual(expected_lyrs[0], result_lyr, compare=compare, pk=pk, geometry={'topo_equal_check': topo_equal_check})
>                 File "/root/QGIS/build/output/python/qgis/testing/__init__.py", line 57, in assertLayersEqual
>                         self.checkLayersEqual(layer_expected, layer_result, True, **kwargs)
>                 File "/root/QGIS/build/output/python/qgis/testing/__init__.py", line 96, in checkLayersEqual
>                         _TestCase.assertEqual(self, layer_expby_location_summary_date.gml'}
>

This one not expected. What gdal/proj version do you use?

Nyall