[PKG-Openstack-devel] Bug#834964: testresources: FTBFS too much often (failing tests)

[Santiago Vila]

Package: src:testresources
Version: 1.0.0-1
Severity: serious

Dear maintainer:

I tried to build this package in stretch with "dpkg-buildpackage -A"
(which is what the "Arch: all" autobuilder would do to build it)
but it failed:

--------------------------------------------------------------------------------
[...]
 debian/rules build-indep
pyversions: missing X(S)-Python-Version in control file, fall back to debian/pyversions
pyversions: missing debian/pyversions file, fall back to supported versions
py3versions: no X-Python3-Version in control file, using supported versions
pyversions: missing X(S)-Python-Version in control file, fall back to debian/pyversions
pyversions: missing debian/pyversions file, fall back to supported versions
py3versions: no X-Python3-Version in control file, using supported versions
dh build-indep --buildsystem=python_distutils --with python2,python3
   dh_testdir -i -O--buildsystem=python_distutils
   dh_update_autotools_config -i -O--buildsystem=python_distutils
   dh_auto_configure -i -O--buildsystem=python_distutils
   dh_auto_build -i -O--buildsystem=python_distutils
pyversions: missing X(S)-Python-Version in control file, fall back to debian/pyversions

[... snipped ...]

testresources.tests.test_test_resource.TestTestResource.testFinishedWithMarksNonDirty ... ok
testresources.tests.test_test_resource.TestTestResource.testFinishedWithResetsCurrentResource ... ok
testresources.tests.test_test_resource.TestTestResource.testGetActivityForResourceWithExtensions ... ok
testresources.tests.test_test_resource.TestTestResource.testGetActivityForResourceWithoutExtensions ... ok
testresources.tests.test_test_resource.TestTestResource.testGetResourceCallsMakeResource ... ok
testresources.tests.test_test_resource.TestTestResource.testGetResourceDoesntDirty ... ok
testresources.tests.test_test_resource.TestTestResource.testGetResourceIncrementsUses ... ok
testresources.tests.test_test_resource.TestTestResource.testGetResourceResetsUsedResource ... ok
testresources.tests.test_test_resource.TestTestResource.testGetResourceReturnsMakeResource ... ok
testresources.tests.test_test_resource.TestTestResource.testGetResourceSetsCurrentResource ... ok
testresources.tests.test_test_resource.TestTestResource.testGetResourceTwiceReturnsIdenticalResource ... ok
testresources.tests.test_test_resource.TestTestResource.testInitiallyNoCurrentResource ... ok
testresources.tests.test_test_resource.TestTestResource.testInitiallyNotDirty ... ok
testresources.tests.test_test_resource.TestTestResource.testInitiallyUnused ... ok
testresources.tests.test_test_resource.TestTestResource.testIsDirty ... ok
testresources.tests.test_test_resource.TestTestResource.testIsDirtyIsTrueIfDependenciesAreDirty ... ok
testresources.tests.test_test_resource.TestTestResource.testIsDirtyIsTrueIfDependenciesChanged ... ok
testresources.tests.test_test_resource.TestTestResource.testIsResetIfDependenciesAreDirty ... ok
testresources.tests.test_test_resource.TestTestResource.testRepeatedGetResourceCallsMakeResourceOnceOnly ... ok
testresources.tests.test_test_resource.TestTestResource.testResetActivityForResourceWithExtensions ... ok
testresources.tests.test_test_resource.TestTestResource.testResetActivityForResourceWithoutExtensions ... ok
testresources.tests.test_test_resource.TestTestResource.testResourceAvailableBetweenFinishedWithCalls ... ok
testresources.tests.test_test_resource.TestTestResource.testUnimplementedGetResource ... ok
testresources.tests.test_test_resource.TestTestResource.testUsedResourceResetBetweenUses ... ok
testresources.tests.test_test_resource.TestTestResource.testUsingTwiceMakesAndCleansTwice ... ok
testresources.tests.test_test_resource.TestTestResource.testneededResourcesClosure ... ok
testresources.tests.test_test_resource.TestTestResource.testneededResourcesDefault ... ok
testresources.tests.test_test_resource.TestTestResource.testneededResourcesDependenciesFirst ... ok
testresources.tests.test_test_resource.test_suite ... ok

======================================================================
FAIL: testresources.tests.test_optimising_test_suite.TestGraphStuff.testBasicSortTests
----------------------------------------------------------------------
testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/<<PKGBUILDDIR>>/testresources/tests/test_optimising_test_suite.py", line 527, in testBasicSortTests
    "failed with permutation %s" % (permutation,))
  File "/usr/lib/python3/dist-packages/testtools/testcase.py", line 356, in assertIn
    self.assertThat(haystack, Contains(needle), message)
  File "/usr/lib/python3/dist-packages/testtools/testcase.py", line 435, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: [test_three, test_one, test_two, test_four] not in [[test_one, test_two, test_three, test_four], [test_three, test_two, test_one, test_four]]: failed with permutation [test_one, test_two, test_three, test_four]


----------------------------------------------------------------------
Ran 108 tests in 0.167s

FAILED (failures=1)
debian/rules:26: recipe for target 'override_dh_auto_test' failed
make[1]: *** [override_dh_auto_test] Error 1
make[1]: Leaving directory '/<<PKGBUILDDIR>>'
debian/rules:12: recipe for target 'build-indep' failed
make: *** [build-indep] Error 2
dpkg-buildpackage: error: debian/rules build-indep gave error exit status 2
--------------------------------------------------------------------------------

Because this source package only generates "Arch: all" packages, this
is the same as a FTBFS bug in the usual sense, and the fact that I was
doing "dpkg-buildpackage -A" does not mean anything special.

I attach a single build log. There are more here:

https://tests.reproducible-builds.org/debian/rb-pkg/unstable/amd64/testresources.html

Thanks.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: testresources_1.0.0-1_amd64-20160818T0413Z.gz
Type: application/gzip
Size: 11614 bytes
Desc: 
URL: <http://lists.alioth.debian.org/pipermail/openstack-devel/attachments/20160821/6addf25b/attachment-0001.bin>