ci.debian.org and pkg-perl packages

[Niko Tyni]

On Wed, Sep 10, 2014 at 04:13:35PM +0200, Martin Pitt wrote:
> I see smoke coming out of my laptop, but I now ran through all the
> Perl packages. Stats:
> 
>   Total:    2914         <https://people.debian.org/~mpitt/tmp/perl-all.txt>
>   Passing:  2344 (80.4%)
>   Failing:   369 (12.6%) <https://people.debian.org/~mpitt/tmp/perl-failed-tests.txt>
>   No tests:  201 (6.9%)  <https://people.debian.org/~mpitt/tmp/perl-no-tests.txt>

It turns out that we have a bug in our test runner script that makes
it exit with a status of 0 even with failed tests. This seems to only
affect the build-dep tests as the runtime-deps ones typically have
STDERR output when things go south.

There are 115 packages with 'Result: FAIL' in auto-build-deps-stdout,
but all of those have PASS in the summary file.

As all the logs I have are those from the 'failed' tarball, I can't
say how many packages have been classified as OK even though the
build-dep tests really failed.

Martin, could you please grep for 'Result: FAIL' in the successful
packages if you still have the logs around?
-- 
Niko Tyni   ntyni at debian.org