Bug#863072: cronutils: Non-determistically FTBFS due to unreliable timing in tests

[Chris Lamb]

Jamie Wilkinson wrote:

> Yeah, it's pretty ugly.  Do you have any ideas on how to improve it?

Sorry, didn't see this until now. I don't have an idea on how to
improve it per-se, but IMHO it is ipso facto not a real test as it
is nondeterminstic. :(


Regards,

-- 
  ,''`.
 : :'  : Chris Lamb
 `. `'`  la...@debian.org / chris-lamb.co.uk
   `-

Bug#863072: cronutils: Non-determistically FTBFS due to unreliable timing in tests

[Jamie Wilkinson]

Yeah, it's pretty ugly.  Do you have any ideas on how to improve it?

On 21 May 2017 at 20:06, Chris Lamb  wrote:

> Source: cronutils
> Version: 1.9-1
> Severity: important
> Justification: fails to build from source
> User: reproducible-bui...@lists.alioth.debian.org
> Usertags: ftbfs
> X-Debbugs-Cc: reproducible-b...@lists.alioth.debian.org
>
> Dear Maintainer,
>
> cronutils's testsuite appears to use method timing/benchmarking in such
> a way that it will non-deterministically FTBFS. I believe this is because
> it passes "-t 5" to runalarm in tests/2.sh which, of course, will
> nondeterministically fail depending on the load of the build machine:
>
>  dh_auto_test
> make -j1 test
>   make[1]: Entering directory '/build/1st/cronutils-1.9'
>   ./regtest.sh
>   1: OK
>   2: FAIL - output match:
>   5d4
>   < 5
>   Makefile:53: recipe for target 'test' failed
>   make[1]: *** [test] Error 1
>   make[1]: Leaving directory '/build/1st/cronutils-1.9'
>
> The full build log is attached or can be viewed here:
>
> https://tests.reproducible-builds.org/debian/logs/
> unstable/amd64/cronutils_1.9-1.build1.log.gz
>
>
> Regards,
>
> --
>   ,''`.
>  : :'  : Chris Lamb
>  `. `'`  la...@debian.org / chris-lamb.co.uk
>`-
>

Bug#863072: cronutils: Non-determistically FTBFS due to unreliable timing in tests

[Chris Lamb]

Source: cronutils
Version: 1.9-1
Severity: important
Justification: fails to build from source
User: reproducible-bui...@lists.alioth.debian.org
Usertags: ftbfs
X-Debbugs-Cc: reproducible-b...@lists.alioth.debian.org

Dear Maintainer,

cronutils's testsuite appears to use method timing/benchmarking in such 
a way that it will non-deterministically FTBFS. I believe this is because
it passes "-t 5" to runalarm in tests/2.sh which, of course, will
nondeterministically fail depending on the load of the build machine:

 dh_auto_test
make -j1 test
  make[1]: Entering directory '/build/1st/cronutils-1.9'
  ./regtest.sh
  1: OK
  2: FAIL - output match:
  5d4
  < 5
  Makefile:53: recipe for target 'test' failed
  make[1]: *** [test] Error 1
  make[1]: Leaving directory '/build/1st/cronutils-1.9'

The full build log is attached or can be viewed here:


https://tests.reproducible-builds.org/debian/logs/unstable/amd64/cronutils_1.9-1.build1.log.gz


Regards,

-- 
  ,''`.
 : :'  : Chris Lamb
 `. `'`  la...@debian.org / chris-lamb.co.uk
   `-


cronutils.1.9-1.logs.unstable.log.txt.gz
Description: Binary data