Your message dated Sun, 01 Jan 2023 11:19:10 +0000
with message-id <e1pbwmw-002qbd...@fasolo.debian.org>
and subject line Bug#1027466: fixed in python-cmaes 0.9.0-2
has caused the Debian Bug report #1027466,
regarding python-cmaes: flaky autopkgtest: Unreliable test timings
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact ow...@bugs.debian.org
immediately.)


-- 
1027466: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1027466
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems
--- Begin Message ---
Source: python-cmaes
Version: 0.9.0-1
Severity: serious
User: debian...@lists.debian.org
Usertags: flaky

Dear maintainer(s),

I looked at the results of the autopkgtest of your package. I noticed that it regularly fails on some architectures, particularly on s390x, but not exclusively there. Yesterday I triggered 5 or 6 reference runs on every architecture and 6/6 failed on s390x and 1/5 failed on ppc64el. The error message suggests the solution is to turn deadlines off. Can you consider doing that? The same error happened at least once also on amd64, so it's not only the "obscure" release architectures.

Because the unstable-to-testing migration software now blocks on
regressions in testing, flaky tests, i.e. tests that flip between
passing and failing without changes to the list of installed packages,
are causing people unrelated to your package to spend time on these
tests.

Don't hesitate to reach out if you need help and some more information
from our infrastructure.

Paul

https://ci.debian.net/data/autopkgtest/testing/ppc64el/p/python-cmaes/29815406/log.gz

Draw 5: [(array([-2.81633907e+14, -1.17549435e-38, -1.17549435e-38]), 0.0), (array([4.39569613e+009, 2.22507386e-313, 4.39569613e+009]), 67207168.0), (array([-2.81500763e+14, -2.81500763e+14, -2.81500763e+14]), 1537.0), (array([1.70317369e+15, 1.70317369e+15, 5.62915594e+14]), 486606715.0), (array([-2.25294795e+15, 2.00001000e+00, -2.25294795e+15]), -4295688511.0), (array([-1.75639510e+07, 0.00000000e+00, 2.89334784e+14]), 117020729737728.0), (array([ 2.561e+03, 2.561e+03, -1.000e-05]), 1.9)] Draw 6: [(array([4.50843053e+13, 1.09954551e+12, 1.09954551e+12]), -4.294967296334234e+16), (array([ 2.85877335e+14, -6.59750009e+13, -6.59750009e+13]), -1.2061593328768367e-165), (array([-1.1467774e+12, -1.1467774e+12, -1.1467774e+12]), 0.0), (array([-4.22236517e+14, 2.00001000e+00, 0.00000000e+00]), 496085902557184.0), (array([5.62915594e+14, 5.62915594e+14, 5.62915594e+14]), 288235272011776.0), (array([2.82578968e+14, 2.82578968e+14, 2.82578968e+14]), -1.7976931348623157e+308), (array([ 1.67774790e+07, 2.05828577e+15, -2.22044605e-16]), -1103823438096.0)] Draw 7: [(array([-6.60146835e+12, -1.53700000e+03, 0.00000000e+00]), -167839291.0), (array([ 4.31259682e+009, -1.11253693e-308, -1.11253693e-308]), 0.0), (array([2.60000000e+02, 3.40282347e+38, 3.40282347e+38]), 1.1), (array([-8.55704363e+08, -8.55704363e+08, 2.00001000e+00]), 1.5), (array([-1.33575193e+12, -1.33575193e+12, -1.33575193e+12]), -5e-324), (array([66305., 66305., 66305.]), 0.0), (array([-9.00719925e+15, nan, 1.13818803e+12]), 0.0)] Unreliable test timings! On an initial run, this test took 540.20ms, which exceeded the deadline of 200.00ms, but on a subsequent run it took 5.07 ms, which did not. If you expect this sort of variability in your test timings, consider turning deadlines off for this test by setting deadline=None.


https://ci.debian.net/data/autopkgtest/testing/s390x/p/python-cmaes/29815257/log.gz

0., 0., 0., 0., 0., 0., 0., 0., 0., 0.]), 0.0), (array([0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
       0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
       0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
       0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
0., 0., 0., 0., 0., 0., 0., 0., 0., 0.]), 0.0), (array([0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
       0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
       0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
       0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
       0., 0., 0., 0., 0., 0., 0., 0., 0., 0.]), 0.0)]
Unreliable test timings! On an initial run, this test took 386.19ms, which exceeded the deadline of 200.00ms, but on a subsequent run it took 27.02 ms, which did not. If you expect this sort of variability in your test timings, consider turning deadlines off for this test by setting deadline=None.


https://ci.debian.net/data/autopkgtest/testing/amd64/p/python-cmaes/29718110/log.gz

======================================================================
ERROR: test_cma_tell (tests.test_fuzzing.TestFuzzing)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmp/autopkgtest-lxc.d1aldrvi/downtmp/autopkgtest_tmp/tests/test_fuzzing.py", line 10, in test_cma_tell
    data=st.data(),
File "/usr/lib/python3/dist-packages/hypothesis/core.py", line 1190, in wrapped_test
    raise the_error_hypothesis_found
File "/usr/lib/python3/dist-packages/hypothesis/core.py", line 586, in test
    raise DeadlineExceeded(runtime, self.settings.deadline)
hypothesis.errors.DeadlineExceeded: Test took 206.80ms, which exceeds the deadline of 200.00ms

Attachment: OpenPGP_signature
Description: OpenPGP digital signature


--- End Message ---
--- Begin Message ---
Source: python-cmaes
Source-Version: 0.9.0-2
Done: Gard Spreemann <g...@nonempty.org>

We believe that the bug you reported is fixed in the latest version of
python-cmaes, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 1027...@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Gard Spreemann <g...@nonempty.org> (supplier of updated python-cmaes package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmas...@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Format: 1.8
Date: Sun, 01 Jan 2023 11:48:11 +0100
Source: python-cmaes
Architecture: source
Version: 0.9.0-2
Distribution: unstable
Urgency: medium
Maintainer: Gard Spreemann <g...@nonempty.org>
Changed-By: Gard Spreemann <g...@nonempty.org>
Closes: 1027466
Changes:
 python-cmaes (0.9.0-2) unstable; urgency=medium
 .
   * Add patch to set a long test deadline in order to avoid
     flakiness. (Closes: #1027466)
   * Standards-version 4.6.2, no changes needed.
Checksums-Sha1:
 e30956f176cf7b569e08a1bd343449f00ccfe823 2092 python-cmaes_0.9.0-2.dsc
 067a846378b49125a44ee054d79bf3fc55c3152d 2908 
python-cmaes_0.9.0-2.debian.tar.xz
 ca695452e7883a3bbeef341ca82e6262d4c97f83 7782 
python-cmaes_0.9.0-2_source.buildinfo
Checksums-Sha256:
 46deb6d3cbb352bc82c19fd72624e04c99dffe63f88ad56a32a921f2e2230896 2092 
python-cmaes_0.9.0-2.dsc
 5fa84ea2a76371fb90b0fe3015740a55ac2f933a209d95aa3ffa65e63437d60c 2908 
python-cmaes_0.9.0-2.debian.tar.xz
 d29402e2116288d7e535d776d714be039e68a3836aa87d062665bb097b027987 7782 
python-cmaes_0.9.0-2_source.buildinfo
Files:
 fc68110c6c5551b18921636587f3b357 2092 python optional python-cmaes_0.9.0-2.dsc
 0f769243b75c6e54160bb4e854c36645 2908 python optional 
python-cmaes_0.9.0-2.debian.tar.xz
 0d34dd7f352c673b7c3f4abcf777c445 7782 python optional 
python-cmaes_0.9.0-2_source.buildinfo

-----BEGIN PGP SIGNATURE-----

iQJGBAEBCgAwFiEEz8XvhRCFHnNVtV6AnRFYKv1UjPoFAmOxZZsSHGdzcHJAbm9u
ZW1wdHkub3JnAAoJEJ0RWCr9VIz6m7AQALDMB17W4KHSnoCO6wdyaHTsvTZEbRel
vByZS9CQOKiAY25r3jhveCNA2QY6ghlei8yjUqF0SwabzA2bZ67GQkLR/ZjTUVVX
AmYT2HJbUGzXURFJJKa8IAdS1dV5kd90au0ct4RErmNnF65fnGrZqFhvD4uk26YU
EFzsTRVUkSGqIVsX4R2xF+3vAv3GTin9pbVLZq4uT3U/dexzgSyGd5iTrfXhI3mT
pL7j5VoDB3374RBj+1rR08ti1Zi7Uu35yEYnydplcqTfndurISZXVL6LEzSAIxam
Q/TSP8jD0ulRuM28dyI+eer98+GjCMYd2D+PE1Io9gYgod9lfGEKaraaK1Qn5H6Q
x+/YlMMvxKVPGQIJE8hCYDwwA+GAJVaIOmAf5hl+iyl/cXmBA/LXtsqkAexPqjVX
cMe7yW+w/hJFeXKdvU2jivGxB6gElYPkTWTYlrXNUUPlRLiS+4hqebZPRr5lg5QA
jpEkb9/+5jd6ZmKu01ifwtpc2v+wSnOx+btkqj74PhmYsxeaQUzgXga76+oXlDxj
CbrmHm7PNab8qtuP8BUAQU2lN4KfO8kDMG2bNP+FreqzC1ShAkIcmFxU8z8SeNGj
SljpmKe9zhC/ADqQm0cc8jq1Insg9IOqd4c3Mj0XiYwQpyAQ12HevfKTBJj0c78S
SQEY7a610V+g
=w1JL
-----END PGP SIGNATURE-----

--- End Message ---

Reply via email to