Source: metalfinder
Version: 2.1.6-1
Severity: serious
User: debian...@lists.debian.org
Usertags: flaky

Dear maintainer(s),

I looked at the results of the autopkgtest of your package. I noticed that it regularly fails. The failures seem related on the host that runs the test. ci-worker13 is a beefy machine [1], while the other amd64 workers are much more moderate [2]. It's also flaky on ppc64el, but those hosts are (or should be) all the same.

Because the unstable-to-testing migration software now blocks on
regressions in testing, flaky tests, i.e. tests that flip between
passing and failing without changes to the list of installed packages,
are causing people unrelated to your package to spend time on these
tests.

Don't hesitate to reach out if you need help and some more information
from our infrastructure.

Paul

[1] https://metal.equinix.com/product/servers/m3-large/
[2] https://aws.amazon.com/ec2/instance-types/m5/

https://ci.debian.net/data/autopkgtest/testing/amd64/m/metalfinder/29786825/log.gz

=================================== FAILURES =================================== _________________________________ test_issue28 _________________________________

cachedir = PosixPath('/tmp/pytest-of-debci/pytest-0/test_issue280/cache')
musicdir = PosixPath('/tmp/pytest-of-debci/pytest-0/test_issue280/music')
caplog = <_pytest.logging.LogCaptureFixture object at 0x7f705a5efad0>

    def test_issue28(cachedir, musicdir, caplog):
"""Test metalfinder continues running if a file passed through get_artist()
           raises an exception"""
        caplog.set_level(logging.WARNING)
for filename in ['no_header.flac', 'no_artist.flac', 'arch_enemy.flac']:
            _ = move_testfile(filename, musicdir)
        artist_list = mfs.scan_wrapper(str(musicdir), str(cachedir))
        assert artist_list == {'Arch Enemy'}
>       assert NO_ARTIST_ERROR in caplog.records[0].args[1]
E assert "<class 'KeyError'>: 'artist'" in "<class 'mutagen.flac.FLACNoHeaderError'>: '/tmp/pytest-of-debci/pytest-0/test_issue280/music/no_header.flac' is not a valid FLAC file"

tests/test_scan.py:170: AssertionError


https://ci.debian.net/data/autopkgtest/testing/ppc64el/m/metalfinder/29794715/log.gz

=================================== FAILURES =================================== _________________________________ test_issue28 _________________________________

cachedir = PosixPath('/tmp/pytest-of-debci/pytest-0/test_issue280/cache')
musicdir = PosixPath('/tmp/pytest-of-debci/pytest-0/test_issue280/music')
caplog = <_pytest.logging.LogCaptureFixture object at 0x7fff8e0ec4d0>

    def test_issue28(cachedir, musicdir, caplog):
"""Test metalfinder continues running if a file passed through get_artist()
           raises an exception"""
        caplog.set_level(logging.WARNING)
for filename in ['no_header.flac', 'no_artist.flac', 'arch_enemy.flac']:
            _ = move_testfile(filename, musicdir)
        artist_list = mfs.scan_wrapper(str(musicdir), str(cachedir))
        assert artist_list == {'Arch Enemy'}
>       assert NO_ARTIST_ERROR in caplog.records[0].args[1]
E assert "<class 'KeyError'>: 'artist'" in "<class 'mutagen.flac.FLACNoHeaderError'>: '/tmp/pytest-of-debci/pytest-0/test_issue280/music/no_header.flac' is not a valid FLAC file"

tests/test_scan.py:170: AssertionError

Attachment: OpenPGP_signature
Description: OpenPGP digital signature

Reply via email to