Hi,

> 2024年5月19日 13:51,Paul Gevers <elb...@debian.org> 写道:
> 
> I already noticed yesterday and had it run; it failed. (Currently) top one 
> here: https://ci.debian.net/packages/z/zfs-linux/testing/amd64/
> 

My concern now is that the results do not seem to be stable or reproducible.

Seven tests have been run since yesterday, of which two failed on 
zfs-test-suite-foo.
Most of these failures may be false positive, and a re-run typically makes them 
pass.
Almost every single test in the failed list can pass independently, but the 
whole test
sequence is failure-prone. 

I have also observed similar behavior when testing locally (and also in 
upstream CI).
Is there any convention in handling such situation? E.g., should I mark all 
zfs-test-suite-x
as flaky and treat them as reference only?

Thanks,
Shengqi Chen

Reply via email to