FreeBSD CI Weekly Report 2020-10-04
===
Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-09-28 to 2020-10-04.
During this period, we have:
* 1983 builds (93.9% (+0.2) passed, 6.1% (-0.2) failed) of buildworld and
buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
sparc64 architectures for head, stable/12, stable/11 branches.
* 236 test runs (18.6% (-1.5) passed, 81.4% (+2.6) unstable, 0.0% (-1.1)
exception) were executed on amd64, i386, riscv64 architectures for head,
stable/12, stable/11 branches.
* 52 doc and www builds (100% passed)
Test case status (on 2020-10-04 23:59):
| Branch/Architecture | Total | Pass | Fail | Skipped |
| --- | - | -- | -- | --- |
| head/amd64 | 7899 (+3) | 7798 (+11) | 2 (-5) | 99 (-3) |
| head/i386 | 7897 (+3) | 7776 (+8) | 2 (-5) | 119 (0) |
| 12-STABLE/amd64 | 7630 (+2) | 7570 (+8) | 0 (-6) | 60 (0) |
| 12-STABLE/i386 | 7628 (+2) | 7563 (+8) | 0 (-6) | 65 (0) |
| 11-STABLE/amd64 | 6912 (0) | 6858 (0) | 0 (0) | 54 (0) |
| 11-STABLE/i386 | 6910 (0) | 6854 (-3) | 0 (0) | 56 (+3) |
(The statistics from experimental jobs are omitted)
If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.
The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20201004 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed
## Fixed test cases
### HEAD
* sys.kern.sonewconn_overflow.sonewconn_overflow_01
Workarounded in r366469
### HEAD / 12-STABLE
* sys.kern.coredump_phnum_test.coredump_phnum
* usr.bin.procstat.procstat_test.binary_info
* usr.bin.procstat.procstat_test.command_line_arguments
* usr.bin.procstat.procstat_test.environment
* usr.bin.procstat.procstat_test.file_descriptor
* usr.bin.procstat.procstat_test.kernel_stacks
Fixed in https://svnweb.freebsd.org/changeset/base/366237
## Failing test cases
### HEAD
* sys.capsicum.functional.ForkedOpenatTest_WithFlagInCapabilityMode___
* sys.capsicum.functional.OpenatTest__WithFlag
https://bugs.freebsd.org/249960
## Failing jobs
* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
There are still mutiple errors when building with gcc6, error log available at
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
See also:
https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
## Regressions
* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64
after r360915
https://bugs.freebsd.org/246537
* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
https://bugs.freebsd.org/244732
Needs to check if llvm11 import fixes this.
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
https://bugs.freebsd.org/244163
Discovered by newly endabled sys.net.* tests.
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
https://bugs.freebsd.org/244168
Discovered by newly endabled sys.net.* tests.
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs
more verification.
* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
https://bugs.freebsd.org/249055 & https://bugs.freebsd.org/249229
OpenZFS' zfs.ko can't be loaded in non-64bit platforms
## Failing and Flaky tests (from experimental jobs)
* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh
* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 524 success, 47 failures, 110 skipped, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details
* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2289 success, 647 failures, 813 skipped
## Disabled Tests
* sys.fs.tmpfs.mount_test.large
https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
https://bugs.freebsd.org/238870
Workaround committed and need to
