Re: Thinkpad X1 Carbon gen11 - suspend not work

[Li-Wen Hsu]

On Thu, Oct 5, 2023 at 4:00 PM Oleksandr Kryvulia 
wrote:

> Hi,
> I have Thinkpad X1 Carbon gen11 where s3 is not available:
>
> # sysctl hw.acpi.supported_sleep_state
> hw.acpi.supported_sleep_state: S4 S5
>
> FreeBSD 15.0-CURRENT #47 main-n265480-95a4709b2cca-dirty, latest available
> bios.
>
> What can be done to investigate?
>

I'm not sure about gen11, but for the earlier generations, the sleep state
can be adjusted in BIOS. This is what on my gen6:
https://twitter.com/lwhsu/status/1039711710913945601

Re: 7addfafe73e0 early boot kernel panics

[Li-Wen Hsu]

On Tue, Aug 22, 2023 at 10:52 PM Juraj Lutter  wrote:

>
>
> > On 22 Aug 2023, at 16:30, Graham Perrin  wrote:
> >
> > I could not get 7addfafe73e0 to boot.
> >
> > 
> (2023-08-21, 21 hours ago).
> >
> > I reverted to a edacf4b4824a boot environment, which is fine.
> >
> > Should I simply update to ?
> Assuming a known issue with 7addfafe73e0
>
> Recent c941b82e1c31 boots and runs fine (as a bhyve guest)
>
> otis
>

You can also check the test status in our CI
https://ci.freebsd.org/job/FreeBSD-main-amd64-test/

There might be some failing test cases, or panic on running some test case,
but at least you can check if one revision boots or not, in a reference
system.

Best,
Li-Wen

Re: HEADS-UP: ASLR for 64-bit executables enabled by default on main

[Li-Wen Hsu]

On Wed, Nov 17, 2021 at 6:30 AM Marcin Wojtas  wrote:
>
> As of b014e0f15bc7 the ASLR (Address Space Layout
> Randomization) feature becomes enabled for the all 64-bit
> binaries by default.
>
> Address Space Layout Randomization (ASLR) is an exploit mitigation
> technique implemented in the majority of modern operating systems.
> It involves randomly positioning the base address of an executable
> and the position of libraries, heap, and stack, in a process's address
> space. Although over the years ASLR proved to not guarantee full OS
> security on its own, this mechanism can make exploitation more difficult
> (especially when combined with other methods, such as W^X).
>
> Tests on the tier 1 64-bit architectures demonstrated that the ASLR is
> stable and does not result in noticeable performance degradation,
> therefore it is considered safe to enable this mechanism by default.
> Moreover its effectiveness is increased for PIE (Position Independent
> Executable) binaries. Thanks to commit 9a227a2fd642 ("Enable PIE by
> default on 64-bit architectures"), building from src is not necessary
> to have PIE binaries and it is enough to control usage of ASLR in the
> OS solely by setting the appropriate sysctls. The defaults were toggled
> for the 64-bit PIE and non-PIE executables.
>
> As for the drawbacks, a consequence of using the ASLR is more
> significant VM fragmentation, hence the issues may be encountered
> in the systems with a limited address space in high memory consumption
> cases, such as buildworld. As a result, although the tests on 32-bit
> architectures with ASLR enabled were mostly on par with what was
> observed on 64-bit ones, the defaults for the former are not changed
> at this time. Also, for the sake of safety the feature remains disabled
> for 32-bit executables on 64-bit machines, too.
>
> The committed change affects the overall OS operation, so the
> following should be taken into consideration:
> * Address space fragmentation.
> * A changed ABI due to modified layout of address space.
> * More complicated debugging due to:
>   * Non-reproducible address space layout between runs.
>   * Some debuggers automatically disable ASLR for spawned processes,
> making target's environment different between debug and
> non-debug runs.
>
> The known issues (such as PR239873 or PR253208) have been fixed in
> HEAD up front, however please pay attention to the system behavior after
> upgrading the kernel to the newest revisions.
> In order to confirm/rule-out the dependency of any encountered issue
> on ASLR it is strongly advised to re-run the test with the feature
> disabled - it can be done by setting the following sysctls
> in the /etc/sysctl.conf file:
> kern.elf64.aslr.enable=0
> kern.elf64.aslr.pie_enable=0
>
> The change is a result of combined efforts under the auspices
> of the FreeBSD Foundation and the Semihalf team sponsored
> by Stormshield.
>
> Best regards,
> Marcin

Thanks very much for working on this. FYI, there are some test cases
seem to be affected by this:

https://ci.freebsd.org/job/FreeBSD-main-amd64-test/19828/testReport/

The mkimg ones are a bit tricky, it seems the output is changed in
each run. We may need a way to generate reproducible results..

I'm still checking them, but hope more people can join and fix them.

Best,
Li-Wen

Re: FreeBSD 14.0-CURRENT snapshots in Google Compute Engine

[Li-Wen Hsu]

On Wed, Nov 17, 2021 at 11:56 AM Alan Somers  wrote:
>
> Google Compute Engine has images for 11.4-RELEASE, 12.2-RELEASE, and
> 13.0-RELEASE.  Are there any images for current snapshots, and if so
> what are their names?
> -Alan

You can use this command to list all the images built by re:

gcloud compute images list --no-standard-images
--project=freebsd-org-cloud-dev

gcloud is from net/google-cloud-sdk

Li-Wen

Re: [HEADS UP] Rename of the vendor/openzfs branch

[Li-Wen Hsu]

On Tue, Jun 8, 2021 at 7:45 PM Li-Wen Hsu  wrote:
>
> Hello,
>
> As mentioned in the "OpenZFS imports, status update":
>
> https://lists.freebsd.org/archives/freebsd-git/2021-June/13.html
>
> We're going to rename the current openzfs vendor branch,
> vendor/openzfs, to vendor/openzfs/legacy

The renaming has been done:

https://cgit.freebsd.org/src/log/?h=vendor/openzfs/legacy

If you have a local branch tracking vendor/openzfs, please refer to
the previous mail for migration.

https://lists.freebsd.org/archives/freebsd-git/2021-June/15.html

Best,
Li-Wen

[HEADS UP] Rename of the vendor/openzfs branch

[Li-Wen Hsu]

Hello,

As mentioned in the "OpenZFS imports, status update":

https://lists.freebsd.org/archives/freebsd-git/2021-June/13.html

We're going to rename the current openzfs vendor branch,
vendor/openzfs, to vendor/openzfs/legacy
and import directly the master and zfs-2.1-release branches from the
upstream OpenZFS to vendor/openzfs/* for merging to our main and
stable/13 branches. The details can be found in the mail above.

The people have local branch tracking the original vendor/openzfs may
encounter error message like this whey doing `git pull`:

error: cannot lock ref
'refs/remotes/freebsd/vendor/openzfs/legacy':
'refs/remotes/freebsd/vendor/openzfs' exists; cannot create
'refs/remotes/freebsd/vendor/openzfs/legacy'

The solution is update the upstream of the tracking branch:

(change "freebsd" to "origin" if you use the default remote name)
git remote prune freebsd
(on your tracking branch)
git branch -u freebsd/vendor/openzfs/legacy

If you don't want the first command prune all the branches not
existing in the remote repository, use this:

git update-ref -d refs/remotes/freebsd/vendor/openzfs
(also, change "freebsd" to "origin" if you use the default remote name)

After that you can do `git pull` or `git fetch` as usual.

If you have any questions, please post on -git@ list.

Best,
Li-Wen

Re: HEADS UP: FreeBSD src repo transitioning to git this weekend

[Li-Wen Hsu]

On Sat, Jan 2, 2021 at 4:25 AM Christian Weisgerber  wrote:
>
> On 2021-01-01, Shawn Webb  wrote:
>
> > This is why I asked FreeBSD to provide anonymous read-only ssh://
> > support for git. I'm very grateful they support it.
> >
> > One thing that I need to do with the HardenedBSD infrastructure is
> > publish on our site the ssh pubkeys of the server (both RSA and
> > ed25519). I plan to do that sometime this coming week. I wonder if it
> > would be a good idea for FreeBSD to do the same
>
> The draft FreeBSD Git docs have the SSH fingerprints of the Git
> servers.
> https://github.com/bsdimp/freebsd-git-docs/blob/main/URLs.md
>
> Here's one from my own ~/.ssh/known_hosts:
> SHA256:y1ljKrKMD3lDObRUG3xJ9gXwEIuqnh306tSyFd1tuZE git.freebsd.org (ED25519)

And the ssh-keys file is available on the project site, signed with
security-officer's key:

https://www.freebsd.org/internal/ssh-keys.asc

And in that file's header:
"""
Note that all machines listed below also have signed SSHFP records in
DNS.  If you have a DNSSEC-aware resolver and set VerifyHostKeyDNS to
"ask" or "yes" in ~/.ssh/config, OpenSSH will verify host keys against
these SSHFP records.
"""

Best,
Li-Wen
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: Wake from sleep kinda broken-ish? (ThinkPad Carbon X1 6th gen)

[Li-Wen Hsu]

On Mon, Oct 12, 2020 at 5:22 PM Eirik Øverby  wrote:
>
> On Wednesday, September 16, 2020 9:05:43 AM CEST Warner Losh wrote:
> > I too can report this for my Lenovo Yoga running code as of September 13,
> > but with manu's latest drm...  It used to work fine, but my last build on
> > the system was from May. Most likely a new panic in that code path, but
> > I've not chased down further...
>
> So I got a gen8 to play with, and the list of grievances is long - but I have
> one observation that may be of interest:
> The gen8 would be usable (at least seemingly so) with a 13-kernel from lat
> 2019 or very early 2020. Then around the end of January - I've bisected it
> down to around Jan 24, give or take, it would start wedging _hard_ after a
> minute or two of heavy load (compiling, cat /dev/random, that sort of thing).
> It was a problem prior to that too but it was _much_ harder to trigger, at
> least based on my tests this weekend.
>
> The "solution" is to add
>   hint.hwpstate_intel.0.disabled="1"
> to /boot/loader.conf. This obviously has disastrous impact on battery life.
> The emt module takes over, so power management is a lot more rudimentary
> (powerd now does nearly nothing, while powerd++ kills interactivity). Battery
> life is much shorter than on my gen6, and it gets hotter.
>
> BUT: This thing - gen8 - would get stuck in the acpi_beep before adding this
> to loader.conf. After adding the hint, I have not had a single failure when
> resuming. It's behaving much better than my gen6.

Recently I got an interesting observation: if I suspend with `zzz`,
(which is basically doing `acpiconf -s S3`), and resuming by pushing
the power button, there is 95% chance of resuming failure.
However, if I use close/open the lid to suspend/resume, I haven't hit
any failure since last week.

I suppose that these 2 suspend/resume methods are basically doing the
same thing?  My hw.acpi.lid_switch_state sysctl is S3.

I have tried suspending with `zzz` then closing the lid, there is
about 50% failure rate, but the sample number is very small.

Is there any idea about what makes the difference between these 2
suspend/resume methods?

I'm running 13.0-CURRENT r367582, with drm-devel-kmod-5.4.62.g20201109
and gpu-firmware-kmod-g20200920. My /boot/loader.conf has
hw.i915kms.enable_psr=0 but no hint.hwpstate_intel.0.disabled=1

Best,
Li-Wen
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2020-10-11

[Li-Wen Hsu]

FreeBSD CI Weekly Report 2020-10-11
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-10-05 to 2020-10-11.

During this period, we have:

* 1809 builds (94.6% (+0.7) passed, 5.4% (-0.7) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 213 test runs (70.5% (+51.9) passed, 28.6% (-52.8) unstable, 0.9% (+0.9)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 34 doc and www builds (100% passed)

Test case status (on 2020-10-11 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped  |
| --- | -- | -- | -- |  |
| head/amd64  | 7995 (+96) | 7891 (+93) | 0 (-2) | 104 (+5) |
| head/i386   | 7993 (+96) | 7869 (+93) | 0 (-2) | 124 (+5) |
| 12-STABLE/amd64 | 7630 (0)   | 7570 (0)   | 0 (0)  | 60 (0)   |
| 12-STABLE/i386  | 7628 (0)   | 7563 (0)   | 0 (0)  | 65 (0)   |
| 11-STABLE/amd64 | 6912 (0)   | 6858 (0)   | 0 (0)  | 54 (0)   |
| 11-STABLE/i386  | 6910 (0)   | 6857 (+3)  | 0 (0)  | 53 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20201011 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## News

* Capsicum tests have been turned fine grained results. Now each test case 
reports individually:
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/lastCompletedBuild/testReport/junit/sys.capsicum/functional/
  The test are executed with root by default now and some previously skipped 
test cases are being executed now.

## Failing test cases

### HEAD

* sys.capsicum.functional.Capability__NoBypassDAC
  https://bugs.freebsd.org/250178
* sys.capsicum.functional.Pdfork__OtherUserForked
  https://bugs.freebsd.org/250179

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055 & https://bugs.freebsd.org/249229
  OpenZFS' zfs.ko can't be loaded in non-64bit platforms
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 524 success, 47 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2289 success, 647 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
  Workaround committed and need to verify.
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  

FreeBSD CI Weekly Report 2020-10-04

[Li-Wen Hsu]

FreeBSD CI Weekly Report 2020-10-04
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-09-28 to 2020-10-04.

During this period, we have:

* 1983 builds (93.9% (+0.2) passed, 6.1% (-0.2) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 236 test runs (18.6% (-1.5) passed, 81.4% (+2.6) unstable, 0.0% (-1.1)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 52 doc and www builds (100% passed)

Test case status (on 2020-10-04 23:59):
| Branch/Architecture | Total | Pass   | Fail   | Skipped |
| --- | - | -- | -- | --- |
| head/amd64  | 7899 (+3) | 7798 (+11) | 2 (-5) | 99 (-3) |
| head/i386   | 7897 (+3) | 7776 (+8)  | 2 (-5) | 119 (0) |
| 12-STABLE/amd64 | 7630 (+2) | 7570 (+8)  | 0 (-6) | 60 (0)  |
| 12-STABLE/i386  | 7628 (+2) | 7563 (+8)  | 0 (-6) | 65 (0)  |
| 11-STABLE/amd64 | 6912 (0)  | 6858 (0)   | 0 (0)  | 54 (0)  |
| 11-STABLE/i386  | 6910 (0)  | 6854 (-3)  | 0 (0)  | 56 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20201004 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed

## Fixed test cases

### HEAD
* sys.kern.sonewconn_overflow.sonewconn_overflow_01
  Workarounded in r366469

### HEAD / 12-STABLE
* sys.kern.coredump_phnum_test.coredump_phnum
* usr.bin.procstat.procstat_test.binary_info
* usr.bin.procstat.procstat_test.command_line_arguments
* usr.bin.procstat.procstat_test.environment
* usr.bin.procstat.procstat_test.file_descriptor
* usr.bin.procstat.procstat_test.kernel_stacks
  Fixed in https://svnweb.freebsd.org/changeset/base/366237

## Failing test cases

### HEAD

* sys.capsicum.functional.ForkedOpenatTest_WithFlagInCapabilityMode___
* sys.capsicum.functional.OpenatTest__WithFlag
  https://bugs.freebsd.org/249960

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055 & https://bugs.freebsd.org/249229
  OpenZFS' zfs.ko can't be loaded in non-64bit platforms
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 524 success, 47 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2289 success, 647 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
  Workaround committed and need to 

FreeBSD CI Weekly Report 2020-09-27

[Li-Wen Hsu]

FreeBSD CI Weekly Report 2020-09-27
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-09-21 to 2020-09-27.

During this period, we have:

* 2211 builds (93.7% (-1.8) passed, 6.3% (+1.8) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 268 test runs (20.1% (-42.5) passed, 78.8% (+41.8) unstable, 1.1% (+0.7)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 50 doc and www builds (100% passed)

Test case status (on 2020-09-27 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped  |
| --- | - | - | -- |  |
| head/amd64  | 7896 (+2) | 7787 (-2) | 7 (+1) | 102 (+3) |
| head/i386   | 7894 (+2) | 7768 (+1) | 7 (+1) | 119 (0)  |
| 12-STABLE/amd64 | 7628 (0)  | 7562 (-8) | 6 (+5) | 60 (+3)  |
| 12-STABLE/i386  | 7626 (0)  | 7555 (-5) | 6 (+5) | 65 (0)   |
| 11-STABLE/amd64 | 6912 (0)  | 6858 (-3) | 0 (0)  | 54 (+3)  |
| 11-STABLE/i386  | 6910 (0)  | 6857 (0)  | 0 (0)  | 53 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200927 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## News

* !x86 tests running in QEMU are configured to run once a day:
  * https://ci.freebsd.org/job/FreeBSD-head-aarch64-test/
  * https://ci.freebsd.org/job/FreeBSD-head-armv7-test/
  * https://ci.freebsd.org/job/FreeBSD-head-mips64-test/
  * https://ci.freebsd.org/job/FreeBSD-head-powerpc64-test/
  * https://ci.freebsd.org/job/FreeBSD-head-riscv64-test/

## Fixed test cases

### 12-STABLE
* sys.opencrypto.runtests.main
  Fixed in r366010 and r366073
  https://bugs.freebsd.org/237403

## Failing test cases

### HEAD

* sys.capsicum.capsicum-test.main
  https://bugs.freebsd.org/249960
  * OpenatTest.WithFlag
  * ForkedOpenatTest_WithFlagInCapabilityMode._

### HEAD / 12-STABLE
* sys.kern.coredump_phnum_test.coredump_phnum
* usr.bin.procstat.procstat_test.binary_info
* usr.bin.procstat.procstat_test.command_line_arguments
* usr.bin.procstat.procstat_test.environment
* usr.bin.procstat.procstat_test.file_descriptor
* usr.bin.procstat.procstat_test.kernel_stacks

(Fixed in https://svnweb.freebsd.org/changeset/base/366237 on 2020-09-29)

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055 & https://bugs.freebsd.org/249229
  OpenZFS' zfs.ko can't be loaded in non-64bit platforms
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 524 success, 47 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2289 success, 647 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* 

FreeBSD CI Weekly Report 2020-09-20

[Li-Wen Hsu]

FreeBSD CI Weekly Report 2020-09-20
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-09-14 to 2020-09-20.

During this period, we have:

* 2056 builds (95.5% (+1.5) passed, 4.5% (-1.5) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 246 test runs (62.6% (-25.2) passed, 37.0% (+27.2) unstable, 0.4% (-2.0)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 50 doc and www builds (100% passed)

Test case status (on 2020-09-20 23:59):
| Branch/Architecture | Total  | Pass  | Fail   | Skipped   |
| --- | -- | - | -- | - |
| head/amd64  | 7894 (+13) | 7789 (-2) | 6 (+6) | 99 (+9)   |
| head/i386   | 7892 (+13) | 7767 (-4) | 6 (+6) | 119 (+11) |
| 12-STABLE/amd64 | 7628 (+2)  | 7570 (+1) | 1 (+1) | 57 (0)|
| 12-STABLE/i386  | 7626 (+2)  | 7560 (+4) | 1 (+1) | 65 (-3)   |
| 11-STABLE/amd64 | 6912 (0)   | 6861 (0)  | 0 (0)  | 51 (0)|
| 11-STABLE/i386  | 6910 (0)   | 6857 (0)  | 0 (0)  | 53 (0)|

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200920 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failed and fixed test cases

* sys.fs.tmpfs.times_test.{empty,non_empty}
  https://bugs.freebsd.org/249362
* sys.posixshm.posixshm_test.*
  https://bugs.freebsd.org/249417

## Failing test cases

### HEAD
* sys.kern.coredump_phnum_test.coredump_phnum
* usr.bin.procstat.procstat_test.binary_info
* usr.bin.procstat.procstat_test.command_line_arguments
* usr.bin.procstat.procstat_test.environment
* usr.bin.procstat.procstat_test.file_descriptor
* usr.bin.procstat.procstat_test.kernel_stacks

(Fixed in https://svnweb.freebsd.org/changeset/base/366237 on 2020-09-29)

### 12-STABLE
* sys.opencrypto.runtests.main
  Not fully migrated to python3
  https://bugs.freebsd.org/237403

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055 & https://bugs.freebsd.org/249229
  OpenZFS' zfs.ko can't be loaded in non-64bit platforms
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 524 success, 47 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2289 success, 647 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
  

Re: Wake from sleep kinda broken-ish? (ThinkPad Carbon X1 6th gen)

[Li-Wen Hsu]

On Wed, Sep 16, 2020 at 2:30 PM Andriy Gapon  wrote:
>
> On 15/09/2020 23:13, Eirik Øverby wrote:
> > On 9/15/20 9:50 PM, Andriy Gapon wrote:
> >> On 15/09/2020 22:36, Eirik Øverby wrote:
> >>> Now, since I updated from r365358 to r365688, I have not once been able 
> >>> to wake from sleep.
> >>
> >> Is that the only thing that changed?
> >> Any port / package upgrades?
> >
> > There have been updates to packages, yes - but it didn't even occur to me 
> > that these could impact the resume process at such an early stage. Not sure 
> > which that would be; obviously the drm module has been rebuilt each time I 
> > upgraded, but I don't have any other kernel modules installed from packages.

Which version of drm module are you using?

> Yes, I specifically had drm modules in mind.

I also use X1C 6th and it was working perfectly after updating BIOS to
1.30 (which I'm currently using) in Sep. 2018 [1]. I don't remember
any suspend/resume failures. But since late 2019, it has exactly the
same symptom as yours. Suspending is fine, but upon resuming, there is
about a 50% probability that the power LDE continues pulsating with
all other LDEs like FnLock and CapsLock are on like the machine is
awake.

I still doubt if this is related to drm. I have tried to
suspend/resume without drm module loads, all successed, but the number
of the experiments are too small (< 10) so I can't tell if this is the
conclusion.

Currently I'm on r363470 with drm-devel-kmod-5.3.g20200724. While
reporting issue [2], I found that setting hw.i915kms.enable_psr=0 in
/boot/loader.conf helps. Before that it has about a 30% probability of
failing to resume (yes one of the few things getting better in 2020),
after that, I still see some failures, but the failure rate reduces to
about 5~10%.

I haven't upgraded to newer kernel/world and drm-devel-kmod yet.

[1] https://twitter.com/lwhsu/status/1039711710913945601
[2] https://github.com/freebsd/drm-kmod/issues/14

Best,
Li-Wen
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2020-09-13

[Li-Wen Hsu]

FreeBSD CI Weekly Report 2020-09-13
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-09-07 to 2020-09-13.

During this period, we have:

* 2533 builds (94.0% (+2.0) passed, 6.0% (-2.0) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 296 test runs (87.8% (+45.2) passed, 9.8% (-14.7) unstable, 2.4% (-30.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 26 doc and www builds (100% passed)

Test case status (on 2020-09-13 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7881 (+2) | 7791 (+2) | 0 (0) | 90 (0)  |
| head/i386   | 7879 (+2) | 7771 (+2) | 0 (0) | 108 (0) |
| 12-STABLE/amd64 | 7626 (0)  | 7569 (+3) | 0 (0) | 57 (-3) |
| 12-STABLE/i386  | 7624 (0)  | 7556 (0)  | 0 (0) | 68 (0)  |
| 11-STABLE/amd64 | 6912 (0)  | 6861 (0)  | 0 (0) | 51 (0)  |
| 11-STABLE/i386  | 6910 (0)  | 6857 (0)  | 0 (0) | 53 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200913 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055 & https://bugs.freebsd.org/249229
  OpenZFS' zfs.ko can't be loaded in non-64bit platforms
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 524 success, 47 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2289 success, 647 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
  Workaround committed and need to verify.
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* 

FreeBSD CI Weekly Report 2020-09-06

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-09-06
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-08-31 to 2020-09-06.

During this period, we have:

* 2089 builds (92.0% (+3.7) passed, 8.0% (-3.7) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 237 test runs (42.6% (-2.7) passed, 24.5% (-3.2) unstable, 32.9% (+5.9)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 30 doc and www builds (100% passed)

Test case status (on 2020-09-06 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped  |
| --- | - | - | -- |  |
| head/amd64  | 7879 (+3) | 7789 (+4) | 0 (-1) | 90 (0)   |
| head/i386   | 7877 (+4) | 7769 (-4) | 0 (0)  | 108 (+8) |
| 12-STABLE/amd64 | 7626 (0)  | 7566 (-3) | 0 (0)  | 60 (+3)  |
| 12-STABLE/i386  | 7624 (0)  | 7556 (-3) | 0 (0)  | 68 (+3)  |
| 11-STABLE/amd64 | 6912 (0)  | 6861 (0)  | 0 (0)  | 51 (0)   |
| 11-STABLE/i386  | 6910 (0)  | 6857 (+3) | 0 (0)  | 53 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200906 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Fixed test cases

* sys.kern.kern_copyin.kern_copyin
  Fails after somewhere in (r364509, r364542]
  https://bugs.freebsd.org/248933
  Fixed in r365327 and r365337

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055
  Loading zfs.ko hangs i386 kernel
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 524 success, 47 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2291 success, 645 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* 

Re: FreeBSD CI Weekly Report 2020-08-30

[Li-Wen Hsu]

On Thu, Sep 3, 2020 at 8:57 PM Alan Somers  wrote:
>
> On Thu, Sep 3, 2020 at 4:06 AM Li-Wen Hsu  wrote:
>
> >
> > FreeBSD CI Weekly Report 2020-08-30
> > ===
> > * https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
> > * Total 681 tests, 525 success, 46 failures, 110 skipped, see
> >
> > https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
> > for more details
> >
> That's 35 more failures than we used to have.  What changed?  Was this
> using the openzfs kmod?  It looks like test run 7392 was when the change
> happened.
> https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/7392/changes

Yes as described in the news section, the statistics are from the
build after openzfs importing.

Best,
Li-Wen
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2020-08-30

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-08-30
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-08-24 to 2020-08-30.

During this period, we have:

* 2429 builds (88.3% (+0.4) passed, 11.7% (-0.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 274 test runs (45.3% (-8.1) passed, 27.7% (-8.0) unstable, 27.0% (+16.1)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 24 doc and www builds (100% (0) passed)

Test case status (on 2020-08-30 23:59):
| Branch/Architecture | Total | Pass   | Fail  | Skipped  |
| --- | - | -- | - |  |
| head/amd64  | 7876 (+1) | 7785 (+1)  | 1 (0) | 90 (0)   |
| head/i386   | 7873 (0)  | 7773 (-3)  | 0 (0) | 100 (+3) |
| 12-STABLE/amd64 | 7626 (0)  | 7569 (0)   | 0 (0) | 57 (0)   |
| 12-STABLE/i386  | 7624 (0)  | 7559 (+3)  | 0 (0) | 65 (-3)  |
| 11-STABLE/amd64 | 6912 (0)  | 6861 (-30) | 0 (0) | 51 (+30) |
| 11-STABLE/i386  | 6910 (0)  | 6854 (-3)  | 0 (0) | 56 (+3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200830 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## News

* Numbers of FreeBSD-head-amd64-test_zfs are changed after OpenZFS importing,
  we encouage everyone check and fix the failing and skipped test cases.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  See also:
  https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
  
## Failing test cases

* sys.kern.kern_copyin.kern_copyin
  Fails after somewhere in (r364509, r364542]
  https://bugs.freebsd.org/248933
  
* lib.libbe.be_create.* and sbin.bectl.bectl_test.*
  https://bugs.freebsd.org/249055
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* sys.kern.kern_copyin.kern_copyin
  https://bugs.freebsd.org/248933

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* Total 681 tests, 525 success, 46 failures, 110 skipped, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2292 success, 644 failures, 813 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* 

FreeBSD CI Weekly Report 2020-08-23

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-08-23
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-08-17 to 2020-08-23.

During this period, we have:

* 2124 builds (87.9% (-5.8) passed, 12.1% (+5.8) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 238 test runs (53.4% (-34.4) passed, 35.7% (+23.9) unstable, 10.9% (+10.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 100 doc and www builds (100% (+0) passed)

Test case status (on 2020-08-23 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped  |
| --- | -- | -- | --- |  |
| head/amd64  | 7875 (-19) | 7784 (-2)  | 1 (-17) | 90 (0)   |
| head/i386   | 7873 (-19) | 7776 (-1)  | 0 (-18) | 97 (0)   |
| 12-STABLE/amd64 | 7626 (+6)  | 7569 (+6)  | 0 (0)   | 57 (0)   |
| 12-STABLE/i386  | 7624 (+6)  | 7556 (+6)  | 0 (0)   | 68 (0)   |
| 11-STABLE/amd64 | 6912 (0)   | 6891 (+33) | 0 (0)   | 21 (-33) |
| 11-STABLE/i386  | 6910 (0)   | 6857 (+3)  | 0 (0)   | 53 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200823 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## News

* lib.libcasper.services.cap_net.net_test.* tests are temporarily disabled
  in CI env due to require to access public Internet, which is currently
  unavailable in the test VM execution environment. Safe internet access
  of the test VM is WIP but it is suggested writing tests without external
  dependenies.  This is why the total case number dropped.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  
## Failing test cases

* sys.kern.kern_copyin.kern_copyin
  Fails after somewhere in (r364509, r364542]
  https://bugs.freebsd.org/248933
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.

* sys.kern.kern_copyin.kern_copyin
  https://bugs.freebsd.org/248933

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress
* Work on running these tests over OpenZFS is in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* 

FreeBSD CI Weekly Report 2020-08-16

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-08-16
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-08-10 to 2020-08-16.

During this period, we have:

* 2008 builds (93.7% (-0.3) passed, 6.3% (+0.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 229 test runs (87.8% (-8.6) passed, 11.8% (+8.7) unstable, 0.4% (-0.1)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 100 doc and www builds (100% (+0) passed)

Test case status (on 2020-08-16 23:59):
| Branch/Architecture | Total  | Pass  | Fail | Skipped |
| --- | -- | - |  | --- |
| head/amd64  | 7894 (+20) | 7786 (+2) | 18 (+18) | 90 (0)  |
| head/i386   | 7892 (+20) |  (+5) | 18 (+18) | 97 (-3) |
| 12-STABLE/amd64 | 7620 (0)   | 7563 (+3) | 0 (0)| 57 (-3) |
| 12-STABLE/i386  | 7618 (0)   | 7550 (0)  | 0 (0)| 68 (0)  |
| 11-STABLE/amd64 | 6912 (0)   | 6858 (-3) | 0 (0)| 54 (+3) |
| 11-STABLE/i386  | 6910 (0)   | 6854 (0)  | 0 (0)| 56 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200816 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  There are still mutiple errors when building with gcc6, error log available at
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
  
## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732
  Needs to check if llvm11 import fixes this.

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix committed as https://svnweb.freebsd.org/changeset/base/364220 , needs 
more verification.
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress
* Work on running these tests over OpenZFS is in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  lib.libcasper.services.cap_net.net_test.*
  

FreeBSD CI Weekly Report 2020-08-09

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-08-09
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-08-02 to 2020-08-09.

During this period, we have:

* 1823 builds (94.0% (-1.4) passed, 6.0% (+1.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 193 test runs (96.4% (+27.4) passed, 3.1% (-26.9) unstable, 0.5% (-0.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 28 doc and www builds (100% (+0.0) passed)

Test case status (on 2020-08-09 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped  |
| --- | - | - | -- |  |
| head/amd64  | 7874 (+2) | 7784 (+3) | 0 (-1) | 90 (0)   |
| head/i386   | 7872 (+2) | 7772 (0)  | 0 (-1) | 100 (+3) |
| 12-STABLE/amd64 | 7620 (+1) | 7560 (-2) | 0 (0)  | 60 (+3)  |
| 12-STABLE/i386  | 7618 (+1) | 7550 (-2) | 0 (0)  | 68 (+3)  |
| 11-STABLE/amd64 | 6912 (0)  | 6861 (0)  | 0 (0)  | 51 (0)   |
| 11-STABLE/i386  | 6910 (0)  | 6854 (0)  | 0 (0)  | 56 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200809 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/ 
  Patches to fix (partially):
  https://reviews.freebsd.org/D25953
  https://reviews.freebsd.org/D25954
  
## Fixed cases

* lib.googletest.gtest_main.googletest-port-test.main
  https://svnweb.freebsd.org/changeset/base/363821

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/
  
## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/

FreeBSD CI Weekly Report 2020-08-02

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-08-02
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-07-27 to 2020-08-02.

During this period, we have:

* 1744 builds (95.4% (-0.3) passed, 4.6% (+0.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 207 test runs (69.0% (-21.8) passed, 30.0% (+21.2) unstable, 1.0% (+0.6)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 26 doc and www builds (100% (+0.0) passed)

Test case status (on 2020-08-02 23:59):
| Branch/Architecture | Total| Pass  | Fail   | Skipped |
| --- |  | - | -- | --- |
| head/amd64  | 7872 (0) | 7781 (-1) | 1 (+1) | 90 (0)  |
| head/i386   | 7870 (0) | 7772 (+2) | 1 (+1) | 97 (-3) |
| 12-STABLE/amd64 | 7619 (0) | 7562 (0)  | 0 (0)  | 57 (0)  |
| 12-STABLE/i386  | 7617 (0) | 7552 (+3) | 0 (0)  | 65 (-3) |
| 11-STABLE/amd64 | 6912 (0) | 6861 (+3) | 0 (0)  | 51 (-3) |
| 11-STABLE/i386  | 6910 (0) | 6854 (-3) | 0 (0)  | 56 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200802 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

  From kevans@:
  one of ncurses' scripts that generates box and a bunch of other symbols is 
shooting blanks with gcc6, however it seems fine on gcc9.
  
  Patch by jhb@: https://reviews.freebsd.org/D25731

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/
  
* lib.googletest.gtest_main.googletest-port-test.main
  https://bugs.freebsd.org/248452

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* 

FreeBSD CI Weekly Report 2020-07-26

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-07-26
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-07-20 to 2020-07-26.

During this period, we have:

* 2211 builds (95.7% (+2.4) passed, 4.3% (-2.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 261 test runs (90.8% (+2.8) passed, 8.8% (-3.2) unstable, 0.4% (+0.4)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 22 doc and www builds (100% (+0) passed)

Test case status (on 2020-07-26 23:59):
| Branch/Architecture | Total  | Pass   | Fail  | Skipped  |
| --- | -- | -- | - |  |
| head/amd64  | 7872 (+13) | 7782 (+14) | 0 (0) | 90 (-1)  |
| head/i386   | 7870 (+13) | 7770 (+11) | 0 (0) | 100 (+2) |
| 12-STABLE/amd64 | 7619 (+2)  | 7562 (+5)  | 0 (0) | 57 (-3)  |
| 12-STABLE/i386  | 7617 (+2)  | 7549 (-1)  | 0 (0) | 68 (+3)  |
| 11-STABLE/amd64 | 6912 (0)   | 6858 (-3)  | 0 (0) | 54 (+3)  |
| 11-STABLE/i386  | 6910 (0)   | 6857 (+3)  | 0 (0) | 53 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200726 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

  From kevans@:
  one of ncurses' scripts that generates box and a bunch of other symbols is 
shooting blanks with gcc6, however it seems fine on gcc9.

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  

FreeBSD CI Weekly Report 2020-07-19

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-07-19
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-07-13 to 2020-07-19.

During this period, we have:

* 1699 builds (93.3% (-2.4) passed, 6.7% (+2.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 191 test runs (88.0% (+1.3) passed, 12.0% (+0) unstable, 0% (-1.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 36 doc and www builds (100% (+0) passed)

Test case status (on 2020-07-19 23:59):
| Branch/Architecture | Total| Pass  | Fail  | Skipped |
| --- |  | - | - | --- |
| head/amd64  | 7859 (0) | 7768 (+1) | 0 (0) | 91 (-1) |
| head/i386   | 7857 (0) | 7759 (+1) | 0 (0) | 98 (-1) |
| 12-STABLE/amd64 | 7617 (0) | 7557 (0)  | 0 (0) | 60 (0)  |
| 12-STABLE/i386  | 7615 (0) | 7550 (+3) | 0 (0) | 65 (-3) |
| 11-STABLE/amd64 | 6912 (0) | 6861 (0)  | 0 (0) | 51 (0)  |
| 11-STABLE/i386  | 6910 (0) | 6854 (0)  | 0 (0) | 56 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200719 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.


## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

  From kevans@:
  one of ncurses' scripts that generates box and a bunch of other symbols is 
shooting blanks with gcc6, however it seems fine on gcc9.

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* 

FreeBSD CI Weekly Report 2020-07-12

[Li-Wen Hsu]

FreeBSD CI Weekly Report 2020-07-12
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-07-06 to 2020-07-12.

During this period, we have:

* 1964 builds (95.7% (+0.0) passed, 4.3% (+0.0) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 225 test runs (86.7% (-4.7) passed, 13.3% (+6.1) unstable, 0.0% (-1.4)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 36 doc and www builds (100% (+4.3) passed)

Test case status (on 2020-07-12 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7859 (+2) | 7767 (+5) | 0 (0) | 92 (-3) |
| head/i386   | 7857 (+2) | 7758 (+5) | 0 (0) | 99 (-3) |
| 12-STABLE/amd64 | 7617 (0)  | 7557 (+1) | 0 (0) | 60 (-1) |
| 12-STABLE/i386  | 7615 (0)  | 7547 (+1) | 0 (0) | 68 (-1) |
| 11-STABLE/amd64 | 6912 (0)  | 6861 (0)  | 0 (0) | 51 (0)  |
| 11-STABLE/i386  | 6910 (0)  | 6854 (-3) | 0 (0) | 56 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200712 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
  https://bugs.freebsd.org/244732

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* 

FreeBSD CI Weekly Report 2020-07-05

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-07-05
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-06-29 to 2020-07-05.

During this period, we have:

* 1899 builds (95.7% (+1.3) passed, 4.3% (-1.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 221 test runs (91.4% (+2.3) passed, 7.2% (-3.0) unstable, 1.4% (+0.7)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 23 doc and www builds (95.7% (-0.3) passed, 4.3% (+0.3) failed)

Test case status (on 2020-07-05 23:59):
| Branch/Architecture | Total  | Pass   | Fail  | Skipped  |
| --- | -- | -- | - |  |
| head/amd64  | 7857 (0)   | 7762 (-4)  | 0 (0) | 95 (+4)  |
| head/i386   | 7855 (0)   | 7753 (-1)  | 0 (0) | 102 (+1) |
| 12-STABLE/amd64 | 7617 (+24) | 7556 (+21) | 0 (0) | 61 (+3)  |
| 12-STABLE/i386  | 7615 (+24) | 7546 (+21) | 0 (0) | 69 (+3)  |
| 11-STABLE/amd64 | 6912 (+24) | 6861 (+24) | 0 (0) | 51 (0)   |
| 11-STABLE/i386  | 6910 (+24) | 6857 (+24) | 0 (0) | 53 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200705 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is 
welcome.https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 647 failures, 825 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  

FreeBSD CI Weekly Report 2020-06-28

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-06-28
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-06-22 to 2020-06-28.

During this period, we have:

* 2388 builds (94.4% (+0.5) passed, 5.6% (-0.5) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 283 test runs (89.1% (+9.3) passed, 10.2% (-2.9) unstable, 0.7% (-6.4)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 96.0 doc and www builds (96.0% (-4.0) passed, 4.0% (+4.0) failed)

Test case status (on 2020-xx-xx 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped  |
| --- | - | - | - |  |
| head/amd64  | 7857 (-6) | 7766 (+2) | 0 (0) | 91 (-8)  |
| head/i386   | 7855 (-6) | 7754 (-2) | 0 (0) | 101 (-4) |
| 12-STABLE/amd64 | 7593 (+2) | 7535 (+3) | 0 (0) | 58 (-1)  |
| 12-STABLE/i386  | 7591 (+2) | 7525 (0)  | 0 (0) | 66 (+2)  |
| 11-STABLE/amd64 | 6888 (+1) | 6837 (+3) | 0 (0) | 51 (-2)  |
| 11-STABLE/i386  | 6886 (+1) | 6833 (0)  | 0 (0) | 53 (+1)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200628 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Fixed test cases

* bin.sh.execution.functional_test.bg12
  https://bugs.freebsd.org/247559

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 646 failures, 826 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* 

Re: weird Ctrl-T debug messages

[Li-Wen Hsu]

On Sat, Jun 27, 2020 at 3:04 PM Hartmann, O.  wrote:
>
> Running poudriere on recent CURRENT with (recent) 12-STABLE and CURRENT
> jails reveals a weird behaviour recently when hitting Ctrl-T:
...
> Is this debug fallout from /bin/sh?

It's because kern.tty_info_kstacks is on by default now:

https://svnweb.freebsd.org/changeset/base/362141

Li-Wen
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2020-06-21

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-06-21
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-06-15 to 2020-06-21.

During this period, we have:

* 2272 builds (93.9% (+3.9) passed, 6.1% (-3.9) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 268 test runs (79.8% (+1.9) passed, 13.1% (-7.5) unstable, 7.1% (+5.6)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 100.0 doc and www builds (100% (+3.4) passed)

Test case status (on 2020-06-21 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped  |
| --- | - | - | -- |  |
| head/amd64  | 7863 (0)  | 7764 (-9) | 0 (0)  | 99 (+9)  |
| head/i386   | 7861 (0)  | 7756 (-6) | 0 (0)  | 105 (+6) |
| 12-STABLE/amd64 | 7591 (+4) | 7532 (+4) | 0 (0)  | 59 (0)   |
| 12-STABLE/i386  | 7589 (+4) | 7525 (+4) | 0 (0)  | 64 (0)   |
| 11-STABLE/amd64 | 6887 (+2) | 6834 (0)  | 0 (-1) | 53 (+3)  |
| 11-STABLE/i386  | 6885 (+2) | 6833 (+3) | 0 (-1) | 52 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200621 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 646 failures, 826 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* 

FreeBSD CI Weekly Report 2020-06-14

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-06-14
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-06-08 to 2020-06-14.

During this period, we have:

* 1798 builds (90.0% (+1.4) passed, 10.0% (-1.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 199 test runs (77.9% (+1.1) passed, 20.6% (-0.1) unstable, 1.5% (-1.0)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 29 doc and www builds (96.6% (-3.4) passed, 3.4% (+3.4) failed)

Test case status (on 2020-06-14 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7863 (+30) | 7773 (+32) | 0 (+0) | 90 (-2) |
| head/i386   | 7861 (+30) | 7762 (+27) | 0 (+0) | 99 (+3) |
| 12-STABLE/amd64 | 7587 (+1)  | 7528 (+1)  | 0 (+0) | 59 (+0) |
| 12-STABLE/i386  | 7585 (+1)  | 7521 (+4)  | 0 (+0) | 64 (-3) |
| 11-STABLE/amd64 | 6885 (+2)  | 6835 (+5)  | 0 (+0) | 50 (-3) |
| 11-STABLE/i386  | 6883 (+2)  | 6831 (+2)  | 0 (+0) | 52 (+0) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200614 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  Fix in review: https://reviews.freebsd.org/D25284

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3749 tests, 2277 success, 646 failures, 826 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* 

FreeBSD CI Weekly Report 2020-06-07

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-06-07
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-06-31 to 2020-06-07.

During this period, we have:

* 2077 builds (88.6% (+1.3) passed, 11.4% (-1.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 241 test runs (76.8% (-10.5) passed, 20.7% (+20.7) unstable, 2.5% (-10.2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 52 doc and www builds (100% (+0) passed)

Test case status (on 2020-06-07 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped |
| --- | - | - | -- | --- |
| head/amd64  | 7833 (+3) | 7741 (+1) | 0 (+0) | 92 (+2) |
| head/i386   | 7831 (+3) | 7735 (+4) | 0 (+0) | 96 (-1) |
| 12-STABLE/amd64 | 7586 (+0) | 7527 (-3) | 0 (+0) | 59 (+3) |
| 12-STABLE/i386  | 7584 (+0) | 7517 (-3) | 0 (+0) | 67 (+3) |
| 11-STABLE/amd64 | 6883 (+0) | 6830 (-3) | 0 (+0) | 53 (+3) |
| 11-STABLE/i386  | 6881 (+0) | 6829 (+3) | 0 (+0) | 52 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200607 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (0), 579 failures (0), 806 skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  

FreeBSD CI Weekly Report 2020-05-31

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-05-31
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-05-25 to 2020-05-31.

During this period, we have:

* 1877 builds (87.3% (-7.3) passed, 12.7% (+7.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 217 test runs (78.8% (+18.9) passed, 20.3% (-11.6) unstable, 0.9% (-7.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 12 doc and www builds (100% (+0) passed)

Test case status (on 2020-05-31 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped |
| --- | - | - | -- | --- |
| head/amd64  | 7830 (+1) | 7740 (+4) | 0 (+0) | 90 (-3) |
| head/i386   | 7828 (+1) | 7731 (+1) | 0 (+0) | 97 (+0) |
| 12-STABLE/amd64 | 7586 (+3) | 7530 (+4) | 0 (+0) | 56 (-1) |
| 12-STABLE/i386  | 7584 (+3) | 7520 (+4) | 0 (+0) | 64 (-1) |
| 11-STABLE/amd64 | 6883 (+0) | 6833 (+3) | 0 (+0) | 50 (-3) |
| 11-STABLE/i386  | 6881 (+0) | 6826 (-3) | 0 (+0) | 55 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200531 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (0), 579 failures (0), 806 skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  

FreeBSD CI Weekly Report 2020-05-24

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-05-24
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-05-18 to 2020-05-24.

During this period, we have:

* 2064 builds (94.6% (0) passed, 5.4% (0) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 232 test runs (59.9% (+18.8) passed, 27.6% (-6.3) unstable, 12.5% (-12.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 40 doc and www builds (100% (+3.0) passed)

Test case status (on 2020-05-24 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7829 (+1)  | 7736 (-1)  | 0 (-1) | 93 (+3) |
| head/i386   | 7827 (+1)  | 7730 (+5)  | 0 (0)  | 97 (-4) |
| 12-STABLE/amd64 | 7583 (+41) | 7526 (+42) | 0 (0)  | 57 (-1) |
| 12-STABLE/i386  | 7581 (+41) | 7516 (+45) | 0 (0)  | 65 (-4) |
| 11-STABLE/amd64 | 6883 (0)   | 6830 (0)   | 0 (0)  | 53 (0)  |
| 11-STABLE/i386  | 6881 (0)   | 6829 (0)   | 0 (0)  | 52 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200524 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* Compression algorithm of disk images at https://artifacts.ci.freebsd.org has 
been changed to zstd.

## Fixed test cases

* sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 
after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (0), 579 failures (0), 806 skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 

FreeBSD CI Weekly Report 2020-05-17

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-05-17
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-05-11 to 2020-05-17.

During this period, we have:

* 1977 builds (94.6% (+2.5) passed, 5.4% (-2.5) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 236 test runs (41.1% (+17.4) passed, 33.9% (-1.1) unstable, 25.0% (-16.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 33 doc and www builds (97.0% (+17.6) passed, 3.0% (-17.6) failed)

Test case status (on 2020-05-17 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped  |
| --- | -- | -- | --- |  |
| head/amd64  | 7828 (+46) | 7737 (+45) | 1 (+1)  | 90 (0)   |
| head/i386   | 7826 (+46) | 7725 (+43) | 0 (0)   | 101 (+3) |
| 12-STABLE/amd64 | 7542 (+21) | 7484 (+24) | 0 (0)   | 58 (-3)  |
| 12-STABLE/i386  | 7540 (+21) | 7471 (+18) | 0 (0)   | 69 (+3)  |
| 11-STABLE/amd64 | 6883 (0)   | 6830 (-3)  | 0 (-1)  | 53 (+4)  |
| 11-STABLE/i386  | 6881 (0)   | 6829 (+13) | 0 (-14) | 52 (+1)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200517 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* (new) lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on 
amd64 after r360915
  https://bugs.freebsd.org/246537

* (head, stable/12, stable/11) 2 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158
  Will be fixed after r360807 merged to stable/12.

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (0), 579 failures (0), 806 skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  

FreeBSD CI Weekly Report 2020-05-10

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-05-10
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-05-04 to 2020-05-10.

During this period, we have:

* 2003 builds (92.1% (-1.5) passed, 7.9% (+1.5) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 283 test runs (23.7% (-44.5) passed, 35.0% (+6.9) unstable, 41.3% (+37.6)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 68 doc and www builds (79.4% (-5.2) passed, 20.6% (+5.2) failed)

Test case status (on 2020-05-10 23:59):
| Branch/Architecture | Total | Pass   | Fail | Skipped |
| --- | - | -- |  | --- |
| head/amd64  | 7782 (+4) | 7692 (+7)  | 0 (0)| 90 (-3) |
| head/i386   | 7780 (+4) | 7682 (+6)  | 0 (0)| 98 (-2) |
| 12-STABLE/amd64 | 7521 (0)  | 7460 (-3)  | 0 (-2)   | 61 (+5) |
| 12-STABLE/i386  | 7519 (0)  | 7453 (0)   | 0 (-2)   | 66 (+2) |
| 11-STABLE/amd64 | 6883 (0)  | 6833 (-1)  | 1 (+1)   | 49 (0)  |
| 11-STABLE/i386  | 6881 (0)  | 6816 (-14) | 14 (+14) | 51 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200510 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* Several non-x86 jobs for -head are added:
  * https://ci.freebsd.org/job/FreeBSD-head-aarch64-test/
  * https://ci.freebsd.org/job/FreeBSD-head-armv7-test/
  * https://ci.freebsd.org/job/FreeBSD-head-mips64-test/
  * https://ci.freebsd.org/job/FreeBSD-head-powerpc64-test/
  Most of the work are done by trasz@
  These jobs will be scheduled to run at least once a day after the dedicated 
VM host has been setup.

## Fixed test cases

* lib.libproc.proc_test.symbol_lookup
  Fixed in https://svnweb.freebsd.org/changeset/base/360979

## Fixed and fixed test cases

* lib.atf.* and libexec.atf.* on stable/11
  Failed after llvm9 merged, fixed after build 
https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2662/ with fixeds merged.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* (head, stable/12, stable/11) 3 tests start failing after llvm10 import
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158
  Will be fixed after r360807 merged to stable/12.

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (0), 579 failures (0), 806 skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* 

FreeBSD CI Weekly Report 2020-05-03

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-05-03
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-04-27 to 2020-05-03.

During this period, we have:

* 2099 builds (93.6% (-0.8) passed, 6.4% (+0.8) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 327 test runs (68.2% (+5.7) passed, 28.1% (-6.7) unstable, 3.7% (+1.0)
  exception) were executed on amd64, i386, riq scv64 architectures for head,
  stable/12, stable/11 branches.
* 26 doc and www builds (84.6% (+0.4) passed, 15.4% (-0.4) failed)

Test case status (on 2020-05-03 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped  |
| --- | -- | -- | -- |  |
| head/amd64  | 7778 (+10) | 7685 (+10) | 0 (0)  | 93 (0)   |
| head/i386   | 7776 (+10) | 7676 (+11) | 0 (0)  | 100 (-1) |
| 12-STABLE/amd64 | 7521 (+3)  | 7463 (+1)  | 2 (+2) | 56 (0)   |
| 12-STABLE/i386  | 7519 (+3)  | 7453 (+1)  | 2 (+2) | 64 (0)   |
| 11-STABLE/amd64 | 6883 (0)   | 6834 (0)   | 0 (0)  | 49 (0)   |
| 11-STABLE/i386  | 6881 (0)   | 6830 (0)   | 0 (0)  | 51 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200503 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Fixed tests

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229
  Fixed in r360567

* sys.netipsec.tunnel.empty.v{4,6} fail after r359374
  https://bugs.freebsd.org/245832
  Fixed in r360560

## Failing (and fixed) jobs

* https://ci.freebsd.org/job/FreeBSD-head-powerpc-build/
  https://ci.freebsd.org/job/FreeBSD-head-powerpcspe-build/
  Failing after r360569 and fixed in r360788

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* (head, stable/12) 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 806 skipped 
(0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* 

FreeBSD CI Weekly Report 2020-04-26

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-04-26
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-04-20 to 2020-04-26.

During this period, we have:

* 2503 builds (94.4% (+5.1) passed, 5.6% (-5.1) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 402 test runs (62.5% (+20.5) passed, 34.8% (-21.1) unstable, 2.7% (+0.6)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 19 doc and www builds (84.2% (-10.8) passed, 15.8% (+10.8) failed)

Test case status (on 2020-04-26 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped  |
| --- | -- | -- | -- |  |
| head/amd64  | 7768 (+12) | 7675 (+18) | 0 (-5) | 93 (-1)  |
| head/i386   | 7766 (+12) | 7665 (+19) | 0 (-8) | 101 (+1) |
| 12-STABLE/amd64 | 7518 (0)   | 7462 (0)   | 0 (0)  | 56 (0)   |
| 12-STABLE/i386  | 7516 (0)   | 7452 (0)   | 0 (0)  | 64 (0)   |
| 11-STABLE/amd64 | 6883 (+1)  | 6834 (+4)  | 0 (0)  | 49 (-3)  |
| 11-STABLE/i386  | 6881 (+1)  | 6830 (+4)  | 0 (0)  | 51 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200426 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Fixed tests

* sys.netpfil.common.*
  Fixed by patching scapy, more details:
  https://lists.freebsd.org/pipermail/freebsd-testing/2020-April/002278.html

* timer tests of sys.kqueue.libkqueue.kqueue_test.main failing on i386
  https://bugs.freebsd.org/245768
  This is fixed in r360108 and r360140, and the case found another issue in 
compat32, which is fixed in r360155.

* sys.opencrypto.blake2_test.blake2{b,s}_vectors_x86 failed after r359374
  https://bugs.freebsd.org/245825
  test cases are fixed in r360203

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158
  
* sys.netipsec.tunnel.empty.v{4,6} fail after r359374
  https://bugs.freebsd.org/245832
  This is probably some sort of regression (of null cipher) in r359374

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 806 skipped 
(0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  

FreeBSD CI Weekly Report 2020-04-19

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-04-19
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-04-13 to 2020-04-19.

During this period, we have:

* 2136 builds (89.3% (-4.7) passed, 10.7% (+4.7) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 333 test runs (42.0% (+17.0) passed, 55.9% (+26.0) unstable, 2.1% (-43.0)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 20 doc and www builds (95.0% (+11.7) passed, 5.0% (-11.7) failed)

Test case status (on 2020-04-19 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped  |
| --- | -- | -- | --- |  |
| head/amd64  | 7756 (+12) | 7657 (+19) | 5 (-9)  | 94 (+2)  |
| head/i386   | 7754 (+12) | 7646 (+18) | 8 (-8)  | 100 (+2) |
| 12-STABLE/amd64 | 7518 (+10) | 7462 (+13) | 0 (-1)  | 56 (-2)  |
| 12-STABLE/i386  | 7516 (+10) | 7452 (+27) | 0 (-2)  | 64 (-15) |
| 11-STABLE/amd64 | 6882 (0)   | 6830 (+1)  | 0 (-1)  | 52 (0)   |
| 11-STABLE/i386  | 6880 (0)   | 6826 (+77) | 0 (-80) | 54 (+3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200419 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o):
 in function `curses::Window::Box(unsigned int, unsigned int)':
  
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361:
 undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Failing tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
  * local.kyua.integration.cmd_about_test.topic__authors__installed
  * sys.netipsec.tunnel.empty.v4
  * sys.netipsec.tunnel.empty.v6
  * sys.opencrypto.blake2_test.blake2b_vectors_x86
  * sys.opencrypto.blake2_test.blake2s_vectors_x86

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
  All amd64 failures and:
  * sys.kqueue.libkqueue.kqueue_test.main
  * sys.netinet.divert.ipdivert_ip_input_local_success
  * sys.netinet.divert.ipdivert_ip_output_remote_success

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 806 skipped 
(0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  

Re: xtoolchain-llvm10 missing?

[Li-Wen Hsu]

On Sat, Apr 18, 2020 at 11:15 PM Ronald Klop  wrote:
>
> Hi,
>
> Building CURRENT on my laptop takes very very long because every little
> change in llvm/clang makes it recompile a complete compiler. So I want to
> build with CROSS_TOOLCHAIN=xtoolchain-llvm10 (10.0) and
> WITHOUT_TOOLCHAIN=yes.
> In ports/pkgs the most recent versions I see are xtoolchain-llvm90 or
> xtoolchain-llvm-devel (11.0?).
> Is xtoolchain-llvm10 missing on purpose?

I guess you want something like CROSS_TOOLCHAIN=llvm10, and

/usr/local/share/toolchains/llvm10.mk
/usr/local/share/toolchains/llvm-devel.mk

Are installed by llvm10 and llvm-devel now.

Best,
Li-Wen
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: Outdated jemalloc in CURRENT

[Li-Wen Hsu]

On Sat, Apr 18, 2020 at 11:22 PM Steve Kargl
 wrote:
>
> On Sat, Apr 18, 2020 at 05:01:08PM +0200, Gordon Bergling wrote:
> >
> > On Sat, Apr 18, 2020 at 07:20:03AM -0700, Steve Kargl wrote:
> >> On Sat, Apr 18, 2020 at 03:05:25PM +0300, nonamel...@ukr.net wrote:
> >>> Hi everyone!
> >>>
> >>> As I see, CURRENT still uses outdated jemalloc 5.1.0 with some
> >>> performance regressions that was fixed in 5.2.1.
> >>>
> >>> Are there some issues that blocking update jemalloc to recent version?
> >>>
> >>
> >> 
> >> r354606 | jasone | 2019-11-10 21:06:49 -0800 (Sun, 10 Nov 2019) | 4 lines
> >>
> >> Revert r354605: Update jemalloc to version 5.2.1.
> >>
> >> Compilation fails for non-llvm-based platforms.
> >>
> >> 
> >> r354605 | jasone | 2019-11-10 19:27:14 -0800 (Sun, 10 Nov 2019) | 2 lines
> >>
> >> Update jemalloc to version 5.2.1.
> >>
> >
> > I am not sure, that this info is correct. As far as I remember the
> > update for jemalloc was reverted due to build problems, on some
> > architecture. An updated revision has still to be commited to -CURRENT.
> >
>
> Those two commits confirm your memory.  5.2.1 was committed
> in r354605.  5.2.1 was reverted with r354606 where the reason
> for reverting is stated.  As 5.2.1 has not been re-committed
> and there is nothing in reviews.freebsd.org for review, one
> may expect the reason in r354606 still stands.
>
> PS: Please, do not top-post.
> PPS: Please, wrap your messages to something less than 80 characters.

I think it's fine to (and hope we can) update it again as the previous
error was on outdated gcc which is not existing anymore:

https://lists.freebsd.org/pipermail/svn-src-all/2020-March/195013.html

Li-Wen
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2020-04-12

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-04-12
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-04-06 to 2020-04-12.

During this period, we have:

* 1801 builds (94.0% (+0.4) passed, 6.0% (-0.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 288 test runs (25.1% (-24.6) passed, 29.9% (+10.6) unstable, 45.1% (+14.1)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 30 doc and www builds (83.3% (-1.3) passed, 16.7% (+1.3) failed)

Test case status (on 2020-04-12 23:59):
| Branch/Architecture | Total | Pass   | Fail | Skipped  |
| --- | - | -- |  |  |
| head/amd64  | 7744 (+4) | 7638 (+19) | 14 (+5)  | 92 (-20) |
| head/i386   | 7742 (+4) | 7628 (+15) | 16 (+5)  | 98 (-16) |
| 12-STABLE/amd64 | 7508 (0)  | 7449 (-3)  | 1 (+1)   | 58 (+2)  |
| 12-STABLE/i386  | 7506 (0)  | 7425 (-17) | 2 (+2)   | 79 (+15) |
| 11-STABLE/amd64 | 6882 (0)  | 6829 (-6)  | 1 (+1)   | 52 (+5)  |
| 11-STABLE/i386  | 6880 (0)  | 6749 (-82) | 80 (+80) | 51 (+2)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200412 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* The test env now loads the required module for firewall tests.

* New armv7 job is added (to replace armv6 one):
  * FreeBSD-head-armv7-testvm
  The images are available at https://artifact.ci.freebsd.org
  FreeBSD-head-armv7-test is ready but needs test env update.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  * See console log for the error details.

## Failing tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
  * local.kyua.integration.cmd_about_test.topic__authors__installed
  * sys.netipsec.tunnel.empty.v4
  * sys.netipsec.tunnel.empty.v6
  * sys.netpfil.common.forward.ipf_v4
  * sys.netpfil.common.forward.ipfw_v4
  * sys.netpfil.common.forward.pf_v4
  * sys.netpfil.common.tos.ipfw_tos
  * sys.netpfil.common.tos.pf_tos
  * sys.netpfil.pf.forward.v4
  * sys.netpfil.pf.set_tos.v4
  * sys.opencrypto.blake2_test.blake2b_vectors_x86
  * sys.opencrypto.blake2_test.blake2s_vectors_x86

  * sbin.nvmecontrol.basic.__test_cases_list__
Fixed in r359903
  * usr.bin.calendar.legacy_test.main
Fixed in r359862

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
  All amd64 failures and:
  * sys.netinet.divert.ipdivert_ip_input_local_success
  * sys.netinet.divert.ipdivert_ip_output_remote_success

* https://ci.freebsd.org/job/FreeBSD-stable-12-amd64-test/
  * usr.bin.calendar.legacy_test.main
Fixed in r359863
  * sbin.nvmecontrol.basic.__test_cases_list__
Fixed in r359904

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
  * usr.bin.calendar.legacy_test.main
Fixed in r359863

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
  * usr.bin.calendar.legacy_test.main
Fixed in r359864

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
  Many failure all due to kyua.conf issue.  Already fixed on 2020-04-13.

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* 

FreeBSD CI Weekly Report 2020-04-05

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-04-05
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-03-30 to 2020-04-05.

During this period, we have:

* 1715 builds (93.6% (+0.1) passed, 6.4% (-0.1) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 274 test runs (49.7% (-4.6) passed, 19.3% (-24.4) unstable, 31.0% (+29.0)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 26 doc and www builds (84.6 (-10.6) passed, 15.4% (+10.6) failed)

Test case status (on 2020-04-05 23:59):
| Branch/Architecture | Total | Pass  | Fail| Skipped  |
| --- | - | - | --- |  |
| head/amd64  | 7740 (+4) | 7619 (-6) | 9 (+4)  | 112 (+6) |
| head/i386   | 7738 (+4) | 7613 (-4) | 11 (+6) | 114 (+2) |
| 12-STABLE/amd64 | 7508 (+2) | 7452 (+2) | 0 (0)   | 56 (0)   |
| 12-STABLE/i386  | 7506 (+2) | 7442 (-1) | 0 (0)   | 64 (+3)  |
| 11-STABLE/amd64 | 6882 (+2) | 6835 (+5) | 0 (0)   | 47 (-3)  |
| 11-STABLE/i386  | 6880 (+2) | 6831 (+5) | 0 (0)   | 49 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200405 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* New armv6 job is added:
  * FreeBSD-head-armv6-testvm
  The images are available at https://artifact.ci.freebsd.org

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  * See console log for the error details.

## Failing tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
  Some test cases not correctly skipped because test env loads the
  wrong kyua.conf after kyua imported to the base.
  * lib.libproc.proc_test.symbol_lookup
  * lib.msun.ctrig_test.test_inf_inputs
  * local.kyua.integration.cmd_about_test.topic__authors__installed
  * sys.kern.ptrace_test.ptrace__parent_wait_after_attach
  * sys.netipsec.tunnel.empty.v4
  * sys.netipsec.tunnel.empty.v6
  * sys.opencrypto.blake2_test.blake2b_vectors_x86
  * sys.opencrypto.blake2_test.blake2s_vectors_x86
  * usr.bin.calendar.legacy_test.main

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
  All amd64 failures and:
  * sys.kern.ptrace_test.ptrace__parent_exits_before_child
  * sys.net.if_lagg_test.witness

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 806 skipped 
(0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* 

FreeBSD CI Weekly Report 2020-03-29

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-03-29
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-03-23 to 2020-03-29.

During this period, we have:

* 1811 builds (93.5% (+2.8) passed, 6.5% () failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 293 test runs (54.3% (-41.1) passed, 43.7% (+40.4) unstable, 2.0% (+0.7)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 21 doc and www builds (95.2% (+16.4) passed, 4.8 (-16.4) failed)

Test case status (on 2020-03-29 23:59):
| Branch/Architecture | Total  | Pass  | Fail   | Skipped  |
| --- | -- | - | -- |  |
| head/amd64  | 7736 (+14) | 7625 (0)  | 5 (+5) | 106 (+9) |
| head/i386   | 7734 (+14) | 7617 (+3) | 5 (+5) | 112 (+6) |
| 12-STABLE/amd64 | 7506 (0)   | 7450 (-3) | 0 (0)  | 56 (+3)  |
| 12-STABLE/i386  | 7504 (0)   | 7443 (+3) | 0 (0)  | 61 (-3)  |
| 11-STABLE/amd64 | 6880 (0)   | 6830 (-3) | 0 (0)  | 50 (+3)  |
| 11-STABLE/i386  | 6878 (0)   | 6826 (0)  | 0 (0)  | 52 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200329 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* After [r359233](https://svnweb.freebsd.org/changeset/base/359233),
  all the supported architectures are using clang/lld as default toolchain,
  and [CI.FreeBSD.org 
follows](https://github.com/freebsd/freebsd-ci/commit/5e8704617365488891576e27d4325e0474bc90de).
  Now FreeBSD-head-mips64-build job is fine but please note that using
  mips64-gcc6 as external toolchain still fails.

* Two powerpc64 jobs are added:
  * FreeBSD-head-powerpc64-images
  * FreeBSD-head-powerpc64-testvm
  The images are available at https://artifact.ci.freebsd.org

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-mips64-build (now switched to 
clang/lld, gcc6 build will be moved to FreeBSD-head-mips64-gcc6_build)
  This error was encountered when this job was using devel/gcc6@mips64 port 
(mips64-gcc6 pacakge)
  This job was switched to use clang/lld on 2020-03-24. Gcc job will be added 
later.
  ```
  ===> include/rpcsvc (includes)
  RPCGEN_CPP=/usr/local/bin/mips64-unknown-freebsd12.0-cpp6\ 
--sysroot=/usr/home/lwhsu/freebsd-obj-gcc6/usr/home/lwhsu/freebsd-src/mips.mips64/tmp\
 -B/usr/local/mips64-unknown-freebsd12.0/bin/ rpcgen -C -h -DWANT_NFS3 
/usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x -o mount.h
  /usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x:1:0: error: '-march=mips1' 
is not compatible with the selected ABI
   /*-
 
  *** [mount.h] Error code 1

  make[4]: stopped in /usr/home/lwhsu/freebsd-src/include/rpcsvc
  1 error
  ```

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  --- all_subdir_usr.bin/clang/lldb ---
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandler.o): in 
function `curses::Window::Box(unsigned int, unsigned int)':
  /workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* 

FreeBSD CI Weekly Report 2020-03-22

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)a

FreeBSD CI Weekly Report 2020-03-22
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-03-16 to 2020-03-22.

During this period, we have:

* 1907 builds (90.7% (+0.6) passed, 9.3% (-0.6) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 307 test runs (95.4% (+20.3) passed, 3.3% (-13.8) unstable, 1.3% (-6.5
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 33 doc and www builds (78.8% (-9.4) passed, 21.2 (+9.4) failed)

Test case status (on 2020-03-22 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7722 (+1) | 7625 (+1) | 0 (0) | 97 (0)  |
| head/i386   | 7720 (+1) | 7614 (+1) | 0 (0) | 106 (0) |
| 12-STABLE/amd64 | 7506 (0)  | 7453 (0)  | 0 (0) | 53 (0)  |
| 12-STABLE/i386  | 7504 (0)  | 7440 (-3) | 0 (0) | 64 (+3) |
| 11-STABLE/amd64 | 6880 (0)  | 6833 (0)  | 0 (0) | 47 (0)  |
| 11-STABLE/i386  | 6878 (0)  | 6826 (0)  | 0 (0) | 52 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200322 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-mips64-build
  This error was encountered when this job was using devel/gcc6@mips64 port 
(mips64-gcc6 pacakge)
  This job was switched to use clang/lld on 2020-03-24. Gcc job will be added 
later.
  ```
  ===> include/rpcsvc (includes)
  RPCGEN_CPP=/usr/local/bin/mips64-unknown-freebsd12.0-cpp6\ 
--sysroot=/usr/home/lwhsu/freebsd-obj-gcc6/usr/home/lwhsu/freebsd-src/mips.mips64/tmp\
 -B/usr/local/mips64-unknown-freebsd12.0/bin/ rpcgen -C -h -DWANT_NFS3 
/usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x -o mount.h
  /usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x:1:0: error: '-march=mips1' 
is not compatible with the selected ABI
   /*-
 
  *** [mount.h] Error code 1

  make[4]: stopped in /usr/home/lwhsu/freebsd-src/include/rpcsvc
  1 error
  ```

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  --- all_subdir_usr.bin/clang/lldb ---
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandler.o): in 
function `curses::Window::Box(unsigned int, unsigned int)':
  /workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 

FreeBSD CI Weekly Report 2020-03-15

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-03-15
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-03-09 to 2020-03-15.

During this period, we have:

* 1903 builds (90.1% (+41.9) passed, 9.9% (-41.9) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 293 test runs (75.1% (-12.4) passed, 17.1% (+12.9) unstable, 7.8% (-0.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 34 doc and www builds (88.2% (+5.4) passed, 11.8 (-5.4) failed)

Test case status (on 2020-03-15 23:59):
| Branch/Architecture | Total  | Pass  | Fail  | Skipped  |
| --- | -- | - | - |  |
| head/amd64  | 7721 (+12) | 7624 (+7) | 0 (0) | 97 (+5)  |
| head/i386   | 7719 (+12) | 7613 (+4) | 0 (0) | 106 (+8) |
| 12-STABLE/amd64 | 7506 (+5)  | 7453 (+1) | 0 (0) | 53 (+4)  |
| 12-STABLE/i386  | 7504 (+5)  | 7443 (+1) | 0 (0) | 61 (+4)  |
| 11-STABLE/amd64 | 6880 (+2)  | 6833 (+2) | 0 (0) | 47 (0)   |
| 11-STABLE/i386  | 6878 (+2)  | 6826 (+2) | 0 (0) | 52 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200315 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* https://ci.freebsd.org/job/FreeBSD-head-mips64-build
  This job is using devel/gcc6@mips64 port (mips64-gcc6 pacakge)
  ```
  ===> include/rpcsvc (includes)
  RPCGEN_CPP=/usr/local/bin/mips64-unknown-freebsd12.0-cpp6\ 
--sysroot=/usr/home/lwhsu/freebsd-obj-gcc6/usr/home/lwhsu/freebsd-src/mips.mips64/tmp\
 -B/usr/local/mips64-unknown-freebsd12.0/bin/ rpcgen -C -h -DWANT_NFS3 
/usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x -o mount.h
  /usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x:1:0: error: '-march=mips1' 
is not compatible with the selected ABI
   /*-
 
  *** [mount.h] Error code 1

  make[4]: stopped in /usr/home/lwhsu/freebsd-src/include/rpcsvc
  1 error
  ```

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  --- all_subdir_usr.bin/clang/lldb ---
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandler.o): in 
function `curses::Window::Box(unsigned int, unsigned int)':
  /workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  collect2: error: ld returned 1 exit status
  ```

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test
  Usually panics when executing sys.netpfil.pf.nat.exhaust
  For more details: https://bugs.freebsd.org/244703

## Regressions

* 3 tests start failing after llvm10 import
* lib.libproc.proc_test.symbol_lookup
* lib.msun.ctrig_test.test_inf_inputs
  https://bugs.freebsd.org/244732
* (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
  https://bugs.freebsd.org/244823

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d
* https://bugs.freebsd.org/244823

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/

FreeBSD CI Weekly Report 2020-03-08

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-03-08
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-03-02 to 2020-03-08.

During this period, we have:

* 2239 builds (48.2% (-39.2) passed, 51.8 (+39.2) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 120 test runs (87.5% (+10.0) passed, 4.2% (-17.3) unstable, 8.3% (+7.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 29 doc and www builds (82.8% (-11.3) passed, 17.2% (+11.3) failed)

Test case status (on 2020-03-08 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7709 (+10) | 7617 (+19) | 0 (-9) | 92 (0)  |
| head/i386   | 7707 (+10) | 7609 (+19) | 0 (-9) | 98 (0)  |
| 12-STABLE/amd64 | 7501 (0)   | 7452 (0)   | 0 (0)  | 49 (0)  |
| 12-STABLE/i386  | 7499 (0)   | 7442 (0)   | 0 (0)  | 57 (0)  |
| 11-STABLE/amd64 | 6878 (0)   | 6831 (+3)  | 0 (0)  | 47 (-3) |
| 11-STABLE/i386  | 6876 (0)   | 6824 (-3)  | 0 (0)  | 52 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200308 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing jobs

* Most of the build was failed due to pkg repository ABI mismatching. (Fixed)
  For more details: https://bugs.freebsd.org/244549

* https://ci.freebsd.org/job/FreeBSD-head-mips64-build
  This job is using devel/gcc6@mips64 port (mips64-gcc6 pacakge)
  ```
  ===> include/rpcsvc (includes)
  RPCGEN_CPP=/usr/local/bin/mips64-unknown-freebsd12.0-cpp6\ 
--sysroot=/usr/home/lwhsu/freebsd-obj-gcc6/usr/home/lwhsu/freebsd-src/mips.mips64/tmp\
 -B/usr/local/mips64-unknown-freebsd12.0/bin/ rpcgen -C -h -DWANT_NFS3 
/usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x -o mount.h
  /usr/home/lwhsu/freebsd-src/include/rpcsvc/mount.x:1:0: error: '-march=mips1' 
is not compatible with the selected ABI
   /*-
   
  *** [mount.h] Error code 1
  
  make[4]: stopped in /usr/home/lwhsu/freebsd-src/include/rpcsvc
  1 error
  ```

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
  ```
  --- all_subdir_usr.bin/clang/lldb ---
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandler.o): in 
function `curses::Window::Box(unsigned int, unsigned int)':
  /workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  /usr/local/bin/x86_64-unknown-freebsd12.1-ld: 
/workspace/src/contrib/llvm-project/lldb/source/Core/IOHandler.cpp:926: 
undefined reference to `box'
  collect2: error: ld returned 1 exit status
  
  ```

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test
  Usually panics when executing sys.netpfil.pf.nat.exhaust
  For more details: https://bugs.freebsd.org/244703

## Regressions

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 806 skipped 
(0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* 

FreeBSD CI Weekly Report 2020-03-01

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-03-01
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-02-24 to 2020-03-01.

During this period, we have:

* 1930 builds (87.4% (-0.3) passed, 12.6% (+0.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 288 test runs (77.5% (+10.7) passed, 21.5% (-8.8) unstable, 1.0% (-1.9)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 17 doc and www builds (94.1% (-1.9) passed, 5.9% (+1.9) failed)

Test case status (on 2020-03-01 23:59):
| Branch/Architecture | Total| Pass  | Fail   | Skipped |
| --- |  | - | -- | --- |
| head/amd64  | 7699 (0) | 7598 (-3) | 9 (+3) | 92 (0)  |
| head/i386   | 7697 (0) | 7590 (-3) | 9 (+3) | 98 (0)  |
| 12-STABLE/amd64 | 7501 (0) | 7452 (+8) | 0 (0)  | 49 (-8) |
| 12-STABLE/i386  | 7499 (0) | 7442 (-8) | 0 (0)  | 57 (+8) |
| 11-STABLE/amd64 | 6878 (0) | 6828 (-3) | 0 (0)  | 50 (+3) |
| 11-STABLE/i386  | 6876 (0) | 6827 (+3) | 0 (0)  | 49 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200301 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.


## Failed and Fixed tests

* sys.netpfil.pf.fragmentation.v6
  https://bugs.freebsd.org/244393

* 9 sys.audit. tests
  https://bugs.freebsd.org/244537

## Regressions

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2285 success (-5), 579 failures (+5), 806 skipped 
(0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* 

FreeBSD CI Weekly Report 2020-02-23

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-02-23
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-02-17 to 2020-02-23.

During this period, we have:

* 1969 builds (87.7% (-3.0) passed, 12.3% (+3.0) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 307 test runs (66.8% (+6.7) passed, 30.3% (+0.8) unstable, 2.9% (-7.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 50 doc and www builds (96% (-3.0) passed, 4.0% (+3.0) failed)

Test case status (on 2020-02-23 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7699 (-39) | 7601 (-45) | 6 (+6) | 92 (0)  |
| head/i386   | 7697 (-39) | 7593 (-47) | 6 (+6) | 98 (+2) |
| 12-STABLE/amd64 | 7501 (-42) | 7444 (-50) | 0 (0)  | 57 (+8) |
| 12-STABLE/i386  | 7499 (-42) | 7450 (-34) | 0 (0)  | 49 (-8) |
| 11-STABLE/amd64 | 6878 (+7)  | 6831 (+7)  | 0 (0)  | 47 (0)  |
| 11-STABLE/i386  | 6876 (+7)  | 6824 (+4)  | 0 (0)  | 52 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200223 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* FreeBSD-head-sparc64-build has been disabled since 2020-02-20

* Default amd64 GCC build job has been swtich to
  https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build which uses 
devel/amd64-gcc6,
  https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build uses devel/amd64-gcc
  has been deprecated.

## Failed and Fixed tests

* sys.file.flock_test.main panics kernel after [r358153, r358170]
  https://bugs.freebsd.org/244250

## Regressions

* fusefs tests fail when mac_bsdextended.ko is loaded
  https://bugs.freebsd.org/244229

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (0), 2290 success (0), 574 failures (0), 806 skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* 

FreeBSD CI Weekly Report 2020-02-16

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-02-16
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-02-10 to 2020-02-16.

During this period, we have:

* 2180 builds (90.7% (+3.4) passed, 9.3% (-3.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 336 test runs (60.1% (-1.6) passed, 29.5% (+1.4) unstable, 10.4% (-0.2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 33 doc and www builds (97% (+1.0) passed, 3.0% (-1.0) failed)

Test case status (on 2020-02-16 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped  |
| --- | -- | -- | -- |  |
| head/amd64  | 7738 (+65) | 7646 (+49) | 0 (-5) | 92 (+21) |
| head/i386   | 7736 (+65) | 7640 (+45) | 0 (-4) | 96 (+24) |
| 12-STABLE/amd64 | 7543 (+23) | 7494 (+25) | 0 (0)  | 49 (-2)  |
| 12-STABLE/i386  | 7541 (+23) | 7484 (+22) | 0 (0)  | 57 (+1)  |
| 11-STABLE/amd64 | 6871 (+10) | 6824 (+13) | 0 (0)  | 47 (-3)  |
| 11-STABLE/i386  | 6869 (+10) | 6820 (+10) | 0 (0)  | 49 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200216 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Regression

* `dtrace -c` causes program dumps core after somewhere between (r357694, 
r357701]
  https://bugs.freebsd.org/244053
  
* Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386
  https://bugs.freebsd.org/244163
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
  https://bugs.freebsd.org/244168
  Discovered by newly endabled sys.net.* tests. 
([r357857](https://svnweb.freebsd.org/changeset/base/357857))
  
* (test case) sys.geom.class.multipath.misc.fail_on_error (on 12-STABLE)
  https://bugs.freebsd.org/244158

## Fixed tests

* sys.netipsec.tunnel.aes_cbc_128_hmac_sha1.v4
  https://bugs.freebsd.org/244077

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (+0), 2290 success (+13), 574 failures (-13), 806 
skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  https://bugs.freebsd.org/242689
* 

FreeBSD CI Weekly Report 2020-02-09

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-02-09
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-02-03 to 2020-02-09.

During this period, we have:

* 2010 builds (87.3% (+) passed, 12.7% () failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 324 test runs (61.7% (+) passed, 28.1% (-) unstable, 10.2% ()
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 50 doc and www builds (96% (0) passed, 4.0% () failed)

Test case status (on 2020-02-09 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7673 (0)   | 7597 (-7)  | 5 (+4) | 71 (+3) |
| head/i386   | 7671 (0)   | 7595 (-4)  | 4 (+4) | 72 (0)  |
| 12-STABLE/amd64 | 7520 (0)   | 7469 (-3)  | 0 (0)  | 51 (+3) |
| 12-STABLE/i386  | 7518 (0)   | 7462 (+3)  | 0 (0)  | 56 (-3) |
| 11-STABLE/amd64 | 6861 (0)   | 6811 (0)   | 0 (0)  | 50 (0)  |
| 11-STABLE/i386  | 6859 (0)   | 6810 (0)   | 0 (0)  | 49 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200209 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* https://ci.freebsd.org/job/FreeBSD-doc-head/ now includes building htdoc,
  the source of https://www.FreeBSD.org

## Failing builds and tests

* https://ci.freebsd.org/job/FreeBSD-head-mips64-build/

* sys.geom.class.multipath.failloop.failloop

## Failed and fixed tests

* https://ci.freebsd.org/job/FreeBSD-head-mips-build/
  Workaround: disable GOOGLETEST:
  https://svnweb.freebsd.org/changeset/base/357703
  More information is available at https://reviews.freebsd.org/D23128

* i386 boot panics after r357314
  https://bugs.freebsd.org/243837
  Fixed in r357463

* sys.capsicum.capsicum-test.main fails after r357412
  https://bugs.freebsd.org/243839
  Fixed in r357461

* lib.libc.gen.setdomainname_test.setdomainname_basic
* sys.mac.portacl.nobody_test.main
* sys.mac.portacl.root_test.main
  Fixed in https://svnweb.freebsd.org/changeset/base/357745

## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (+0), 2290 success (+13), 574 failures (-13), 806 
skipped (0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  

FreeBSD CI Weekly Report 2020-02-02

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-02-02
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-01-27 to 2020-02-02.

During this period, we have:

* 2188 builds (88.6% (-0.8) passed, 11.4% (+0.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 347 test runs (70.3% (+5.7) passed, 17.0% (-9.4) unstable, 12.7% (+3.7)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 42 doc builds (95.2% (-3.1) passed, 4.8% (+3.1) failed)

Test case status (on 2020-02-02 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7673 (+11) | 7604 (+10) | 1 (+1) | 68 (0)  |
| head/i386   | 7671 (+11) | 7599 (+11) | 0 (0)  | 72 (0)  |
| 12-STABLE/amd64 | 7520 (0)   | 7472 (0)   | 0 (0)  | 48 (0)  |
| 12-STABLE/i386  | 7518 (0)   | 7459 (-3)  | 0 (0)  | 59 (+3) |
| 11-STABLE/amd64 | 6861 (0)   | 6811 (-3)  | 0 (0)  | 50 (+3) |
| 11-STABLE/i386  | 6859 (0)   | 6810 (+3)  | 0 (0)  | 49 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200202 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing builds

* https://ci.freebsd.org/job/FreeBSD-head-mips-build/
* https://ci.freebsd.org/job/FreeBSD-head-mips64-build/
  More information is available at https://reviews.freebsd.org/D23128

## Failed and fixed tests

* i386 boot panics after r357314
  https://bugs.freebsd.org/243837
  Fixed in r357463

* sys.capsicum.capsicum-test.main fails after r357412
  https://bugs.freebsd.org/243839
  Fixed in r357461


## Failing and Flaky tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (+0), 2277 success (+2), 587 failures (+1), 806 skipped 
(-3)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  https://bugs.freebsd.org/242689
* sys.kern.ptrace_test.ptrace__procdesc_reparent_wait_child
  https://bugs.freebsd.org/243605

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* 

FreeBSD CI Weekly Report 2020-01-26

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-01-26
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-01-20 to 2020-01-26.

During this period, we have:

* 2153 builds (89.4% (+4.1) passed, 10.6% (-4.1) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 356 test runs (64.6% (-17.4) passed, 26.4% (+14.3) unstable, 9.0% (+3.1)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 59 doc builds (98.3% (-1.7) passed, 1.7% (+1.7) failed)

Test case status (on 2020-01-26 23:59):
| Branch/Architecture | Total  | Pass   | Fail  | Skipped |
| --- | -- | -- | - | --- |
| head/amd64  | 7662 (+16) | 7594 (+18) | 0 (0) | 68 (-2) |
| head/i386   | 7660 (+16) | 7588 (+18) | 0 (0) | 72 (-2) |
| 12-STABLE/amd64 | 7520 (0)   | 7472 (0)   | 0 (0) | 48 (0)  |
| 12-STABLE/i386  | 7518 (0)   | 7462 (0)   | 0 (0) | 56 (0)  |
| 11-STABLE/amd64 | 6861 (0)   | 6814 (0)   | 0 (0) | 47 (0)  |
| 11-STABLE/i386  | 6859 (0)   | 6807 (0)   | 0 (0) | 52 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200126 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## Failing builds

* https://ci.freebsd.org/job/FreeBSD-head-mips-build/
* https://ci.freebsd.org/job/FreeBSD-head-mips64-build/
  More information is available at https://reviews.freebsd.org/D23128

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (+0), 2275 success (-3), 586 failures (+3), 809 skipped 
(+0)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  https://bugs.freebsd.org/242689
* sys.kern.ptrace_test.ptrace__procdesc_reparent_wait_child (new)
  https://bugs.freebsd.org/243605

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* 

FreeBSD CI Weekly Report 2020-01-19

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-01-19
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-01-13 to 2020-01-19.

During this period, we have:

* 2185 builds (85.3% (-0.3) passed, 14.7% (+0.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 340 test runs (82.0% (-0.5) passed, 12.1% (-4.4) unstable, 5.9% (+4.9)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 34 doc builds (100% (0) passed)

Test case status (on 2020-01-19 23:59):
| Branch/Architecture | Total| Pass  | Fail  | Skipped |
| --- |  | - | - | --- |
| head/amd64  | 7646 (0) | 7576 (-3) | 0 (0) | 70 (+3) |
| head/i386   | 7644 (0) | 7570 (-3) | 0 (0) | 74 (+3) |
| 12-STABLE/amd64 | 7520 (0) | 7472 (+3) | 0 (0) | 48 (-3) |
| 12-STABLE/i386  | 7518 (0) | 7462 (0)  | 0 (0) | 56 (0)  |
| 11-STABLE/amd64 | 6861 (0) | 6814 (+3) | 0 (0) | 47 (-3) |
| 11-STABLE/i386  | 6859 (0) | 6807 (0)  | 0 (0) | 52 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200119 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* All the -head jobs except sparc64 and mips/mips64 are switched to clang/lld
  toolchain (powerpc* are using GNU ld except powerpc64) for preparing the GCC
  4.2.1 removal. Now the official toolchain of mips* are mips*-gcc6 packages
  (devel/freebsd-gcc6 in ports with mips* FLAVOR)
  For more information, please check:
* ["Gcc 4.2.1 to be removed before FreeBSD 13, a firm timeline" on 
freebsd-arch@ mailing 
list](https://lists.freebsd.org/pipermail/freebsd-arch/2020-January/019823.html)
* "Default Tool Chain" section of arch(7)
* https://wiki.freebsd.org/ExternalGCC
  
## Failing builds

* https://ci.freebsd.org/job/FreeBSD-head-powerpcspe-build/
  Broken after PowerPC switch to llvm toolchain, waiting for
  https://reviews.llvm.org/D72014 merged.

* https://ci.freebsd.org/job/FreeBSD-head-mips-build/
* https://ci.freebsd.org/job/FreeBSD-head-mips64-build/
  More information is available at https://reviews.freebsd.org/D23128

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (+1609), 2278 success (+4), 583 failures (-4), 809 
skipped (+87)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* 

FreeBSD CI Weekly Report 2020-01-12

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-01-12
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-01-06 to 2020-01-12.

During this period, we have:

* 2218 builds (85.6% (-5.9) passed, 14.4% +5.9) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 297 test runs (82.5% (-7.4) passed, 16.5% (+13.8) unstable, 1.0% (-6.4)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 24 doc builds (100% (0) passed)

Test case status (on 2020-01-12 23:59):
| Branch/Architecture | Total  | Pass   | Fail  | Skipped |
| --- | -- | -- | - | --- |
| head/amd64  | 7646 (+1)  | 7579 (+4)  | 0 (0) | 67 (-3) |
| head/i386   | 7644 (+1)  | 7573 (+4)  | 0 (0) | 71 (-3) |
| 12-STABLE/amd64 | 7520 (+25) | 7469 (+22) | 0 (0) | 51 (+3) |
| 12-STABLE/i386  | 7518 (+25) | 7462 (+24) | 0 (0) | 56 (+1) |
| 11-STABLE/amd64 | 6861 (+1)  | 6811 (-2)  | 0 (0) | 50 (+3) |
| 11-STABLE/i386  | 6859 (+1)  | 6807 (-2)  | 0 (0) | 52 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200112 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* All the -head jobs except sparc64 and mips/mips64 are switched to clang/lld
  toolchain (powerpc* are using GNU ld except powerpc64) for preparing the GCC
  4.2.1 removal. Now the official toolchain of mips* are mips*-gcc6 packages
  (devel/freebsd-gcc6 in ports with mips* FLAVOR)
  For more information, please check:
* ["Gcc 4.2.1 to be removed before FreeBSD 13, a firm timeline" on 
freebsd-arch@ mailing 
list](https://lists.freebsd.org/pipermail/freebsd-arch/2020-January/019823.html)
* "Default Tool Chain" section of arch(7)
* https://wiki.freebsd.org/ExternalGCC
  
## Failing builds

* https://ci.freebsd.org/job/FreeBSD-head-powerpcspe-build/
  Broken after PowerPC switch to llvm toolchain, waiting for
  https://reviews.llvm.org/D72014 merged.

* https://ci.freebsd.org/job/FreeBSD-head-mips-build/
* https://ci.freebsd.org/job/FreeBSD-head-mips64-build/
  More information is available at https://reviews.freebsd.org/D23128

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 3670 tests (+1609), 2274 success (+1376), 587 failures (+146), 809 
skipped (+87)

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  

FreeBSD CI Weekly Report 2020-01-05

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2020-01-05
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2020-12-30 to 2020-01-05.

During this period, we have:

* 2029 builds (91.5% (-3.6) passed, 8.5% (+3.6) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 258 test runs (89.9% (+1) passed, 2.7% (+0.2) unstable, 7.4% (-1.2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 64 doc builds (100% (0) passed)

Test case status (on 2020-01-05 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7645 (+9) | 7575 (+8) | 0 (0) | 70 (+1) |
| head/i386   | 7643 (+9) | 7569 (+6) | 0 (0) | 74 (+3) |
| 12-STABLE/amd64 | 7495 (+4) | 7447 (+7) | 0 (0) | 48 (-3) |
| 12-STABLE/i386  | 7493 (+4) | 7438 (+4) | 0 (0) | 55 (0)  |
| 11-STABLE/amd64 | 6860 (0)  | 6813 (0)  | 0 (0) | 47 (0)  |
| 11-STABLE/i386  | 6858 (0)  | 6809 (+3) | 0 (0) | 49 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20200105 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* LTP (Linux Test Project) for Linux compatibility layer job is added:
  https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
  More information is available at https://wiki.freebsd.org/linux-kernel/
  
## Failing build

* https://ci.freebsd.org/job/FreeBSD-head-powerpcspe-build/
  There are some issues after PowerPC switch to llvm toolchain.

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
* Total 2061 tests, 898 success, 441 failures , 722 skipped

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  https://bugs.freebsd.org/242689

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/242689
  

Re: FreeBSD-head-amd64-test - Build #13912 (r356671) - Failure

[Li-Wen Hsu]

Thanks and all tests are good now:

https://ci.freebsd.org/job/FreeBSD-head-i386-test/8056/
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/13917/

On Mon, Jan 13, 2020 at 10:36 PM Mateusz Guzik  wrote:
>
> Fixed in r356683.
>
> On 1/13/20, Mateusz Guzik  wrote:
> > On 1/13/20, Li-Wen Hsu  wrote:
> >> On Mon, Jan 13, 2020 at 1:10 PM  wrote:
> >>>
> >>> FreeBSD-head-amd64-test - Build #13912 (r356671) - Failure
> >>>
> >>> Build information:
> >>> https://ci.freebsd.org/job/FreeBSD-head-amd64-test/13912/
> >>> Full change log:
> >>> https://ci.freebsd.org/job/FreeBSD-head-amd64-test/13912/changes
> >>> Full build log:
> >>> https://ci.freebsd.org/job/FreeBSD-head-amd64-test/13912/console
> >>>
> >>> Status explanation:
> >>> "Failure" - the build is suspected being broken by the following changes
> >>> "Still Failing" - the build has not been fixed by the following changes
> >>> and
> >>>   this is a notification to note that these changes have
> >>>   not been fully tested by the CI system
> >>>
> >>> Change summaries:
> >>> (Those commits are likely but not certainly responsible)
> >>>
> >>> 356671 by mjg:
> >>> ufs: use lazy list instead of active list for syncer
> >>>
> >>> Quota code is temporarily regressed to do a full vnode scan.
> >>>
> >>> Reviewed by:jeff
> >>> Tested by:  pho (in a larger patch, previous version)
> >>> Differential Revision:  https://reviews.freebsd.org/D22996
> >>>
> >>> 356670 by mjg:
> >>> vfs: add per-mount vnode lazy list and use it for deferred inactive +
> >>> msync
> >>>
> >>> This obviates the need to scan the entire active list looking for vnodes
> >>> of interest.
> >>>
> >>> msync is handled by adding all vnodes with write count to the lazy list.
> >>>
> >>> deferred inactive directly adds vnodes as it sets the VI_DEFINACT flag.
> >>>
> >>> Vnodes get dequeued from the list when their hold count reaches 0.
> >>>
> >>> Newly added MNT_VNODE_FOREACH_LAZY* macros support filtering so that
> >>> spurious locking is avoided in the common case.
> >>>
> >>> Reviewed by:jeff
> >>> Tested by:  pho (in a larger patch, previous version)
> >>> Differential Revision:  https://reviews.freebsd.org/D22995
> >>>
> >>> 356669 by mjg:
> >>> ufs: add a setter for inode i_flag field
> >>>
> >>> This will be used later to add vnodes to the lazy list.
> >>>
> >>> Reviewed by:kib (previous version), jeff
> >>> Tested by:  pho (in a larger patch)
> >>> Differential Revision:  https://reviews.freebsd.org/D22994
> >>
> >> Hi Mateusz,
> >>
> >> I suspect these changes might have something to do about panic of i386
> >> and amd64 in testing:
> >
> > I'm on it.
> >
> >>
> >> root@:/usr/tests # cd /usr/tests/usr.sbin/makefs/
> >> root@:/usr/tests/usr.sbin/makefs # kyua debug
> >> makefs_cd9660_tests:o_flag_rockridge_dev_nodes
> >> VNASSERT failed
> >> 0xf8000f24a1e8: type VCHR
> >> usecount 1, writecount 0, refcount 1 rdev 0
> >> flags ()
> >>  VI_LOCKedlock type ufs: SHARED (count 1)
> >> nlink=1, effnlink=1, size=0, extsize 0
> >> generation=73c32c64, uid=0, gid=0, flags=0x0
> >> ino 117778, on dev gpt/rootfs
> >> panic: ffs_unlock_debug: modified vnode (420) not on lazy list
> >> cpuid = 1
> >> time = 1578910603
> >> KDB: stack backtrace:
> >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame
> >> 0xfe0038a70fd0
> >> vpanic() at vpanic+0x185/frame 0xfe0038a71030
> >> panic() at panic+0x43/frame 0xfe0038a71090
> >> ffs_unlock_debug() at ffs_unlock_debug+0xa5/frame 0xfe0038a710c0
> >> lookup() at lookup+0xd26/frame 0xfe0038a71160
> >> namei() at namei+0x4d8/frame 0xfe0038a71250
> >> kern_fchmodat() at kern_fchmodat+0x92/frame 0xfe0038a71380
> >> amd64_syscall() at amd64_syscall+0x2d6/frame 0xfe0038a714b0
> >> fast_syscall_common() at fast_syscall_common+0x101/frame
> >> 0xfe0038a714b0
> >> --- syscall (15, FreeBSD ELF64

Re: FreeBSD-head-amd64-test - Build #13912 (r356671) - Failure

[Li-Wen Hsu]

On Mon, Jan 13, 2020 at 1:10 PM  wrote:
>
> FreeBSD-head-amd64-test - Build #13912 (r356671) - Failure
>
> Build information: https://ci.freebsd.org/job/FreeBSD-head-amd64-test/13912/
> Full change log: 
> https://ci.freebsd.org/job/FreeBSD-head-amd64-test/13912/changes
> Full build log: 
> https://ci.freebsd.org/job/FreeBSD-head-amd64-test/13912/console
>
> Status explanation:
> "Failure" - the build is suspected being broken by the following changes
> "Still Failing" - the build has not been fixed by the following changes and
>   this is a notification to note that these changes have
>   not been fully tested by the CI system
>
> Change summaries:
> (Those commits are likely but not certainly responsible)
>
> 356671 by mjg:
> ufs: use lazy list instead of active list for syncer
>
> Quota code is temporarily regressed to do a full vnode scan.
>
> Reviewed by:jeff
> Tested by:  pho (in a larger patch, previous version)
> Differential Revision:  https://reviews.freebsd.org/D22996
>
> 356670 by mjg:
> vfs: add per-mount vnode lazy list and use it for deferred inactive + msync
>
> This obviates the need to scan the entire active list looking for vnodes
> of interest.
>
> msync is handled by adding all vnodes with write count to the lazy list.
>
> deferred inactive directly adds vnodes as it sets the VI_DEFINACT flag.
>
> Vnodes get dequeued from the list when their hold count reaches 0.
>
> Newly added MNT_VNODE_FOREACH_LAZY* macros support filtering so that
> spurious locking is avoided in the common case.
>
> Reviewed by:jeff
> Tested by:  pho (in a larger patch, previous version)
> Differential Revision:  https://reviews.freebsd.org/D22995
>
> 356669 by mjg:
> ufs: add a setter for inode i_flag field
>
> This will be used later to add vnodes to the lazy list.
>
> Reviewed by:kib (previous version), jeff
> Tested by:  pho (in a larger patch)
> Differential Revision:  https://reviews.freebsd.org/D22994

Hi Mateusz,

I suspect these changes might have something to do about panic of i386
and amd64 in testing:

root@:/usr/tests # cd /usr/tests/usr.sbin/makefs/
root@:/usr/tests/usr.sbin/makefs # kyua debug
makefs_cd9660_tests:o_flag_rockridge_dev_nodes
VNASSERT failed
0xf8000f24a1e8: type VCHR
usecount 1, writecount 0, refcount 1 rdev 0
flags ()
 VI_LOCKedlock type ufs: SHARED (count 1)
nlink=1, effnlink=1, size=0, extsize 0
generation=73c32c64, uid=0, gid=0, flags=0x0
ino 117778, on dev gpt/rootfs
panic: ffs_unlock_debug: modified vnode (420) not on lazy list
cpuid = 1
time = 1578910603
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfe0038a70fd0
vpanic() at vpanic+0x185/frame 0xfe0038a71030
panic() at panic+0x43/frame 0xfe0038a71090
ffs_unlock_debug() at ffs_unlock_debug+0xa5/frame 0xfe0038a710c0
lookup() at lookup+0xd26/frame 0xfe0038a71160
namei() at namei+0x4d8/frame 0xfe0038a71250
kern_fchmodat() at kern_fchmodat+0x92/frame 0xfe0038a71380
amd64_syscall() at amd64_syscall+0x2d6/frame 0xfe0038a714b0
fast_syscall_common() at fast_syscall_common+0x101/frame 0xfe0038a714b0
--- syscall (15, FreeBSD ELF64, sys_chmod), rip = 0x8003ba95a, rsp =
0x7fffe758, rbp = 0x7fffe7e0 ---
KDB: enter: panic
[ thread pid 1393 tid 100092 ]
Stopped at  kdb_enter+0x37: movq$0,0x1084396(%rip)
db:0:kdb.enter.panic> show pcpu
cpuid= 1
dynamic pcpu = 0xfe00887a7d80
curthread= 0xf8000f25a000: pid 1393 tid 100092 critnest 1 "bsdtar"
curpcb   = 0xf8000f25a4f0
fpcurthread  = 0xf8000f25a000: pid 1393 "bsdtar"
idlethread   = 0xf800033976e0: tid 14 "idle: cpu1"
self = 0x82211000
curpmap  = 0xf80003e35120
tssp = 0x82211384
rsp0 = 0xfe0038a71580
kcr3 = 0x8f2ab405
ucr3 = 0x8f287c05
scr3 = 0xf287c05
gs32p= 0x82211404
ldt  = 0x82211444
tss  = 0x82211434
tlb gen  = 889
curvnet  = 0
spin locks held:
db:0:kdb.enter.panic>

full log:
https://ci.freebsd.org/job/FreeBSD-head-i386-test/8051/consoleFull
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/13912/consoleFull

test image:
https://artifact.ci.freebsd.org/snapshot/head/r356671/i386/i386/disk-test.img.xz
https://artifact.ci.freebsd.org/snapshot/head/r356671/amd64/amd64/disk-test.img.xz

Can you help check this? Thanks.

Best,
Li-Wen
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-12-29

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-12-29
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-12-23 to 2019-12-29.

During this period, we have:

* 1811 builds (95.1% (-3.4) passed, 4.9% (+3.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 197 test runs (88.9% (+2.3) passed, 2.5% (-4.5) unstable, 8.6% (+2.2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 22 doc builds (100% (0) passed)

Test case status (on 2019-12-29 23:59):
| Branch/Architecture | Total| Pass  | Fail  | Skipped |
| --- |  | - | - | --- |
| head/amd64  | 7636 (0) | 7567 (-3) | 0 (0) | 69 (+3) |
| head/i386   | 7634 (0) | 7563 (+3) | 0 (0) | 71 (-3) |
| 12-STABLE/amd64 | 7491 (0) | 7440 (-3) | 0 (0) | 51 (+3) |
| 12-STABLE/i386  | 7489 (0) | 7434 (0)  | 0 (0) | 55 (0)  |
| 11-STABLE/amd64 | 6860 (0) | 6813 (+3) | 0 (0) | 47 (-3) |
| 11-STABLE/i386  | 6858 (0) | 6806 (-3) | 0 (0) | 52 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191229 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* FreeBSD Foundation 2019 in Review: CI and Testing Advancements
  
https://www.freebsdfoundation.org/blog/2019-in-review-ci-and-testing-advancements/
  
## Failing build

* https://ci.freebsd.org/job/FreeBSD-head-powerpcspe-build/
  There are some issues after PowerPC switch to llvm toolchain.

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  https://bugs.freebsd.org/242689

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/242689
  sys.geom.class.multipath.failloop.failloop fails due to too many CTF entries
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* 

FreeBSD CI Weekly Report 2019-12-22

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-12-22
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-12-15 to 2019-12-22.

During this period, we have:

* 2352 builds (98.5% (+2.2) passed, 1.5% (-2.2) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 313 test runs (86.6% (-9.8) passed, 7.0% (+5.2) unstable, 6.4% (+4.6)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 16 doc builds (100% (+7) passed)

Test case status (on 2019-12-22 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7636 (+1) | 7570 (+4) | 0 (0) | 66 (-3) |
| head/i386   | 7634 (+1) | 7560 (0)  | 0 (0) | 74 (+1) |
| 12-STABLE/amd64 | 7491 (+3) | 7443 (+3) | 0 (0) | 48 (0)  |
| 12-STABLE/i386  | 7489 (+3) | 7434 (+6) | 0 (0) | 55 (-3) |
| 11-STABLE/amd64 | 6860 (+2) | 6810 (-1) | 0 (0) | 50 (+3) |
| 11-STABLE/i386  | 6858 (+2) | 6809 (+2) | 0 (0) | 49 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191222 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* FreeBSD Foundation 2019 in Review: CI and Testing Advancements
  
https://www.freebsdfoundation.org/blog/2019-in-review-ci-and-testing-advancements/

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
* sys.geom.class.multipath.failloop.failloop
  https://bugs.freebsd.org/242689

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/242689
  sys.geom.class.multipath.failloop.failloop fails due to too many CTF entries
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237656
  "Freed UMA keg 

FreeBSD CI Weekly Report 2019-12-15

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-12-15
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-12-09 to 2019-12-15.

During this period, we have:

* 2566 builds (96.3% (+1.3) passed, 3.7% (-1.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 400 test runs (96.4% (-1.6) passed, 1.8% (+0.1) unstable, 1.8% (+1.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 43 doc builds (93% (-7) passed, 7% (+7) failed)

Test case status (on 2019-12-15 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7635 (+3) | 7566 (+3) | 0 (0) | 69 (0)  |
| head/i386   | 7633 (+3) | 7560 (+3) | 0 (0) | 73 (0)  |
| 12-STABLE/amd64 | 7488 (0)  | 7440 (+3) | 0 (0) | 48 (-3) |
| 12-STABLE/i386  | 7486 (0)  | 7428 (0)  | 0 (0) | 58 (0)  |
| 11-STABLE/amd64 | 6858 (0)  | 6811 (0)  | 0 (0) | 47 (0)  |
| 11-STABLE/i386  | 6856 (0)  | 6807 (+3) | 0 (0) | 49 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191215 and archive is available at
https://hackmd.io/@FreeBSD-CI/ , any help is welcome.

## News

* Experimental "Hardware test lab" result is available at:
  https://ci.freebsd.org/hwlab/ , more hardware support is welcomed!

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." 
seen when running sys/netipsec tests
* https://bugs.freebsd.org/238781
  sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when 

FreeBSD CI Weekly Report 2019-12-08

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-12-08
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-12-02 to 2019-12-08.

During this period, we have:

* 2463 builds (95% (-1.3) passed, 5% (+1.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 353 test runs (98% (+0.5) passed, 1.7% (-0.8) unstable, 0.3% (+0.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 42 doc builds (100% (0) passed)

Test case status (on 2019-12-08 23:59):
| Branch/Architecture | Total  | Pass  | Fail  | Skipped |
| --- | -- | - | - | --- |
| head/amd64  | 7632 (+12) | 7563 (+9) | 0 (0) | 69 (+3) |
| head/i386   | 7630 (+12) | 7557 (+9) | 0 (0) | 73 (+3) |
| 12-STABLE/amd64 | 7488 (+5)  | 7437 (+5) | 0 (0) | 51 (0)  |
| 12-STABLE/i386  | 7486 (+5)  | 7428 (+2) | 0 (0) | 58 (+3) |
| 11-STABLE/amd64 | 6858 (+5)  | 6811 (+5) | 0 (0) | 47 (0)  |
| 11-STABLE/i386  | 6856 (+5)  | 6804 (+2) | 0 (0) | 52 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191208 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* Experimental "Hardware test lab" result is available at:
  https://ci.freebsd.org/hwlab/ , more hardware support is welcomed!

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~109 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." 
seen when running sys/netipsec tests
* https://bugs.freebsd.org/238781
  sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when 
mac_portacl(4) 

FreeBSD CI Weekly Report 2019-12-01

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-12-01
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-11-25 to 2019-12-01.

During this period, we have:

* 2134 builds (96.3% (+1.2) passed, 3.7% (-1.2) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 283 test runs (97.5% (+14.4) passed, 2.5% (-6.4) unstable, 0% (-8)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 22 doc builds (100% (0) passed)

Test case status (on 2019-12-01 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7620 (+2) | 7554 (+2) | 0 (0) | 66 (0)  |
| head/i386   | 7618 (+2) | 7548 (+2) | 0 (0) | 70 (0)  |
| 12-STABLE/amd64 | 7483 (0)  | 7432 (-3) | 0 (0) | 51 (+3) |
| 12-STABLE/i386  | 7481 (0)  | 7426 (0)  | 0 (0) | 55 (0)  |
| 11-STABLE/amd64 | 6853 (0)  | 6806 (+3) | 0 (0) | 47 (-3) |
| 11-STABLE/i386  | 6851 (0)  | 6802 (+3) | 0 (0) | 49 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191201 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.
  
* A list of "FreeBSD CI Tasks and Ideas" is keeping at
  https://hackmd.io/@FreeBSD-CI/freebsd-ci-todo , please contact
  freebsd-test...@freebsd.org and lw...@freebsd.org if you are interested or
  have new ideas.

* Experimental "Hardware test lab" result is available at:
  https://ci.freebsd.org/hwlab/ , more hardware support is welcomed!

* We are collecting information of FreeBSD in software development, for future
  collaboration. The wiki page is https://wiki.freebsd.org/3rdPartySoftwareCI ,
  plese help adding more information.

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~14 failing and ~100 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and 

FreeBSD CI Weekly Report 2019-11-24

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-11-24
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-11-18 to 2019-11-24.

During this period, we have:

* 2617 builds (95.1% (+3.9) passed, 4.9% (-3.9) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 349 test runs (83.1% (-14.8) passed, 8.9% (-6.8) unstable, 8.0% (+8)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 48 doc builds (100% (0) passed)

Test case status (on 2019-11-24 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7618 (+7) | 7552 (+6) | 0 (0) | 66 (+1) |
| head/i386   | 7616 (+7) | 7546 (+9) | 0 (0) | 70 (-2) |
| 12-STABLE/amd64 | 7483 (0)  | 7435 (0)  | 0 (0) | 48 (0)  |
| 12-STABLE/i386  | 7481 (0)  | 7426 (+3) | 0 (0) | 55 (-3) |
| 11-STABLE/amd64 | 6853 (0)  | 6803 (-3) | 0 (0) | 50 (+3) |
| 11-STABLE/i386  | 6851 (0)  | 6799 (0)  | 0 (0) | 52 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191124 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.
  
* A list of "FreeBSD CI Tasks and Ideas" is keeping at
  https://hackmd.io/@FreeBSD-CI/freebsd-ci-todo , please contact
  freebsd-test...@freebsd.org and lw...@freebsd.org if you are interested or
  have new ideas.

* Experimental "Hardware test lab" result is available at:
  https://ci.freebsd.org/hwlab/ , more hardware support is welcomed!

* We are collecting information of FreeBSD in software development, for future
  collaboration. The wiki page is https://wiki.freebsd.org/3rdPartySoftwareCI ,
  plese help adding more information.

## Fixed tests

* https://bugs.freebsd.org/242095
  failing test case: usr.bin.unifdef.basic_test.basic

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~13 failing and ~100 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause 

FreeBSD CI Weekly Report 2019-11-17

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-11-17
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-11-11 to 2019-11-17.

During this period, we have:

* 2174 builds (91.2% (-3.7) passed, 8.8% (+3.7) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 331 test runs (97.9% (+5.8) passed, 2.1% (-4.3) unstable, 0% (-1.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 30 doc builds (100% passed)

Test case status (on 2019-11-17 23:59):
| Branch/Architecture | Total | Pass  | Fail  | Skipped |
| --- | - | - | - | --- |
| head/amd64  | 7611 (0)  | 7546 (+3) | 0 (0) | 65 (-3) |
| head/i386   | 7609 (0)  | 7537 (-3) | 0 (0) | 72 (+3) |
| 12-STABLE/amd64 | 7483 (0)  | 7435 (0)  | 0 (0) | 48 (0)  |
| 12-STABLE/i386  | 7481 (0)  | 7423 (-3) | 0 (0) | 58 (+3) |
| 11-STABLE/amd64 | 6853 (+4) | 6806 (+4) | 0 (0) | 47 (0)  |
| 11-STABLE/i386  | 6851 (+4) | 6799 (+1) | 0 (0) | 52 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191117 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.
  
* A list of "FreeBSD CI Tasks and Ideas" is keeping at
  https://hackmd.io/@FreeBSD-CI/freebsd-ci-todo , please contact
  freebsd-test...@freebsd.org and lw...@freebsd.org if you are interested or
  have new ideas.

* Experimental "Hardware test lab" result is available at:
  https://ci.freebsd.org/hwlab/ , more hardware support is welcomed!

* We are collecting information of FreeBSD in software development, for future
  collaboration. The wiki page is https://wiki.freebsd.org/3rdPartySoftwareCI ,
  plese help adding more information.

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~7 failing and ~100 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
  https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy 

Re: Reverting -current by date.

[Li-Wen Hsu]

On Thu, Nov 21, 2019 at 1:39 AM bob prohaska  wrote:
>
> From time to time it would be handy to revert freebsd-current to
> an older, well-behaved revision.
>
> Is there a mechanism for identifying revision numbers that
> will at least compile and boot, by date?
>
> In my case buildworld seems to be markedly slower than, say,
> six months ago. Maybe it's hardware, maybe something else. Is
> there a way to pick a revision number to revert to, that's
> better than merely guessing?
>
> Thanks for reading,

I suggest checking the build history in our CI system, for example,
head-amd64: https://ci.freebsd.org/job/FreeBSD-head-amd64-build/

Li-Wen
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: SVN r354896 breaks build

[Li-Wen Hsu]

On Thu, Nov 21, 2019 at 12:39 AM Michael Butler
 wrote:
>
> The no-relax flag can't be used on all architectures ..
>
> Building /usr/obj/usr/src/amd64.amd64/usr.sbin/jail/jail
> --- jail ---
> ld: error: unknown argument '--no-relax'
> cc: error: linker command failed with exit code 1 (use -v to see invocation)
> --- all_subdir_usr.sbin/portsnap ---
> --- all_subdir_usr.sbin/portsnap/make_index ---
> ===> usr.sbin/portsnap/make_index (all)
> --- all_subdir_usr.sbin/jail ---
> *** [jail] Error code 1

My bad, should be fixed in r354899.

Li-Wen
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-11-10

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-11-10
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-11-04 to 2019-11-10.

During this period, we have:

* 2331 builds (94.9% (+) passed, 5.1% () failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 267 test runs (92.1% (+) passed, 6.4% (-) unstable, 1.5% ()
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 86 doc builds (100% (0) passed)

Test case status (on 2019-11-10 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped |
| --- | -- | -- | --- | --- |
| head/amd64  | 7611 (+2)  | 7543 (+2)  | 0 (0)   | 68 (0)  |
| head/i386   | 7609 (+23) | 7540 (+28) | 0 (0)   | 69 (-5) |
| 12-STABLE/amd64 | 7483 (0)   | 7435 (-1)  | 0 (0)   | 48 (+1) |
| 12-STABLE/i386  | 7481 (0)   | 7426 (-1)  | 0 (0)   | 55 (+1) |
| 11-STABLE/amd64 | 6849 (0)   | 6802 (0)   | 0 (-)   | 47 (0)  |
| 11-STABLE/i386  | 6847 (0)   | 6798 (+34) | 0 (-34) | 49 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191110 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.
  
* A list of "FreeBSD CI Tasks and Ideas" is keeping at
  https://hackmd.io/@FreeBSD-CI/freebsd-ci-todo , please contact
  freebsd-test...@freebsd.org and lw...@freebsd.org if you are interested or
  have new ideas.

* Experimental "Hardware test lab" result is available at:
  https://ci.freebsd.org/hwlab/ , more hardware support is welcomed!

* We are collecting information of FreeBSD in software development, for future
  collaboration. The wiki page is https://wiki.freebsd.org/3rdPartySoftwareCI ,
  plese help adding more information.

## Fixed tests

Tests of i386 netinet6 and netpfil were failing because a bug in scapy, fixed
by bz@ and upstreaming at https://github.com/secdev/scapy/pull/2329

* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.netpfil.common.forward.pf_v4 (i386 only)
  https://bugs.freebsd.org/240085
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* sys.netinet6.frag6.*
  https://bugs.freebsd.org/241493
  
libexecinfo tests are enabled and found that the tests needs unstripped binary,
and also found that we need to enable unwind tables on !amd64.

* https://bugs.freebsd.org/241562
  failing test case: lib.libexecinfo.backtrace_test.backtrace_fmt_basic

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~18 failing and ~97 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  

FreeBSD CI Weekly Report 2019-11-03

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-11-03
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-10-29 to 2019-11-03.

During this period, we have:

* 1820 builds (94.1% (-2.6) passed, 5.9% (+2.6) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 277 test runs (81.6% (+26.5) passed, 18.4% (-19.7) unstable, 0% (-6.8)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 27 doc builds (88.0% (-12) passed)

Test case status (on 2019-11-03 23:59):
| Branch/Architecture | Total| Pass  | Fail   | Skipped |
| --- |  | - | -- | --- |
| head/amd64  | 7609 (0) | 7541 (+1) | 0 (0)  | 68 (-1) |
| head/i386   | 7586 (0) | 7512 (+3) | 0 (0)  | 74 (-3) |
| 12-STABLE/amd64 | 7483 (0) | 7436 (+4) | 0 (0)  | 47 (-4) |
| 12-STABLE/i386  | 7481 (0) | 7427 (+1) | 0 (0)  | 54 (-1) |
| 11-STABLE/amd64 | 6849 (0) | 6802 (-3) | 0 (0)  | 47 (+3) |
| 11-STABLE/i386  | 6847 (0) | 6764 (-3) | 34 (0) | 49 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191103 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.
  
* A list of "FreeBSD CI Tasks and Ideas" is keeping at 
https://hackmd.io/@FreeBSD-CI/freebsd-ci-todo , please contact 
freebsd-test...@freebsd.org and lw...@freebsd.org if you are interested or have 
new ideas.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~18 failing and ~97 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* (new) lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* (new) sys.netinet6.frag6.*
  https://bugs.freebsd.org/241493

## Issues

## New

* https://bugs.freebsd.org/241562
  failing test case: lib.libexecinfo.backtrace_test.backtrace_fmt_basic
  (Already fixed on 2019-11-07)
* https://bugs.freebsd.org/241662
  Flakey test case: lib.libarchive.functional_test.test_fuzz_iso9660

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or 

FreeBSD CI Weekly Report 2019-10-27

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-10-27
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-10-21 to 2019-10-27.

During this period, we have:

* 2267 builds (96.7% (+3.1) passed, 3.3% (-3.1) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 352 test runs (55.1% (+34.3) passed, 38.1% (+27.5) unstable, 6.8% (+6.8)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 22 doc builds (100% (0) passed)

Test case status (on 2019-10-27 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7609 (+19) | 7540 (+13) | 0 (0)  | 69 (+6) |
| head/i386   | 7586 (-2)  | 7509 (-4)  | 0 (0)  | 77 (+2) |
| 12-STABLE/amd64 | 7483 (+2)  | 7432 (-7)  | 0 (0)  | 51 (+7) |
| 12-STABLE/i386  | 7481 (0)   | 7426 (-4)  | 0 (0)  | 55 (+4) |
| 11-STABLE/amd64 | 6849 (0)   | 6805 (0)   | 0 (0)  | 44 (0)  |
| 11-STABLE/i386  | 6847 (0)   | 6767 (-3)  | 34 (0) | 46 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191027 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~18 failing and ~97 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683
* (new) lib.libcasper.services.cap_dns.dns_test.main
  https://bugs.freebsd.org/241435
* (new) sys.netinet6.frag6.*
  https://bugs.freebsd.org/241493

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy 

FreeBSD CI Weekly Report 2019-10-20

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-10-20
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-10-14 to 2019-10-20.

During this period, we have:

* 2475 builds (93.6% (+2.5) passed, 6.4% (-2.5) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 341 test runs (89.4% (+8.1) passed, 10.6% (+2.1) unstable, 0% (-10.2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 20 doc builds (100% (0) passed)

Test case status (on 2019-xx-xx 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped |
| --- | - | - | -- | --- |
| head/amd64  | 7590 (0)  | 7527 (0)  | 0 (0)  | 63 (0)  |
| head/i386   | 7588 (0)  | 7513 (-3) | 0 (0)  | 75 (+3) |
| 12-STABLE/amd64 | 7483 (+1) | 7439 (-1) | 0 (0)  | 44 (0)  |
| 12-STABLE/i386  | 7481 (+1) | 7430 (-2) | 0 (0)  | 51 (+2) |
| 11-STABLE/amd64 | 6849 (0)  | 6805 (-3) | 0 (0)  | 44 (+3) |
| 11-STABLE/i386  | 6847 (0)  | 6770 (0)  | 34 (0) | 43 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191020 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~18 failing and ~97 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details
* Work for cleaning these failing cass are in progress

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237403
  Tests in 

FreeBSD CI Weekly Report 2019-10-13

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-10-13
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-10-07 to 2019-10-13.

During this period, we have:

* 2217 builds (91.1% (-8.3) passed, 8.9% (+8.3) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 283 test runs (81.3% (-0.4) passed, 8.5% (-9.8) unstable, 10.2% (+10.2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 30 doc builds (100% passed)

Test case status (on 2019-10-13 23:59):
| Branch/Architecture | Total | Pass  | Fail   | Skipped  |
| --- | - | - | -- |  |
| head/amd64  | 7590 (+1) | 7527 (+1) | 0 (0)  | 63 (0)   |
| head/i386   | 7588 (+1) | 7516 (+1) | 0 (0)  | 72 (0)   |
| 12-STABLE/amd64 | 7482 (0)  | 7438 (-3) | 0 (0)  | 44 (+3)  |
| 12-STABLE/i386  | 7480 (0)  | 7432 (0)  | 0 (0)  | 48 (0)   |
| 11-STABLE/amd64 | 6849 (0)  | 6808 (0)  | 0 (0)  | 41 (0)   |
| 11-STABLE/i386  | 6847 (0)  | 6770 (0)  | 34 (0) | 43 (0)   |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191013 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~18 failing and ~97 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* 

FreeBSD CI Weekly Report 2019-10-06

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-10-06
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-09-30 to 2019-10-06.

During this period, we have:

* 2129 builds (99.4% (+0.8) passed, 0.6% (-0.8) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 333 test runs (81.7% (+10.2) passed, 18.3% (-1.7) unstable) were executed on
  amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 42 doc builds (100% passed)

Test case status (on 2019-10-06 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped  |
| --- | -- | -- | --- |  |
| head/amd64  | 7589 (+1)  | 7526 (+1)  | 0 (0)   | 63 (0)   |
| head/i386   | 7587 (+1)  | 7515 (+1)  | 0 (0)   | 72 (0)   |
| 12-STABLE/amd64 | 7482 (+8)  | 7441 (+11) | 0 (0)   | 41 (-3)  |
| 12-STABLE/i386  | 7480 (+8)  | 7434 (+13) | 0 (0)   | 48 (-3)  |
| 11-STABLE/amd64 | 6849 (0)   | 6808 (+3)  | 0 (0)   | 41 (-3)  |
| 11-STABLE/i386  | 6847 (0)   | 6770 (+3)  | 34 (0)  | 43 (-3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20191006 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

* A new wiki page started at https://wiki.freebsd.org/Jenkins/Debug describes 
  how to reproduce and debug the failing cases. It is welcomed to add more
  contents.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.amd64.arrays.t_dtrace_contrib.tst_uregsarray_d
* Fixed in head https://svnweb.freebsd.org/changeset/base/353107

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~18 failing and ~97 skipped cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* 

FreeBSD CI Weekly Report 2019-09-29

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-09-29
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-09-23 to 2019-09-29.

During this period, we have:

* 2159 builds (98.6% (-0.4) passed, 1.4% (+0.4) failed) of buildworld and
  buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
  armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 340 test runs (71.5% (-5.7) passed, 20% (-2.8) unstable, 8.5% (+8.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 22 doc builds (100% passed)

Test case status (on 2019-09-29 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped  |
| --- | -- | -- | -- |  |
| head/amd64  | 7588 (+21) | 7525 (+21) | 0 (0)  | 63 (0)   |
| head/i386   | 7586 (+21) | 7514 (+21) | 0 (0)  | 72 (0)   |
| 12-STABLE/amd64 | 7474 (0)   | 7430 (0)   | 0 (0)  | 44 (0)   |
| 12-STABLE/i386  | 7472 (0)   | 7421 (0)   | 0 (0)  | 51 (+3)  |
| 11-STABLE/amd64 | 6849 (0)   | 6805 (0)   | 0 (0)  | 44 (0)   |
| 11-STABLE/i386  | 6847 (0)   | 6767 (-3)  | 34 (0) | 46 (+3)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20190929 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

## Fixed Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
* https://svnweb.freebsd.org/changeset/base/352807
* https://svnweb.freebsd.org/changeset/base/352869

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.amd64.arrays.t_dtrace_contrib.tst_uregsarray_d
* https://bugs.freebsd.org/240358
* Fixed in head https://svnweb.freebsd.org/changeset/base/353107

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:

FreeBSD CI Weekly Report 2019-09-22

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-09-22
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-09-16 to 2019-09-22.

During this period, we have:

* 2048 builds (99% (+3.7) passed, 1% (-3.7) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 359 test runs (77.2% (+18.8) passed, 22.8% (-8.2) unstable) were executed on
  amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 42 doc builds (100% passed)

Test case status (on 2019-09-22 23:59):
| Branch/Architecture | Total  | Pass   | Fail   | Skipped |
| --- | -- | -- | -- | --- |
| head/amd64  | 7567 (+4)  | 7504 (+4)  | 0 (0)  | 63 (+1) |
| head/i386   | 7565 (+4)  | 7493 (+3)  | 0 (-2) | 72 (+3) |
| 12-STABLE/amd64 | 7474 (+41) | 7430 (+41) | 0 (0)  | 44 (0)  |
| 12-STABLE/i386  | 7472 (+41) | 7424 (+44) | 0 (0)  | 48 (-3) |
| 11-STABLE/amd64 | 6849 (+3)  | 6805 (+3)  | 0 (0)  | 44 (0)  |
| 11-STABLE/i386  | 6847 (+3)  | 6770 (+3)  | 34 (0) | 43 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20190922 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

* [Testing/CI session in 
DevSummit201909](https://wiki.freebsd.org/DevSummit/201909)

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.amd64.arrays.t_dtrace_contrib.tst_uregsarray_d
* https://bugs.freebsd.org/240358

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
  Patch available: https://reviews.freebsd.org/D21566
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510
* lib.libc.sys.stat_test.stat_socket
  https://bugs.freebsd.org/240621
* (new) sys.netpfil.common.tos.pf_tos (i386 only)
  https://bugs.freebsd.org/240086
* (new) lib.libarchive.functional_test.test_write_filter_zstd
  https://bugs.freebsd.org/240683

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* 

FreeBSD CI Weekly Report 2019-09-15

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-09-15
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-09-09 to 2019-09-15.

During this period, we have:

* 2095 builds (95.3% (-4.1) passed, 4.7% (+4.1) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 358 test runs (58.4% (-1.2) passed, 31.0% (-8.1) unstable, 10.6% (+9.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 32 doc builds (100% (0) passed)

Test case status (on 2019-09-15 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped |
| --- | -- | -- | --- | --- |
| head/amd64  | 7563 (+7)  | 7501 (+6)  | 0 (0)   | 62 (+1) |
| head/i386   | 7561 (+7)  | 7490 (+6)  | 2 (0)   | 69 (+1) |
| 12-STABLE/amd64 | 7433 (+40) | 7389 (+48) | 0 (-11) | 44 (+3) |
| 12-STABLE/i386  | 7431 (+40) | 7380 (+51) | 0 (-11) | 51 (0)  |
| 11-STABLE/amd64 | 6846 (0)   | 6802 (0)   | 0 (0)   | 44 (0)  |
| 11-STABLE/i386  | 6844 (0)   | 6767 (0)   | 34 (0)  | 43 (0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20190915 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-stable-12-amd64-test/
* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netipsec.tunnel.aes_cbc_128_hmac_sha1.v6
* sys.netipsec.tunnel.aes_cbc_256_hmac_sha2_256.v6
* sys.netipsec.tunnel.aes_gcm_128.v6
* sys.netipsec.tunnel.aes_gcm_256.v6
* sys.netipsec.tunnel.aesni_aes_cbc_128_hmac_sha1.v6
* sys.netipsec.tunnel.aesni_aes_cbc_256_hmac_sha2_256.v6
* sys.netipsec.tunnel.aesni_aes_gcm_128.v6
* sys.netipsec.tunnel.aesni_aes_gcm_256.v6
* sys.netipsec.tunnel.empty.v6
* sys.netpfil.pf.fragmentation.v6
* sys.netpfil.pf.pass_block.v6
* https://bugs.freebsd.org/240437

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.amd64.arrays.t_dtrace_contrib.tst_uregsarray_d
* https://bugs.freebsd.org/240358

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see
  
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
  Patch available: https://reviews.freebsd.org/D21566
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380 (updating net/scapy to 2.4.3 may fix this)
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219
* (new) sys.kern.ptrace_test.ptrace__getppid
  https://bugs.freebsd.org/240510


## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: 

FreeBSD CI Weekly Report 2019-09-08

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-09-08
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-09-02 to 2019-09-08.

During this period, we have:

* 2122 builds (99.4% (+2) passed, 0.6% (-2) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 373 test runs (59.6% (-0.2) passed, 39.1% (-1.1) unstable, 1.3% (+1.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 50 doc builds (100% (+2) passed)

Test case status (on 2019-09-08 23:59):
| Branch/Architecture | Total  | Pass   | Fail  | Skipped  |
| --- | -- | -- | - |  |
| head/amd64  | 7556 (+6)  | 7495 (+11) | 0 (-1)| 61 (-4)  |
| head/i386   | 7554 (+6)  | 7484 (+7)  | 2 (0) | 68 (-1)  |
| 12-STABLE/amd64 | 7393 (+1)  | 7341 (-7)  | 11 (+11)  | 41 (-3)  |
| 12-STABLE/i386  | 7391 (+1)  | 7329 (-10) | 11 (+11)  | 51 (0)   |
| 11-STABLE/amd64 | 6846 (+1)  | 6802 (+4)  | 0 (0) | 44 (-3)  |
| 11-STABLE/i386  | 6844 (+1)  | 6767 (-7)  | 34 (0)| 43 (-6)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20190908 and archive is available at
https://hackmd.io/@FreeBSD-CI/, any help is welcome.

## News

* Weekly CI report archive has been moved to https://hackmd.io/@FreeBSD-CI

* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md)
  is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* (flakey) usr.bin.procstat.procstat_test.environment
* (flakey) usr.bin.procstat.procstat_test.command_line_arguments
  Fixed in https://svnweb.freebsd.org/changeset/base/351819

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-12-amd64-test/
* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netipsec.tunnel.aes_cbc_128_hmac_sha1.v6
* sys.netipsec.tunnel.aes_cbc_256_hmac_sha2_256.v6
* sys.netipsec.tunnel.aes_gcm_128.v6
* sys.netipsec.tunnel.aes_gcm_256.v6
* sys.netipsec.tunnel.aesni_aes_cbc_128_hmac_sha1.v6
* sys.netipsec.tunnel.aesni_aes_cbc_256_hmac_sha2_256.v6
* sys.netipsec.tunnel.aesni_aes_gcm_128.v6
* sys.netipsec.tunnel.aesni_aes_gcm_256.v6
* sys.netipsec.tunnel.empty.v6
* sys.netpfil.pf.fragmentation.v6
* sys.netpfil.pf.pass_block.v6
* https://bugs.freebsd.org/240511

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.amd64.arrays.t_dtrace_contrib.tst_uregsarray_d
* https://bugs.freebsd.org/240358

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
  Patch available: https://reviews.freebsd.org/D21566
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380 (updating net/scapy to 2.4.3 may fix this)
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  

FreeBSD CI Weekly Report 2019-09-01

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-09-01
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-08-26 to 2019-09-01.

During this period, we have:

* 1625 builds (97.4% (+14.4) passed, 2.6% (-14.4) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 276 test runs (59.8% (+14.6) passed, 40.2% (-8.6) unstable, 0% (-6)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 51 doc builds (98.0% (-2) passed, 2% (+2) failed)

Test case status (on 2019-09-01 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped |
| --- | -- | -- | --- | --- |
| head/amd64  | 7550 (+17) | 7484 (+21) | 1 (+1)  | 65 (-5) |
| head/i386   | 7548 (+17) | 7477 (+22) | 2 (+2)  | 69 (-5) |
| 12-STABLE/amd64 | 7392 (0)   | 7348 (+3)  | 0 (0)   | 44 (-3) |
| 12-STABLE/i386  | 7390 (0)   | 7339 (+3)  | 0 (0)   | 51 (-3) |
| 11-STABLE/amd64 | 6845 (0)   | 6798 (-3)  | 0 (0)   | 47 (+3) |
| 11-STABLE/i386  | 6843 (0)   | 6760 (-3)  | 34 (0)  | 49 (+3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/@FreeBSD-CI/report-20190901 and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## News
 
* Faliure notification has been turned on for 
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc/
 
* [FCP 20190401-ci_policy: CI 
policy](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md) 
is in "feedback" state, please check and provide comments on -fcp@ and 
-hackers@ mailing lists.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.kern.pdeathsig.signal_delivered_ptrace
* Reported in https://bugs.freebsd.org/237657
* Fixed in https://svnweb.freebsd.org/changeset/base/351210

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* sys.cddl.zfs.tests.atime.atime_test.atime_001_pos
* Reported in https://bugs.freebsd.org/240221
* Fixed in https://svnweb.freebsd.org/changeset/base/351642

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* (flaky) sys.sys.qmath_test.qdivq_s64q
* https://bugs.freebsd.org/240219
* Disabled in https://svnweb.freebsd.org/changeset/base/351739

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237641
* cddl.usr.sbin.dtrace.amd64.arrays.t_dtrace_contrib.tst_uregsarray_d
* https://bugs.freebsd.org/240358

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380 (updating net/scapy to 2.4.3 may fix this)
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425
* lib.libc.gen.getmntinfo_test.getmntinfo_test
  https://bugs.freebsd.org/240049
* sys.sys.qmath_test.qdivq_s64q
  https://bugs.freebsd.org/240219

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o 

FreeBSD CI Weekly Report 2019-08-25

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-08-25
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-08-19 to 2019-08-25.

During this period, we have:

* 2262 builds (83% (-10.3) passed, 17% (+10.3) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 403 test runs (45.2% (-18.1) passed, 48.8% (+14.1) unstable, 6% (+4)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 38 doc builds (100% (0) passed)

Test case status (on 2019-08-25 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped  |
| --- | -- | -- | --- |  |
| head/amd64  | 7533 (+22) | 7463 (+17) | 0 (-2)  | 70 (+7)  |
| head/i386   | 7531 (+22) | 7455 (+18) | 0 (-2)  | 74 (+4)  |
| 12-STABLE/amd64 | 7392 (0)   | 7345 (+4)  | 0 (-2)  | 47 (-2)  |
| 12-STABLE/i386  | 7390 (0)   | 7336 (+4)  | 0 (-2)  | 54 (-2)  |
| 11-STABLE/amd64 | 6845 (0)   | 6801 (+7)  | 0 (0)   | 44 (-7)  |
| 11-STABLE/i386  | 6843 (0)   | 6763 (+7)  | 34 (0)  | 46 (-7)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/HkcTCgnVB and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## News
  
* [FCP 20190401-ci_policy: CI policy
](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md) is in 
"feedback" state, please check and provide comments.

* Per imp@ suggested [timeline of gcc 4.2.1 
removal](https://lists.freebsd.org/pipermail/freebsd-arch/2019-August/019674.html):
* -Werror has been turned off for gcc 4.2.1 in
  [r351429](https://svnweb.freebsd.org/changeset/base/351429) and
  [r351430](https://svnweb.freebsd.org/changeset/base/351430)
* power*-build has been fixed in 
[r351485](https://svnweb.freebsd.org/changeset/base/351485)
* amd64-gcc build still need fix, patch is being discussed in
  https://reviews.freebsd.org/D21418

* Some pf tests failing on i386 which may be related to bpf, need more help:
* https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
* https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/12237/
* https://ci.freebsd.org/job/FreeBSD-head-i386-test/6383/
* sys.acl.00.main
* sys.acl.02.main
  Fixed by update package to perl5.30
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.icmp.cve_2019_5598
  Due to [r351212](https://svnweb.freebsd.org/changeset/base/351212) 
changed options of ping6(8),
  fixed in [r351391](https://svnweb.freebsd.org/changeset/base/351391)

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  

FreeBSD CI Weekly Report 2019-08-18

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-08-18
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-08-12 to 2019-08-18.

During this period, we have:

* 2205 builds (93.3% (+2.3) passed, 6.7% (-2.3) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 401 test runs (63.3% (-21.8) passed, 34.7% (+19.8) unstable, 2% (+2)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 8 doc builds (100% (+0) passed)

Test case status (on 2019-08-18 23:59):
| Branch/Architecture | Total  | Pass  | Fail| Skipped  |
| --- | -- | - | --- |  |
| head/amd64  | 7511 (+4)  | 7446 (-3) | 2 (+2)  | 63 (+5)  |
| head/i386   | 7509 (+4)  | 7437 (-6) | 2 (+2)  | 70 (+8)  |
| 12-STABLE/amd64 | 7392 (0)   | 7341 (-7) | 2 (+2)  | 49 (+5)  |
| 12-STABLE/i386  | 7390 (0)   | 7332 (-7) | 2 (+2)  | 56 (+5)  |
| 11-STABLE/amd64 | 6845 (0)   | 6794 (-7) | 0 (0)   | 51 (+7)  |
| 11-STABLE/i386  | 6843 (0)   | 6756 (-7) | 34 (0)  | 53 (+7)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/S1ueobKEH and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## News
  
* [FCP 20190401-ci_policy: CI policy
](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md) is in 
"feedback" state, please check and provide comments.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/12237/
* https://ci.freebsd.org/job/FreeBSD-head-i386-test/6383/
* sys.acl.00.main
* sys.acl.02.main
  These are due to /usr/local/bin/perl changed to be installed by 
lang/perl5.30 (fixed now).
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.icmp.cve_2019_5598

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared
  A fix is committed: https://svnweb.freebsd.org/changeset/base/351151

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237403
  Tests 

FreeBSD CI Weekly Report 2019-08-11

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-08-11
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-08-05 to 2019-08-11.

During this period, we have:

* 2066 builds (91% (-4.8) passed, 9% (4.8) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 343 test runs (85.1% (-2.3) passed, 14.9% (+2.3) unstable)
  were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 18 doc builds (100% (+0) passed)

Test case status (on 2019-08-11 23:59):
| Branch/Architecture | Total  | Pass   | Fail| Skipped |
| --- | -- | -- | --- | --- |
| head/amd64  | 7507 (+47) | 7449 (+40) | 0 (0)   | 58 (+7) |
| head/i386   | 7505 (+47) | 7443 (+43) | 0 (0)   | 62 (+4) |
| 12-STABLE/amd64 | 7392 (+4)  | 7348 (+4)  | 0 (0)   | 44 (0)  |
| 12-STABLE/i386  | 7390 (+4)  | 7339 (+4)  | 0 (0)   | 51 (0)  |
| 11-STABLE/amd64 | 6845 (0)   | 6801 (+4)  | 0 (-1)  | 44 (-3) |
| 11-STABLE/i386  | 6843 (0)   | 6763 (+3)  | 34 (0)  | 46 (-3) |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/HySDseqQB and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## News
  
* [FCP 20190401-ci_policy: CI policy
](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md) is in 
"feedback" state, please check and provide comments.

* This week we added LINT kernel build job for aarch64:
  https://ci.freebsd.org/job/FreeBSD-head-aarch64-LINT/
  We will add more LINT kernel build jobs for tier2 and tier3 soon.
  
* Total test case number increased a lot by fusefs update in
  [r350665](https://svnweb.freebsd.org/changeset/base/350665).

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared
  Patch available: https://reviews.freebsd.org/D21069

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: 

FreeBSD CI Weekly Report 2019-08-04

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-08-04
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-07-29 to 2019-08-04.

During this period, we have:

* 1662 builds (95.8% (-1.3) passed, 4.2% (+1.3) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 309 test runs (87.4% (+6.6) passed, 12.6% (-6.3) unstable, 0% (-0.3)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 18 doc builds (100% (+0) passed)

Test case status (on 2019-07-28 23:59):
| Branch/Architecture | Total  | Pass  | Fail| Skipped  |
| --- | -- | - | --- |  |
| head/amd64  | 7460 (+0)  | 7409 (+0) | 0 (+0)  | 51 (+0)  |
| head/i386   | 7458 (+0)  | 7400 (+0) | 0 (+0)  | 58 (+0)  |
| 12-STABLE/amd64 | 7388 (+0)  | 7344 (+0) | 0 (+0)  | 44 (+0)  |
| 12-STABLE/i386  | 7386 (+0)  | 7332 (-3) | 0 (+0)  | 54 (+3)  |
| 11-STABLE/amd64 | 6845 (+0)  | 6800 (+3) | 1 (+0)  | 44 (-3)  |
| 11-STABLE/i386  | 6843 (+0)  | 6760 (+1) | 34 (-1) | 49 (+0)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/rkEiIYr7B and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## News
  
* [FCP 20190401-ci_policy: CI policy
](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md) is in 
"feedback" state, please check and provide comments.

* We are skipping the test cases failing in CI system only when "ci"
  configuration variable is true.  This value can be set in kyua.conf
  or cli as: `kyua -v test_suites.FreeBSD.ci=true test`

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared
  Patch available: https://reviews.freebsd.org/D21069

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: error: 
expected relocatable expression
* https://bugs.freebsd.org/237403
  Tests in 

FreeBSD CI Weekly Report 2019-07-28

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-07-28
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-07-22 to 2019-07-28.

During this period, we have:

* 1689 builds (97.1% (+0.4) passed, 2.9% (-0.4) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 317 test runs (80.8% (+24.6) passed, 18.9% (-24.2) unstable, 0.3% (-0.4)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 36 doc builds (100% (+0) passed)

Test case status (on 2019-07-28 23:59):
| Branch/Architecture | Total  | Pass  | Fail| Skipped  |
| --- | -- | - | --- |  |
| head/amd64  | 7460 (+0)  | 7409 (-2) | 0 (+0)  | 51 (+2)  |
| head/i386   | 7458 (+0)  | 7400 (-6) | 0 (+0)  | 58 (+10) |
| 12-STABLE/amd64 | 7388 (+0)  | 7344 (+3) | 0 (+0)  | 44 (-3)  |
| 12-STABLE/i386  | 7386 (+0)  | 7335 (+0) | 0 (-5)  | 51 (+5)  |
| 11-STABLE/amd64 | 6845 (+0)  | 6797 (-3) | 1 (+1)  | 47 (+2)  |
| 11-STABLE/i386  | 6843 (+0)  | 6759 (+0) | 35 (+1) | 49 (-1)  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/r1l5zGmMH and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## News
  
* [FCP 20190401-ci_policy: CI policy
](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md) is in 
"feedback" state, please check and provide comments.

* This week we disabled most unstable test cases in CI runs to let the real 
error caused by the commit can be noticed more easier.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.opencrypto.runtests.main
  https://svnweb.freebsd.org/changeset/base/350209

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
  https://bugs.freebsd.org/220841
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
  https://bugs.freebsd.org/237450
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781
* sys.netpfil.pf.names.names
* sys.netpfil.pf.synproxy.synproxy
  https://bugs.freebsd.org/238870
* sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger 
  https://bugs.freebsd.org/239292
* sys.netpfil.pf.forward.v4 (i386 only)
* sys.netpfil.pf.forward.v6 (i386 only)
* sys.netpfil.pf.set_tos.v4 (i386 only)
  https://bugs.freebsd.org/239380
* sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger 
  https://bugs.freebsd.org/239397
* sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
  https://bugs.freebsd.org/239399
* sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
  https://bugs.freebsd.org/239425

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared
  Patch available: https://reviews.freebsd.org/D21069

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237077
  possible race in build: 

FreeBSD CI Weekly Report 2019-07-21

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-07-21
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-07-15 to 2019-07-21.

During this period, we have:

* 1659 builds (96.7% (-0.7) passed, 3.3% (+0.7) failed) were executed on
  aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
  powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11
  branches.
* 306 test runs (56.2% (+1.9) passed, 43.1% (+5.6) unstable, 0.7% (-7.5)
  exception) were executed on amd64, i386, riscv64 architectures for head,
  stable/12, stable/11 branches.
* 18 doc builds (100% (+0) passed)

Test case status (by 2019-07-21 23:59):
| Branch/Architecture | Total | Pass | Fail | Skipped |
| --- | - |  |  | --- |
| head/amd64  | 7460  | 7411 | 0| 49  |
| head/i386   | 7458  | 7406 | 4| 48  |
| 12-STABLE/amd64 | 7388  | 7341 | 0| 47  |
| 12-STABLE/i386  | 7386  | 7335 | 5| 46  |
| 11-STABLE/amd64 | 6845  | 6800 | 0| 45  |
| 11-STABLE/i386  | 6843  | 6759 | 34   | 50  |

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/rJJdcpCbH and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.opencrypto.runtests.main
  Fixed in http://svnweb.freebsd.org/changeset/base/350164

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* Analysis from kp@:
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* Same as -head:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libregex.exhaust_test.regcomp_too_big
* flaky, sometimes failed with:
  ```
  /usr/src/contrib/netbsd-tests/lib/libc/regex/t_exhaust.c:72: p != 
NULL not met
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: error: 
expected relocatable expression
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
  tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since 
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655
  Non-deterministic panic when running pf tests in interface ioctl code (NULL 
passed to strncmp)
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 

FreeBSD CI Weekly Report 2019-07-14

[Li-Wen Hsu]

(Please send the followup to freebsd-testing@ and note Reply-To is set.)

FreeBSD CI Weekly Report 2019-07-14
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-07-08 to 2019-07-14.

During this period, we have:

* 1628 builds (97.4% passed, 2.6% failed) were executed on aarch64, amd64,
  armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 317 test runs (54.3% passed, 37.5% unstable, 8.2% exception) were executed on
  amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 48 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/Bk5EdrMbB and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.opencrypto.runtests.main
  Fixed in [r349872](https://reviews.freebsd.org/rS349872)

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* Analysis from kp@:
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* Same as -head:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* sys.opencrypto.runtests.main
* Needs MFC more than r349872.
* lib.libregex.exhaust_test.regcomp_too_big
* flaky, sometimes failed with:
  ```
  /usr/src/contrib/netbsd-tests/lib/libc/regex/t_exhaust.c:72: p != 
NULL not met
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: error: 
expected relocatable expression
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
  tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since 
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655
  Non-deterministic panic when running pf tests in interface ioctl code (NULL 
passed to strncmp)
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." 
seen when running sys/netipsec tests
* https://bugs.freebsd.org/237657
  sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on i386
* https://bugs.freebsd.org/238781
  sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when 
mac_portacl(4) loaded

### Others

* [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

* https://issues.tmatesoft.com/issue/SVNKIT-740
  The patch is 

FreeBSD CI Weekly Report 2019-07-07

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-07-07
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-07-01 to 2019-07-07.

During this period, we have:

* 1871 builds (96.2% passed, 3.8% failed) were executed on aarch64, amd64,
  armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 335 test runs (47.5% passed, 45.3% unstable, 7.2% exception) were executed on
  amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 34 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/BJmFeVxbB and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* Analysis from kp@:
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* Same as -head:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```
* lib.libregex.exhaust_test.regcomp_too_big
* flaky, sometimes failed with:
  ```
  /usr/src/contrib/netbsd-tests/lib/libc/regex/t_exhaust.c:72: p != 
NULL not met
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of 
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781

## Issues

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s
* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared

### Cause kernel panics
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic
  Patch exists:
* https://reviews.freebsd.org/D20868
* https://reviews.freebsd.org/D20869

### Open
* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: error: 
expected relocatable expression
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
  tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since 
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655
  Non-deterministic panic when running pf tests in interface ioctl code (NULL 
passed to strncmp)
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." 
seen when running sys/netipsec tests
* https://bugs.freebsd.org/237657
  sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on i386
* https://bugs.freebsd.org/238781
  sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when 
mac_portacl(4) loaded

### 

FreeBSD CI Weekly Report 2019-06-30

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-06-30
===

Here is a summary of the FreeBSD Continuous Integration results for the period 
from 2019-06-24 to 2019-06-30.

During this period, we have:

* 1764 builds (95.9% passed, 4.1% failed) were executed on aarch64, amd64,
  armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 333 test runs (57.1% passed, 33.6% unstable, 9.3% exception) were executed on
  amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 44 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/BkT334Wer and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* Analysis from kp@:
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* Same as -head:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```
* lib.libregex.exhaust_test.regcomp_too_big
* flaky, sometimes failed with:
  ```
  /usr/src/contrib/netbsd-tests/lib/libc/regex/t_exhaust.c:72: p != 
NULL not met
  ```


* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of 
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781

## Issues

### New

* https://bugs.freebsd.org/238828
  Possible build race: lib/libsysdecode/tables.h:948: error: 
'IPV6_MIN_MEMBERSHIPS' undeclared
* https://bugs.freebsd.org/238870
  sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic

### Cause build fails
* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Open
* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: error: 
expected relocatable expression
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
  tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since 
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655
  Non-deterministic panic when running pf tests in interface ioctl code (NULL 
passed to strncmp)
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." 
seen when running sys/netipsec tests
* https://bugs.freebsd.org/237657
  sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on i386
* https://bugs.freebsd.org/238781
  sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when 
mac_portacl(4) loaded

### Others

* [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

* 

FreeBSD CI Weekly Report 2019-06-23

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-06-23
===

Here is a summary of the FreeBSD Continuous Integration results for the period
from 2019-06-17 to 2019-06-23.

During this period, we have:

* 1835 builds (98.7% passed, 1.3% failed) were executed on aarch64, amd64,
  armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
  sparc64 architectures for head, stable/12, stable/11 branches.
* 356 test runs (38.2% passed, 55.9% unstable, 5.9% exception) were executed on
  amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 32 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or expertise
please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/Sy6_MI6kH and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* Others:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* Analysis from kp@:
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
* 
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libregex.exhaust_test.regcomp_too_big
* flaky, sometimes failed with:
  ```
  /usr/src/contrib/netbsd-tests/lib/libc/regex/t_exhaust.c:72: p != 
NULL not met
  ```
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of 
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
 for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588
* sys.netinet.socket_afinet.socket_afinet_bind_zero (new)
  https://bugs.freebsd.org/238781

## Issues

### New

* https://bugs.freebsd.org/238781
  sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when 
mac_portacl(4) loaded

### Open

* https://bugs.freebsd.org/237077
  possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: error: 
expected relocatable expression
* https://bugs.freebsd.org/237403
  Tests in sys/opencrypto should be converted to Python3
* https://bugs.freebsd.org/237641
  Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
  tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since 
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655
  Non-deterministic panic when running pf tests in interface ioctl code (NULL 
passed to strncmp)
* https://bugs.freebsd.org/237656
  "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." 
seen when running sys/netipsec tests
* https://bugs.freebsd.org/237657
  sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on i386

### Cause build fails

* https://bugs.freebsd.org/233735
  Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: 
machine/endian.h: No such file or directory
* https://bugs.freebsd.org/233769
  Possible build race: ld: error: unable to find library -lgcc_s

### Others

* [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

* https://issues.tmatesoft.com/issue/SVNKIT-740
  The patch is asked to be updated and help wanted.
  
* https://bugs.freebsd.org/235356
  Help on how to reproduce and analyze is wanted.

___
freebsd-current@freebsd.org mailing list

FreeBSD CI Weekly Report 2019-06-16

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-06-16
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-06-10 to 2019-06-16.

During this period, we have:

* 1927 builds (98.1% passed, 1.9% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 199 test runs (56.8% passed, 42.7% unstable, 0.5% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 45 doc builds (97.8% passed, 2.2 failed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/BJmuwS5yS and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed Builds

* All -testvm jobs
* Script for building test VM image in freebsd-ci has been updated
to fulfill that pkg(8) requires `/dev/null`

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc/
* Fixed in [r349008](https://reviews.freebsd.org/rS349008)

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  Affected by mac_portacl(4), which is loaded by MAC tests. Need
to specify AF_INET to workaround and fix is being discussed.

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* Same as amd64:
* sys.netinet.socket_afinet.socket_afinet_bind_zero
* Others:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* Analysis from kp@:
*
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001933.html
*
https://lists.freebsd.org/pipermail/freebsd-testing/2019-June/001934.html
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression
* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3
* https://bugs.freebsd.org/237641 Flakey test case:
common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655 Non-deterministic panic when running
pf tests in interface ioctl code (NULL passed to strncmp)
* https://bugs.freebsd.org/237656 "Freed UMA keg (rtentry) was not
empty (18 items). Lost 1 pages of memory." seen when running
sys/netipsec tests
* https://bugs.freebsd.org/237657
sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on
i386

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others

* [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

* https://issues.tmatesoft.com/issue/SVNKIT-740

FreeBSD CI Weekly Report 2019-06-09

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-06-09
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-06-03 to 2019-06-09.

During this period, we have:

* 2444 builds (92.9% passed, 7.1% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 247 test runs (51% passed, 49% unstable) were executed on amd64,
i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 76 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/BJI5k8RRV and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* [r348808](https://reviews.freebsd.org/rS348808) fixed i386
kernel panics on loading ipsec(4) kernel module, which is needed after
[347410](https://svnweb.freebsd.org/changeset/base/347410). For more
information, see:
* https://bugs.freebsd.org/238012
* https://bugs.freebsd.org/230857
* https://reviews.freebsd.org/D17512

## Failing builds

* https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc/
* See https://reviews.freebsd.org/D20622

* pkg(8) now requires `/dev/null` which doesn't exist on jail builds
test VM image.  Fix is under development now.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  Affected by mac_portacl(4), which is loaded by MAC tests. Need
to specify AF_INET to workaround and fix is being discussed.

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* Same as amd64:
* sys.netinet.socket_afinet.socket_afinet_bind_zero
* Others:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression
* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3
* https://bugs.freebsd.org/237641 Flakey test case:
common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655 Non-deterministic panic when running
pf tests in interface ioctl code (NULL passed to strncmp)
* https://bugs.freebsd.org/237656 "Freed UMA keg (rtentry) was not
empty (18 items). Lost 1 pages of memory." seen when running
sys/netipsec tests
* https://bugs.freebsd.org/237657
sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on
i386

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library

FreeBSD CI Weekly Report 2019-06-02

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-06-02
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-05-27 to 2019-06-02.

During this period, we have:

* 1752 builds (97.8% passed, 2.2% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 327 test runs (36.7% passed, 63.3% unstable) were executed on amd64,
i386, riscv64 architectures for head, stable/12, stable/11 branches.
* 23 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/ryVi1WiaN and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Removed Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.geom.class.eli.init_test.init
* sys.geom.class.eli.init_test.init_a
* sys.geom.class.eli.init_test.init_alias
* sys.geom.class.eli.integrity_test.copy
* sys.geom.class.eli.integrity_test.data
* sys.geom.class.eli.integrity_test.hmac
  Those geli(8) test cases are failing because some algorithms are
deprecated in [r348206](https://reviews.freebsd.org/rS348206) and the
return value and output are changed.  The fix to the test cases are
under development.  Those tests are removed in
[r348454](https://reviews.freebsd.org/rS348454), while it is still
wothy to adjust the test code to check if the deprecated algorithms
are correctly marked deprecated in the future.

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* Same as amd64

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  Affected by mac_portacl(4), which is loaded by MAC tests. Need
to specify AF_INET to workaround and fix is being discussed.

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* i386 test is current suffering from loading ipsec(4) kernel
module, which is needed after
https://svnweb.freebsd.org/changeset/base/347410 ,  causes kernel
panic.
For more information, see:
* https://bugs.freebsd.org/238012
* https://bugs.freebsd.org/230857
* https://reviews.freebsd.org/D17512
* Same as amd64:
* sys.netinet.socket_afinet.socket_afinet_bind_zero
* Others:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Fixed Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* There are ~980 test cases failure with message:
`dtrace: failed to compile script err.D_AGG_SCALAR.maxnoarg.d:
[D_UNKNOWN] "/usr/lib/dtrace/mbuf.d", line 114: failed to copy type of
'm_data': Type information is in parent and unavailable`
  Fixed by https://svnweb.freebsd.org/changeset/base/348329

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression
* https://bugs.freebsd.org/237403 

FreeBSD CI Weekly Report 2019-05-26

[Li-Wen Hsu]

(Please send the followup discussions to freebsd-testing@ list.)

FreeBSD CI Weekly Report 2019-05-26
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-05-20 to 2019-05-26.

During this period, we have:

* 2273 builds (97% passed, 3% failed) were executed on aarch64, amd64,
armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe,
riscv64, sparc64 architectures for head, stable/12, stable/11
branches.
* test runs (% passed, % unstable, % exception) were executed on
amd64, i386, riscv64 architectures for head, stable/12, stable/11
branches.
* 21 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/HyiX1HETN and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.geom.class.eli.init_test.init
* sys.geom.class.eli.init_test.init_a
* sys.geom.class.eli.init_test.init_alias
* sys.geom.class.eli.integrity_test.copy
* sys.geom.class.eli.integrity_test.data
* sys.geom.class.eli.integrity_test.hmac
  Those geli(8) test cases are failing because some algorithms are
deprecated in r348206 and the return value and output are changed.
The fix to the test cases are under development.
* sys.netinet.socket_afinet.socket_afinet_bind_zero
  Affected by mac_portacl(4), which is loaded by MAC tests. Need
to specify AF_INET to workaround and fix is being discussed.

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* i386 test is current suffering from loading ipsec(4) kernel
module, which is needed after
https://svnweb.freebsd.org/changeset/base/347410 ,  causes kernel
panic.
For more information, see:
* https://bugs.freebsd.org/238012
* https://bugs.freebsd.org/230857
* https://reviews.freebsd.org/D17512
* Same as amd64:
* sys.geom.class.eli.init_test.init
* sys.geom.class.eli.init_test.init_a
* sys.geom.class.eli.init_test.init_alias
* sys.geom.class.eli.integrity_test.copy
* sys.geom.class.eli.integrity_test.data
* sys.geom.class.eli.integrity_test.hmac
* sys.netinet.socket_afinet.socket_afinet_bind_zero
* Others:
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* sys.opencrypto.runtests.main

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.opencrypto.runtests.main
  Failed with:
  ```
File "/usr/tests/sys/opencrypto/cryptodev.py", line 179, in __init__
  ioctl(_cryptodev, CIOCGSESSION2, s, 1)
  IOError: [Errno 22] Invalid argument
  ```

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* There are ~980 test cases failure with message:
`dtrace: failed to compile script err.D_AGG_SCALAR.maxnoarg.d:
[D_UNKNOWN] "/usr/lib/dtrace/mbuf.d", line 114: failed to copy type of
'm_data': Type information is in parent and unavailable`
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* This job is currently suffering from timeout because of
https://bugs.freebsd.org/237652
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression
* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3
* https://bugs.freebsd.org/237641 Flakey test case:
common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since
somewhere in (r346814, r 346845]
* 

FreeBSD CI Weekly Report 2019-05-19

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-05-19
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-05-13 to 2019-05-19.

During this period, we have:

* 1845 builds (97% passed, 3% failed) were executed on aarch64, amd64,
armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe,
riscv64, sparc64 architectures for head, stable/12, stable/11
branches.
* test runs (58.7% passed, 19.6% unstable, 21.7% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 20 doc builds (95% passed)

Note: there was a updating of ci.freebsd.org system and resulted some
(less than 10) failures.

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/SJIjkSeaE and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* 
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/11251/testReport/junit/lib.libarchive/functional_test/test_read_format_zip_utf8_paths/
  Fixed in https://svnweb.freebsd.org/changeset/base/347999

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
i386 test is current suffering from loading ipsec(4) kernel
module, which is needed after
https://svnweb.freebsd.org/changeset/base/347410 ,  causes kernel
panic.
For more information, see:
* https://bugs.freebsd.org/238012
* https://bugs.freebsd.org/230857
* https://reviews.freebsd.org/D17512

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing and Flaky Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
  https://bugs.freebsd.org/237641

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression
* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3
* https://bugs.freebsd.org/237641 Flakey test case:
common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655 Non-deterministic panic when running
pf tests in interface ioctl code (NULL passed to strncmp)
* https://bugs.freebsd.org/237656 "Freed UMA keg (rtentry) was not
empty (18 items). Lost 1 pages of memory." seen when running
sys/netipsec tests
* https://bugs.freebsd.org/237657
sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on
i386

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

## Other news
* https://issues.tmatesoft.com/issue/SVNKIT-740
  The patch is asked to be updated and help wanted.

* https://bugs.freebsd.org/235356
  Help on how to reproduce and analyze is wanted.
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-05-12

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-05-12
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-05-06 to 2019-05-12.

During this period, we have:

* 2151 builds (98.2% passed, 1.8% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 394 test runs (43.9% passed, 13.7% unstable, 42.4% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 19 doc builds (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/SJ9KUn16V and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
i386 test is current suffering from loading ipsec(4) kernel
module, which is needed after
https://svnweb.freebsd.org/changeset/base/347410 ,  causes kernel
panic.

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression
* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3
* https://bugs.freebsd.org/237641 Flakey test case:
common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655 Non-deterministic panic when running
pf tests in interface ioctl code (NULL passed to strncmp)
* https://bugs.freebsd.org/237656 "Freed UMA keg (rtentry) was not
empty (18 items). Lost 1 pages of memory." seen when running
sys/netipsec tests
* https://bugs.freebsd.org/237657
sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on
i386

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-05-05

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-05-05
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-04-29 to 2019-05-05.

During this period, we have:

* 2372 builds (99.9% passed, 0.1% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 384 test runs (53.9% passed, 44.5% unstable, 1.6% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 20 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/B13k-VEoN and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.


## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.kern.coredump_phnum_test.coredump_phnum
  https://svnweb.freebsd.org/changeset/base/346909
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4
  https://svnweb.freebsd.org/changeset/base/346912

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4
  https://svnweb.freebsd.org/changeset/base/346911

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.opencrypto.runtests.main
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## New Issues

* https://bugs.freebsd.org/237641 Flakey test case:
common.misc.t_dtrace_contrib.tst_dynopt_d
* https://bugs.freebsd.org/237652
tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since
somewhere in (r346814, r 346845]
* https://bugs.freebsd.org/237655 Non-deterministic panic when running
pf tests in interface ioctl code (NULL passed to strncmp)
* https://bugs.freebsd.org/237656 "Freed UMA keg (rtentry) was not
empty (18 items). Lost 1 pages of memory." seen when running
sys/netipsec tests
* https://bugs.freebsd.org/237657
sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on
i386

## Oepn Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression

* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD Continuous Weekly Report 2019-04-28

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-04-28
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-04-22 to 2019-04-28.

During this period, we have:

* 2358 builds (96.9% passed, 3.1% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 436 test runs (34.9% passed, 59.4% unstable, 5.7% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 9 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/ByfvuSs54 and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.fragmentation.v6
* sys.netpfil.pf.icmp.cve_2019_5598
* sys.netpfil.pf.set_tos.v4
  https://bugs.freebsd.org/237305

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.kern.coredump_phnum_test.coredump_phnum
  https://svnweb.freebsd.org/changeset/base/346542

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netmap.ctrl-api-test.main

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh
  https://svnweb.freebsd.org/changeset/base/346854

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.opencrypto.runtests.main
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  MFC pending: https://svnweb.freebsd.org/changeset/base/346542
* sys.netpfil.pf.forward.v6
* usr.bin.procstat.procstat_test.command_line_arguments
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.set_tos.v4

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* (flaky) usr.bin.procstat.procstat_test.environment

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Closed Issues

* https://bugs.freebsd.org/237305 Multiple sys.netpfil.pf.* tests
failing on ^/head and ^/stable/12 because of TypeError with scapy
library reading interfaces from bpf

## Oepn Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression

* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-04-21

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-04-21
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-04-15 to 2019-04-21.

During this period, we have:

* 2346 builds (95.5% passed, 4.5% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 400 test runs (13.5% passed, % 69.8unstable, 16.7% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
  Most of the exceptions were because of there is no initial entropy
pre-stored in the test VM image, and r346250 blocks read until the
device is seeded, whcih causes hang in boot. r346292 and r346358 added
tunables to not being blocked when reading from unseeded random
device.
* 25 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/HJUJV7VcV and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* lib.libc.gen.floatunditf_test.floatunditf
* lib.libc.stdio.printfloat_test.hexadecimal_rounding
* lib.msun.ctrig_test.test_small_inputs
* lib.msun.precision_test.t_precision
  https://bugs.freebsd.org/236936
  Fixed by https://svnweb.freebsd.org/changeset/base/346294

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.netpfil.pf.forward.v4
* sys.netpfil.pf.forward.v6
* sys.netpfil.pf.fragmentation.v6
* sys.netpfil.pf.icmp.cve_2019_5598
* sys.netpfil.pf.set_tos.v4
  https://bugs.freebsd.org/237305 fix committed, wait for package build

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.opencrypto.runtests.main
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Closed Issues

* https://bugs.freebsd.org/236936 4 test cases failing on i386 after r345562

## Oepn Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression

* https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be
converted to Python3

### In progress

* https://bugs.freebsd.org/237305 Multiple sys.netpfil.pf.* tests
failing on ^/head and ^/stable/12 because of TypeError with scapy
library reading interfaces from bpf

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-current@freebsd.org mailing list

FreeBSD CI Weekly Report 2019-04-14

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-04-14
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-04-08 to 2019-04-14.

During this period, we have:

* 1702 builds (95.7% passed, 4.3% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 274 test runs (47.1% passed, 45.6% unstable, 7.3% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 13 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/r1EE3jotE and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.geom.class.eli.online_resize_test.online_resize (at clean up stage)
  Fixed in https://svnweb.freebsd.org/changeset/base/346057

* https://ci.freebsd.org/job/FreeBSD-head-riscv64-test/
* Because Python default version switched 3, fixed in the test code.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.opencrypto.runtests.main
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4
* lib.libc.gen.floatunditf_test.floatunditf
* lib.libc.stdio.printfloat_test.hexadecimal_rounding
* lib.msun.ctrig_test.test_small_inputs
* lib.msun.precision_test.t_precision
  https://bugs.freebsd.org/236936 (fixed when this report published)

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Closed Issues

* https://bugs.freebsd.org/237128
sys/geom/class/eli:online_resize_test fails to clean up cleanly,
causing false positives
* https://bugs.freebsd.org/237129 sys.netmap.ctrl-api-test.main fails
on ^/stable/11 and ^/stable/12 i386 because the kernel lacks netmap
support

## Oepn Issues

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression

### In progress

* https://bugs.freebsd.org/236936 4 test cases failing on i386 after r345562

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-04-07

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-04-07
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-04-01 to 2019-04-07.

During this period, we have:

* 1841 builds (96% passed, 4% failed) were executed on aarch64, amd64,
armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe,
riscv64, sparc64 architectures for head, stable/12, stable/11
branches.
* 314 test runs (34.7% passed, 65% unstable, 0.3% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 4 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/BymrvPI_4 and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* sys.geom.class.eli.online_resize_test.online_resize
  https://bugs.freebsd.org/237128

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
  https://bugs.freebsd.org/237129
* sys.opencrypto.runtests.main
  https://bugs.freebsd.org/237130
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4
* lib.libc.gen.floatunditf_test.floatunditf
* lib.libc.stdio.printfloat_test.hexadecimal_rounding
* lib.msun.ctrig_test.test_small_inputs
* lib.msun.precision_test.t_precision
  https://bugs.freebsd.org/236936

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netmap.ctrl-api-test.main
  https://bugs.freebsd.org/237129
* sys.opencrypto.runtests.main
  https://bugs.freebsd.org/237130
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
  https://bugs.freebsd.org/237129
* sys.opencrypto.runtests.main
  https://bugs.freebsd.org/237130
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Oepn Issues

### New

* https://bugs.freebsd.org/237077 possible race in build:
/usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected
relocatable expression

### In progress

* https://bugs.freebsd.org/236936 4 test cases failing on i386 after r345562

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others

[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

## Other News

* Some PF tests are filing for a while because of py27-pcap-0.6.5,
thanks for kp@'s report and bofh@ committed update of py-pcap-0.6.6.
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-03-31

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-03-31
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-03-25 to 2019-03-31.

During this period, we have:

* 2095 builds (98.7% passed, 1.3% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 363 test runs (52.6% passed, 46.8% unstable, 0.6% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 8 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/BymrvPI_4 and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Fixed Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* lib.libarchive.functional_test.test_fuzz_zip
  Fixed in https://svnweb.freebsd.org/changeset/base/345497

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
  Fixed in https://svnweb.freebsd.org/changeset/base/345516

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4
* (New) lib.libc.gen.floatunditf_test.floatunditf
* (New) lib.libc.stdio.printfloat_test.hexadecimal_rounding
* (New) lib.msun.ctrig_test.test_small_inputs
* (New) lib.msun.precision_test.t_precision
  https://bugs.freebsd.org/236936

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Closed Issues

* Flakey test case: lib.libarchive.functional_test.test_fuzz_zip
  https://bugs.freebsd.org/236300

## Oepn Issues

* https://bugs.freebsd.org/236936 4 test cases failing on i386 after r345562

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-03-24

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-03-24
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-03-18 to 2019-03-24.

During this period, we have:

* 2286 builds (98.3% passed, 1.7% failed) were executed on aarch64,
amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64,
powerpcspe, riscv64, sparc64 architectures for head, stable/12,
stable/11 branches.
* 498 test runs (37.3% passed, 60.7% unstable, 2% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 15 doc buils (100% passed)

(The statistics from experimental jobs are omitted)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/rybS4spvN and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* lib.libarchive.functional_test.test_fuzz_zip
  (flakey) See https://bugs.freebsd.org/236300 for more details

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sbin.bectl.bectl_test.bectl_mount
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Closed Issues

* [29: genassym.o build race](https://bugs.freebsd.org/29)

* sys.netmap.ctrl-api-test.main failed after
https://svnweb.freebsd.org/changeset/base/345269 , fixed in
https://svnweb.freebsd.org/changeset/base/345323 .

* https://bugs.freebsd.org/236475 triggered assertion failure on
initialing ZFS in tests, is fixed in
https://svnweb.freebsd.org/changeset/base/345418

* sys.netpfil.pf.icmp.cve_2019_5598 added with wrong failname in
https://svnweb.freebsd.org/changeset/base/345409 , fixed in
https://svnweb.freebsd.org/changeset/base/345430

## Open Issues

* Flakey test case: lib.libarchive.functional_test.test_fuzz_zip
https://bugs.freebsd.org/236300

### Cause build fails

* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)

## Other News

* mizhka@ is fixing the subversion library used in Jenkins, which
solves the problem that Jenkins cannot checkout from a subversion
repository when running on FreeBSD after inode64 merge (FreeBSD
12.0-RELEASE). More details available:
  https://issues.tmatesoft.com/issue/SVNKIT-740
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD CI Weekly Report 2019-03-17

[Li-Wen Hsu]

(bcc -current and -stable for more audience)

FreeBSD CI Weekly Report 2019-03-17
===

Here is a summary of the FreeBSD Continuous Integration results for
the period from 2019-03-11 to 2019-03-17.

During this period, we have:

* 1918 builds (93.2% passed, 2.3% failed, 86% exception) were executed
on aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc,
powerpc64, powerpcspe, riscv64, sparc64 architectures for head,
stable/12, stable/11 branches.
* 339 test runs (54.9% passed, 44.8% unstable, 0.3% exception) were
executed on amd64, i386, riscv64 architectures for head, stable/12,
stable/11 branches.
* 15 doc buils (100% passed)

(For more meaningful statistics, we omitted the numbers from experimental jobs)

If any of the issues found by CI are in your area of interest or
expertise please investigate the PRs listed below.

The latest web version of this report is available at
https://hackmd.io/s/SJc5jaHw4 and archive is available at
http://hackfoldr.org/freebsd-ci-report/, any help is welcome.

## Failing Tests

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test/
* lib.libarchive.functional_test.test_fuzz_zip
  (flakey) See https://bugs.freebsd.org/236300 for more details

* https://ci.freebsd.org/job/FreeBSD-head-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495
* (New) lib.libc.sys.sendfile_test.fd_positive_shm_v4
* (New) lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

* https://ci.freebsd.org/job/FreeBSD-stable-12-i386-test/
* sbin.bectl.bectl_test.bectl_mount
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* lib.libc.regex.exhaust_test.regcomp_too_big
* lib.libregex.exhaust_test.regcomp_too_big
* sys.kern.coredump_phnum_test.coredump_phnum
  WIP: https://reviews.freebsd.org/D18495

* https://ci.freebsd.org/job/FreeBSD-stable-11-amd64-test/
* usr.bin.procstat.procstat_test.kernel_stacks

* https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/
* sys.netmap.ctrl-api-test.main
* sys.opencrypto.runtests.main
* usr.bin.procstat.procstat_test.kernel_stacks
* local.kyua.* (31 cases)
* local.lutok.* (3 cases)
* lib.libc.sys.sendfile_test.fd_positive_shm_v4
* lib.libc.sys.sendfile_test.hdtr_negative_bad_pointers_v4

## Failing Tests (from experimental jobs)

* https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
* common.rates.t_dtrace_contrib.tst_switchrate_d
* common.syscall.t_dtrace_contrib.tst_args_d
* common.misc.t_dtrace_contrib.tst_dynopt_d
* common.ip.t_dtrace_contrib.tst_ipv4localsctp_ksh
* common.ip.t_dtrace_contrib.tst_localsctpstate_ksh

* https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
* There are ~60 failing cases, including flakey ones, see
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
for more details

## Disabled Tests

* lib.libc.sys.mmap_test.mmap_truncate_signal
  https://bugs.freebsd.org/211924
* sys.fs.tmpfs.mount_test.large
  https://bugs.freebsd.org/212862
* sys.fs.tmpfs.link_test.kqueue
  https://bugs.freebsd.org/213662
* sys.kqueue.libkqueue.kqueue_test.main
  https://bugs.freebsd.org/233586
* usr.bin.procstat.procstat_test.command_line_arguments
  https://bugs.freebsd.org/233587
* usr.bin.procstat.procstat_test.environment
  https://bugs.freebsd.org/233588

## Open Issues

* Flakey test case: lib.libarchive.functional_test.test_fuzz_zip
https://bugs.freebsd.org/236300

### Cause build fails

* [29: genassym.o build race](https://bugs.freebsd.org/29)
* Patch available:
https://people.freebsd.org/~bdrewery/patches/PR29.diff
* [233735: Possible build race: genoffset.o /usr/src/sys/sys/types.h:
error: machine/endian.h: No such file or
directory](https://bugs.freebsd.org/233735)
* [233769: Possible build race: ld: error: unable to find library
-lgcc_s](https://bugs.freebsd.org/233769)

### Others
[Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"