On Thu, Sep 3, 2020 at 4:06 AM Li-Wen Hsu <lwhsu at freebsd.org> wrote:
> (Please send the followup to freebsd-testing@ and note Reply-To is set.)
>
> FreeBSD CI Weekly Report 2020-08-30
> ==================================>
> Here is a summary of the FreeBSD Continuous Integration results for the
> period
> from 2020-08-24 to 2020-08-30.
>
> During this period, we have:
>
> * 2429 builds (88.3% (+0.4) passed, 11.7% (-0.4) failed) of buildworld and
> buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
> armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
> sparc64 architectures for head, stable/12, stable/11 branches.
> * 274 test runs (45.3% (-8.1) passed, 27.7% (-8.0) unstable, 27.0% (+16.1)
> exception) were executed on amd64, i386, riscv64 architectures for head,
> stable/12, stable/11 branches.
> * 24 doc and www builds (100% (0) passed)
>
> Test case status (on 2020-08-30 23:59):
> | Branch/Architecture | Total | Pass | Fail | Skipped |
> | ------------------- | --------- | ---------- | ----- | -------- |
> | head/amd64 | 7876 (+1) | 7785 (+1) | 1 (0) | 90 (0) |
> | head/i386 | 7873 (0) | 7773 (-3) | 0 (0) | 100 (+3) |
> | 12-STABLE/amd64 | 7626 (0) | 7569 (0) | 0 (0) | 57 (0) |
> | 12-STABLE/i386 | 7624 (0) | 7559 (+3) | 0 (0) | 65 (-3) |
> | 11-STABLE/amd64 | 6912 (0) | 6861 (-30) | 0 (0) | 51 (+30) |
> | 11-STABLE/i386 | 6910 (0) | 6854 (-3) | 0 (0) | 56 (+3) |
>
> (The statistics from experimental jobs are omitted)
>
> If any of the issues found by CI are in your area of interest or expertise
> please investigate the PRs listed below.
>
> The latest web version of this report is available at
> https://hackmd.io/@FreeBSD-CI/report-20200830 and archive is available at
> https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.
>
> ## News
>
> * Numbers of FreeBSD-head-amd64-test_zfs are changed after OpenZFS
> importing,
> we encouage everyone check and fix the failing and skipped test cases.
>
> ## Failing jobs
>
> * https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
> There are still mutiple errors when building with gcc6, error log
> available at
>
>
https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
> See also:
>
> https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
>
> ## Failing test cases
>
> * sys.kern.kern_copyin.kern_copyin
> Fails after somewhere in (r364509, r364542]
> https://bugs.freebsd.org/248933
>
> * lib.libbe.be_create.* and sbin.bectl.bectl_test.*
> https://bugs.freebsd.org/249055
>
> ## Regressions
>
> * lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on
> amd64 after r360915
> https://bugs.freebsd.org/246537
>
> * lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
> https://bugs.freebsd.org/244732
> Needs to check if llvm11 import fixes this.
>
> * Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on
> i386
> https://bugs.freebsd.org/244163
> Discovered by newly endabled sys.net.* tests. ([r357857](
> https://svnweb.freebsd.org/changeset/base/357857))
>
> * sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
> https://bugs.freebsd.org/244168
> Discovered by newly endabled sys.net.* tests. ([r357857](
> https://svnweb.freebsd.org/changeset/base/357857))
> Fix committed as https://svnweb.freebsd.org/changeset/base/364220 ,
> needs more verification.
>
> * sys.kern.kern_copyin.kern_copyin
> https://bugs.freebsd.org/248933
>
> ## Failing and Flaky tests (from experimental jobs)
>
> * https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
> * cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
> * https://bugs.freebsd.org/237641
>
> * https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
> * Total 681 tests, 525 success, 46 failures, 110 skipped, see
>
>
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
> for more details
>
That's 35 more failures than we used to have. What changed? Was this
using the openzfs kmod? It looks like test run 7392 was when the change
happened.
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/7392/changes
>
> * https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
> * Total 3749 tests, 2292 success, 644 failures, 813 skipped
>
> ## Disabled Tests
>
> * sys.fs.tmpfs.mount_test.large
> https://bugs.freebsd.org/212862
> * sys.fs.tmpfs.link_test.kqueue
> https://bugs.freebsd.org/213662
> * sys.kqueue.libkqueue.kqueue_test.main
> https://bugs.freebsd.org/233586
> * sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
> https://bugs.freebsd.org/220841
> * lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
> https://bugs.freebsd.org/237450
> * sys.netinet.socket_afinet.socket_afinet_bind_zero
> https://bugs.freebsd.org/238781
> * sys.netpfil.pf.names.names
> * sys.netpfil.pf.synproxy.synproxy
> https://bugs.freebsd.org/238870
> *
> sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger
> https://bugs.freebsd.org/239292
> *
> sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger
>
> https://bugs.freebsd.org/239397
> * sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
> https://bugs.freebsd.org/239399
> *
> sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
> https://bugs.freebsd.org/239425
> * sys.sys.qmath_test.qdivq_s64q
> https://bugs.freebsd.org/240219
> * sys.kern.ptrace_test.ptrace__getppid
> https://bugs.freebsd.org/240510
> * lib.libc.sys.stat_test.stat_socket
> https://bugs.freebsd.org/240621
> * lib.libarchive.functional_test.test_write_filter_zstd
> https://bugs.freebsd.org/240683
> * lib.libcasper.services.cap_dns.dns_test.main
> lib.libcasper.services.cap_net.net_test.*
> https://bugs.freebsd.org/241435
> * local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
> https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
> * sys.kern.ptrace_test.ptrace__procdesc_reparent_wait_child
> https://bugs.freebsd.org/243605
> * sys.kern.ptrace_test.ptrace__parent_wait_after_attach
> https://bugs.freebsd.org/244055
> * sys.kern.ptrace_test.ptrace__parent_exits_before_child
> https://bugs.freebsd.org/244056
> * sys.net.if_lagg_test.witness (i386)
> https://bugs.freebsd.org/244163
> * PipePdfork.WildcardWait in sys.capsicum.capsicum-test.main
> https://bugs.freebsd.org/244165
> * sys.net.if_lagg_test.lacp_linkstate_destroy_stress (i386)
> https://bugs.freebsd.org/244168
> * sys.netinet6.frag6.frag6_07.frag6_07
> https://bugs.freebsd.org/244170
> * sys.netinet.fibs_test.udp_dontroute6
> https://bugs.freebsd.org/244172
> * sys.netpfil.pf.nat.exhaust
> https://bugs.freebsd.org/244703
> * sys.geom.class.gate.ggate_test.ggated (i386)
> https://bugs.freebsd.org/244737
> * sys.kern.sysv_test.msg
> https://bugs.freebsd.org/233649
>
> ## Issues
>
> ### Cause build fails
> * https://bugs.freebsd.org/233769
> Possible build race: ld: error: unable to find library -lgcc_s
>
> ### Cause kernel panics
> * https://bugs.freebsd.org/238870
> sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause
> panic
>
> ### Open
> * https://bugs.freebsd.org/237641
> Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
> * https://bugs.freebsd.org/237656
> "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of
> memory." seen when running sys/netipsec tests
> * https://bugs.freebsd.org/238781
> sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when
> mac_portacl(4) loaded
> * https://bugs.freebsd.org/239292
> Flakey test case:
> sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger
> * https://bugs.freebsd.org/239397
> Flakey test case:
> sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger
> * https://bugs.freebsd.org/239399
> Flakey test case:
> sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
> * https://bugs.freebsd.org/239425
> Flakey test case:
> sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
> * https://bugs.freebsd.org/241662
> Flakey test case: lib.libarchive.functional_test.test_fuzz_iso9660
> * https://bugs.freebsd.org/246443
> sys.net.if_clone_test.epair_stress sometimes exceeds timeout limit but
> not caught by kyua
> * https://bugs.freebsd.org/247510
> sys.net.if_lagg_test.status_stress panics kernel on i386
>
> ### Others
>
> * [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
> _______________________________________________
> freebsd-testing at freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-testing
> To unsubscribe, send any mail to "freebsd-testing-unsubscribe at
freebsd.org"
>