Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists

2016-06-25 Thread Mark Millard 
On 2016-Jun-25, at 12:44 AM, Ngie Cooper  wrote:

> On Fri, Jun 24, 2016 at 9:50 PM, Mark Millard  wrote:
>> On 2016-Jun-24, at 2:50 PM, Alan Somers  wrote:
>> 
>>> As of r302180., the usr.sbin/rpcbind, sys/acl, and sys/sys/bitstring
>>> tests should all be fixed.  I opened PR 210329 for the
>>> usr.bin/lastcomm test.  I haven't investigated the others.
> 
> ...
> 
>> This time the totals were 15 broken (down from 24) and 41 failed (down
>> from 59).
>> 
>> My results this time were. . .
> 
> Hi Mark,
>Please file bugs for all of the individual component failures,
> e.g. lib/msun, and CC me on the bugs.
> Thanks,
> -Ngie

Done. I generally omitted the --verbose Metadata output. For a few there was a 
large block of Standard output or Standard error text that I omitted.

I was not sure of the intent but I put all the lib/msun "broken" items in one 
submittal, for example. Similarly for each of the other "broken" components.

Similarly for lib/msun "failed" items (a separate submittal). Similarly for 
each of the other "failed" components.



I noted explicitly in each submittal that I'd used -mcpu=cortex-a7 in my builds.

But in more detail:

A) buildworld and buildkernel had -march=armv7-a -mcpu=cortex-a7 both listed

B) ports builds (such as kyua itself) had -mcpu=cortex-a7 (but not 
-march=armv7-a)

This is because for ports I use options that do not complain for either clang 
3.8.0 or for fairly modern gcc and gcc does complain about specifying both 
-mcpu=armv7-a and -mcpu=cortex-a7. Even the "armv7-a" notation is from gcc 
rejecting armv7a but both clang and gcc accepting armv7-a notation.

(As I remember gcc uses -march=armv7-a where it conflicts with -mcpu=cortex-a7 
when both are listed but gcc does warn about conflict despite having a 
resolution rule.)

Other than the 11.0 -r302180 being more recent the "context details" in

https://lists.freebsd.org/pipermail/freebsd-current/2016-June/061831.html

still apply. I did not repeat that information in the submittals but at least 
the src.conf and the like are available for reference.

===
Mark Millard
markmi at dsl-only.net

___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists

2016-06-25 Thread Ngie Cooper 
On Fri, Jun 24, 2016 at 9:50 PM, Mark Millard  wrote:
> On 2016-Jun-24, at 2:50 PM, Alan Somers  wrote:
>
>> As of r302180., the usr.sbin/rpcbind, sys/acl, and sys/sys/bitstring
>> tests should all be fixed.  I opened PR 210329 for the
>> usr.bin/lastcomm test.  I haven't investigated the others.

...

> This time the totals were 15 broken (down from 24) and 41 failed (down
> from 59).
>
> My results this time were. . .

Hi Mark,
Please file bugs for all of the individual component failures,
e.g. lib/msun, and CC me on the bugs.
Thanks,
-Ngie
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists

2016-06-24 Thread Mark Millard 
On 2016-Jun-24, at 2:50 PM, Alan Somers  wrote:

> As of r302180., the usr.sbin/rpcbind, sys/acl, and sys/sys/bitstring
> tests should all be fixed.  I opened PR 210329 for the
> usr.bin/lastcomm test.  I haven't investigated the others.
> 
> -Alan

I updated to -r302180 and ran kyua again. It confirms the rpcbind, acl,
and bitstring items are gone from the broken and failed lists.

This time the totals were 15 broken (down from 24) and 41 failed (down
from 59).

My results this time were. . .

# kyua report --results-filter broken --results-file /usr/tests | more
===> Broken tests
lib/msun/cexp_test:main  ->  broken: Received signal 6  [1.094s]
lib/msun/ctrig_test:main  ->  broken: Received signal 6  [1.097s]
lib/msun/exponential_test:main  ->  broken: Received signal 6  [1.097s]
lib/msun/fenv_test:main  ->  broken: Received signal 6  [1.099s]
lib/msun/fma_test:main  ->  broken: Received signal 6  [1.114s]
lib/msun/invctrig_test:main  ->  broken: Received signal 6  [1.118s]
lib/msun/invtrig_test:main  ->  broken: Received signal 6  [1.114s]
lib/msun/logarithm_test:main  ->  broken: Received signal 6  [1.096s]
lib/msun/lrint_test:main  ->  broken: Received signal 6  [1.096s]
lib/msun/nearbyint_test:main  ->  broken: Received signal 6  [1.096s]
lib/msun/rem_test:main  ->  broken: Received signal 6  [1.091s]
lib/msun/trig_test:main  ->  broken: Received signal 6  [1.094s]
sbin/growfs/legacy_test:main  ->  broken: Reported plan differs from actual 
executed tests  [0.479s]
sys/geom/class/eli/integrity_copy_test:main  ->  broken: Test case timed out  
[1200.089s]
sys/geom/class/eli/onetime_a_test:main  ->  broken: Test case timed out  
[600.041s]
===> Summary
Results read from /root/.kyua/store/results.usr_tests.20160625-012941-048472.db
Test cases: 5700 total, 54 skipped, 20 expected failures, 15 broken, 41 failed
Total time: 9093.092s

# kyua report --results-filter failed --results-file /usr/tests | more
===> Failed tests
lib/libc/c063/fstatat_test:fstatat_fd  ->  failed: 
/usr/src/contrib/netbsd-tests/lib/libc/c063/t_fstatat.c:74: memcmp(, , 
sizeof(st1)) == 0 not met  [0.028s]
lib/libc/ssp/ssp_test:fgets  ->  failed: Test case body returned a non-ok exit 
code, but this is not allowed  [0.159s]
lib/libc/ssp/ssp_test:gets  ->  failed: Test case body returned a non-ok exit 
code, but this is not allowed  [0.152s]
lib/libc/ssp/ssp_test:memcpy  ->  failed: atf-check failed; see the output of 
the test for details  [0.150s]
lib/libc/ssp/ssp_test:memmove  ->  failed: atf-check failed; see the output of 
the test for details  [0.149s]
lib/libc/ssp/ssp_test:memset  ->  failed: atf-check failed; see the output of 
the test for details  [0.152s]
lib/libc/ssp/ssp_test:read  ->  failed: Test case body returned a non-ok exit 
code, but this is not allowed  [0.159s]
lib/libc/ssp/ssp_test:readlink  ->  failed: atf-check failed; see the output of 
the test for details  [0.161s]
lib/libc/ssp/ssp_test:snprintf  ->  failed: atf-check failed; see the output of 
the test for details  [0.143s]
lib/libc/ssp/ssp_test:sprintf  ->  failed: atf-check failed; see the output of 
the test for details  [0.143s]
lib/libc/ssp/ssp_test:stpcpy  ->  failed: atf-check failed; see the output of 
the test for details  [0.146s]
lib/libc/ssp/ssp_test:stpncpy  ->  failed: atf-check failed; see the output of 
the test for details  [0.149s]
lib/libc/ssp/ssp_test:strcat  ->  failed: atf-check failed; see the output of 
the test for details  [0.148s]
lib/libc/ssp/ssp_test:strcpy  ->  failed: atf-check failed; see the output of 
the test for details  [0.152s]
lib/libc/ssp/ssp_test:strncat  ->  failed: atf-check failed; see the output of 
the test for details  [0.143s]
lib/libc/ssp/ssp_test:strncpy  ->  failed: atf-check failed; see the output of 
the test for details  [0.147s]
lib/libc/ssp/ssp_test:vsnprintf  ->  failed: atf-check failed; see the output 
of the test for details  [0.145s]
lib/libc/ssp/ssp_test:vsprintf  ->  failed: atf-check failed; see the output of 
the test for details  [0.146s]
lib/libc/stdio/printbasic_test:int_within_limits  ->  failed: printf("%tu", 
(size_t)-1) ==> [18446744073709551615], expected [4294967295]<>  
[0.029s]
lib/libc/stdio/scanfloat_test:infinities_and_nans  ->  failed: 
/usr/src/lib/libc/tests/stdio/scanfloat_test.c:191: fetestexcept(FE_INVALID) == 
0 not met  [0.032
s]
lib/libc/sys/mincore_test:mincore_resid  ->  failed: 
/usr/src/contrib/netbsd-tests/lib/libc/sys/t_mincore.c:225: 
check_residency(addr, npgs) == 0 not met  [0.04
1s]
lib/libc/sys/mincore_test:mincore_shmseg  ->  failed: 
/usr/src/contrib/netbsd-tests/lib/libc/sys/t_mincore.c:298: 
check_residency(addr, npgs) == 0 not met  [0.0
32s]
lib/libc/tls/tls_dynamic_test:t_tls_dynamic  ->  failed: 15 checks failed; see 
output for more details  [0.037s]
lib/libproc/proc_test:symbol_lookup  ->  failed: 
/usr/src/lib/libproc/tests/proc_test.c:116: state != PS_STOP: process has state 
4  [0.180s]
lib/libxo/functional_test:test_02__E  ->

Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists

2016-06-24 Thread Alan Somers 
>> > On Mon, Jun 13, 2016 at 11:29 AM, Mark Millard > > > wrote:
>> > > With the newly less strict alignment requirements "kyua test -k
>> > > /usr/tests/Kyuafile" runs to completion, unlike before.
>> > >
>> > > > ===> Summary
>> > > > Results read from /root/.kyua/store/results.usr_tests.20160613
>> > > > -080302-120731.db
>> > > > Test cases: 5694 total, 54 skipped, 21 expected failures, 24
>> > > > broken, 59 failed
>> > > > Total time: 8723.243s
>> > >
>> > >
>> > > I only list the one line summaries below. Then I list various
>> > > context details.
>> > >
>> > > > ===> Broken tests
>> > > > lib/msun/cexp_test:main  ->  broken: Received signal 6
>> > > >  [1.054s]
>> > > > lib/msun/ctrig_test:main  ->  broken: Received signal 6
>> > > >  [1.074s]
>> > > > lib/msun/exponential_test:main  ->  broken: Received signal 6
>> > > >  [1.045s]
>> > > > lib/msun/fenv_test:main  ->  broken: Received signal 6
>> > > >  [1.048s]
>> > > > lib/msun/fma_test:main  ->  broken: Received signal 6  [1.080s]
>> > > > lib/msun/invctrig_test:main  ->  broken: Received signal 6
>> > > >  [1.091s]
>> > > > lib/msun/invtrig_test:main  ->  broken: Received signal 6
>> > > >  [1.086s]
>> > > > lib/msun/logarithm_test:main  ->  broken: Received signal 6
>> > > >  [1.054s]
>> > > > lib/msun/lrint_test:main  ->  broken: Received signal 6
>> > > >  [1.069s]
>> > > > lib/msun/nearbyint_test:main  ->  broken: Received signal 6
>> > > >  [1.066s]
>> > > > lib/msun/rem_test:main  ->  broken: Received signal 6  [1.069s]
>> > > > lib/msun/trig_test:main  ->  broken: Received signal 6
>> > > >  [1.070s]
>> > > > sbin/growfs/legacy_test:main  ->  broken: Reported plan differs
>> > > > from actual executed tests  [0.459s]
>> > > > sys/geom/class/eli/integrity_copy_test:main  ->  broken: Test
>> > > > case timed out  [1200.082s]
>> > > > sys/geom/class/eli/integrity_hmac_test:main  ->  broken: Test
>> > > > case timed out  [600.138s]
>> > > > sys/geom/class/eli/onetime_a_test:main  ->  broken: Test case
>> > > > timed out  [600.044s]
>> > > > sys/sys/bitstring_test:bit_clear  ->  broken: Test case body
>> > > > timed out  [300.032s]
>> > > > sys/sys/bitstring_test:bit_count  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.080s]
>> > > > sys/sys/bitstring_test:bit_ffc  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.077s]
>> > > > sys/sys/bitstring_test:bit_ffc_at  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.081s]
>> > > > sys/sys/bitstring_test:bit_ffs  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.082s]
>> > > > sys/sys/bitstring_test:bit_ffs_at  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.077s]
>> > > > sys/sys/bitstring_test:bit_nclear  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.083s]
>> > > > sys/sys/bitstring_test:bit_nset  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.079s]
>> > >
>> > >
>> > > > ===> Failed tests
>> > > > lib/libc/c063/fstatat_test:fstatat_fd  ->  failed:
>> > > > /usr/src/contrib/netbsd-tests/lib/libc/c063/t_fstatat.c:74:
>> > > > memcmp(, , sizeof(st1)) == 0 not met  [0.
>> > > > 027s]
>> > > > lib/libc/nss/gethostby_test:getipnodebyname_getaddrinfo_ipv4
>> > > > ->  failed: /usr/src/lib/libc/tests/nss/gethostby_test.c:1335:
>> > > > run_tests(_hostlist_file, _snapshot
>> > > > _file, 2, TEST_GETHOSTBYNAME2_GETADDRINFO, 0) == 0 not met
>> > > >  [15.315s]
>> > > > lib/libc/ssp/ssp_test:fgets  ->  failed: Test case body
>> > > > returned a non-ok exit code, but this is not allowed  [0.153s]
>> > > > lib/libc/ssp/ssp_test:gets  ->  failed: Test case body returned
>> > > > a non-ok exit code, but this is not allowed  [0.158s]
>> > > > lib/libc/ssp/ssp_test:memcpy  ->  failed: atf-check failed; see
>> > > > the output of the test for details  [0.148s]
>> > > > lib/libc/ssp/ssp_test:memmove  ->  failed: atf-check failed;
>> > > > see the output of the test for details  [0.147s]
>> > > > lib/libc/ssp/ssp_test:memset  ->  failed: atf-check failed; see
>> > > > the output of the test for details  [0.147s]
>> > > > lib/libc/ssp/ssp_test:read  ->  failed: Test case body returned
>> > > > a non-ok exit code, but this is not allowed  [0.154s]
>> > > > lib/libc/ssp/ssp_test:readlink  ->  failed: atf-check failed;
>> > > > see the output of the test for details  [0.155s]
>> > > > lib/libc/ssp/ssp_test:snprintf  ->  failed: atf-check failed;
>> > > > see the output of the test for details  [0.149s]
>> > > > lib/libc/ssp/ssp_test:sprintf  ->  failed: atf-check failed;
>> > > > see the output of the test for details  [0.149s]
>> > > > lib/libc/ssp/ssp_test:stpcpy  ->  failed: atf-check failed; see
>> > > > the output of the test for details  [0.149s]
>> > > > lib/libc/ssp/ssp_test:stpncpy  ->  failed: atf-check failed;
>> > > > see the output of

Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists

2016-06-13 Thread Ian Lepore 
On Mon, 2016-06-13 at 11:04 -0700, Conrad Meyer wrote:
> I expect it's because:
> 
> 1. bitstr_size() is just bytes (doesn't round up to sizeof(bitstr_t ==
> unsigned long))

This might result in allocating too-few bytes, but that's something
you'd only notice if you have something like valgrind watching out for
accesses beyond the allocated size.

> 2. The userspace version of bit_alloc() uses calloc(bitstr_size(), 1)
> (an array of nmemb=bitstr_size() size=bytes, doesn't have to be
> 'unsigned long' sized or aligned).
> 3. Various bit_* functions access the result as if it's an array of
> 'unsigned long', when it was allocated as a single-byte array (no
> ulong alignment or size).

malloc and related functions (including calloc) always return memory
"...suitably aligned for storage of any type of object."  Last time I
checked that basically meant all allocations, even a single byte, are
aligned on a 16-byte boundary on arm.

> 4. ARM isn't as happy about unaligned accesses as x86.
> 

That's mostly not the case anymore.  Using load/store-doubleword or
load/store-multiple instructions requires 4-byte-aligned values (not a
typo: doubleword access requires word alignment).  Everything smaller
than doubleword access in userland these days can be unaligned.  The
optimizer can combine adjacent 32-bit accesses into doubleword
-instruction accesses, leading to alignment faults with unaligned data,
but that shouldn't be the case here because malloc'd memory is aligned.

-- Ian

> I'd make the following change (needs sys/param.h, not compile tested)
> and see if it fixes it:
> 
> --- sys/bitstring.h (revision 301805)
> +++ sys/bitstring.h (working copy)
> @@ -119,7 +119,8 @@
>  static inline bitstr_t *
>  bit_alloc(int _nbits)
>  {
> -   return ((bitstr_t *)calloc(bitstr_size(_nbits), 1));
> +   return (calloc(howmany(bitstr_size(_nbits),
> sizeof(bitstr_t)),
> +   sizeof(bitstr_t)));
>  }
>  #endif
> 
> 
> 
> 
> 
> 
> On Mon, Jun 13, 2016 at 10:49 AM, Alan Somers 
> wrote:
> > Please open a bug for the bitstring test failures and assign it to
> > me.
> > Also, since I don't have any arm hardware, please provide
> > instructions
> > on how to run this code in a VM, or where I can get access to the
> > hardware.
> > 
> > -Alan
> > 
> > On Mon, Jun 13, 2016 at 11:29 AM, Mark Millard  > > wrote:
> > > With the newly less strict alignment requirements "kyua test -k
> > > /usr/tests/Kyuafile" runs to completion, unlike before.
> > > 
> > > > ===> Summary
> > > > Results read from /root/.kyua/store/results.usr_tests.20160613
> > > > -080302-120731.db
> > > > Test cases: 5694 total, 54 skipped, 21 expected failures, 24
> > > > broken, 59 failed
> > > > Total time: 8723.243s
> > > 
> > > 
> > > I only list the one line summaries below. Then I list various
> > > context details.
> > > 
> > > > ===> Broken tests
> > > > lib/msun/cexp_test:main  ->  broken: Received signal 6 
> > > >  [1.054s]
> > > > lib/msun/ctrig_test:main  ->  broken: Received signal 6 
> > > >  [1.074s]
> > > > lib/msun/exponential_test:main  ->  broken: Received signal 6 
> > > >  [1.045s]
> > > > lib/msun/fenv_test:main  ->  broken: Received signal 6 
> > > >  [1.048s]
> > > > lib/msun/fma_test:main  ->  broken: Received signal 6  [1.080s]
> > > > lib/msun/invctrig_test:main  ->  broken: Received signal 6 
> > > >  [1.091s]
> > > > lib/msun/invtrig_test:main  ->  broken: Received signal 6 
> > > >  [1.086s]
> > > > lib/msun/logarithm_test:main  ->  broken: Received signal 6 
> > > >  [1.054s]
> > > > lib/msun/lrint_test:main  ->  broken: Received signal 6 
> > > >  [1.069s]
> > > > lib/msun/nearbyint_test:main  ->  broken: Received signal 6 
> > > >  [1.066s]
> > > > lib/msun/rem_test:main  ->  broken: Received signal 6  [1.069s]
> > > > lib/msun/trig_test:main  ->  broken: Received signal 6 
> > > >  [1.070s]
> > > > sbin/growfs/legacy_test:main  ->  broken: Reported plan differs
> > > > from actual executed tests  [0.459s]
> > > > sys/geom/class/eli/integrity_copy_test:main  ->  broken: Test
> > > > case timed out  [1200.082s]
> > > > sys/geom/class/eli/integrity_hmac_test:main  ->  broken: Test
> > > > case timed out  [600.138s]
> > > > sys/geom/class/eli/onetime_a_test:main  ->  broken: Test case
> > > > timed out  [600.044s]
> > > > sys/sys/bitstring_test:bit_clear  ->  broken: Test case body
> > > > timed out  [300.032s]
> > > > sys/sys/bitstring_test:bit_count  ->  broken: Premature exit;
> > > > test case received signal 11 (core dumped)  [1.080s]
> > > > sys/sys/bitstring_test:bit_ffc  ->  broken: Premature exit;
> > > > test case received signal 11 (core dumped)  [1.077s]
> > > > sys/sys/bitstring_test:bit_ffc_at  ->  broken: Premature exit;
> > > > test case received signal 11 (core dumped)  [1.081s]
> > > > sys/sys/bitstring_test:bit_ffs  ->  broken: Premature exit;
> > > > test case received signal 11 (core dumped)  [1.082s]
> > > > sys/sys/bitstring_test:bit_ffs_at  ->

Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists

2016-06-13 Thread Conrad Meyer 
I expect it's because:

1. bitstr_size() is just bytes (doesn't round up to sizeof(bitstr_t ==
unsigned long))
2. The userspace version of bit_alloc() uses calloc(bitstr_size(), 1)
(an array of nmemb=bitstr_size() size=bytes, doesn't have to be
'unsigned long' sized or aligned).
3. Various bit_* functions access the result as if it's an array of
'unsigned long', when it was allocated as a single-byte array (no
ulong alignment or size).
4. ARM isn't as happy about unaligned accesses as x86.

I'd make the following change (needs sys/param.h, not compile tested)
and see if it fixes it:

--- sys/bitstring.h (revision 301805)
+++ sys/bitstring.h (working copy)
@@ -119,7 +119,8 @@
 static inline bitstr_t *
 bit_alloc(int _nbits)
 {
-   return ((bitstr_t *)calloc(bitstr_size(_nbits), 1));
+   return (calloc(howmany(bitstr_size(_nbits), sizeof(bitstr_t)),
+   sizeof(bitstr_t)));
 }
 #endif






On Mon, Jun 13, 2016 at 10:49 AM, Alan Somers  wrote:
> Please open a bug for the bitstring test failures and assign it to me.
> Also, since I don't have any arm hardware, please provide instructions
> on how to run this code in a VM, or where I can get access to the
> hardware.
>
> -Alan
>
> On Mon, Jun 13, 2016 at 11:29 AM, Mark Millard  wrote:
>> With the newly less strict alignment requirements "kyua test -k 
>> /usr/tests/Kyuafile" runs to completion, unlike before.
>>
>>> ===> Summary
>>> Results read from 
>>> /root/.kyua/store/results.usr_tests.20160613-080302-120731.db
>>> Test cases: 5694 total, 54 skipped, 21 expected failures, 24 broken, 59 
>>> failed
>>> Total time: 8723.243s
>>
>>
>> I only list the one line summaries below. Then I list various context 
>> details.
>>
>>> ===> Broken tests
>>> lib/msun/cexp_test:main  ->  broken: Received signal 6  [1.054s]
>>> lib/msun/ctrig_test:main  ->  broken: Received signal 6  [1.074s]
>>> lib/msun/exponential_test:main  ->  broken: Received signal 6  [1.045s]
>>> lib/msun/fenv_test:main  ->  broken: Received signal 6  [1.048s]
>>> lib/msun/fma_test:main  ->  broken: Received signal 6  [1.080s]
>>> lib/msun/invctrig_test:main  ->  broken: Received signal 6  [1.091s]
>>> lib/msun/invtrig_test:main  ->  broken: Received signal 6  [1.086s]
>>> lib/msun/logarithm_test:main  ->  broken: Received signal 6  [1.054s]
>>> lib/msun/lrint_test:main  ->  broken: Received signal 6  [1.069s]
>>> lib/msun/nearbyint_test:main  ->  broken: Received signal 6  [1.066s]
>>> lib/msun/rem_test:main  ->  broken: Received signal 6  [1.069s]
>>> lib/msun/trig_test:main  ->  broken: Received signal 6  [1.070s]
>>> sbin/growfs/legacy_test:main  ->  broken: Reported plan differs from actual 
>>> executed tests  [0.459s]
>>> sys/geom/class/eli/integrity_copy_test:main  ->  broken: Test case timed 
>>> out  [1200.082s]
>>> sys/geom/class/eli/integrity_hmac_test:main  ->  broken: Test case timed 
>>> out  [600.138s]
>>> sys/geom/class/eli/onetime_a_test:main  ->  broken: Test case timed out  
>>> [600.044s]
>>> sys/sys/bitstring_test:bit_clear  ->  broken: Test case body timed out  
>>> [300.032s]
>>> sys/sys/bitstring_test:bit_count  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.080s]
>>> sys/sys/bitstring_test:bit_ffc  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.077s]
>>> sys/sys/bitstring_test:bit_ffc_at  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.081s]
>>> sys/sys/bitstring_test:bit_ffs  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.082s]
>>> sys/sys/bitstring_test:bit_ffs_at  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.077s]
>>> sys/sys/bitstring_test:bit_nclear  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.083s]
>>> sys/sys/bitstring_test:bit_nset  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.079s]
>>
>>
>>> ===> Failed tests
>>> lib/libc/c063/fstatat_test:fstatat_fd  ->  failed: 
>>> /usr/src/contrib/netbsd-tests/lib/libc/c063/t_fstatat.c:74: memcmp(, 
>>> , sizeof(st1)) == 0 not met  [0.
>>> 027s]
>>> lib/libc/nss/gethostby_test:getipnodebyname_getaddrinfo_ipv4  ->  failed: 
>>> /usr/src/lib/libc/tests/nss/gethostby_test.c:1335: 
>>> run_tests(_hostlist_file, _snapshot
>>> _file, 2, TEST_GETHOSTBYNAME2_GETADDRINFO, 0) == 0 not met  [15.315s]
>>> lib/libc/ssp/ssp_test:fgets  ->  failed: Test case body returned a non-ok 
>>> exit code, but this is not allowed  [0.153s]
>>> lib/libc/ssp/ssp_test:gets  ->  failed: Test case body returned a non-ok 
>>> exit code, but this is not allowed  [0.158s]
>>> lib/libc/ssp/ssp_test:memcpy  ->  failed: atf-check failed; see the output 
>>> of the test for details  [0.148s]
>>> lib/libc/ssp/ssp_test:memmove  ->  failed: atf-check failed; see the output 
>>> of the test for details  [0.147s]
>>> lib/libc/ssp/ssp_test:memset  ->  failed: atf-check

Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists

2016-06-13 Thread Alan Somers 
This isn't an ABI issue.  Since there's no dynamic library, there's no
ABI to break except for weird circumstances like writing the in-memory
representation of a bitstring to a file, rebuilding world, and reading
that file back in.  The ATF tests aren't doing anything like that.

On Mon, Jun 13, 2016 at 12:05 PM, Conrad Meyer  wrote:
> FYI, this implies the ulong-accessed bitstring change is ABI-breaking
> for ARM userspace and maybe shouldn't go to stable/10.
>
> Best,
> Conrad
>
> On Mon, Jun 13, 2016 at 11:04 AM, Conrad Meyer  wrote:
>> I expect it's because:
>>
>> 1. bitstr_size() is just bytes (doesn't round up to sizeof(bitstr_t ==
>> unsigned long))
>> 2. The userspace version of bit_alloc() uses calloc(bitstr_size(), 1)
>> (an array of nmemb=bitstr_size() size=bytes, doesn't have to be
>> 'unsigned long' sized or aligned).
>> 3. Various bit_* functions access the result as if it's an array of
>> 'unsigned long', when it was allocated as a single-byte array (no
>> ulong alignment or size).
>> 4. ARM isn't as happy about unaligned accesses as x86.
>>
>> I'd make the following change (needs sys/param.h, not compile tested)
>> and see if it fixes it:
>>
>> --- sys/bitstring.h (revision 301805)
>> +++ sys/bitstring.h (working copy)
>> @@ -119,7 +119,8 @@
>>  static inline bitstr_t *
>>  bit_alloc(int _nbits)
>>  {
>> -   return ((bitstr_t *)calloc(bitstr_size(_nbits), 1));
>> +   return (calloc(howmany(bitstr_size(_nbits), sizeof(bitstr_t)),
>> +   sizeof(bitstr_t)));
>>  }
>>  #endif
>>
>>
>>
>>
>>
>>
>> On Mon, Jun 13, 2016 at 10:49 AM, Alan Somers  wrote:
>>> Please open a bug for the bitstring test failures and assign it to me.
>>> Also, since I don't have any arm hardware, please provide instructions
>>> on how to run this code in a VM, or where I can get access to the
>>> hardware.
>>>
>>> -Alan
>>>
>>> On Mon, Jun 13, 2016 at 11:29 AM, Mark Millard  wrote:
 With the newly less strict alignment requirements "kyua test -k 
 /usr/tests/Kyuafile" runs to completion, unlike before.

> ===> Summary
> Results read from 
> /root/.kyua/store/results.usr_tests.20160613-080302-120731.db
> Test cases: 5694 total, 54 skipped, 21 expected failures, 24 broken, 59 
> failed
> Total time: 8723.243s


 I only list the one line summaries below. Then I list various context 
 details.

> ===> Broken tests
> lib/msun/cexp_test:main  ->  broken: Received signal 6  [1.054s]
> lib/msun/ctrig_test:main  ->  broken: Received signal 6  [1.074s]
> lib/msun/exponential_test:main  ->  broken: Received signal 6  [1.045s]
> lib/msun/fenv_test:main  ->  broken: Received signal 6  [1.048s]
> lib/msun/fma_test:main  ->  broken: Received signal 6  [1.080s]
> lib/msun/invctrig_test:main  ->  broken: Received signal 6  [1.091s]
> lib/msun/invtrig_test:main  ->  broken: Received signal 6  [1.086s]
> lib/msun/logarithm_test:main  ->  broken: Received signal 6  [1.054s]
> lib/msun/lrint_test:main  ->  broken: Received signal 6  [1.069s]
> lib/msun/nearbyint_test:main  ->  broken: Received signal 6  [1.066s]
> lib/msun/rem_test:main  ->  broken: Received signal 6  [1.069s]
> lib/msun/trig_test:main  ->  broken: Received signal 6  [1.070s]
> sbin/growfs/legacy_test:main  ->  broken: Reported plan differs from 
> actual executed tests  [0.459s]
> sys/geom/class/eli/integrity_copy_test:main  ->  broken: Test case timed 
> out  [1200.082s]
> sys/geom/class/eli/integrity_hmac_test:main  ->  broken: Test case timed 
> out  [600.138s]
> sys/geom/class/eli/onetime_a_test:main  ->  broken: Test case timed out  
> [600.044s]
> sys/sys/bitstring_test:bit_clear  ->  broken: Test case body timed out  
> [300.032s]
> sys/sys/bitstring_test:bit_count  ->  broken: Premature exit; test case 
> received signal 11 (core dumped)  [1.080s]
> sys/sys/bitstring_test:bit_ffc  ->  broken: Premature exit; test case 
> received signal 11 (core dumped)  [1.077s]
> sys/sys/bitstring_test:bit_ffc_at  ->  broken: Premature exit; test case 
> received signal 11 (core dumped)  [1.081s]
> sys/sys/bitstring_test:bit_ffs  ->  broken: Premature exit; test case 
> received signal 11 (core dumped)  [1.082s]
> sys/sys/bitstring_test:bit_ffs_at  ->  broken: Premature exit; test case 
> received signal 11 (core dumped)  [1.077s]
> sys/sys/bitstring_test:bit_nclear  ->  broken: Premature exit; test case 
> received signal 11 (core dumped)  [1.083s]
> sys/sys/bitstring_test:bit_nset  ->  broken: Premature exit; test case 
> received signal 11 (core dumped)  [1.079s]


> ===> Failed tests
> lib/libc/c063/fstatat_test:fstatat_fd  ->  failed: 
> /usr/src/contrib/netbsd-tests/lib/libc/c063/t_fstatat.c:74: memcmp(, 
> , sizeof(st1)) == 0 not met  [0.
> 027s]

Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists

2016-06-13 Thread Mark Millard 
[I've added a list of core files generated and a few other notes.]

On 2016-Jun-13, at 10:29 AM, Mark Millard  wrote:

> With the newly less strict alignment requirements "kyua test -k 
> /usr/tests/Kyuafile" runs to completion, unlike before.
> 
>> ===> Summary
>> Results read from 
>> /root/.kyua/store/results.usr_tests.20160613-080302-120731.db
>> Test cases: 5694 total, 54 skipped, 21 expected failures, 24 broken, 59 
>> failed
>> Total time: 8723.243s
> 
> 
> I only list the one line summaries below. Then I list various context details.
> 
>> ===> Broken tests
>> lib/msun/cexp_test:main  ->  broken: Received signal 6  [1.054s]
>> lib/msun/ctrig_test:main  ->  broken: Received signal 6  [1.074s]
>> lib/msun/exponential_test:main  ->  broken: Received signal 6  [1.045s]
>> lib/msun/fenv_test:main  ->  broken: Received signal 6  [1.048s]
>> lib/msun/fma_test:main  ->  broken: Received signal 6  [1.080s]
>> lib/msun/invctrig_test:main  ->  broken: Received signal 6  [1.091s]
>> lib/msun/invtrig_test:main  ->  broken: Received signal 6  [1.086s]
>> lib/msun/logarithm_test:main  ->  broken: Received signal 6  [1.054s]
>> lib/msun/lrint_test:main  ->  broken: Received signal 6  [1.069s]
>> lib/msun/nearbyint_test:main  ->  broken: Received signal 6  [1.066s]
>> lib/msun/rem_test:main  ->  broken: Received signal 6  [1.069s]
>> lib/msun/trig_test:main  ->  broken: Received signal 6  [1.070s]
>> sbin/growfs/legacy_test:main  ->  broken: Reported plan differs from actual 
>> executed tests  [0.459s]
>> sys/geom/class/eli/integrity_copy_test:main  ->  broken: Test case timed out 
>>  [1200.082s]
>> sys/geom/class/eli/integrity_hmac_test:main  ->  broken: Test case timed out 
>>  [600.138s]
>> sys/geom/class/eli/onetime_a_test:main  ->  broken: Test case timed out  
>> [600.044s]
>> sys/sys/bitstring_test:bit_clear  ->  broken: Test case body timed out  
>> [300.032s]
>> sys/sys/bitstring_test:bit_count  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.080s]
>> sys/sys/bitstring_test:bit_ffc  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.077s]
>> sys/sys/bitstring_test:bit_ffc_at  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.081s]
>> sys/sys/bitstring_test:bit_ffs  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.082s]
>> sys/sys/bitstring_test:bit_ffs_at  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.077s]
>> sys/sys/bitstring_test:bit_nclear  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.083s]
>> sys/sys/bitstring_test:bit_nset  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.079s]
> 
> 
>> ===> Failed tests
>> lib/libc/c063/fstatat_test:fstatat_fd  ->  failed: 
>> /usr/src/contrib/netbsd-tests/lib/libc/c063/t_fstatat.c:74: memcmp(, 
>> , sizeof(st1)) == 0 not met  [0.
>> 027s]
>> lib/libc/nss/gethostby_test:getipnodebyname_getaddrinfo_ipv4  ->  failed: 
>> /usr/src/lib/libc/tests/nss/gethostby_test.c:1335: run_tests(_hostlist_file, 
>> _snapshot
>> _file, 2, TEST_GETHOSTBYNAME2_GETADDRINFO, 0) == 0 not met  [15.315s]
>> lib/libc/ssp/ssp_test:fgets  ->  failed: Test case body returned a non-ok 
>> exit code, but this is not allowed  [0.153s]
>> lib/libc/ssp/ssp_test:gets  ->  failed: Test case body returned a non-ok 
>> exit code, but this is not allowed  [0.158s]
>> lib/libc/ssp/ssp_test:memcpy  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.148s]
>> lib/libc/ssp/ssp_test:memmove  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.147s]
>> lib/libc/ssp/ssp_test:memset  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.147s]
>> lib/libc/ssp/ssp_test:read  ->  failed: Test case body returned a non-ok 
>> exit code, but this is not allowed  [0.154s]
>> lib/libc/ssp/ssp_test:readlink  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.155s]
>> lib/libc/ssp/ssp_test:snprintf  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.149s]
>> lib/libc/ssp/ssp_test:sprintf  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.149s]
>> lib/libc/ssp/ssp_test:stpcpy  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.149s]
>> lib/libc/ssp/ssp_test:stpncpy  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.147s]
>> lib/libc/ssp/ssp_test:strcat  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.147s]
>> lib/libc/ssp/ssp_test:strcpy  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.147s]
>> lib/libc/ssp/ssp_test:strncat  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.147s]
>> lib/libc/ssp/ssp_test:strncpy  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.146s]
>>

Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists

2016-06-13 Thread Mark Millard 
On 2016-Jun-13, at 10:49 AM, Alan Somers  wrote:

> Please open a bug for the bitstring test failures and assign it to me.
> Also, since I don't have any arm hardware, please provide instructions
> on how to run this code in a VM, or where I can get access to the
> hardware.
> 
> -Alan

I have created https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=210260 for the 
broken kyua bitstring tests.

I do not seem to have any control over the Assignee. (I  have no FreeBSD status 
of any kind so this is not surprising to me.)

I've never used QEMU or any arm-hardware based virtual machines. I've only used 
an rpi2 for armv6. So far the only VM's I've used are for amd64 running on 
amd64 hardware --and I run those under Mac OS X (VirtualBox, Parallels).

I'm not set up to give remote access to the rpi2 that I'm using.

So at this point I'm not much help for those arm-specific instructions that you 
asked for. Sorry.

===
Mark Millard
markmi at dsl-only.net

> On Mon, Jun 13, 2016 at 11:29 AM, Mark Millard  wrote:
>> With the newly less strict alignment requirements "kyua test -k 
>> /usr/tests/Kyuafile" runs to completion, unlike before.
>> 
>>> ===> Summary
>>> Results read from 
>>> /root/.kyua/store/results.usr_tests.20160613-080302-120731.db
>>> Test cases: 5694 total, 54 skipped, 21 expected failures, 24 broken, 59 
>>> failed
>>> Total time: 8723.243s
>> 
>> 
>> I only list the one line summaries below. Then I list various context 
>> details.
>> 
>>> ===> Broken tests
. . .
>>> sys/sys/bitstring_test:bit_clear  ->  broken: Test case body timed out  
>>> [300.032s]
>>> sys/sys/bitstring_test:bit_count  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.080s]
>>> sys/sys/bitstring_test:bit_ffc  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.077s]
>>> sys/sys/bitstring_test:bit_ffc_at  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.081s]
>>> sys/sys/bitstring_test:bit_ffs  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.082s]
>>> sys/sys/bitstring_test:bit_ffs_at  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.077s]
>>> sys/sys/bitstring_test:bit_nclear  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.083s]
>>> sys/sys/bitstring_test:bit_nset  ->  broken: Premature exit; test case 
>>> received signal 11 (core dumped)  [1.079s]
>> 
. . .
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists

2016-06-13 Thread Conrad Meyer 
FYI, this implies the ulong-accessed bitstring change is ABI-breaking
for ARM userspace and maybe shouldn't go to stable/10.

Best,
Conrad

On Mon, Jun 13, 2016 at 11:04 AM, Conrad Meyer  wrote:
> I expect it's because:
>
> 1. bitstr_size() is just bytes (doesn't round up to sizeof(bitstr_t ==
> unsigned long))
> 2. The userspace version of bit_alloc() uses calloc(bitstr_size(), 1)
> (an array of nmemb=bitstr_size() size=bytes, doesn't have to be
> 'unsigned long' sized or aligned).
> 3. Various bit_* functions access the result as if it's an array of
> 'unsigned long', when it was allocated as a single-byte array (no
> ulong alignment or size).
> 4. ARM isn't as happy about unaligned accesses as x86.
>
> I'd make the following change (needs sys/param.h, not compile tested)
> and see if it fixes it:
>
> --- sys/bitstring.h (revision 301805)
> +++ sys/bitstring.h (working copy)
> @@ -119,7 +119,8 @@
>  static inline bitstr_t *
>  bit_alloc(int _nbits)
>  {
> -   return ((bitstr_t *)calloc(bitstr_size(_nbits), 1));
> +   return (calloc(howmany(bitstr_size(_nbits), sizeof(bitstr_t)),
> +   sizeof(bitstr_t)));
>  }
>  #endif
>
>
>
>
>
>
> On Mon, Jun 13, 2016 at 10:49 AM, Alan Somers  wrote:
>> Please open a bug for the bitstring test failures and assign it to me.
>> Also, since I don't have any arm hardware, please provide instructions
>> on how to run this code in a VM, or where I can get access to the
>> hardware.
>>
>> -Alan
>>
>> On Mon, Jun 13, 2016 at 11:29 AM, Mark Millard  wrote:
>>> With the newly less strict alignment requirements "kyua test -k 
>>> /usr/tests/Kyuafile" runs to completion, unlike before.
>>>
 ===> Summary
 Results read from 
 /root/.kyua/store/results.usr_tests.20160613-080302-120731.db
 Test cases: 5694 total, 54 skipped, 21 expected failures, 24 broken, 59 
 failed
 Total time: 8723.243s
>>>
>>>
>>> I only list the one line summaries below. Then I list various context 
>>> details.
>>>
 ===> Broken tests
 lib/msun/cexp_test:main  ->  broken: Received signal 6  [1.054s]
 lib/msun/ctrig_test:main  ->  broken: Received signal 6  [1.074s]
 lib/msun/exponential_test:main  ->  broken: Received signal 6  [1.045s]
 lib/msun/fenv_test:main  ->  broken: Received signal 6  [1.048s]
 lib/msun/fma_test:main  ->  broken: Received signal 6  [1.080s]
 lib/msun/invctrig_test:main  ->  broken: Received signal 6  [1.091s]
 lib/msun/invtrig_test:main  ->  broken: Received signal 6  [1.086s]
 lib/msun/logarithm_test:main  ->  broken: Received signal 6  [1.054s]
 lib/msun/lrint_test:main  ->  broken: Received signal 6  [1.069s]
 lib/msun/nearbyint_test:main  ->  broken: Received signal 6  [1.066s]
 lib/msun/rem_test:main  ->  broken: Received signal 6  [1.069s]
 lib/msun/trig_test:main  ->  broken: Received signal 6  [1.070s]
 sbin/growfs/legacy_test:main  ->  broken: Reported plan differs from 
 actual executed tests  [0.459s]
 sys/geom/class/eli/integrity_copy_test:main  ->  broken: Test case timed 
 out  [1200.082s]
 sys/geom/class/eli/integrity_hmac_test:main  ->  broken: Test case timed 
 out  [600.138s]
 sys/geom/class/eli/onetime_a_test:main  ->  broken: Test case timed out  
 [600.044s]
 sys/sys/bitstring_test:bit_clear  ->  broken: Test case body timed out  
 [300.032s]
 sys/sys/bitstring_test:bit_count  ->  broken: Premature exit; test case 
 received signal 11 (core dumped)  [1.080s]
 sys/sys/bitstring_test:bit_ffc  ->  broken: Premature exit; test case 
 received signal 11 (core dumped)  [1.077s]
 sys/sys/bitstring_test:bit_ffc_at  ->  broken: Premature exit; test case 
 received signal 11 (core dumped)  [1.081s]
 sys/sys/bitstring_test:bit_ffs  ->  broken: Premature exit; test case 
 received signal 11 (core dumped)  [1.082s]
 sys/sys/bitstring_test:bit_ffs_at  ->  broken: Premature exit; test case 
 received signal 11 (core dumped)  [1.077s]
 sys/sys/bitstring_test:bit_nclear  ->  broken: Premature exit; test case 
 received signal 11 (core dumped)  [1.083s]
 sys/sys/bitstring_test:bit_nset  ->  broken: Premature exit; test case 
 received signal 11 (core dumped)  [1.079s]
>>>
>>>
 ===> Failed tests
 lib/libc/c063/fstatat_test:fstatat_fd  ->  failed: 
 /usr/src/contrib/netbsd-tests/lib/libc/c063/t_fstatat.c:74: memcmp(, 
 , sizeof(st1)) == 0 not met  [0.
 027s]
 lib/libc/nss/gethostby_test:getipnodebyname_getaddrinfo_ipv4  ->  failed: 
 /usr/src/lib/libc/tests/nss/gethostby_test.c:1335: 
 run_tests(_hostlist_file, _snapshot
 _file, 2, TEST_GETHOSTBYNAME2_GETADDRINFO, 0) == 0 not met  [15.315s]
 lib/libc/ssp/ssp_test:fgets  ->  failed: Test case body returned a non-ok 
 exit code, but this is not allowed  [0.153s]
 lib/libc/ssp/ssp_test:gets  ->  failed: Test case body returned a non-ok

Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists

2016-06-13 Thread Alan Somers 
Please open a bug for the bitstring test failures and assign it to me.
Also, since I don't have any arm hardware, please provide instructions
on how to run this code in a VM, or where I can get access to the
hardware.

-Alan

On Mon, Jun 13, 2016 at 11:29 AM, Mark Millard  wrote:
> With the newly less strict alignment requirements "kyua test -k 
> /usr/tests/Kyuafile" runs to completion, unlike before.
>
>> ===> Summary
>> Results read from 
>> /root/.kyua/store/results.usr_tests.20160613-080302-120731.db
>> Test cases: 5694 total, 54 skipped, 21 expected failures, 24 broken, 59 
>> failed
>> Total time: 8723.243s
>
>
> I only list the one line summaries below. Then I list various context details.
>
>> ===> Broken tests
>> lib/msun/cexp_test:main  ->  broken: Received signal 6  [1.054s]
>> lib/msun/ctrig_test:main  ->  broken: Received signal 6  [1.074s]
>> lib/msun/exponential_test:main  ->  broken: Received signal 6  [1.045s]
>> lib/msun/fenv_test:main  ->  broken: Received signal 6  [1.048s]
>> lib/msun/fma_test:main  ->  broken: Received signal 6  [1.080s]
>> lib/msun/invctrig_test:main  ->  broken: Received signal 6  [1.091s]
>> lib/msun/invtrig_test:main  ->  broken: Received signal 6  [1.086s]
>> lib/msun/logarithm_test:main  ->  broken: Received signal 6  [1.054s]
>> lib/msun/lrint_test:main  ->  broken: Received signal 6  [1.069s]
>> lib/msun/nearbyint_test:main  ->  broken: Received signal 6  [1.066s]
>> lib/msun/rem_test:main  ->  broken: Received signal 6  [1.069s]
>> lib/msun/trig_test:main  ->  broken: Received signal 6  [1.070s]
>> sbin/growfs/legacy_test:main  ->  broken: Reported plan differs from actual 
>> executed tests  [0.459s]
>> sys/geom/class/eli/integrity_copy_test:main  ->  broken: Test case timed out 
>>  [1200.082s]
>> sys/geom/class/eli/integrity_hmac_test:main  ->  broken: Test case timed out 
>>  [600.138s]
>> sys/geom/class/eli/onetime_a_test:main  ->  broken: Test case timed out  
>> [600.044s]
>> sys/sys/bitstring_test:bit_clear  ->  broken: Test case body timed out  
>> [300.032s]
>> sys/sys/bitstring_test:bit_count  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.080s]
>> sys/sys/bitstring_test:bit_ffc  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.077s]
>> sys/sys/bitstring_test:bit_ffc_at  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.081s]
>> sys/sys/bitstring_test:bit_ffs  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.082s]
>> sys/sys/bitstring_test:bit_ffs_at  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.077s]
>> sys/sys/bitstring_test:bit_nclear  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.083s]
>> sys/sys/bitstring_test:bit_nset  ->  broken: Premature exit; test case 
>> received signal 11 (core dumped)  [1.079s]
>
>
>> ===> Failed tests
>> lib/libc/c063/fstatat_test:fstatat_fd  ->  failed: 
>> /usr/src/contrib/netbsd-tests/lib/libc/c063/t_fstatat.c:74: memcmp(, 
>> , sizeof(st1)) == 0 not met  [0.
>> 027s]
>> lib/libc/nss/gethostby_test:getipnodebyname_getaddrinfo_ipv4  ->  failed: 
>> /usr/src/lib/libc/tests/nss/gethostby_test.c:1335: run_tests(_hostlist_file, 
>> _snapshot
>> _file, 2, TEST_GETHOSTBYNAME2_GETADDRINFO, 0) == 0 not met  [15.315s]
>> lib/libc/ssp/ssp_test:fgets  ->  failed: Test case body returned a non-ok 
>> exit code, but this is not allowed  [0.153s]
>> lib/libc/ssp/ssp_test:gets  ->  failed: Test case body returned a non-ok 
>> exit code, but this is not allowed  [0.158s]
>> lib/libc/ssp/ssp_test:memcpy  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.148s]
>> lib/libc/ssp/ssp_test:memmove  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.147s]
>> lib/libc/ssp/ssp_test:memset  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.147s]
>> lib/libc/ssp/ssp_test:read  ->  failed: Test case body returned a non-ok 
>> exit code, but this is not allowed  [0.154s]
>> lib/libc/ssp/ssp_test:readlink  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.155s]
>> lib/libc/ssp/ssp_test:snprintf  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.149s]
>> lib/libc/ssp/ssp_test:sprintf  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.149s]
>> lib/libc/ssp/ssp_test:stpcpy  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.149s]
>> lib/libc/ssp/ssp_test:stpncpy  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.147s]
>> lib/libc/ssp/ssp_test:strcat  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.147s]
>> lib/libc/ssp/ssp_test:strcpy  ->  failed: atf-check failed; see the output 
>> of the test for details  [0.147s]
>> lib/libc/ssp/ssp_test:strncat  ->  failed: atf-check failed; see the output 
>> of