It seems that you fixed the C02 test for good. However, on macppc,
'make test' fails the multibyte character test D07 with the following
output (see also the attached test-macppc.log). I have LC_CTYPE set
to en_US.UTF-8, in case that matters.
[...]
./D07multibyte.ztst: starting.
Testing multibyte with locale en_US.UTF-8
*** /usr/ports/pobj/zsh-5.1/zsh-5.1/tmp.ztst.out.498 Wed Sep 2 12:13:27 2015
--- /usr/ports/pobj/zsh-5.1/zsh-5.1/tmp.ztst.tout.498 Wed Sep 2 12:13:27 2015
***************
*** 1,2 ****
! one ＺＳＨ three
four five six
--- 1,2 ----
! one ＺＳＨ three
four five six
Test ./D07multibyte.ztst failed: output differs from expected as shown above
for:
lines=$'one\tＺＳＨ\tthree\nfour\tfive\tsix'
print -X8 -r -- $lines
Was testing: Tab expansion with extra-wide characters
./D07multibyte.ztst: test failed.
./D08cmdsubst.ztst: starting.
[...]
**************************************
44 successful test scripts, 1 failure, 0 skipped
**************************************
*** Error 1 in Test (Makefile:204 'check')
*** Error 1 in /usr/ports/pobj/zsh-5.1/zsh-5.1 (Makefile:265 'check')
Moreover, on amd64, a number of tests fail sometimes, but I can't
reproduce that reliably. This time, after
$ make clean=all
$ make build
$ make test
I got a number of failures. This is nothing new, jca@ encountered
similar issues with 5.0.7:
https://marc.info/?l=openbsd-ports&m=142953123907535&w=2
However, after a reebot, all tests passed again (on amd64).
The output of the failing tests is attached as test-amd64.log.
cd Test ; make check
if test -n "cc"; then cd .. && DESTDIR= make MODDIR=`pwd`/Test/Modules
install.modules > /dev/null; fi
if ZTST_testlist="`for f in ./*.ztst; do echo $f; done`" ZTST_srcdir="."
ZTST_exe=../Src/zsh ../Src/zsh +Z -f ./runtests.zsh; then stat=0; else
stat=1; fi; sleep 1; rm -rf Modules .zcompdump; exit $stat
./A01grammar.ztst: starting.
This test hangs the shell when it fails...
./A01grammar.ztst: all tests successful.
./A02alias.ztst: starting.
This test hangs the shell when it fails...
./A02alias.ztst: all tests successful.
./A03quoting.ztst: starting.
./A03quoting.ztst: all tests successful.
./A04redirect.ztst: starting.
./A04redirect.ztst: all tests successful.
./A05execution.ztst: starting.
This test takes 5 seconds to fail...
./A05execution.ztst: all tests successful.
./A06assign.ztst: starting.
./A06assign.ztst: all tests successful.
./A07control.ztst: starting.
./A07control.ztst: all tests successful.
./B01cd.ztst: starting.
./B01cd.ztst: all tests successful.
./B02typeset.ztst: starting.
./B02typeset.ztst: all tests successful.
./B03print.ztst: starting.
./B03print.ztst: all tests successful.
./B04read.ztst: starting.
./B04read.ztst: all tests successful.
./B05eval.ztst: starting.
./B05eval.ztst: all tests successful.
./B06fc.ztst: starting.
./B06fc.ztst: all tests successful.
./B07emulate.ztst: starting.
./B07emulate.ztst: all tests successful.
./B08shift.ztst: starting.
./B08shift.ztst: all tests successful.
./C01arith.ztst: starting.
./C01arith.ztst: all tests successful.
./C02cond.ztst: starting.
This test takes two seconds...
./C02cond.ztst: all tests successful.
./C03traps.ztst: starting.
This test takes at least three seconds...
This test, too, takes at least three seconds...
Another test that takes three seconds
./C03traps.ztst: all tests successful.
./C04funcdef.ztst: starting.
./C04funcdef.ztst: all tests successful.
./C05debug.ztst: starting.
./C05debug.ztst: all tests successful.
./D01prompt.ztst: starting.
./D01prompt.ztst: all tests successful.
./D02glob.ztst: starting.
./D02glob.ztst: all tests successful.
./D03procsubst.ztst: starting.
./D03procsubst.ztst: all tests successful.
./D04parameter.ztst: starting.
./D04parameter.ztst: all tests successful.
./D05array.ztst: starting.
./D05array.ztst: all tests successful.
./D06subscript.ztst: starting.
./D06subscript.ztst: all tests successful.
./D07multibyte.ztst: starting.
Testing multibyte with locale en_US.UTF-8
*** /usr/ports/pobj/zsh-5.1/zsh-5.1/tmp.ztst.out.498 Wed Sep 2 12:13:27 2015
--- /usr/ports/pobj/zsh-5.1/zsh-5.1/tmp.ztst.tout.498 Wed Sep 2 12:13:27 2015
***************
*** 1,2 ****
! one ＺＳＨ three
four five six
--- 1,2 ----
! one ＺＳＨ three
four five six
Test ./D07multibyte.ztst failed: output differs from expected as shown above
for:
lines=$'one\tＺＳＨ\tthree\nfour\tfive\tsix'
print -X8 -r -- $lines
Was testing: Tab expansion with extra-wide characters
./D07multibyte.ztst: test failed.
./D08cmdsubst.ztst: starting.
./D08cmdsubst.ztst: all tests successful.
./D09brace.ztst: starting.
./D09brace.ztst: all tests successful.
./E01options.ztst: starting.
This test hangs the shell when it fails...
./E01options.ztst: all tests successful.
./E02xtrace.ztst: starting.
./E02xtrace.ztst: all tests successful.
./V01zmodload.ztst: starting.
./V01zmodload.ztst: all tests successful.
./V02zregexparse.ztst: starting.
./V02zregexparse.ztst: all tests successful.
./V03mathfunc.ztst: starting.
./V03mathfunc.ztst: all tests successful.
./V04features.ztst: starting.
./V04features.ztst: all tests successful.
./V05styles.ztst: starting.
./V05styles.ztst: all tests successful.
./V06parameter.ztst: starting.
./V06parameter.ztst: all tests successful.
./V07pcre.ztst: starting.
Testing PCRE multibyte with locale en_US.UTF-8
./V07pcre.ztst: all tests successful.
./V08zpty.ztst: starting.
./V08zpty.ztst: all tests successful.
./V09datetime.ztst: starting.
Test case skipped: strftime extensions not supported
Test case skipped: strftime extensions not supported
./V09datetime.ztst: all tests successful.
./W01history.ztst: starting.
History tests write to /dev/tty
./W01history.ztst: all tests successful.
./X02zlevi.ztst: starting.
./X02zlevi.ztst: all tests successful.
./Y01completion.ztst: starting.
./Y01completion.ztst: all tests successful.
./Y02compmatch.ztst: starting.
./Y02compmatch.ztst: all tests successful.
./Y03arguments.ztst: starting.
./Y03arguments.ztst: all tests successful.
**************************************
44 successful test scripts, 1 failure, 0 skipped
**************************************
*** Error 1 in Test (Makefile:204 'check')
*** Error 1 in /usr/ports/pobj/zsh-5.1/zsh-5.1 (Makefile:265 'check')
cd Test ; make check
if test -n "cc"; then cd .. && DESTDIR= make MODDIR=`pwd`/Test/Modules
install.modules > /dev/null; fi
if ZTST_testlist="`for f in ./*.ztst; do echo $f; done`" ZTST_srcdir="."
ZTST_exe=../Src/zsh ../Src/zsh +Z -f ./runtests.zsh; then stat=0; else
stat=1; fi; sleep 1; rm -rf Modules .zcompdump; exit $stat
./A01grammar.ztst: starting.
This test hangs the shell when it fails...
./A01grammar.ztst: all tests successful.
./A02alias.ztst: starting.
This test hangs the shell when it fails...
./A02alias.ztst: all tests successful.
./A03quoting.ztst: starting.
./A03quoting.ztst: all tests successful.
./A04redirect.ztst: starting.
./A04redirect.ztst: all tests successful.
./A05execution.ztst: starting.
This test takes 5 seconds to fail...
./A05execution.ztst: all tests successful.
./A06assign.ztst: starting.
./A06assign.ztst: all tests successful.
./A07control.ztst: starting.
./A07control.ztst: all tests successful.
./B01cd.ztst: starting.
./B01cd.ztst: all tests successful.
./B02typeset.ztst: starting.
./B02typeset.ztst: all tests successful.
./B03print.ztst: starting.
./B03print.ztst: all tests successful.
./B04read.ztst: starting.
./B04read.ztst: all tests successful.
./B05eval.ztst: starting.
./B05eval.ztst: all tests successful.
./B06fc.ztst: starting.
./B06fc.ztst: all tests successful.
./B07emulate.ztst: starting.
./B07emulate.ztst: all tests successful.
./B08shift.ztst: starting.
./B08shift.ztst: all tests successful.
./C01arith.ztst: starting.
./C01arith.ztst: all tests successful.
./C02cond.ztst: starting.
This test takes two seconds...
./C02cond.ztst: all tests successful.
./C03traps.ztst: starting.
This test takes at least three seconds...
This test, too, takes at least three seconds...
Another test that takes three seconds
./C03traps.ztst: all tests successful.
./C04funcdef.ztst: starting.
./C04funcdef.ztst: all tests successful.
./C05debug.ztst: starting.
./C05debug.ztst: all tests successful.
./D01prompt.ztst: starting.
./D01prompt.ztst: all tests successful.
./D02glob.ztst: starting.
./D02glob.ztst: all tests successful.
./D03procsubst.ztst: starting.
./D03procsubst.ztst: all tests successful.
./D04parameter.ztst: starting.
./D04parameter.ztst: all tests successful.
./D05array.ztst: starting.
./D05array.ztst: all tests successful.
./D06subscript.ztst: starting.
./D06subscript.ztst: all tests successful.
./D07multibyte.ztst: starting.
Testing multibyte with locale en_US.UTF-8
./D07multibyte.ztst: all tests successful.
./D08cmdsubst.ztst: starting.
./D08cmdsubst.ztst: all tests successful.
./D09brace.ztst: starting.
./D09brace.ztst: all tests successful.
./E01options.ztst: starting.
This test hangs the shell when it fails...
./E01options.ztst: all tests successful.
./E02xtrace.ztst: starting.
./E02xtrace.ztst: all tests successful.
./V01zmodload.ztst: starting.
./V01zmodload.ztst: all tests successful.
./V02zregexparse.ztst: starting.
./V02zregexparse.ztst: all tests successful.
./V03mathfunc.ztst: starting.
./V03mathfunc.ztst: all tests successful.
./V04features.ztst: starting.
./V04features.ztst: all tests successful.
./V05styles.ztst: starting.
./V05styles.ztst: all tests successful.
./V06parameter.ztst: starting.
./V06parameter.ztst: all tests successful.
./V07pcre.ztst: starting.
Testing PCRE multibyte with locale en_US.UTF-8
./V07pcre.ztst: all tests successful.
./V08zpty.ztst: starting.
Test ./V08zpty.ztst failed: bad status 1, expected 0 from:
zpty cat cat
zpty -w cat a line of text
var=
zpty -r cat var && print -r -- ${var%%$'\r\n'}
zpty -d cat
Error output:
(zpty):zpty:1: can't open pseudo terminal: bad file descriptor
(eval):zpty:2: no such pty command: cat
(eval):zpty:4: no such pty command: cat
(eval):zpty:5: no such pty command: cat
Was testing: zpty with a process that does not set up the terminal: internal
write
./V08zpty.ztst: test failed.
./V09datetime.ztst: starting.
Test case skipped: strftime extensions not supported
Test case skipped: strftime extensions not supported
./V09datetime.ztst: all tests successful.
./W01history.ztst: starting.
History tests write to /dev/tty
./W01history.ztst: all tests successful.
./X02zlevi.ztst: starting.
(zpty):zpty:21: can't open pseudo terminal: bad file descriptor
comptestinit:zpty:23: no such pty command: zsh
Test ./X02zlevi.ztst failed: non-zero status from preparation code:
if [[ $OSTYPE = cygwin ]]; then
ZTST_unimplemented="the zsh/zpty module does not work on Cygwin"
elif ( zmodload -i zsh/zpty ) >/dev/null 2>&1; then
. $ZTST_srcdir/comptest
comptestinit -v -z $ZTST_testdir/../Src/zsh
else
ZTST_unimplemented="the zsh/zpty module is not available"
fi
./X02zlevi.ztst: test failed.
Test ./X02zlevi.ztst failed: bad status 1, expected 0 from:
zletest $'goox\ecld'
Error output:
zletest:zpty:6: no such pty command: zsh
zletest:zpty:8: no such pty command: zsh
zletest:zpty:9: no such pty command: zsh
Was testing: change last character in buffer
./X02zlevi.ztst: test failed.
./Y01completion.ztst: starting.
(zpty):zpty:21: can't open pseudo terminal: bad file descriptor
comptestinit:zpty:23: no such pty command: zsh
Test ./Y01completion.ztst failed: non-zero status from preparation code:
if [[ $OSTYPE = cygwin ]]; then
ZTST_unimplemented="the zsh/zpty module does not work on Cygwin"
elif ( zmodload -i zsh/zpty ) >/dev/null 2>&1; then
. $ZTST_srcdir/comptest
mkdir comp.tmp
cd comp.tmp
comptestinit -z $ZTST_testdir/../Src/zsh &&
{
mkdir dir1 &&
mkdir dir2 &&
touch file1 &&
touch file2
}
else
ZTST_unimplemented="the zsh/zpty module is not available"
fi
./Y01completion.ztst: test failed.
Test ./Y01completion.ztst failed: bad status 1, expected 0 from:
comptest $': \t\t\t\t\t\t\t'
Error output:
comptest:zpty:2: no such pty command: zsh
comptest:zpty:3: no such pty command: zsh
Was testing: directories and files
./Y01completion.ztst: test failed.
./Y02compmatch.ztst: starting.
(zpty):zpty:21: can't open pseudo terminal: bad file descriptor
comptestinit:zpty:23: no such pty command: zsh
Test ./Y02compmatch.ztst failed: non-zero status from preparation code:
if [[ $OSTYPE = cygwin ]]; then
ZTST_unimplemented="the zsh/zpty module does not work on Cygwin"
elif ( zmodload -i zsh/zpty ) >/dev/null 2>&1; then
. $ZTST_srcdir/comptest
mkdir match.tmp
cd match.tmp
comptestinit -z $ZTST_testdir/../Src/zsh &&
{
list1=(IndianRed IndianRed2 IndianRed3 IndianRed4)
test_code () {
matcher=$1;
list=$2;
code="compdef _tst tst ; _tst () { echo -n '<COMPADD>';compadd -M '"
code="$code$matcher"
code="$code' - ${(P)list} ; echo -n '</COMPADD>'"
code="$code; $extra_cmd"
code="$code; echo -n '<INSERT_POSITIONS>'"
code="$code; echo \$compstate[insert_positions]"
code="$code; echo -n '</INSERT_POSITIONS>'"
code="$code}"
comptesteval "$code"
}
}
else
ZTST_unimplemented="the zsh/zpty module is not available"
fi
./Y02compmatch.ztst: test failed.
Test ./Y02compmatch.ztst failed: bad status 1, expected 0 from:
test_code z: list1
comptest $'tst \t'
Error output:
(eval):1: command not found: test_code
comptest:zpty:2: no such pty command: zsh
comptest:zpty:3: no such pty command: zsh
Was testing: Match Error for "z:"
./Y02compmatch.ztst: test failed.
./Y03arguments.ztst: starting.
(zpty):zpty:21: can't open pseudo terminal: bad file descriptor
comptestinit:zpty:23: no such pty command: zsh
Test ./Y03arguments.ztst failed: non-zero status from preparation code:
if [[ $OSTYPE = cygwin ]]; then
ZTST_unimplemented="the zsh/zpty module does not work on Cygwin"
elif ( zmodload -i zsh/zpty ) >/dev/null 2>&1; then
. $ZTST_srcdir/comptest
mkdir comp.tmp
cd comp.tmp
comptestinit -z $ZTST_testdir/../Src/zsh &&
{
comptesteval 'compdef _tst tst'
tst_arguments () { comptesteval "_tst () { _arguments ${${(@qq)*}} }" }
}
else
ZTST_unimplemented="the zsh/zpty module is not available"
fi
./Y03arguments.ztst: test failed.
Test ./Y03arguments.ztst failed: bad status 1, expected 0 from:
tst_arguments ':desc1:(arg1)'
comptest $'tst \t\C-wa\t\C-war\t\C-warg\t\C-warg1\t\C-wr\t\C-wx\t \ty \t'
Error output:
(eval):1: command not found: tst_arguments
comptest:zpty:2: no such pty command: zsh
comptest:zpty:3: no such pty command: zsh
Was testing: one non-option argument
./Y03arguments.ztst: test failed.
**************************************
40 successful test scripts, 5 failures, 0 skipped
**************************************
*** Error 1 in Test (Makefile:204 'check')
*** Error 1 in /usr/ports/pobj/zsh-5.1/zsh-5.1 (Makefile:265 'check')
