bug#19005: [platform-testers] new snapshot available: grep-2.20.83-06900
On Tue, Nov 11, 2014 at 9:22 AM, C de-Avillez wrote: > On 09/11/14 15:00, Jim Meyering wrote: >> Testing the first snapshot exposed several problems, >> and most have been addressed. The sole remaining problem >> is the failure of an "expensive" (not run by default: big-match) >> that makes most systems run out of memory. I haven't looked at it yet. > > No failures (except for bug-match) on Ubuntu Vivid x86_64. > Check-expensive was run. Glad to hear it. Thanks for reporting in.
bug#19005: [platform-testers] new snapshot available: grep-2.20.83-06900
On 09/11/14 15:00, Jim Meyering wrote: > Testing the first snapshot exposed several problems, > and most have been addressed. The sole remaining problem > is the failure of an "expensive" (not run by default: big-match) > that makes most systems run out of memory. I haven't looked at it yet. No failures (except for bug-match) on Ubuntu Vivid x86_64. Check-expensive was run. Cheers, ..C.. signature.asc Description: OpenPGP digital signature
bug#19005: [platform-testers] new snapshot available: grep-2.20.83-06900
On 11/09/2014 05:30 PM, Assaf Gordon wrote: On 11/09/2014 04:00 PM, Jim Meyering wrote: Testing the first snapshot exposed several problems, and most have been addressed. The sole remaining problem is the failure of an "expensive" (not run by default: big-match) that makes most systems run out of memory. I haven't looked at it yet. <...> Please let us know if you find any problems. No failures on the following VMs (amd64, tested without PCRE, and only non-expensive tests): freebsd 9.3 freebsd 10 openbsd 5.5 netbsd 6.1.4 debian 7.6 gnewsense 3.1 (=debian 6) trisquel 6.0.1 (=ubuntu 12 LTS) ubuntu 14.04.1 opensuse 13.1 fedora 20 centos 7 GNU Hurd/Debian 0.5 (32-bit). Two cases on less common OSes: On DilOS 1.3.7, based on Illumos/OpenSolaris, "multibyte-white-space" fails. log attached. From a brief look, perhaps it has something to do with the recent "hex printf" change? not sure. This is a weird system, as they try to use Illumos kernel with Debian user space, so things could be mis-configured. Few quick checks (relating to the "hex printf" implementation): === $ bash --version | head -n1 GNU bash, version 4.2.45(2)-release (x86_64-pc-solaris2.11) $ printf --version -bash: printf: --: invalid option printf: usage: printf [-v var] format [arguments] $ which printf /usr/gnu/bin/printf $ /usr/gnu/bin/printf --version | head -n1 printf (GNU coreutils) 8.21 $ which sed /usr/gnu/bin/sed $ $(which sed) --version | head -n1 /usr/gnu/bin/sed (GNU sed) 4.2.2 === On MINIX R3.3.0, "symlinks" fails, which seems similar to the previous NetBSD6.1.4 issue. Log attached. I was not able to install Ktrace/Kdump yet. I will sadly not be able to test more until next weekend. Regards, - Assaf == GNU grep 2.20.83-06900: tests/test-suite.log == # TOTAL: 85 # PASS: 62 # SKIP: 21 # XFAIL: 1 # FAIL: 1 # XPASS: 0 # ERROR: 0 .. contents:: :depth: 2 FAIL: multibyte-white-space === ++ initial_cwd_=/tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests ++ fail=0 +++ testdir_prefix_ +++ printf gt ++ pfx_=gt +++ mktempd_ /tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests gt-multibyte-white-space. +++ case $# in +++ destdir_=/tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests +++ template_=gt-multibyte-white-space. +++ MAX_TRIES_=4 +++ case $destdir_ in +++ case $template_ in unset TMPDIR +++ d=/tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/gt-multibyte-white-space.Kp1p +++ case $d in +++ test -d /tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/gt-multibyte-white-space.Kp1p ls -dgo /tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/gt-multibyte-white-space.Kp1p tr S - LC_ALL=C env -- tr S - +++ perms='drwx-- 2 117 Nov 10 01:12 /tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/gt-multibyte-white-space.Kp1p' +++ case $perms in +++ test 0 = 0 +++ echo /tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/gt-multibyte-white-space.Kp1p +++ return ++ test_dir_=/tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/gt-multibyte-white-space.Kp1p ++ cd /tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/gt-multibyte-white-space.Kp1p ++ gl_init_sh_nl_=' ' ++ IFS=' ' ++ for sig_ in 1 2 3 13 15 +++ expr 1 + 128 ++ eval 'trap '\''Exit 129'\'' 1' +++ trap 'Exit 129' 1 ++ for sig_ in 1 2 3 13 15 +++ expr 2 + 128 ++ eval 'trap '\''Exit 130'\'' 2' +++ trap 'Exit 130' 2 ++ for sig_ in 1 2 3 13 15 +++ expr 3 + 128 ++ eval 'trap '\''Exit 131'\'' 3' +++ trap 'Exit 131' 3 ++ for sig_ in 1 2 3 13 15 +++ expr 13 + 128 ++ eval 'trap '\''Exit 141'\'' 13' +++ trap 'Exit 141' 13 ++ for sig_ in 1 2 3 13 15 +++ expr 15 + 128 ++ eval 'trap '\''Exit 143'\'' 15' +++ trap 'Exit 143' 15 ++ trap remove_tmp_ 0 + path_prepend_ ../src + test 1 '!=' 0 + path_dir_=../src + case $path_dir_ in + abs_path_dir_=/tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/../src + case $abs_path_dir_ in + PATH=/tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/../src:/tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/src:/usr/gnu/bin:/usr/bin:/usr/sbin:/sbin + create_exe_shims_ /tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/../src + case $EXEEXT in + return 0 + shift + test 0 '!=' 0 + export PATH + require_en_utf8_locale_ + path_prepend_ . + test 1 '!=' 0 + path_dir_=. + case $path_dir_ in + abs_path_dir_=/tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/. + case $abs_path_dir_ in + PATH=/tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/.:/tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/../src:/tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/src:/usr/gnu/bin:/usr/bin:/usr/sbin:/sbin + create_exe_shims_ /tmp/grep-2.20.83-06900.9QfptX/grep-2.20.83-06900/tests/. + case $EXEEXT in + return 0 + shift + test 0 '!=' 0 + export PATH + case $(get-mb-cur-max en_US.UTF-8) in ++ get-mb-cur-max e
bug#19005: [platform-testers] new snapshot available: grep-2.20.83-06900
On Sun, Nov 9, 2014 at 2:30 PM, Assaf Gordon wrote: > Hello, > > On 11/09/2014 04:00 PM, Jim Meyering wrote: >> >> Testing the first snapshot exposed several problems, >> and most have been addressed. The sole remaining problem >> is the failure of an "expensive" (not run by default: big-match) >> that makes most systems run out of memory. I haven't looked at it yet. > > <...> > >> Please let us know if you find any problems. > > > Two quick tests: > > -1- > On an old ubuntu 10 64-bit machine with PCRE, test > "pcre-invalid-utf8-input" fails. > Log attached. > It is possible due to the test using "en_US.UTF-8" but the available locales > are: > > $ locale -a | grep en_US > en_US > en_US.utf8 > > However, the 'get-mb-cur-max' does seem to accept "UTF-8": > > $ ./tests/get-mb-cur-max en_US > 1 > $ ./tests/get-mb-cur-max en_US.utf8 > 6 > $ ./tests/get-mb-cur-max en_US.UTF-8 > 6 > $ ./tests/get-mb-cur-max en_US.FOO-8 > (EMPTY) > > It is possible this old machine is mis-configured, and if so - please ignore > this failure. > > Using "libpcre3" version "7.8-3build1" (from ubuntu 10 package). Hi Assaf, Thanks for the prompt tests and feedback. This part of your log implicates that old ubuntu system's libpcre: + LC_ALL=en_US.UTF-8 timeout 3 grep -P k$ in + test 124 -eq 1 + fail=1 + echo k That suggests that grep -P was stuck in an infinite loop when timeout terminated the process (the exit 124). In this case, the error is highly desirable: it is your warning that you cannot rely on grep -P built with that library. > -2- > On the same machine, which has 128 GB ram total, and 106 GB ram free: > > $ free -g > total used free sharedbuffers > cached > Mem: 125 38 87 0 6 > 13 > -/+ buffers/cache: 18106 > Swap:9 3 6 > > The "big-match" test is still skipped with "not enough main memory to run > the test" - which sounds a bit weird. > Log attached. > During the execution of the tests, the "grep" process consumed up to 4.0GB > of ram (in the "RES" column of "top"). I interrupted one run of that test when it had reached 95GB RSS. That tests's combination of regexp and input provoke massive allocation in regexp-internal code, albeit no leak I have seen.
bug#19005: [platform-testers] new snapshot available: grep-2.20.83-06900
Hello, On 11/09/2014 04:00 PM, Jim Meyering wrote: Testing the first snapshot exposed several problems, and most have been addressed. The sole remaining problem is the failure of an "expensive" (not run by default: big-match) that makes most systems run out of memory. I haven't looked at it yet. <...> Please let us know if you find any problems. Two quick tests: -1- On an old ubuntu 10 64-bit machine with PCRE, test "pcre-invalid-utf8-input" fails. Log attached. It is possible due to the test using "en_US.UTF-8" but the available locales are: $ locale -a | grep en_US en_US en_US.utf8 However, the 'get-mb-cur-max' does seem to accept "UTF-8": $ ./tests/get-mb-cur-max en_US 1 $ ./tests/get-mb-cur-max en_US.utf8 6 $ ./tests/get-mb-cur-max en_US.UTF-8 6 $ ./tests/get-mb-cur-max en_US.FOO-8 (EMPTY) It is possible this old machine is mis-configured, and if so - please ignore this failure. Using "libpcre3" version "7.8-3build1" (from ubuntu 10 package). -2- On the same machine, which has 128 GB ram total, and 106 GB ram free: $ free -g total used free sharedbuffers cached Mem: 125 38 87 0 6 13 -/+ buffers/cache: 18106 Swap:9 3 6 The "big-match" test is still skipped with "not enough main memory to run the test" - which sounds a bit weird. Log attached. During the execution of the tests, the "grep" process consumed up to 4.0GB of ram (in the "RES" column of "top"). I'll be able to run the other test (on more OSes) a bit later. Regards, - Assaf == GNU grep 2.20.83-06900: tests/test-suite.log == # TOTAL: 1 # PASS: 0 # SKIP: 1 # XFAIL: 0 # FAIL: 0 # XPASS: 0 # ERROR: 0 .. contents:: :depth: 2 SKIP: big-match === + initial_cwd_=/data/gordon/sources/grep-2.20.83-06900/tests + fail=0 + testdir_prefix_ + printf gt + pfx_=gt + mktempd_ /data/gordon/sources/grep-2.20.83-06900/tests gt-big-match. + destdir_=/data/gordon/sources/grep-2.20.83-06900/tests + template_=gt-big-match. + MAX_TRIES_=4 + unset TMPDIR + d=/data/gordon/sources/grep-2.20.83-06900/tests/gt-big-match.Pveu + test -d /data/gordon/sources/grep-2.20.83-06900/tests/gt-big-match.Pveu + ls -dgo /data/gordon/sources/grep-2.20.83-06900/tests/gt-big-match.Pveu tr S - + LC_ALL=C env -- tr S - + perms=drwx-- 2 6 Nov 9 16:58 /data/gordon/sources/grep-2.20.83-06900/tests/gt-big-match.Pveu + test 0 = 0 + echo /data/gordon/sources/grep-2.20.83-06900/tests/gt-big-match.Pveu + return + test_dir_=/data/gordon/sources/grep-2.20.83-06900/tests/gt-big-match.Pveu + cd /data/gordon/sources/grep-2.20.83-06900/tests/gt-big-match.Pveu + gl_init_sh_nl_= + IFS= + expr 1 + 128 + eval trap 'Exit 129' 1 + trap Exit 129 1 + expr 2 + 128 + eval trap 'Exit 130' 2 + trap Exit 130 2 + expr 3 + 128 + eval trap 'Exit 131' 3 + trap Exit 131 3 + expr 13 + 128 + eval trap 'Exit 141' 13 + trap Exit 141 13 + expr 15 + 128 + eval trap 'Exit 143' 15 + trap Exit 143 15 + trap remove_tmp_ 0 + path_prepend_ ../src + test 1 != 0 + path_dir_=../src + abs_path_dir_=/data/gordon/sources/grep-2.20.83-06900/tests/../src + PATH=/data/gordon/sources/grep-2.20.83-06900/tests/../src:/data/gordon/sources/grep-2.20.83-06900/src:/home/agordon/bin:/data/gordon/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games + create_exe_shims_ /data/gordon/sources/grep-2.20.83-06900/tests/../src + return 0 + shift + test 0 != 0 + export PATH + expensive_ + test yes != yes + echo x + dd bs=1024k seek=2048 0+1 records in 0+1 records out 2 bytes (2 B) copied, 0.00201553 s, 1.0 kB/s + skip_diagnostic= + LC_ALL=C grep -a ^.* 2G-plus-2 + diagnostic= + status=0 + LC_ALL=C grep -a ^.*x\(\)\1 2G-plus-2 + diagnostic=grep: memory exhausted + status=2 + skip_diagnostic=not enough main memory to run the test + skip_ not enough main memory to run the test + warn_ big-match: skipped test: not enough main memory to run the test + printf %s\n big-match: skipped test: not enough main memory to run the test big-match: skipped test: not enough main memory to run the test + test 9 = 2 + printf %s\n big-match: skipped test: not enough main memory to run the test + sed 1q + Exit 77 + set +e + exit 77 + exit 77 + remove_tmp_ + __st=77 + cleanup_ + : + cd /data/gordon/sources/grep-2.20.83-06900/tests + chmod -R u+rwx /data/gordon/sources/grep-2.20.83-06900/tests/gt-big-match.Pveu + rm -rf /data/gordon/sources/grep-2.20.83-06900/tests/gt-big-match.Pveu + exit 77 SKIP big-match (exit status: 77) == GNU grep 2.20.83-06900: tests/test-suite.log == # TOTAL: 1 # PASS: 0 # SKIP: 0 # XFAIL: 0 # FAIL: 1 # XPASS: 0 # ERROR: 0 .. contents:: :depth: 2 FAIL: pcre-invalid-utf8
