daily CVS update output
Updating src tree: P src/external/mit/ctwm/etc/system.ctwmrc cvs update: `src/external/mit/xorg/bin/xterm/resize/Makefile' is no longer in the repository P src/libexec/httpd/CHANGES P src/libexec/httpd/Makefile P src/libexec/httpd/bozohttpd.c P src/libexec/httpd/bozohttpd.h P src/libexec/httpd/cgi-bozo.c P src/libexec/httpd/content-bozo.c P src/libexec/httpd/main.c P src/libexec/httpd/libbozohttpd/libbozohttpd.3 P src/share/man/man4/iic.4 P src/share/man/man4/pci.4 P src/share/man/man4/spi.4 P src/sys/arch/arm/pic/picvar.h P src/sys/arch/powerpc/ibm4xx/pic_uic.c P src/sys/arch/powerpc/ibm4xx/dev/com_opb.c P src/sys/arch/powerpc/ibm4xx/dev/dwctwo_plb.c P src/sys/arch/powerpc/ibm4xx/dev/ecc_plb.c P src/sys/arch/powerpc/ibm4xx/dev/if_emac.c P src/sys/arch/powerpc/ibm4xx/dev/mal.c P src/sys/arch/sparc/sparc/openfirm.c P src/sys/arch/sparc64/doc/TODO P src/sys/kern/kern_ktrace.c P src/tests/usr.bin/xlint/check-expect.lua P src/tests/usr.bin/xlint/lint1/d_c99_bool_strict.c P src/tests/usr.bin/xlint/lint1/msg_035.c P src/tests/usr.bin/xlint/lint1/msg_035.exp P src/tests/usr.bin/xlint/lint1/msg_118.c U src/tests/usr.bin/xlint/lint1/msg_118.exp P src/tests/usr.bin/xlint/lint1/msg_130.c U src/tests/usr.bin/xlint/lint1/msg_130.exp U src/tests/usr.bin/xlint/lint1/msg_135.c U src/tests/usr.bin/xlint/lint1/msg_135.exp U src/tests/usr.bin/xlint/lint1/msg_153.c U src/tests/usr.bin/xlint/lint1/msg_153.exp P src/tests/usr.bin/xlint/lint1/msg_156.c U src/tests/usr.bin/xlint/lint1/msg_156.exp P src/tests/usr.bin/xlint/lint1/msg_210.exp U src/tests/usr.bin/xlint/lint1/msg_229.c U src/tests/usr.bin/xlint/lint1/msg_229.exp P src/tests/usr.bin/xlint/lint1/msg_241.c U src/tests/usr.bin/xlint/lint1/msg_241.exp P src/tests/usr.bin/xlint/lint1/msg_242.c U src/tests/usr.bin/xlint/lint1/msg_242.exp U src/tests/usr.bin/xlint/lint1/msg_245.c U src/tests/usr.bin/xlint/lint1/msg_245.exp P src/tests/usr.bin/xlint/lint1/msg_275.c U src/tests/usr.bin/xlint/lint1/msg_275.exp P src/tests/usr.bin/xlint/lint1/msg_277.c U src/tests/usr.bin/xlint/lint1/msg_277.exp P src/tests/usr.bin/xlint/lint1/msg_278.c U src/tests/usr.bin/xlint/lint1/msg_278.exp P src/tests/usr.bin/xlint/lint1/msg_279.c U src/tests/usr.bin/xlint/lint1/msg_279.exp P src/usr.bin/resize/Makefile cvs update: `src/usr.bin/resize/resize.1' is no longer in the repository P src/usr.bin/resize/resize.c U src/usr.bin/resize/resize.h U src/usr.bin/resize/resize.man cvs update: `src/usr.bin/resize/xstrings.c' is no longer in the repository cvs update: `src/usr.bin/resize/xstrings.h' is no longer in the repository P src/usr.bin/xlint/common/tyname.c P src/usr.bin/xlint/lint1/decl.c P src/usr.bin/xlint/lint1/err.c P src/usr.bin/xlint/lint1/externs1.h P src/usr.bin/xlint/lint1/tree.c Updating xsrc tree: P xsrc/external/mit/ctwm/dist/add_window.c P xsrc/external/mit/xterm/dist/resize.c Killing core files: Updating file list: -rw-rw-r-- 1 srcmastr netbsd 40278247 Feb 28 03:04 ls-lRA.gz
Automated report: NetBSD-current/i386 build success
The NetBSD-current/i386 build is working again. The following commits were made between the last failed build and the successful build: 2021.02.27.22.37.54 christos src/usr.bin/resize/Makefile,v 1.4 Logs can be found at: http://releng.NetBSD.org/b5reports/i386/commits-2021.02.html#2021.02.27.22.37.54
Re: pkgsrc build hang of python38
On Sat, Feb 27, 2021 at 21:50:35 +0100, Riccardo Mottola wrote: > python38 hangs during build. I tried several times, it hangs in > exactly the same place again. I don't know of course where the issue > comes from, since all is new now :) I vaguely remember running into something like this b/c the system was out of randomness. I don't remember if there should be something obvious in dmesg when that happens, I think it should. As a workaround: https://mail-index.netbsd.org/current-users/2020/05/01/msg038495.html | you can fool it into thinking there is more entropy by running | | dd if=/dev/urandom of=/dev/random bs=32 count=1 | sysctl -w kern.entropy.consolidate=1 | | as root. The kernel will assume that any data written by root to | /dev/u?random have full entropy -uwe
Re: pkgsrc build hang of python38
On 28/02/21 9:50 am, Riccardo Mottola wrote: python38 hangs during build. I tried several times, it hangs in exactly the same place again. I don't know of course where the issue comes from, since all is new now :) Do you have any console messages? Maybe messages about blocking the python process because of not enough entropy? That's a problem I encountered when I was building Python on current. If you are working on the console, then it's all obvious, but if you aren't on the console then it's all mysterious. If that is your problem, then generate some entropy with something like "ls -lR /" and then run dd if=/dev/urandom of=/dev/random bs=32 count=1 sysctl -w kern.entropy.consolidate=1 See https://mail-index.netbsd.org/current-users/2020/05/01/msg038495.html for all the details. Cheers, Lloyd
Re: pkgsrc build hang of python38
On Sat, 27 Feb 2021 at 21:25, Chavdar Ivanov wrote: > > On Sat, 27 Feb 2021 at 20:51, Riccardo Mottola > wrote: > > > > Hi, > > > > after succesfully upgrading to 9.99.80 with a full distribution > > rebuild, I am also rebuilding pkgsrc!I did follow the pkgdb migration. > > > > python38 hangs during build. I tried several times, it hangs in exactly > > the same place again. I don't know of course where the issue comes from, > > since all is new now :) > > > > > > /usr/bin/install -c -o root -g wheel -m 644 ./Lib/pydoc_data/__init__.py > > /usr/pkg/lib/python3.8/pydoc_data > > /usr/bin/install -c -o root -g wheel -m 644 ./Lib/pydoc_data/_pydoc.css > > /usr/pkg/lib/python3.8/pydoc_data > > /usr/bin/install -c -o root -g wheel -m 644 ./Lib/pydoc_data/topics.py > > /usr/pkg/lib/python3.8/pydoc_data > > /usr/bin/install -c -o root -g wheel -m 644 `cat > > pybuilddir.txt`/_sysconfigdata_netbsd9.py > > /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8; > > /usr/bin/install -c -o root -g wheel -m 644 ./LICENSE > > /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8/LICENSE.txt > > if test -d > > /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8/distutils/tests; > > then /usr/bin/install -c -o root -g wheel -m 644 ./Modules/xxmodule.c > > /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8/distutils/tests > > ; fi > > PYTHONPATH=/usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8 > > LD_LIBRARY_PATH=/usr/pkgsrc/lang/python38/work/Python-3.8.8 ./python -E > > -Wi > > /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8/compileall.py > > -j0 -d /usr/pkg/lib/python3.8 -f -x > > 'bad_coding|badsyntax|site-packages|lib2to3/tests/data' > > /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8 > > > > > > > > It hangs here with almost 0 cpu consumption, top shows a 99% idle > > system. I clean, retry and hang there again! > > > > When it happens again, try finding the exact process which is hanging > at the moment ( best is with htop in tree mode ), then attach to it > with gdb and run 'thread apply all bt' - I bet all threads (bar one) > are waiting... When you quit gdb, the process magically continues... > > That has been happening with my builds, mainly when I do > 'pkg_rolling-replace', all the time the last several months, I am sure > you can find the mail archives. i still don't know if it is only a > problem with the entropy or something with the thread processing. In > my case it happens most often when running cmake and rebuilding some > kde packages, but this happens elsewhere as well. > > > > > > I tried upgrading python27 but that pulls in python38, so I hang > > again and if I try updating other packages I will end up tehre, > > consistent hang- See https://mail-index.netbsd.org/current-users/2020/05/24/msg038692.html thread for example. > > > > Riccardo > > > > > -- > --
Re: pkgsrc build hang of python38
On Sat, 27 Feb 2021 at 20:51, Riccardo Mottola wrote: > > Hi, > > after succesfully upgrading to 9.99.80 with a full distribution > rebuild, I am also rebuilding pkgsrc!I did follow the pkgdb migration. > > python38 hangs during build. I tried several times, it hangs in exactly > the same place again. I don't know of course where the issue comes from, > since all is new now :) > > > /usr/bin/install -c -o root -g wheel -m 644 ./Lib/pydoc_data/__init__.py > /usr/pkg/lib/python3.8/pydoc_data > /usr/bin/install -c -o root -g wheel -m 644 ./Lib/pydoc_data/_pydoc.css > /usr/pkg/lib/python3.8/pydoc_data > /usr/bin/install -c -o root -g wheel -m 644 ./Lib/pydoc_data/topics.py > /usr/pkg/lib/python3.8/pydoc_data > /usr/bin/install -c -o root -g wheel -m 644 `cat > pybuilddir.txt`/_sysconfigdata_netbsd9.py > /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8; > /usr/bin/install -c -o root -g wheel -m 644 ./LICENSE > /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8/LICENSE.txt > if test -d > /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8/distutils/tests; > then /usr/bin/install -c -o root -g wheel -m 644 ./Modules/xxmodule.c > /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8/distutils/tests > ; fi > PYTHONPATH=/usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8 > LD_LIBRARY_PATH=/usr/pkgsrc/lang/python38/work/Python-3.8.8 ./python -E > -Wi > /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8/compileall.py > -j0 -d /usr/pkg/lib/python3.8 -f -x > 'bad_coding|badsyntax|site-packages|lib2to3/tests/data' > /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8 > > > > It hangs here with almost 0 cpu consumption, top shows a 99% idle > system. I clean, retry and hang there again! > When it happens again, try finding the exact process which is hanging at the moment ( best is with htop in tree mode ), then attach to it with gdb and run 'thread apply all bt' - I bet all threads (bar one) are waiting... When you quit gdb, the process magically continues... That has been happening with my builds, mainly when I do 'pkg_rolling-replace', all the time the last several months, I am sure you can find the mail archives. i still don't know if it is only a problem with the entropy or something with the thread processing. In my case it happens most often when running cmake and rebuilding some kde packages, but this happens elsewhere as well. > I tried upgrading python27 but that pulls in python38, so I hang > again and if I try updating other packages I will end up tehre, > consistent hang- > > Riccardo > --
pkgsrc build hang of python38
Hi, after succesfully upgrading to 9.99.80 with a full distribution rebuild, I am also rebuilding pkgsrc!I did follow the pkgdb migration. python38 hangs during build. I tried several times, it hangs in exactly the same place again. I don't know of course where the issue comes from, since all is new now :) /usr/bin/install -c -o root -g wheel -m 644 ./Lib/pydoc_data/__init__.py /usr/pkg/lib/python3.8/pydoc_data /usr/bin/install -c -o root -g wheel -m 644 ./Lib/pydoc_data/_pydoc.css /usr/pkg/lib/python3.8/pydoc_data /usr/bin/install -c -o root -g wheel -m 644 ./Lib/pydoc_data/topics.py /usr/pkg/lib/python3.8/pydoc_data /usr/bin/install -c -o root -g wheel -m 644 `cat pybuilddir.txt`/_sysconfigdata_netbsd9.py /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8; /usr/bin/install -c -o root -g wheel -m 644 ./LICENSE /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8/LICENSE.txt if test -d /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8/distutils/tests; then /usr/bin/install -c -o root -g wheel -m 644 ./Modules/xxmodule.c /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8/distutils/tests ; fi PYTHONPATH=/usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8 LD_LIBRARY_PATH=/usr/pkgsrc/lang/python38/work/Python-3.8.8 ./python -E -Wi /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8/compileall.py -j0 -d /usr/pkg/lib/python3.8 -f -x 'bad_coding|badsyntax|site-packages|lib2to3/tests/data' /usr/pkgsrc/lang/python38/work/.destdir/usr/pkg/lib/python3.8 It hangs here with almost 0 cpu consumption, top shows a 99% idle system. I clean, retry and hang there again! I tried upgrading python27 but that pulls in python38, so I hang again and if I try updating other packages I will end up tehre, consistent hang- Riccardo
Re: extra files in DESTDIR
bch writes: questions I still wonder about: >>> what arch are you building for >>> what was the build host >>> what was your build.sh line > So I nuked the /usr/obj directory completely (which contained the DESTDIR), > used the -A switch to confirm cvs co is properly tracking -current, and ran > a single job (e.g. no “-j4”) and tools failed to build. I ended up deleting > the tools source completely and re-pulling and it then built properly. I This is a clue. But perhaps you didn't delete the objdir for the tools. After cvs up -A, removal and re-checkout should not change. Do cvs up -I \! and save it. There should be no output, but you might have built files in the tree. Also from top level cvs diff -r HEAD -I \! and again output should be empty. > went on to build a distribution, and ended up at the same place - failed > the final checkflist. The offending file is a regular file, while it’s > analog in my running system is a symlink, which is another curiousity and > perhaps a clue? I’m still at a loss. I captured the build w script(1) so I > may be able to provide more information on request. See src/libexec/ld.elf_so and read the Makefile. I just removed ld.elf_so from my destdir and re-ran make install (via using the arch-specific nbmake in the tooldir) and it worked fine to recreate the symlink. Check that directory specificially in your checkout for not having spurious files. signature.asc Description: PGP signature
Automated report: NetBSD-current/i386 build failure
This is an automatically generated notice of a NetBSD-current/i386 build failure. The failure occurred on babylon5.netbsd.org, a NetBSD/amd64 host, using sources from CVS date 2021.02.27.15.36.39. An extract from the build.sh output follows: nbmake[6]: stopped in /tmp/build/2021.02.27.15.36.39-i386/src/external/gpl3 --- dependall-bsd --- --- dependall-atf --- nbmake[6]: stopped in /tmp/build/2021.02.27.15.36.39-i386/src/external/bsd --- dependall-wpa --- nbmake[6]: stopped in /tmp/build/2021.02.27.15.36.39-i386/src/external/bsd nbmake[5]: stopped in /tmp/build/2021.02.27.15.36.39-i386/src/external --- dependall-gpl3 --- --- dependall-gdb --- nbmake[9]: stopped in /tmp/build/2021.02.27.15.36.39-i386/src/external/gpl3/gdb/lib/libgdb nbmake[8]: stopped in /tmp/build/2021.02.27.15.36.39-i386/src/external/gpl3/gdb/lib nbmake[7]: stopped in /tmp/build/2021.02.27.15.36.39-i386/src/external/gpl3/gdb nbmake[6]: stopped in /tmp/build/2021.02.27.15.36.39-i386/src/external/gpl3 nbmake[5]: stopped in /tmp/build/2021.02.27.15.36.39-i386/src/external nbmake[4]: stopped in /tmp/build/2021.02.27.15.36.39-i386/src nbmake[3]: stopped in /tmp/build/2021.02.27.15.36.39-i386/src nbmake[2]: stopped in /tmp/build/2021.02.27.15.36.39-i386/src nbmake[1]: stopped in /tmp/build/2021.02.27.15.36.39-i386/src nbmake: stopped in /tmp/build/2021.02.27.15.36.39-i386/src ERROR: Failed to make release The following commits were made between the last successful build and the failed build: 2021.02.27.15.26.30 rillig src/usr.bin/xlint/lint1/tree.c,v 1.219 2021.02.27.15.29.15 rillig src/tests/usr.bin/xlint/lint1/msg_241.c,v 1.4 2021.02.27.15.29.15 rillig src/tests/usr.bin/xlint/lint1/msg_241.exp,v 1.3 2021.02.27.15.36.39 christos src/usr.bin/resize/Attic/resize.1,v 1.3 2021.02.27.15.36.39 christos src/usr.bin/resize/Makefile,v 1.2 2021.02.27.15.36.39 christos src/usr.bin/resize/resize.c,v 1.2 2021.02.27.15.36.39 christos src/usr.bin/resize/resize.h,v 1.1 2021.02.27.15.36.39 christos src/usr.bin/resize/resize.man,v 1.1 Logs can be found at: http://releng.NetBSD.org/b5reports/i386/commits-2021.02.html#2021.02.27.15.36.39
Re: Fail do build on amd64: nbmtree: .: missing directory in specification
Hi, That was a clean build and failed. I tried updating after a month, an update build failed, a clean build succeeded. So.. the problem solved by itself :) 9.99.80 NetBSD 9.99.80 is now up and running on my laptop with a full distribution build. I have some issues, but I will ask about them specifically. Riccardo Riccardo Mottola wrote: Hi, just tried to update since a loong time. I updated source, built the kernel, tools just fine. However distribution fails with the error below. Ideas? Riccardo obj ===> regress/sys/kern/ras/ras3 obj ===> regress/sys/kern/unfdpass clean_METALOG ===> . clean_METALOG ===> distrib/sets /usr/src/obj/tooldir.NetBSD-9.99.79-amd64/bin/nbawk '{ a[$1] = $0; } END { for (f in a) print a[f]; }' | sort | /usr/src/obj/tooldir.NetBSD-9.99.79-amd64/bin/nbmtree -CSM -k all -R time -N /usr/src/etc >/usr/src/obj/destdir.amd64/METALOG.new nbmtree: .: missing directory in specification nbmtree: failed at line 1 of the specification *** Failed target: /usr/src/obj/destdir.amd64/METALOG.sanitised *** Failed command: /usr/src/obj/tooldir.NetBSD-9.99.79-amd64/bin/nbawk '{ a[$1] = $0; } END { for (f in a) print a[f]; }' | sort | /usr/src/obj/tooldir.NetBSD-9.99.79-amd64/bin/nbmtree -CSM -k all -R time -N /usr/src/etc >/usr/src/obj/destdir.amd64/METALOG.new *** Error code 1