Re: cmake hang ... again

[Chavdar Ivanov]

On Tue, 6 Apr 2021 at 21:01, Michael van Elst  wrote:
>
> jo...@bec.de (Joerg Sonnenberger) writes:
>
> >On Tue, Apr 06, 2021 at 04:49:58PM -, Michael van Elst wrote:
> >> Otherwise I see several infinite loops, a python deadlock in the samba4 
> >> build
> >> and, new, the kdelibs4 build stalls for kfiltertest_automoc.cpp.
>
> >The samba4 thing can be avoided with MAKE_JOBS_SAFE=no. I don't fully
> >understand what happened with that and run out of steam debugging it.
>
> >kdelibs4 stalls sound like the wait list issue. Does gdb attach or
> >STOP/CONT help?
>
> Didn't help for kdelibs4.
>

After having two or three pkg_rolling-replace runs without any cmake
hangs, I've had another two of the same hangs during my present run.
Again, just attaching to the cmake process and quitting gdb gets it
running, so the pkg_rolling-replace is saved, but it's still annoying
- I was doing something else and didn't notice the first hang for over
24 hours...


-- 

Re: cmake hang ... again

[Michael van Elst]

jo...@bec.de (Joerg Sonnenberger) writes:

>On Tue, Apr 06, 2021 at 04:49:58PM -, Michael van Elst wrote:
>> Otherwise I see several infinite loops, a python deadlock in the samba4 build
>> and, new, the kdelibs4 build stalls for kfiltertest_automoc.cpp.

>The samba4 thing can be avoided with MAKE_JOBS_SAFE=no. I don't fully
>understand what happened with that and run out of steam debugging it.

>kdelibs4 stalls sound like the wait list issue. Does gdb attach or
>STOP/CONT help?

Didn't help for kdelibs4.

Re: cmake hang ... again

[Joerg Sonnenberger]

On Tue, Apr 06, 2021 at 04:49:58PM -, Michael van Elst wrote:
> Otherwise I see several infinite loops, a python deadlock in the samba4 build
> and, new, the kdelibs4 build stalls for kfiltertest_automoc.cpp.

The samba4 thing can be avoided with MAKE_JOBS_SAFE=no. I don't fully
understand what happened with that and run out of steam debugging it.

kdelibs4 stalls sound like the wait list issue. Does gdb attach or
STOP/CONT help?

Joerg

Re: cmake hang ... again

[Joerg Sonnenberger]

On Tue, Apr 06, 2021 at 04:26:44PM -, Christos Zoulas wrote:
> In article ,
> Manuel Bouyer   wrote:
> >On Tue, Apr 06, 2021 at 02:24:50PM +0100, Chavdar Ivanov wrote:
> >> Hi,
> >> 
> >> It may or may not be linked to the recent rather enthralling
> >> discussion about the entropy; I don't know. I've asked for ideas in
> >> the past, but couldn't figure out what to do if it hits me again.
> >> 
> >> Usually I run -current on amd64, updating the systems on average 2-3
> >> times a week; I also use pkgsrc-head and again, 2-3 times a month I
> >> cvs update my pkgsrc tree, together with a ' git pull' in wip, and I
> >> run 'pkg_rolling-replace'.
> >> 
> >> Each and every run of pkg_rolling-replace gets me to a seemingly
> >> identical hang in cmake in a single package - misc/kdepim4 , in
> >> apparently the same spot. with similar trace. Attaching to the process
> >
> >I see the same thing in bulk builds, with various kde packages.
> >When I asked I've been told that this was a known issue, but without fix ...
> 
> I've looked for a specific PR for that problem and while we have multiple
> PR/s for jemalloc we don't have one for this issue. Can we open one?
> Does linking with -lgnumalloc avoid the issue?

This is the CV wait list corruption. jemalloc just makes it more likely.

Joerg

Re: cmake hang ... again

[Michael van Elst]

bou...@antioche.eu.org (Manuel Bouyer) writes:

>I see the same thing in bulk builds, with various kde packages.
>When I asked I've been told that this was a known issue, but without fix ...

There are several issues that hang builds.

The cmake hang usually responds well to a SIGSTOP followed by a SIGCONT.

Otherwise I see several infinite loops, a python deadlock in the samba4 build
and, new, the kdelibs4 build stalls for kfiltertest_automoc.cpp.

Re: cmake hang ... again

[Christos Zoulas]

In article ,
Manuel Bouyer   wrote:
>On Tue, Apr 06, 2021 at 02:24:50PM +0100, Chavdar Ivanov wrote:
>> Hi,
>> 
>> It may or may not be linked to the recent rather enthralling
>> discussion about the entropy; I don't know. I've asked for ideas in
>> the past, but couldn't figure out what to do if it hits me again.
>> 
>> Usually I run -current on amd64, updating the systems on average 2-3
>> times a week; I also use pkgsrc-head and again, 2-3 times a month I
>> cvs update my pkgsrc tree, together with a ' git pull' in wip, and I
>> run 'pkg_rolling-replace'.
>> 
>> Each and every run of pkg_rolling-replace gets me to a seemingly
>> identical hang in cmake in a single package - misc/kdepim4 , in
>> apparently the same spot. with similar trace. Attaching to the process
>
>I see the same thing in bulk builds, with various kde packages.
>When I asked I've been told that this was a known issue, but without fix ...

I've looked for a specific PR for that problem and while we have multiple
PR/s for jemalloc we don't have one for this issue. Can we open one?
Does linking with -lgnumalloc avoid the issue?

christos

Re: cmake hang ... again

[Manuel Bouyer]

On Tue, Apr 06, 2021 at 02:24:50PM +0100, Chavdar Ivanov wrote:
> Hi,
> 
> It may or may not be linked to the recent rather enthralling
> discussion about the entropy; I don't know. I've asked for ideas in
> the past, but couldn't figure out what to do if it hits me again.
> 
> Usually I run -current on amd64, updating the systems on average 2-3
> times a week; I also use pkgsrc-head and again, 2-3 times a month I
> cvs update my pkgsrc tree, together with a ' git pull' in wip, and I
> run 'pkg_rolling-replace'.
> 
> Each and every run of pkg_rolling-replace gets me to a seemingly
> identical hang in cmake in a single package - misc/kdepim4 , in
> apparently the same spot. with similar trace. Attaching to the process

I see the same thing in bulk builds, with various kde packages.
When I asked I've been told that this was a known issue, but without fix ...

-- 
Manuel Bouyer 
 NetBSD: 26 ans d'experience feront toujours la difference
--

cmake hang ... again

[Chavdar Ivanov]

Hi,

It may or may not be linked to the recent rather enthralling
discussion about the entropy; I don't know. I've asked for ideas in
the past, but couldn't figure out what to do if it hits me again.

Usually I run -current on amd64, updating the systems on average 2-3
times a week; I also use pkgsrc-head and again, 2-3 times a month I
cvs update my pkgsrc tree, together with a ' git pull' in wip, and I
run 'pkg_rolling-replace'.

Each and every run of pkg_rolling-replace gets me to a seemingly
identical hang in cmake in a single package - misc/kdepim4 , in
apparently the same spot. with similar trace. Attaching to the process
with gdb and quitting gets cmake to complete without any other action.
I've posted earlier the trace; here is another one, if it may be of
use:

GNU gdb (GDB) 11.0.50.20200914-git
Copyright (C) 2020 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later 
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64--netbsd".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
.
Find the GDB manual and other documentation resources online at:
.

For help, type "help".
Type "apropos word" to search for commands related to "word".
Attaching to process 7852
Reading symbols from /usr/pkg/bin/cmake...
(No debugging symbols found in /usr/pkg/bin/cmake)
[New LWP 10070 of process 7852]
[New LWP 2296 of process 7852]
[New LWP 23501 of process 7852]
[New LWP 27321 of process 7852]
[New LWP 7527 of process 7852]
[New LWP 13098 of process 7852]
[New LWP 29281 of process 7852]
[New LWP 7852 of process 7852]
Reading symbols from /usr/lib/libexecinfo.so.0...
(No debugging symbols found in /usr/lib/libexecinfo.so.0)
Reading symbols from /usr/lib/libexpat.so.2...
(No debugging symbols found in /usr/lib/libexpat.so.2)
Reading symbols from /usr/lib/libz.so.1...
(No debugging symbols found in /usr/lib/libz.so.1)
Reading symbols from /usr/lib/libarchive.so.4...
(No debugging symbols found in /usr/lib/libarchive.so.4)
Reading symbols from /usr/pkg/lib/libcurl.so.4...
(No debugging symbols found in /usr/pkg/lib/libcurl.so.4)
Reading symbols from /usr/pkg/lib/libuv.so.1...
Reading symbols from /usr/lib/libcrypto.so.14...
(No debugging symbols found in /usr/lib/libcrypto.so.14)
Reading symbols from /usr/lib/libstdc++.so.9...
(No debugging symbols found in /usr/lib/libstdc++.so.9)
Reading symbols from /usr/lib/libm.so.0...
(No debugging symbols found in /usr/lib/libm.so.0)
Reading symbols from /usr/lib/libgcc_s.so.1...
(No debugging symbols found in /usr/lib/libgcc_s.so.1)
Reading symbols from /usr/lib/libpthread.so.1...
(No debugging symbols found in /usr/lib/libpthread.so.1)
Reading symbols from /usr/lib/libc.so.12...
(No debugging symbols found in /usr/lib/libc.so.12)
Reading symbols from /usr/lib/libelf.so.2...
(No debugging symbols found in /usr/lib/libelf.so.2)
Reading symbols from /usr/lib/libbz2.so.1...
(No debugging symbols found in /usr/lib/libbz2.so.1)
Reading symbols from /usr/lib/liblzma.so.2...
(No debugging symbols found in /usr/lib/liblzma.so.2)
Reading symbols from /usr/pkg/lib/libnghttp2.so.14...
(No debugging symbols found in /usr/pkg/lib/libnghttp2.so.14)
Reading symbols from /usr/pkg/lib/libidn2.so.0...
(No debugging symbols found in /usr/pkg/lib/libidn2.so.0)
Reading symbols from /usr/pkg/lib/librtmp.so.0...
(No debugging symbols found in /usr/pkg/lib/librtmp.so.0)
Reading symbols from /usr/pkg/lib/libgnutls.so.30...
(No debugging symbols found in /usr/pkg/lib/libgnutls.so.30)
Reading symbols from /usr/pkg/lib/libp11-kit.so.0...
Reading symbols from /usr/pkg/lib/libffi.so.7...
(No debugging symbols found in /usr/pkg/lib/libffi.so.7)
Reading symbols from /usr/pkg/lib/libunistring.so.2...
(No debugging symbols found in /usr/pkg/lib/libunistring.so.2)
Reading symbols from /usr/pkg/lib/libtasn1.so.6...
(No debugging symbols found in /usr/pkg/lib/libtasn1.so.6)
Reading symbols from /usr/lib/libintl.so.1...
(No debugging symbols found in /usr/lib/libintl.so.1)
Reading symbols from /usr/pkg/lib/libhogweed.so.6...
Reading symbols from /usr/pkg/lib/libgmp.so.10...
(No debugging symbols found in /usr/pkg/lib/libgmp.so.10)
Reading symbols from /usr/pkg/lib/libnettle.so.8...
Reading symbols from /usr/pkg/lib/libssh2.so.1...
(No debugging symbols found in /usr/pkg/lib/libssh2.so.1)
Reading symbols from /usr/lib/libssl.so.14...
(No debugging symbols found in /usr/lib/libssl.so.14)
Reading symbols from /usr/lib/libgssapi.so.11...
(No debugging symbols found in /usr/lib/libgssapi.so.11)
Reading symbols from /usr/lib/libkvm.so.6...
(No debugging symbols found in /usr/lib/libkvm.so.6)
Reading symbols from /lib/libcrypt.so.1...
(No debugging symbols found in