Additional basic info:
The jenkins master is running on a 32 core box, we have 38 slaves (of which
10 are currently down), everything in the build queue (6) is waiting on a
specially tagged slave. I can run api or UI requests. System load
average on the master is 0.06, jenkins is using about 75% of a core most of
the time (32 cores, 8 GB Xmx, GC sawtooth drops by more than 2 GB each
time, so not starving for memory).
Summary of a recent ThreadDump:
[wwalker@jenkins ~]$ cat jstack.14042.out | grep -A1 ^Thread | sed -e
's/Thread [0-9]*:/Thread <pid>:/' | sort | uniq -c | sort -nr
206 --
115 Thread <pid>: (state = IN_NATIVE)
92 Thread <pid>: (state = BLOCKED)
46 - sun.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame;
information may be imprecise)
44 - java.io.FileInputStream.readBytes(byte[], int, int) @bci=0
(Compiled frame; information may be imprecise)
32 - java.net.SocketInputStream.socketRead0(java.io.FileDescriptor,
byte[], int, int, int) @bci=0 (Compiled frame; information may be imprecise)
25 - java.lang.Thread.sleep(long) @bci=0 (Compiled frame; information
may be imprecise)
22 - java.lang.UNIXProcess.waitForProcessExit(int) @bci=0
(Interpreted frame)
12 - java.lang.Object.wait(long) @bci=0 (Compiled frame; information
may be imprecise)
8 - sun.nio.ch.EPollArrayWrapper.epollWait(long, int, long, int)
@bci=0 (Compiled frame; information may be imprecise)
7 - sun.nio.ch.ServerSocketChannelImpl.accept() @bci=7, line=225
(Interpreted frame)
4 - java.net.PlainSocketImpl.socketAccept(java.net.SocketImpl)
@bci=0 (Interpreted frame)
2 -
sun.nio.ch.ServerSocketChannelImpl.accept0(java.io.FileDescriptor,
java.io.FileDescriptor, java.net.InetSocketAddress[]) @bci=0 (Interpreted
frame)
2 -
java.net.PlainDatagramSocketImpl.receive0(java.net.DatagramPacket) @bci=0
(Interpreted frame)
2
1 - sun.nio.ch.EPollArrayWrapper.epollWait(long, int, long, int)
@bci=0 (Interpreted frame)
--
You received this message because you are subscribed to the Google Groups
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/jenkinsci-users/e79da303-fe67-4642-bf17-ac2b174616e0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.