We have another instance of WARNING: Failed to ack the stream java.io.IOException: Broken pipe
and scatter/gather is disabled:
/etc/network/if-up.d$ ethtool -k ens3
Features for ens3:
Cannot get device udp-fragmentation-offload settings: Operation not
permitted
rx-checksumming: on [fixed]
tx-checksumming: on
tx-checksum-ipv4: off [fixed]
tx-checksum-ip-generic: on
tx-checksum-ipv6: off [fixed]
tx-checksum-fcoe-crc: off [fixed]
tx-checksum-sctp: off [fixed]
scatter-gather: off
tx-scatter-gather: off
tx-scatter-gather-fraglist: off [fixed]
So that's not it.
On Monday, February 11, 2019 at 3:52:23 PM UTC-5, Glenn Burkhardt wrote:
>
> I've attached the two logs. I did make a change after seeing 'Failed to
> ack the stream' to turn off scatter/gather. But I think that's a bit of a
> "hail mary".
>
> On Monday, February 11, 2019 at 10:16:05 AM UTC-5, Ivan Fernandez Calvo
> wrote:
>>
>> It could be tons of things, Probably, if you go to the node log
>> (JENKINS_URL/computer/NODE_NAME/log) we could see if the agent connect or
>> not, then if the communication is broken before/after connection and in
>> which point.
>>
>>
>>
--
You received this message because you are subscribed to the Google Groups
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/jenkinsci-users/d0977005-4ba9-4a71-b1ad-27c590836039%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
remoting.log.0
Description: Binary data
Virtual machine "-ubuntu-20170406-122-1" (slave title "-ubuntu-122-1") is to be
started.
Starting, waiting for 15000ms to let it fully boot up...
Connecting slave client.
ERROR: [03/12/19 08:51:16] [SSH] Error deleting file.
java.io.IOException: Sorry, this connection is closed.
at
com.trilead.ssh2.transport.TransportManager.ensureConnected(TransportManager.java:600)
at
com.trilead.ssh2.transport.TransportManager.sendMessage(TransportManager.java:673)
at
com.trilead.ssh2.channel.ChannelManager.openSessionChannel(ChannelManager.java:572)
at com.trilead.ssh2.Session.<init>(Session.java:42)
at com.trilead.ssh2.Connection.openSession(Connection.java:1145)
at com.trilead.ssh2.Connection.exec(Connection.java:1566)
at hudson.plugins.sshslaves.SSHLauncher$4.run(SSHLauncher.java:1299)
at
jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
at
jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:210)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at
com.trilead.ssh2.crypto.cipher.CipherInputStream.fill_buffer(CipherInputStream.java:41)
at
com.trilead.ssh2.crypto.cipher.CipherInputStream.internal_read(CipherInputStream.java:52)
at
com.trilead.ssh2.crypto.cipher.CipherInputStream.getBlock(CipherInputStream.java:79)
at
com.trilead.ssh2.crypto.cipher.CipherInputStream.read(CipherInputStream.java:108)
at
com.trilead.ssh2.transport.TransportConnection.receiveMessage(TransportConnection.java:232)
at
com.trilead.ssh2.transport.TransportManager.receiveLoop(TransportManager.java:706)
at
com.trilead.ssh2.transport.TransportManager$1.run(TransportManager.java:502)
... 1 more
[03/12/19 08:51:16] [SSH] Connection closed.
SSHLauncher{host='192.168.122.101', port=22,
credentialsId='83c206e7-6a41-41c5-b5f1-231eb7e88482', jvmOptions='',
javaPath='', prefixStartSlaveCmd='', suffixStartSlaveCmd='',
launchTimeoutSeconds=6000, maxNumRetries=10, retryWaitTime=15,
sshHostKeyVerificationStrategy=hudson.plugins.sshslaves.verifiers.NonVerifyingKeyVerificationStrategy,
tcpNoDelay=true, trackCredentials=true}
[03/12/19 08:51:16] [SSH] Opening SSH connection to 192.168.122.101:22.
[03/12/19 08:51:16] [SSH] WARNING: SSH Host Keys are not being verified.
Man-in-the-middle attacks may be possible against this connection.
[03/12/19 08:51:16] [SSH] Authentication successful.
[03/12/19 08:51:16] [SSH] The remote user's environment is:
BASH=/bin/bash
BASHOPTS=cmdhist:complete_fullquote:extquote:force_fignore:hostcomplete:interactive_comments:progcomp:promptvars:sourcepath
BASH_ALIASES=()
BASH_ARGC=()
BASH_ARGV=()
BASH_CMDS=()
BASH_EXECUTION_STRING=set
BASH_LINENO=()
BASH_SOURCE=()
BASH_VERSINFO=([0]="4" [1]="4" [2]="19" [3]="1" [4]="release"
[5]="x86_64-pc-linux-gnu")
BASH_VERSION='4.4.19(1)-release'
DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/998/bus
DIRSTACK=()
EUID=998
GROUPS=()
HOME=/home/jenkins
HOSTNAME=VirtualBox
HOSTTYPE=x86_64
IFS=$' \t\n'
LANG=en_US.UTF-8
LOGNAME=jenkins
MACHTYPE=x86_64-pc-linux-gnu
MAIL=/var/mail/jenkins
OPTERR=1
OPTIND=1
OSTYPE=linux-gnu
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
PIPESTATUS=([0]="0")
PPID=1494
PS4='+ '
PWD=/home/jenkins
SHELL=/bin/bash
SHELLOPTS=braceexpand:hashall:interactive-comments
SHLVL=1
SSH_CLIENT='192.168.122.1 58906 22'
SSH_CONNECTION='192.168.122.1 58906 192.168.122.101 22'
TERM=dumb
UID=998
USER=jenkins
XDG_RUNTIME_DIR=/run/user/998
XDG_SESSION_ID=2
_=']'
ftp_proxy=http://localhost:3128
http_proxy=http://localhost:3128
https_proxy=http://localhost:3128
no_proxy=localhost,127.0.0.1,::1
[03/12/19 08:51:16] [SSH] Checking java version of /home/jenkins/jdk/bin/java
Couldn't figure out the Java version of /home/jenkins/jdk/bin/java
bash: /home/jenkins/jdk/bin/java: No such file or directory
[03/12/19 08:51:16] [SSH] Checking java version of
/usr/lib/jvm/java-8-oracle/bin/java
[03/12/19 08:51:17] [SSH] /usr/lib/jvm/java-8-oracle/bin/java -version returned
1.8.0_201.
[03/12/19 08:51:17] [SSH] Starting sftp client.
[03/12/19 08:51:17] [SSH] Copying latest remoting.jar...
[03/12/19 08:51:17] [SSH] Copied 776,265 bytes.
Expanded the channel window size to 4MB
[03/12/19 08:51:17] [SSH] Starting agent process: cd "/home/jenkins" &&
/usr/lib/jvm/java-8-oracle/bin/java -jar remoting.jar -workDir /home/jenkins
Mar 12, 2019 8:51:17 AM org.jenkinsci.remoting.engine.WorkDirManager
initializeWorkDir
INFO: Using /home/jenkins/remoting as a remoting work directory
Both error and output logs will be printed to /home/jenkins/remoting
<===[JENKINS REMOTING CAPACITY]===> channel started
Remoting version: 3.25
This is a Unix agent
Evacuated stdout
Agent successfully connected and online
Slave JVM has not reported exit code. Is it still running?
ERROR: Connection terminated
java.io.EOFException
at
java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2681)
at
java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3156)
at
java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:862)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:358)
at
hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:49)
at hudson.remoting.Command.readFrom(Command.java:140)
at hudson.remoting.Command.readFrom(Command.java:126)
at
hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:36)
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
Caused: java.io.IOException: Unexpected termination of the channel
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)
[03/12/19 08:51:26] [SSH] Connection closed.
syslog
Description: Binary data
