[JIRA] (JENKINS-56535) Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents
Title: Message Title Muhammad Faizan ul haq commented on JENKINS-56535 Re: Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents We fought a little and found the issue. We spun up a test-jenkins from a backup of our production jenkins server. Both server had same ID and somehow after aprox two hours of an agent creation, the agents created by one server were being removed by other server. Jie Shen can probably explain this. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-56535) Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents
Title: Message Title Jie Shen commented on JENKINS-56535 Re: Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents Chance Davies Which version were you use before you updated. The latest version of this plugin only fixes error messages in the configuration page and add another way to provide images for agents. This kind of connection errors are always annoying but hard to debug. I plan to put a high priority for vm-agent-plugin's stability in the my next work plan. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-56535) Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents
Title: Message Title Chance Davies commented on JENKINS-56535 Re: Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents Just like Muhammad, we have only begun to see these errors only after the last update. We now have many slaves failing to run jobs which have been very reliable in the past. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-56535) Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents
Title: Message Title Muhammad Faizan ul haq commented on JENKINS-56535 Re: Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents It was working more stable up until two weeks ago. and yes, we are using ssh. It seems like the agent was up and serving the jobs for two hours. the it got allocated to yet another job and during the execution of the job, the VM got disappeared (the deletion seems to be ordrered by the plugin) and job wiill fail with errors like: ERROR: Issue with creating launcher for agent testtempba65f0. The agent has not been fully initialized yet Channel "unknown": Remote call on testtempba65f0 failed. The channel is closing down or has closed down We do not get a chance to look into agent, what has gone wrong. This is big time stopper for us right now. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-56535) Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents
Title: Message Title Azure DevOps started work on JENKINS-56535 Change By: Azure DevOps Status: Open In Progress Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-56535) Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents
Title: Message Title Jie Shen commented on JENKINS-56535 Re: Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents Thanks for reporting the issue here. I think this issue may be relevant with https://github.com/jenkinsci/jenkins/blob/1c9eb43283e7321ee4d3a0e1e9995453493ff04a/core/src/main/java/hudson/model/Slave.java#L496-L500 . The agent does not set up connection with master successfully. Do you choose SSH to connect to slave? The code is not enough robust for now. I think we should set timeout and retry strategy for setting up the connection. Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-56535) Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents
Title: Message Title Jie Shen assigned an issue to Jie Shen Jenkins / JENKINS-56535 Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents Change By: Jie Shen Assignee: Azure DevOps Jie Shen Add Comment This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-56535) Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents
Title: Message Title Muhammad Faizan ul haq created an issue Jenkins / JENKINS-56535 Caused: java.io.IOException: Unexpected termination of the channel for Azure Agents Issue Type: Bug Assignee: Azure DevOps Components: azure-vm-agents-plugin Created: 2019-03-13 08:26 Environment: Jenkins 2.138.2 Azure VM Plugin: 0.7.5 Priority: Blocker Reporter: Muhammad Faizan ul haq We are experiencing this problem quite extensively only on our autoscaled agents. The agent get disconnected during the execution of a job and gets deleted in azure as well. This gives us no time to login to VM and see the agent logs. The job continues to hold the agent even though it is "disconnected" in jenkins and actual VM is already deleted. The Jenkins Agent logs shows: Connection was broken java.io.EOFException at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2681) at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3156) at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:862) at java.io.ObjectInputStream.(ObjectInputStream.java:358) at hudson.remoting.ObjectInputStreamEx.(ObjectInputStreamEx.java:49) at hudson.remoting.Command.readFrom(Command.java:140) at hudson.remoting.Command.readFrom(Command.java:126) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:36) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63) Caused: java.io.IOException: Unexpected termination of the channel at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77) and we looked at logs on jenkins server and found this: 2019-03-12T13:04:28.614306215Z INFO: AzureVMCloud: