[JIRA] (JENKINS-49576) Failure creating provisioned agent after successful provisioning

[he...@geekware.co.za (JIRA)]

Title: Message Title

Henti Smith created an issue   Jenkins / JENKINS-49576 Failure creating provisioned agent after successful provisioning Issue Type: Bug Assignee: Azure DevOps Components: azure-vm-agents-plugin Created: 2018-02-15 12:12 Environment: Jenkins running on Debian Jessie 8.9 provisioning to Debian Stretch 9.3 Jenkins Java : openjdk version "1.8.0_131" Agent Java : openjdk version "1.8.0_151" Jenkins core : Jenkins 2.73.2 Azure VM Agents : Azure VM Agents 0.6.0 Jenkins running directly, not sure about installation. Chrome : Version 64.0.3282.140 (Official Build) (64-bit) System properties awt.toolkit sun.awt.X11.XToolkit executable-war /usr/share/jenkins/jenkins.war file.encoding UTF-8 file.encoding.pkg sun.io file.separator / java.awt.graphicsenv sun.awt.X11GraphicsEnvironment java.awt.headless true java.awt.printerjob sun.print.PSPrinterJob java.class.path /usr/share/jenkins/jenkins.war java.class.version 52.0 java.endorsed.dirs /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/endorsed java.ext.dirs /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/ext:/usr/java/packages/lib/ext java.home /usr/lib/jvm/java-8-openjdk-amd64/jre java.io.tmpdir /tmp java.library.path /usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib java.runtime.name OpenJDK Runtime Environment java.runtime.version 1.8.0_131-8u131-b11-1~bpo8+1-b11 java.specification.name Java Platform API Specification java.specification.vendor Oracle Corporation java.specification.version 1.8 java.vendor Oracle Corporation java.vendor.url http://java.oracle.com/ java.vendor.url.bug http://bugreport.sun.com/bugreport/ java.version 1.8.0_131 java.vm.info mixed mode java.vm.name OpenJDK 64-Bit Server VM java.vm.specification.name Java Virtual Machine Specification java.vm.specification.vendor Oracle Corporation java.vm.specification.version 1.8 java.vm.vendor Oracle Corporation java.vm.version 25.131-b11 jna.loaded true jna.platform.library.path /usr/lib/x86_64-linux-gnu:/lib/x86_64-linux-gnu:/lib64:/usr/lib:/lib jnidispatch.path /tmp/jna--1712433994/jna109663947143428543.tmp line.separator mail.smtp.sendpartial true mail.smtps.sendpartial true os.arch amd64 os.name Linux os.version 3.16.0-4-amd64 path.separator : sun.arch.data.model 64 sun.boot.class.path /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/resources.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jsse.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jce.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/charsets.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jfr.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/classes sun.boot.library.path /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64 sun.cpu.endian little sun.cpu.isalist sun.font.fontmanager sun.awt.X11FontManager sun.io.unicode.encoding UnicodeLittle sun.java.command /usr/share/jenkins/jenkins.war --webroot=/var/cache/jenkins/war --httpPort=8080 --httpKeepAliveTimeout=60000 sun.java.launcher SUN_STANDARD sun.jnu.encoding UTF-8 sun.management.compiler HotSpot 64-Bit Tiered Compilers sun.os.patch.level unknown svnkit.http.methods Digest,Basic,NTLM,Negotiate svnkit.ssh2.persistent false user.country GB user.dir / user.home /var/lib/jenkins user.language en user.name jenkins user.timezone Europe/London Environment Variables _ /usr/bin/daemon HOME /var/lib/jenkins JENKINS_HOME /mnt/jenkins-home LANG en_GB.UTF-8 LANGUAGE en_GB:en LOGNAME jenkins MAIL /var/mail/jenkins PATH /usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games PWD /var/lib/jenkins SHELL /bin/bash SHLVL 1 TERM xterm-256color USER jenkins Plugins ace-editor 1.1 true ant 1.7 true antisamy-markup-formatter 1.5 true apache-httpcomponents-client-4-api 4.5.3-2.0 true authentication-tokens 1.3 true azure-commons 0.2.4 true azure-credentials 1.3.1 true azure-vm-agents 0.6.0 true bouncycastle-api 2.16.2 true branch-api 2.0.15 true build-alias-setter 0.4 true build-timeout 1.19 true cloud-stats 0.16 true cloudbees-folder 6.2.1 true conditional-buildstep 1.3.6 true copyartifact 1.39 true credentials 2.1.16 true credentials-binding 1.13 true disk-usage 0.28 true display-url-api 2.1.0 true docker-commons 1.9 true docker-workflow 1.14 true durable-task 1.15 true email-ext 2.61 true external-monitor-job 1.7 true ghprb 1.39.1-0-Custom true git 3.6.4 true git-client 2.6.0 true git-server 1.7 true github 1.28.1 true github-api 1.90 true github-branch-source 2.2.6 true github-oauth 0.28.1 true github-organization-folder 1.6 true gradle 1.28 true groovy 2.0 true handlebars 1.1.1 true icon-shim 2.0.3 true jackson2-api 2.8.7.0 true javadoc 1.4 true job-dsl 1.66 true jobConfigHistory 2.18 true jquery 1.12.4-0 true jquery-detached 1.2.1 true jsch 0.1.54.1 true junit 1.21 true ldap 1.17 true lockable-resources 2.0 true mailer 1.20 true mapdb-api 1.0.9.0 true matrix-auth 2.1.1 true matrix-project 1.12 true maven-plugin 3.0 true metrics 3.1.2.10 true momentjs 1.1.1 true msbuild 1.28 true nodelabelparameter 1.7.2 true pam-auth 1.3 true parameterized-trigger 2.35.2 true pipeline-build-step 2.5.1 true pipeline-github-lib 1.0 true pipeline-graph-analysis 1.5 true pipeline-input-step 2.8 true pipeline-milestone-step 1.3.1 true pipeline-model-api 1.2.3 true pipeline-model-declarative-agent 1.1.1 true pipeline-model-definition 1.2.3 true pipeline-model-extensions 1.2.3 true pipeline-rest-api 2.9 true pipeline-stage-step 2.3 true pipeline-stage-tags-metadata 1.2.3 true pipeline-stage-view 2.9 true pipeline-utility-steps 1.5.1 true plain-credentials 1.4 true PrioritySorter 3.5.1 true promoted-builds 2.31 true rebuild 1.27 true resource-disposer 0.8 true run-condition 1.0 true scm-api 2.2.5 true script-security 1.35 true ssh-agent 1.15 true ssh-credentials 1.13 true ssh-slaves 1.22 true structs 1.10 true subversion 2.9 true throttle-concurrents 2.0.1 true timestamper 1.8.8 true token-macro 2.3 true windows-slaves 1.3.1 true workflow-aggregator 2.5 true workflow-api 2.23.1 true workflow-basic-steps 2.6 true workflow-cps 2.41 true workflow-cps-global-lib 2.9 true workflow-durable-task-step 2.17 true workflow-job 2.12.2 true workflow-multibranch 2.16 true workflow-scm-step 2.6 true workflow-step-api 2.13 true workflow-support 2.16 true ws-cleanup 0.34 true Priority: Major Reporter: Henti Smith We use a linux-scalable label which spins up agents on Azure. This works mostly well, but have had this issue on a couple of machines:  Jenkins spins up an agent Feb 15, 2018 3:26:00 AM com.microsoft.azure.vmagent.AzureVMCloud$4 call INFO: Azure Cloud: provision: Adding agent linux-scalablef495f0 to Jenkins nodes Feb 15, 2018 3:27:35 AM com.microsoft.azure.vmagent.AzureVMAgent createComputer INFO: AzureVMAgent: createComputer: start for agent linux-scalablef495f0 Feb 15, 2018 3:27:35 AM com.microsoft.azure.vmagent.remote.AzureVMAgentSSHLauncher launch INFO: AzureVMAgentSSHLauncher: launch: launch method called for agent linux-scalablef495f0 Feb 15, 2018 3:27:47 AM com.microsoft.azure.vmagent.remote.AzureVMAgentSSHLauncher getRemoteSession INFO: AzureVMAgentSSHLauncher: getRemoteSession: getting remote session for user jenkins to host linux-scalablef495f0.westeurope.cloudapp.azure.com:22 Feb 15, 2018 3:27:47 AM com.microsoft.azure.vmagent.remote.AzureVMAgentSSHLauncher getRemoteSession INFO: AzureVMAgentSSHLauncher: getRemoteSession: Got remote session for user jenkins to host linux-scalablef495f0.westeurope.cloudapp.azure.com:22 Feb 15, 2018 3:27:58 AM com.microsoft.azure.vmagent.remote.AzureVMAgentSSHLauncher getRemoteSession INFO: AzureVMAgentSSHLauncher: getRemoteSession: getting remote session for user jenkins to host linux-scalablef495f0.westeurope.cloudapp.azure.com:22 Feb 15, 2018 3:27:58 AM com.microsoft.azure.vmagent.remote.AzureVMAgentSSHLauncher getRemoteSession INFO: AzureVMAgentSSHLauncher: getRemoteSession: Got remote session for user jenkins to host linux-scalablef495f0.westeurope.cloudapp.azure.com:22 Starts build  03:28:17 Running on linux-scalablef495f0 in /mnt/resource/jenkins/workspace/Build-Dashboard/opensource The Azure plugin suddenly reports that the VM didn't start up.  Feb 15, 2018 3:44:00 AM com.microsoft.azure.vmagent.AzureVMCloud$4 call SEVERE: Failure creating provisioned agent 'linux-scalablef495f0' com.microsoft.azure.vmagent.exceptions.AzureCloudException: AzureVMCloud: createProvisionedAgent: Deployment jenkins-linux-8-core-build-slave0215032324572 failed, max timeout reached (1200 seconds) at com.microsoft.azure.vmagent.exceptions.AzureCloudException.create(AzureCloudException.java:37) at com.microsoft.azure.vmagent.AzureVMCloud.createProvisionedAgent(AzureVMCloud.java:642) at com.microsoft.azure.vmagent.AzureVMCloud$4.call(AzureVMCloud.java:833) at com.microsoft.azure.vmagent.AzureVMCloud$4.call(AzureVMCloud.java:810) at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) Feb 15, 2018 3:44:29 AM hudson.remoting.SynchronousCommandTransport$ReaderThread run Plugin checks if vm exists, and finds it, then terminates it. Feb 15, 2018 3:44:00 AM com.microsoft.azure.vmagent.AzureVMManagementServiceDelegate virtualMachineExists INFO: AzureVMManagementServiceDelegate: virtualMachineExists: check for jenkins-linux-8-core-build-slavef495f0 Feb 15, 2018 3:44:00 AM com.microsoft.azure.vmagent.AzureVMManagementServiceDelegate virtualMachineExists INFO: AzureVMManagementServiceDelegate: virtualMachineExists: jenkins-linux-8-core-build-slavef495f0 exists Feb 15, 2018 3:44:02 AM com.microsoft.rest.interceptors.LoggingInterceptor log Feb 15, 2018 3:44:24 AM com.microsoft.azure.vmagent.AzureVMManagementServiceDelegate terminateVirtualMachine INFO: AzureVMManagementServiceDelegate: terminateVirtualMachine: Removing virtual machine jenkins-linux-8-core-build-slavef495f0 I/O error in channel jenkins-linux-scalablef495f0 error SEVERE: I/O error in channel jenkins-linux-scalablef495f0 java.io.IOException: Unexpected termination of the channel at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:73) Caused by: java.io.EOFException at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638) at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113) at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853) at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349) at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:59)   Add Comment   This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.