[
https://issues.jenkins-ci.org/browse/JENKINS-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=161014#comment-161014
]
Richard Mortimer commented on JENKINS-11097:
--------------------------------------------
For reference the remoting changes above (at
https://github.com/jenkinsci/remoting/compare/01a6df7...d94bb55 ) have been
contributing to JENKINS-12037
My proposed fix is at https://github.com/jenkinsci/remoting/pull/3
> Jobs get aborted with "Command close created" as cause in the stacktrace
> ------------------------------------------------------------------------
>
> Key: JENKINS-11097
> URL: https://issues.jenkins-ci.org/browse/JENKINS-11097
> Project: Jenkins
> Issue Type: Bug
> Components: core
> Environment: 1.429
> Reporter: Cees Bos
> Priority: Critical
>
> We random see jobs getting aborted with the stacktraces below.
> We see this for long running jobs, which execute a large set of JUnit tests.
> Windows 2008 machine (x64)
> FATAL: Unable to delete script file
> C:\Windows\TEMP\hudson7878511792654741097.bat
> hudson.util.IOException2: remote file operation failed:
> C:\Windows\TEMP\hudson7878511792654741097.bat at
> hudson.remoting.Channel@5a171ae3:srv-nl-crd05
> at hudson.FilePath.act(FilePath.java:754)
> at hudson.FilePath.act(FilePath.java:740)
> at hudson.FilePath.delete(FilePath.java:995)
> at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:92)
> at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:58)
> at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
> at
> hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:693)
> at hudson.model.Build$RunnerImpl.build(Build.java:178)
> at hudson.model.Build$RunnerImpl.doRun(Build.java:139)
> at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:459)
> at hudson.model.Run.run(Run.java:1376)
> at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
> at hudson.model.ResourceController.execute(ResourceController.java:88)
> at hudson.model.Executor.run(Executor.java:230)
> Caused by: hudson.remoting.ChannelClosedException: channel is already closed
> at hudson.remoting.Channel.send(Channel.java:492)
> at hudson.remoting.Request.call(Request.java:110)
> at hudson.remoting.Channel.call(Channel.java:674)
> at hudson.FilePath.act(FilePath.java:747)
> ... 13 more
> Caused by: hudson.remoting.Channel$OrderlyShutdown
> at hudson.remoting.Channel$CloseCommand.execute(Channel.java:819)
> at hudson.remoting.Channel$ReaderThread.run(Channel.java:1071)
> Caused by: Command close created at
> at hudson.remoting.Command.<init>(Command.java:62)
> at hudson.remoting.Command.<init>(Command.java:47)
> at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
> at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
> at hudson.remoting.Channel.close(Channel.java:860)
> at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:112)
> at hudson.remoting.PingThread.ping(PingThread.java:107)
> at hudson.remoting.PingThread.run(PingThread.java:81)
> FATAL: hudson.remoting.RequestAbortedException:
> hudson.remoting.Channel$OrderlyShutdown
> hudson.remoting.RequestAbortedException:
> hudson.remoting.RequestAbortedException:
> hudson.remoting.Channel$OrderlyShutdown
> at hudson.remoting.Request.call(Request.java:149)
> at hudson.remoting.Channel.call(Channel.java:674)
> at
> hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:158)
> at $Proxy35.join(Unknown Source)
> at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:850)
> at hudson.Launcher$ProcStarter.join(Launcher.java:336)
> at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:82)
> at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:58)
> at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
> at
> hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:693)
> at hudson.model.Build$RunnerImpl.build(Build.java:178)
> at hudson.model.Build$RunnerImpl.doRun(Build.java:139)
> at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:459)
> at hudson.model.Run.run(Run.java:1376)
> at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
> at hudson.model.ResourceController.execute(ResourceController.java:88)
> at hudson.model.Executor.run(Executor.java:230)
> Caused by: hudson.remoting.RequestAbortedException:
> hudson.remoting.Channel$OrderlyShutdown
> at hudson.remoting.Request.abort(Request.java:273)
> at hudson.remoting.Channel.terminate(Channel.java:725)
> at hudson.remoting.Channel$CloseCommand.execute(Channel.java:819)
> at hudson.remoting.Channel$ReaderThread.run(Channel.java:1071)
> Caused by: hudson.remoting.Channel$OrderlyShutdown
> ... 2 more
> Caused by: Command close created at
> at hudson.remoting.Command.<init>(Command.java:62)
> at hudson.remoting.Command.<init>(Command.java:47)
> at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
> at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
> at hudson.remoting.Channel.close(Channel.java:860)
> at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:112)
> at hudson.remoting.PingThread.ping(PingThread.java:107)
> at hudson.remoting.PingThread.run(PingThread.java:81)
> Linux (CentOS x64)
> FATAL: Unable to delete script file /tmp/hudson8819356115500333751.sh
> hudson.util.IOException2: remote file operation failed:
> /tmp/hudson8819356115500333751.sh at
> hudson.remoting.Channel@6d12070a:srv-nl-crd12
> at hudson.FilePath.act(FilePath.java:754)
> at hudson.FilePath.act(FilePath.java:740)
> at hudson.FilePath.delete(FilePath.java:995)
> at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:92)
> at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:58)
> at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
> at
> hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:693)
> at hudson.model.Build$RunnerImpl.build(Build.java:178)
> at hudson.model.Build$RunnerImpl.doRun(Build.java:139)
> at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:459)
> at hudson.model.Run.run(Run.java:1376)
> at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
> at hudson.model.ResourceController.execute(ResourceController.java:88)
> at hudson.model.Executor.run(Executor.java:230)
> Caused by: hudson.remoting.ChannelClosedException: channel is already closed
> at hudson.remoting.Channel.send(Channel.java:492)
> at hudson.remoting.Request.call(Request.java:110)
> at hudson.remoting.Channel.call(Channel.java:674)
> at hudson.FilePath.act(FilePath.java:747)
> ... 13 more
> Caused by: hudson.remoting.Channel$OrderlyShutdown
> at hudson.remoting.Channel$CloseCommand.execute(Channel.java:819)
> at hudson.remoting.Channel$ReaderThread.run(Channel.java:1071)
> Caused by: Command close created at
> at hudson.remoting.Command.<init>(Command.java:62)
> at hudson.remoting.Command.<init>(Command.java:47)
> at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
> at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
> at hudson.remoting.Channel.close(Channel.java:860)
> at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:112)
> at hudson.remoting.PingThread.ping(PingThread.java:107)
> at hudson.remoting.PingThread.run(PingThread.java:81)
> FATAL: hudson.remoting.RequestAbortedException:
> hudson.remoting.Channel$OrderlyShutdown
> hudson.remoting.RequestAbortedException:
> hudson.remoting.RequestAbortedException:
> hudson.remoting.Channel$OrderlyShutdown
> at hudson.remoting.Request.call(Request.java:149)
> at hudson.remoting.Channel.call(Channel.java:674)
> at
> hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:158)
> at $Proxy35.join(Unknown Source)
> at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:850)
> at hudson.Launcher$ProcStarter.join(Launcher.java:336)
> at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:82)
> at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:58)
> at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
> at
> hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:693)
> at hudson.model.Build$RunnerImpl.build(Build.java:178)
> at hudson.model.Build$RunnerImpl.doRun(Build.java:139)
> at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:459)
> at hudson.model.Run.run(Run.java:1376)
> at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
> at hudson.model.ResourceController.execute(ResourceController.java:88)
> at hudson.model.Executor.run(Executor.java:230)
> Caused by: hudson.remoting.RequestAbortedException:
> hudson.remoting.Channel$OrderlyShutdown
> at hudson.remoting.Request.abort(Request.java:273)
> at hudson.remoting.Channel.terminate(Channel.java:725)
> at hudson.remoting.Channel$CloseCommand.execute(Channel.java:819)
> at hudson.remoting.Channel$ReaderThread.run(Channel.java:1071)
> Caused by: hudson.remoting.Channel$OrderlyShutdown
> ... 2 more
> Caused by: Command close created at
> at hudson.remoting.Command.<init>(Command.java:62)
> at hudson.remoting.Command.<init>(Command.java:47)
> at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
> at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
> at hudson.remoting.Channel.close(Channel.java:860)
> at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:112)
> at hudson.remoting.PingThread.ping(PingThread.java:107)
> at hudson.remoting.PingThread.run(PingThread.java:81)
> Our master is running on CentOS x64.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira