[ 
https://issues.jenkins-ci.org/browse/JENKINS-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=161014#comment-161014
 ] 

Richard Mortimer commented on JENKINS-11097:
--------------------------------------------

For reference the remoting changes above (at 
https://github.com/jenkinsci/remoting/compare/01a6df7...d94bb55 ) have been 
contributing to JENKINS-12037

My proposed fix is at https://github.com/jenkinsci/remoting/pull/3
                
> Jobs get aborted with "Command close created" as cause in the stacktrace
> ------------------------------------------------------------------------
>
>                 Key: JENKINS-11097
>                 URL: https://issues.jenkins-ci.org/browse/JENKINS-11097
>             Project: Jenkins
>          Issue Type: Bug
>          Components: core
>         Environment: 1.429
>            Reporter: Cees Bos
>            Priority: Critical
>
> We random see jobs getting aborted with the stacktraces below.
> We see this for long running jobs, which execute a large set of JUnit tests.
> Windows 2008 machine (x64)
> FATAL: Unable to delete script file 
> C:\Windows\TEMP\hudson7878511792654741097.bat
> hudson.util.IOException2: remote file operation failed: 
> C:\Windows\TEMP\hudson7878511792654741097.bat at 
> hudson.remoting.Channel@5a171ae3:srv-nl-crd05
>       at hudson.FilePath.act(FilePath.java:754)
>       at hudson.FilePath.act(FilePath.java:740)
>       at hudson.FilePath.delete(FilePath.java:995)
>       at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:92)
>       at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:58)
>       at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
>       at 
> hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:693)
>       at hudson.model.Build$RunnerImpl.build(Build.java:178)
>       at hudson.model.Build$RunnerImpl.doRun(Build.java:139)
>       at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:459)
>       at hudson.model.Run.run(Run.java:1376)
>       at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
>       at hudson.model.ResourceController.execute(ResourceController.java:88)
>       at hudson.model.Executor.run(Executor.java:230)
> Caused by: hudson.remoting.ChannelClosedException: channel is already closed
>       at hudson.remoting.Channel.send(Channel.java:492)
>       at hudson.remoting.Request.call(Request.java:110)
>       at hudson.remoting.Channel.call(Channel.java:674)
>       at hudson.FilePath.act(FilePath.java:747)
>       ... 13 more
> Caused by: hudson.remoting.Channel$OrderlyShutdown
>       at hudson.remoting.Channel$CloseCommand.execute(Channel.java:819)
>       at hudson.remoting.Channel$ReaderThread.run(Channel.java:1071)
> Caused by: Command close created at
>       at hudson.remoting.Command.<init>(Command.java:62)
>       at hudson.remoting.Command.<init>(Command.java:47)
>       at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
>       at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
>       at hudson.remoting.Channel.close(Channel.java:860)
>       at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:112)
>       at hudson.remoting.PingThread.ping(PingThread.java:107)
>       at hudson.remoting.PingThread.run(PingThread.java:81)
> FATAL: hudson.remoting.RequestAbortedException: 
> hudson.remoting.Channel$OrderlyShutdown
> hudson.remoting.RequestAbortedException: 
> hudson.remoting.RequestAbortedException: 
> hudson.remoting.Channel$OrderlyShutdown
>       at hudson.remoting.Request.call(Request.java:149)
>       at hudson.remoting.Channel.call(Channel.java:674)
>       at 
> hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:158)
>       at $Proxy35.join(Unknown Source)
>       at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:850)
>       at hudson.Launcher$ProcStarter.join(Launcher.java:336)
>       at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:82)
>       at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:58)
>       at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
>       at 
> hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:693)
>       at hudson.model.Build$RunnerImpl.build(Build.java:178)
>       at hudson.model.Build$RunnerImpl.doRun(Build.java:139)
>       at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:459)
>       at hudson.model.Run.run(Run.java:1376)
>       at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
>       at hudson.model.ResourceController.execute(ResourceController.java:88)
>       at hudson.model.Executor.run(Executor.java:230)
> Caused by: hudson.remoting.RequestAbortedException: 
> hudson.remoting.Channel$OrderlyShutdown
>       at hudson.remoting.Request.abort(Request.java:273)
>       at hudson.remoting.Channel.terminate(Channel.java:725)
>       at hudson.remoting.Channel$CloseCommand.execute(Channel.java:819)
>       at hudson.remoting.Channel$ReaderThread.run(Channel.java:1071)
> Caused by: hudson.remoting.Channel$OrderlyShutdown
>       ... 2 more
> Caused by: Command close created at
>       at hudson.remoting.Command.<init>(Command.java:62)
>       at hudson.remoting.Command.<init>(Command.java:47)
>       at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
>       at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
>       at hudson.remoting.Channel.close(Channel.java:860)
>       at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:112)
>       at hudson.remoting.PingThread.ping(PingThread.java:107)
>       at hudson.remoting.PingThread.run(PingThread.java:81)
> Linux (CentOS x64)
> FATAL: Unable to delete script file /tmp/hudson8819356115500333751.sh
> hudson.util.IOException2: remote file operation failed: 
> /tmp/hudson8819356115500333751.sh at 
> hudson.remoting.Channel@6d12070a:srv-nl-crd12
>       at hudson.FilePath.act(FilePath.java:754)
>       at hudson.FilePath.act(FilePath.java:740)
>       at hudson.FilePath.delete(FilePath.java:995)
>       at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:92)
>       at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:58)
>       at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
>       at 
> hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:693)
>       at hudson.model.Build$RunnerImpl.build(Build.java:178)
>       at hudson.model.Build$RunnerImpl.doRun(Build.java:139)
>       at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:459)
>       at hudson.model.Run.run(Run.java:1376)
>       at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
>       at hudson.model.ResourceController.execute(ResourceController.java:88)
>       at hudson.model.Executor.run(Executor.java:230)
> Caused by: hudson.remoting.ChannelClosedException: channel is already closed
>       at hudson.remoting.Channel.send(Channel.java:492)
>       at hudson.remoting.Request.call(Request.java:110)
>       at hudson.remoting.Channel.call(Channel.java:674)
>       at hudson.FilePath.act(FilePath.java:747)
>       ... 13 more
> Caused by: hudson.remoting.Channel$OrderlyShutdown
>       at hudson.remoting.Channel$CloseCommand.execute(Channel.java:819)
>       at hudson.remoting.Channel$ReaderThread.run(Channel.java:1071)
> Caused by: Command close created at
>       at hudson.remoting.Command.<init>(Command.java:62)
>       at hudson.remoting.Command.<init>(Command.java:47)
>       at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
>       at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
>       at hudson.remoting.Channel.close(Channel.java:860)
>       at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:112)
>       at hudson.remoting.PingThread.ping(PingThread.java:107)
>       at hudson.remoting.PingThread.run(PingThread.java:81)
> FATAL: hudson.remoting.RequestAbortedException: 
> hudson.remoting.Channel$OrderlyShutdown
> hudson.remoting.RequestAbortedException: 
> hudson.remoting.RequestAbortedException: 
> hudson.remoting.Channel$OrderlyShutdown
>       at hudson.remoting.Request.call(Request.java:149)
>       at hudson.remoting.Channel.call(Channel.java:674)
>       at 
> hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:158)
>       at $Proxy35.join(Unknown Source)
>       at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:850)
>       at hudson.Launcher$ProcStarter.join(Launcher.java:336)
>       at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:82)
>       at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:58)
>       at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
>       at 
> hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:693)
>       at hudson.model.Build$RunnerImpl.build(Build.java:178)
>       at hudson.model.Build$RunnerImpl.doRun(Build.java:139)
>       at hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:459)
>       at hudson.model.Run.run(Run.java:1376)
>       at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
>       at hudson.model.ResourceController.execute(ResourceController.java:88)
>       at hudson.model.Executor.run(Executor.java:230)
> Caused by: hudson.remoting.RequestAbortedException: 
> hudson.remoting.Channel$OrderlyShutdown
>       at hudson.remoting.Request.abort(Request.java:273)
>       at hudson.remoting.Channel.terminate(Channel.java:725)
>       at hudson.remoting.Channel$CloseCommand.execute(Channel.java:819)
>       at hudson.remoting.Channel$ReaderThread.run(Channel.java:1071)
> Caused by: hudson.remoting.Channel$OrderlyShutdown
>       ... 2 more
> Caused by: Command close created at
>       at hudson.remoting.Command.<init>(Command.java:62)
>       at hudson.remoting.Command.<init>(Command.java:47)
>       at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
>       at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:815)
>       at hudson.remoting.Channel.close(Channel.java:860)
>       at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:112)
>       at hudson.remoting.PingThread.ping(PingThread.java:107)
>       at hudson.remoting.PingThread.run(PingThread.java:81)
> Our master is running on CentOS x64.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to