[
https://issues.apache.org/jira/browse/APEXCORE-535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492426#comment-15492426
]
ASF GitHub Bot commented on APEXCORE-535:
-----------------------------------------
GitHub user vrozov opened a pull request:
https://github.com/apache/apex-core/pull/392
APEXCORE-535 - Node.teardown() should try to gracefully shutdown exectutor
service
@tweise, @PramodSSImmaneni Please review.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vrozov/apex-core APEXCORE-535
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/apex-core/pull/392.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #392
----
commit e924284ee026790bf60a0254d4bcdcf822a665ba
Author: Vlad Rozov <[email protected]>
Date: 2016-09-15T05:06:36Z
APEXCORE-535 - Node.teardown() should try to gracefully shutdown exectutor
service
----
> Node.teardown() should try to gracefully shutdown exectutor service
> -------------------------------------------------------------------
>
> Key: APEXCORE-535
> URL: https://issues.apache.org/jira/browse/APEXCORE-535
> Project: Apache Apex Core
> Issue Type: Improvement
> Reporter: Vlad Rozov
> Assignee: Vlad Rozov
> Priority: Minor
> Fix For: 3.5.0
>
>
> Forceful shutdown of the executor service leads to InterruptedException if
> asynchronous checkpointing is in progress:
> {noformat}
> java.lang.InterruptedException
> at java.lang.Object.wait(Native Method)
> at java.lang.Thread.join(Thread.java:1281)
> at java.lang.Thread.join(Thread.java:1355)
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:456)
> at org.apache.hadoop.util.Shell.run(Shell.java:379)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:678)
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:661)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:639)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:305)
> at
> org.apache.hadoop.fs.FileSystem.primitiveCreate(FileSystem.java:1011)
> at
> org.apache.hadoop.fs.DelegateToFileSystem.createInternal(DelegateToFileSystem.java:85)
> at
> org.apache.hadoop.fs.ChecksumFs$ChecksumFSOutputSummer.<init>(ChecksumFs.java:344)
> at org.apache.hadoop.fs.ChecksumFs.createInternal(ChecksumFs.java:390)
> at
> org.apache.hadoop.fs.AbstractFileSystem.create(AbstractFileSystem.java:575)
> at org.apache.hadoop.fs.FileContext$3.next(FileContext.java:676)
> at org.apache.hadoop.fs.FileContext$3.next(FileContext.java:672)
> at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90)
> at org.apache.hadoop.fs.FileContext.create(FileContext.java:672)
> at
> com.datatorrent.common.util.AsyncFSStorageAgent.copyToHDFS(AsyncFSStorageAgent.java:118)
> at
> com.datatorrent.stram.engine.Node$CheckpointHandler.call(Node.java:667)
> at
> com.datatorrent.stram.engine.Node$CheckpointHandler.call(Node.java:656)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2016-09-14 22:02:51,463 [Thread-2109] WARN util.Shell run - Error reading
> the error stream
> java.io.IOException: Stream closed
> at java.io.BufferedReader.ensureOpen(BufferedReader.java:115)
> at java.io.BufferedReader.readLine(BufferedReader.java:310)
> at java.io.BufferedReader.readLine(BufferedReader.java:382)
> at org.apache.hadoop.util.Shell$1.run(Shell.java:431)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
