[jira] [Commented] (YARN-1803) Signal container support in nodemanager
[ https://issues.apache.org/jira/browse/YARN-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942040#comment-14942040 ] Xuan Gong commented on YARN-1803: - Close this as duplication since YARN-1897 has been committed > Signal container support in nodemanager > --- > > Key: YARN-1803 > URL: https://issues.apache.org/jira/browse/YARN-1803 > Project: Hadoop YARN > Issue Type: Sub-task > Components: nodemanager >Reporter: Ming Ma >Assignee: Ming Ma > Labels: BB2015-05-TBR > Attachments: YARN-1803.patch > > > It could include the followings. > 1. ContainerManager is able to process a new event type > ContainerManagerEventType.SIGNAL_CONTAINERS coming from NodeStatusUpdater and > deliver the request to ContainerExecutor. > 2. Translate the platform independent signal command to Linux specific > signals. Windows support will be tracked by another task. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-1803) Signal container support in nodemanager
[
https://issues.apache.org/jira/browse/YARN-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524800#comment-14524800
]
Hadoop QA commented on YARN-1803:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | patch | 0m 0s | The patch command could not apply
the patch during dryrun. |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12643173/YARN-1803.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / f1a152c |
| Console output |
https://builds.apache.org/job/PreCommit-YARN-Build/7606/console |
This message was automatically generated.
Signal container support in nodemanager
---
Key: YARN-1803
URL: https://issues.apache.org/jira/browse/YARN-1803
Project: Hadoop YARN
Issue Type: Sub-task
Components: nodemanager
Reporter: Ming Ma
Assignee: Ming Ma
Attachments: YARN-1803.patch
It could include the followings.
1. ContainerManager is able to process a new event type
ContainerManagerEventType.SIGNAL_CONTAINERS coming from NodeStatusUpdater and
deliver the request to ContainerExecutor.
2. Translate the platform independent signal command to Linux specific
signals. Windows support will be tracked by another task.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-1803) Signal container support in nodemanager
[
https://issues.apache.org/jira/browse/YARN-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524784#comment-14524784
]
Hadoop QA commented on YARN-1803:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | patch | 0m 0s | The patch command could not apply
the patch during dryrun. |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12643173/YARN-1803.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / f1a152c |
| Console output |
https://builds.apache.org/job/PreCommit-YARN-Build/7602/console |
This message was automatically generated.
Signal container support in nodemanager
---
Key: YARN-1803
URL: https://issues.apache.org/jira/browse/YARN-1803
Project: Hadoop YARN
Issue Type: Sub-task
Components: nodemanager
Reporter: Ming Ma
Assignee: Ming Ma
Attachments: YARN-1803.patch
It could include the followings.
1. ContainerManager is able to process a new event type
ContainerManagerEventType.SIGNAL_CONTAINERS coming from NodeStatusUpdater and
deliver the request to ContainerExecutor.
2. Translate the platform independent signal command to Linux specific
signals. Windows support will be tracked by another task.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-1803) Signal container support in nodemanager
[ https://issues.apache.org/jira/browse/YARN-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002847#comment-14002847 ] Ming Ma commented on YARN-1803: --- Vinod, I have updated YARN-1897. Please let me know if you have other suggestions. I can also upload updated version for other subtasks that depend on YARN-1897. Signal container support in nodemanager --- Key: YARN-1803 URL: https://issues.apache.org/jira/browse/YARN-1803 Project: Hadoop YARN Issue Type: Sub-task Components: nodemanager Reporter: Ming Ma Assignee: Ming Ma Attachments: YARN-1803.patch It could include the followings. 1. ContainerManager is able to process a new event type ContainerManagerEventType.SIGNAL_CONTAINERS coming from NodeStatusUpdater and deliver the request to ContainerExecutor. 2. Translate the platform independent signal command to Linux specific signals. Windows support will be tracked by another task. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1803) Signal container support in nodemanager
[ https://issues.apache.org/jira/browse/YARN-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13997062#comment-13997062 ] Ming Ma commented on YARN-1803: --- Vinod, thanks for the great feedback. So to summarize it, 1. Add signalContainers method to both ApplicationClientProtocol and ContainerManagementProtocol to support ordered list. 2. stopContainers will be deprecated eventually. 3. MR needs be changed to call signalContainers instead of stopContainers. For the SignalContainerCommand, I will update that in YARN-1897. We still need to define signalContainerRequest in addition to signalContainersRequest. Signal container support in nodemanager --- Key: YARN-1803 URL: https://issues.apache.org/jira/browse/YARN-1803 Project: Hadoop YARN Issue Type: Sub-task Components: nodemanager Reporter: Ming Ma Assignee: Ming Ma Attachments: YARN-1803.patch It could include the followings. 1. ContainerManager is able to process a new event type ContainerManagerEventType.SIGNAL_CONTAINERS coming from NodeStatusUpdater and deliver the request to ContainerExecutor. 2. Translate the platform independent signal command to Linux specific signals. Windows support will be tracked by another task. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1803) Signal container support in nodemanager
[ https://issues.apache.org/jira/browse/YARN-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13997252#comment-13997252 ] Vinod Kumar Vavilapalli commented on YARN-1803: --- bq. 1. Add signalContainers method to [..] ContainerManagementProtocol to support ordered list. Yup. We can do the above as a follow up though. It seems like most cases are centered primarily around the RM API. Signal container support in nodemanager --- Key: YARN-1803 URL: https://issues.apache.org/jira/browse/YARN-1803 Project: Hadoop YARN Issue Type: Sub-task Components: nodemanager Reporter: Ming Ma Assignee: Ming Ma Attachments: YARN-1803.patch It could include the followings. 1. ContainerManager is able to process a new event type ContainerManagerEventType.SIGNAL_CONTAINERS coming from NodeStatusUpdater and deliver the request to ContainerExecutor. 2. Translate the platform independent signal command to Linux specific signals. Windows support will be tracked by another task. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1803) Signal container support in nodemanager
[ https://issues.apache.org/jira/browse/YARN-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994879#comment-13994879 ] Vinod Kumar Vavilapalli commented on YARN-1803: --- Tx for working on this Ming. Few comments, in line with [my comment on YARN-445|https://issues.apache.org/jira/browse/YARN-445?focusedCommentId=13994878page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13994878] about combining this functionality with the thread-dump feature, - We need to consolidate stopContainer* APIs into the signalContainer APIs. Logically, they are a subset of signalling. - To make that happen, we will need to have bulk signalling APIs to signal multiple containers simultaneously - One other requirement as part of that is to to be able to send an ordered list of signals so that NM can for example do things like sigterm+sigkill or thread-dump+sigterm+sigkill etc. - SignalContainerCommand defines a bunch of commands that aren't going to implemented today - let's only add those that are required and are going to be implemented as part of this set of patches. Still navigating the entire arena w.r.t to the signalling work being done across several JIRAs. Signal container support in nodemanager --- Key: YARN-1803 URL: https://issues.apache.org/jira/browse/YARN-1803 Project: Hadoop YARN Issue Type: Sub-task Components: nodemanager Reporter: Ming Ma Assignee: Ming Ma Attachments: YARN-1803.patch It could include the followings. 1. ContainerManager is able to process a new event type ContainerManagerEventType.SIGNAL_CONTAINERS coming from NodeStatusUpdater and deliver the request to ContainerExecutor. 2. Translate the platform independent signal command to Linux specific signals. Windows support will be tracked by another task. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1803) Signal container support in nodemanager
[
https://issues.apache.org/jira/browse/YARN-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13988557#comment-13988557
]
Hadoop QA commented on YARN-1803:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12643173/YARN-1803.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 6 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:red}-1 findbugs{color}. The patch appears to introduce 1 new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/3690//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-YARN-Build/3690//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3690//console
This message is automatically generated.
Signal container support in nodemanager
---
Key: YARN-1803
URL: https://issues.apache.org/jira/browse/YARN-1803
Project: Hadoop YARN
Issue Type: Sub-task
Components: nodemanager
Reporter: Ming Ma
Assignee: Ming Ma
Attachments: YARN-1803.patch
It could include the followings.
1. ContainerManager is able to process a new event type
ContainerManagerEventType.SIGNAL_CONTAINERS coming from NodeStatusUpdater and
deliver the request to ContainerExecutor.
2. Translate the platform independent signal command to Linux specific
signals. Windows support will be tracked by another task.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
