[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757652#comment-13757652
]
Hudson commented on YARN-1074:
--
SUCCESS: Integrated in Hadoop-Yarn-trunk #322 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/322/])
YARN-1124. Modified YARN CLI application list to display new and submitted
applications together with running apps by default, following up YARN-1074.
Contributed by Xuan Gong. (vinodkv:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519869)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/ApplicationCLI.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Fix For: 2.1.1-beta
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757749#comment-13757749
]
Hudson commented on YARN-1074:
--
SUCCESS: Integrated in Hadoop-Hdfs-trunk #1512 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1512/])
YARN-1124. Modified YARN CLI application list to display new and submitted
applications together with running apps by default, following up YARN-1074.
Contributed by Xuan Gong. (vinodkv:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519869)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/ApplicationCLI.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Fix For: 2.1.1-beta
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757809#comment-13757809
]
Hudson commented on YARN-1074:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk #1539 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1539/])
YARN-1124. Modified YARN CLI application list to display new and submitted
applications together with running apps by default, following up YARN-1074.
Contributed by Xuan Gong. (vinodkv:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519869)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/ApplicationCLI.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Fix For: 2.1.1-beta
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749646#comment-13749646
]
Hudson commented on YARN-1074:
--
FAILURE: Integrated in Hadoop-Yarn-trunk #312 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/312/])
YARN-1074. Cleaned up YARN CLI application list to only display running
applications by default. Contributed by Xuan Gong. (vinodkv:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1517196)
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetApplicationsRequest.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_service_protos.proto
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/YarnClient.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/impl/YarnClientImpl.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/ApplicationCLI.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/api/impl/TestYarnClient.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetApplicationsRequestPBImpl.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMServerUtils.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Fix For: 2.1.1-beta
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749653#comment-13749653
]
Hudson commented on YARN-1074:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk #1529 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1529/])
YARN-1074. Cleaned up YARN CLI application list to only display running
applications by default. Contributed by Xuan Gong. (vinodkv:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1517196)
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetApplicationsRequest.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_service_protos.proto
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/YarnClient.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/impl/YarnClientImpl.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/ApplicationCLI.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/api/impl/TestYarnClient.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetApplicationsRequestPBImpl.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMServerUtils.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Fix For: 2.1.1-beta
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749471#comment-13749471
]
Vinod Kumar Vavilapalli commented on YARN-1074:
---
TestJHSSecurity seems to be caused by YARN-1085.
I'm checking this one in.
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749475#comment-13749475
]
Hudson commented on YARN-1074:
--
SUCCESS: Integrated in Hadoop-trunk-Commit #4322 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/4322/])
YARN-1074. Cleaned up YARN CLI application list to only display running
applications by default. Contributed by Xuan Gong. (vinodkv:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1517196)
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/GetApplicationsRequest.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_service_protos.proto
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/YarnClient.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/impl/YarnClientImpl.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/ApplicationCLI.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/api/impl/TestYarnClient.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/protocolrecords/impl/pb/GetApplicationsRequestPBImpl.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMServerUtils.java
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Fix For: 2.1.1-beta
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13748937#comment-13748937
]
Xuan Gong commented on YARN-1074:
-
uploaded new patch to ignore case sensitive for the filter appStates and
appTypes.
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749273#comment-13749273
]
Vinod Kumar Vavilapalli commented on YARN-1074:
---
+1, looks good. Will check this in once Jenkins gives its blessings.
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749278#comment-13749278
]
Xuan Gong commented on YARN-1074:
-
Do test on single node cluster.
1. Complete a mapreduce job
2. Running a sleep job.
The command : Run the command Yarn application -list --appStates all
The output:
Total number of applications (application-types: [] and states: [NEW,
NEW_SAVING, SUBMITTED, ACCEPTED, RUNNING, FINISHED, FAILED, KILLED]):2
Application-Id Application-NameApplication-Type
User Queue State Final-State
ProgressTracking-URL
application_1377314568682_0001 QuasiMonteCarlo MAPREDUCE
xuan defaultFINISHED SUCCEEDED
100% 192.168.0.16:19888/jobhistory/job/job_1377314568682_0001
application_1377314568682_0002 Sleep job MAPREDUCE
xuan default RUNNING UNDEFINED
5% Xuan-Gongs-MacBook-Pro.local:49615
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749279#comment-13749279
]
Xuan Gong commented on YARN-1074:
-
The command : yarn application -list
The output :
Total number of applications (application-types: [] and states: [RUNNING]):1
Application-Id Application-NameApplication-Type
User Queue State Final-State
ProgressTracking-URL
application_1377314568682_0002 Sleep job MAPREDUCE
xuan default RUNNING UNDEFINED
5.01% Xuan-Gongs-MacBook-Pro.local:49615
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749280#comment-13749280
]
Xuan Gong commented on YARN-1074:
-
Command : yarn application -list --appStates finished
Output:
Total number of applications (application-types: [] and states: [FINISHED]):1
Application-Id Application-NameApplication-Type
User Queue State Final-State
ProgressTracking-URL
application_1377314568682_0001 QuasiMonteCarlo MAPREDUCE
xuan defaultFINISHED SUCCEEDED
100% 192.168.0.16:19888/jobhistory/job/job_1377314568682_0001
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749282#comment-13749282
]
Xuan Gong commented on YARN-1074:
-
Command: yarn application -help
The output:
usage: application
-appStates Comma-separated list of application states Works with
--list to
filter
applications
based on their
state. The
valid
application
state can be
one of the
following:
ALL,NEW,NEW_SAV
ING,SUBMITTED,A
CCEPTED,RUNNING
,FINISHED,FAILE
D,KILLED
-appTypes Comma-separated list of application types Works with
--list to
filter
applications
based on their
type.
-help Displays help
for all
commands.
-kill Application IDKills the
application.
-list List
applications
from the RM.
Supports
optional use of
--appTypes to
filter
applications
based on
application
type, and
--appStates to
filter
applications
based on
application
state
-status Application ID Prints the
status of the
application.
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749281#comment-13749281
]
Xuan Gong commented on YARN-1074:
-
Command : yarn application -list --appStates test
Output:
The application state test is invalid.
The valid application state can be one of the following:
ALL,NEW,NEW_SAVING,SUBMITTED,ACCEPTED,RUNNING,FINISHED,FAILED,KILLED
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749283#comment-13749283
]
Xuan Gong commented on YARN-1074:
-
Command : yarn application -list --appStates all, Running
The output:
Total number of applications (application-types: [] and states: [NEW,
NEW_SAVING, SUBMITTED, ACCEPTED, RUNNING, FINISHED, FAILED, KILLED]):2
Application-Id Application-NameApplication-Type
User Queue State Final-State
ProgressTracking-URL
application_1377314568682_0001 QuasiMonteCarlo MAPREDUCE
xuan defaultFINISHED SUCCEEDED
100% 192.168.0.16:19888/jobhistory/job/job_1377314568682_0001
application_1377314568682_0002 Sleep job MAPREDUCE
xuan default RUNNING UNDEFINED
5.02% Xuan-Gongs-MacBook-Pro.local:49615
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749286#comment-13749286
]
Xuan Gong commented on YARN-1074:
-
Command: yarn application -list --appStates failed
Output:
Total number of applications (application-types: [] and states: [FAILED]):0
Application-Id Application-NameApplication-Type
User Queue State Final-State
ProgressTracking-URL
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749287#comment-13749287
]
Xuan Gong commented on YARN-1074:
-
Command: yarn application -list --appStates runninG,FinishEd
output:Total number of applications (application-types: [] and states:
[RUNNING, FINISHED]):2
Application-Id Application-NameApplication-Type
User Queue State Final-State
ProgressTracking-URL
application_1377314568682_0001 QuasiMonteCarlo MAPREDUCE
xuan defaultFINISHED SUCCEEDED
100% 192.168.0.16:19888/jobhistory/job/job_1377314568682_0001
application_1377314568682_0002 Sleep job MAPREDUCE
xuan default RUNNING UNDEFINED
5.03% Xuan-Gongs-MacBook-Pro.local:49615
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749295#comment-13749295
]
Hadoop QA commented on YARN-1074:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12599777/YARN-1074.8.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 2 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The following test timeouts occurred in
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.mapreduce.v2.TestUberAM
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/1752//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/1752//console
This message is automatically generated.
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749305#comment-13749305
]
Hadoop QA commented on YARN-1074:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12599777/YARN-1074.8.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 2 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.mapreduce.security.TestJHSSecurity
The following test timeouts occurred in
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.mapreduce.v2.TestUberAM
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/1754//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/1754//console
This message is automatically generated.
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749309#comment-13749309
]
Hadoop QA commented on YARN-1074:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12599777/YARN-1074.8.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 2 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.mapreduce.security.TestJHSSecurity
The following test timeouts occurred in
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.mapreduce.v2.TestUberAM
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/1755//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/1755//console
This message is automatically generated.
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch, YARN-1074.7.patch,
YARN-1074.8.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13748067#comment-13748067
]
Xuan Gong commented on YARN-1074:
-
bq.TestApplicationACLs changes seem unnecessary. Shouldn't the default
behaviour be enough for this?
Yes, we do not need to make any changes. Revert the changes from
TestApplicationACLs and TestClientRMServices.
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13748068#comment-13748068
]
Xuan Gong commented on YARN-1074:
-
Use EnumSetYarnApplicationState in the new patch.
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13748241#comment-13748241
]
Xuan Gong commented on YARN-1074:
-
New patch addresses all the comments
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch,
YARN-1074.4.patch, YARN-1074.5.patch, YARN-1074.6.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13746726#comment-13746726
]
Xuan Gong commented on YARN-1074:
-
bq.MapReduce changes are not needed.
The ResourceMgrDelegate extends from YarnClient. We added two new APIs in
YarnClient :
getApplications(SetString applicationTypes, SetString applicationStates)
and getApplicationWithApplicationStatesFilter(SetStringapplicationStates)
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13746873#comment-13746873
]
Xuan Gong commented on YARN-1074:
-
Address all the latest comments
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch, YARN-1074.3.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13745150#comment-13745150
]
Xuan Gong commented on YARN-1074:
-
bq.ClientRMService: We can have app-states and app-types used in conjunction.
So we can't bypass checks if only one of them is empty. Checks can be bypassed
only if both are empty.
We did use app-states and app-types in conjunction. The check will not be
bypassed if only one of them is empty. But for the case that both of them are
empty, we should just output the RUNNING applications.
{code}
SetString applicationTypes = request.getApplicationTypes();
SetString applicationStates = request.getApplicationStates();
boolean bypassFilterOnAppTypes = applicationTypes.isEmpty();
boolean bypassFilterOnAppStates = applicationStates.isEmpty();
ListApplicationReport reports = new ArrayListApplicationReport();
for (RMApp application : this.rmContext.getRMApps().values()) {
if (!(bypassFilterOnAppTypes || applicationTypes.contains(application
.getApplicationType( {
continue;
}
if (bypassFilterOnAppStates) {
if(application.getState() != RMAppState.RUNNING) {
continue;
}
} else {
if(!applicationStates.contains(application.getState().toString())) {
continue;
}
}
{code}
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13745152#comment-13745152
]
Xuan Gong commented on YARN-1074:
-
bq.Let's not break GetApplicationsRequest API. Add one new API that takes in a
states filter only and another one which takes both.
Add new API for taking both of appStates and appTypes. But for the case that
only takes in a states filter, we may need to give it a new name.
{code}
@Public
@Stable
public static GetApplicationsRequest
newInstance(SetString applicationTypes) {
GetApplicationsRequest request =
Records.newRecord(GetApplicationsRequest.class);
request.setApplicationTypes(applicationTypes);
return request;
}
@Public
@Stable
public static GetApplicationsRequest filterApplicationsByStates(
SetString applicationStates) {
GetApplicationsRequest request =
Records.newRecord(GetApplicationsRequest.class);
request.setApplicationStates(applicationStates);
return request;
}
@Public
@Stable
public static GetApplicationsRequest newInstance(
SetString applicationTypes, SetString applicationStates) {
GetApplicationsRequest request =
Records.newRecord(GetApplicationsRequest.class);
request.setApplicationTypes(applicationTypes);
request.setApplicationStates(applicationStates);
return request;
}
{code}
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch, YARN-1074.2.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13743498#comment-13743498
]
Junping Du commented on YARN-1074:
--
Shall we have column for info like app start time? If so, we can build filter
on it so that we can list jobs running within 1 hour, 1 day, etc.
btw, I saw TestUberAM timeout intermittent in some jenkins tests before. Do we
have JIRA to track this?
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.
[
https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13743510#comment-13743510
]
Xuan Gong commented on YARN-1074:
-
bq.Shall we have column for info like app start time? If so, we can build
filter on it so that we can list jobs running within 1 hour, 1 day, etc.
We can do that in the web service. We can provide a range of start time or
finished time, then We can filter based on the range.
Also, it is very easy to add the columns like start time or finished time,
because we do save those informations at RMApp.
Clean up YARN CLI app list to show only running apps.
-
Key: YARN-1074
URL: https://issues.apache.org/jira/browse/YARN-1074
Project: Hadoop YARN
Issue Type: Improvement
Components: client
Reporter: Tassapol Athiapinya
Assignee: Xuan Gong
Attachments: YARN-1074.1.patch
Once a user brings up YARN daemon, runs jobs, jobs will stay in output
returned by $ yarn application -list even after jobs complete already. We
want YARN command line to clean up this list. Specifically, we want to remove
applications with FINISHED state(not Final-State) or KILLED state from the
result.
{code}
[user1@host1 ~]$ yarn application -list
Total Applications:150
Application-IdApplication-Name
Application-Type User Queue State
Final-State ProgressTracking-URL
application_1374638600275_0109 Sleep job
MAPREDUCEuser1 default KILLED
KILLED 100%host1:54059
application_1374638600275_0121 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0121
application_1374638600275_0020 Sleep job
MAPREDUCEuser1 defaultFINISHED
SUCCEEDED 100% host1:19888/jobhistory/job/job_1374638600275_0020
application_1374638600275_0038 Sleep job
MAPREDUCEuser1 default
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
