[jira] [Commented] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13639084#comment-13639084 ] Hudson commented on YARN-549: - Integrated in Hadoop-Mapreduce-trunk #1408 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1408/]) YARN-549. YarnClient.submitApplication should wait for application to be accepted by the RM (Zhijie Shen via bikas) (Revision 1470797) Result = SUCCESS bikas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1470797 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ClientRMProtocol.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/YarnClient.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/YarnClientImpl.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/TestYarnClient.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml > YarnClient.submitApplication should wait for application to be accepted by > the RM > - > > Key: YARN-549 > URL: https://issues.apache.org/jira/browse/YARN-549 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen > Fix For: 2.0.5-beta > > Attachments: Proposal of Asynchronous Application Submission_v1.pdf, > YARN-549.1.patch, YARN-549.2.patch, YARN-549.3.patch, YARN-549.4.patch > > > Currently, when submitting an application, storeApplication will be called > for recovery. However, it is a blocking API, and is likely to block > concurrent application submissions. Therefore, it is good to make application > submission asynchronous, and postpone storeApplication. YarnClient needs to > change to wait for the whole operation to complete so that clients can be > notified after the application is really submitted. YarnClient needs to wait > for application to reach SUBMITTED state or beyond. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13639005#comment-13639005 ] Hudson commented on YARN-549: - Integrated in Hadoop-Hdfs-trunk #1381 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1381/]) YARN-549. YarnClient.submitApplication should wait for application to be accepted by the RM (Zhijie Shen via bikas) (Revision 1470797) Result = FAILURE bikas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1470797 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ClientRMProtocol.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/YarnClient.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/YarnClientImpl.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/TestYarnClient.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml > YarnClient.submitApplication should wait for application to be accepted by > the RM > - > > Key: YARN-549 > URL: https://issues.apache.org/jira/browse/YARN-549 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen > Fix For: 2.0.5-beta > > Attachments: Proposal of Asynchronous Application Submission_v1.pdf, > YARN-549.1.patch, YARN-549.2.patch, YARN-549.3.patch, YARN-549.4.patch > > > Currently, when submitting an application, storeApplication will be called > for recovery. However, it is a blocking API, and is likely to block > concurrent application submissions. Therefore, it is good to make application > submission asynchronous, and postpone storeApplication. YarnClient needs to > change to wait for the whole operation to complete so that clients can be > notified after the application is really submitted. YarnClient needs to wait > for application to reach SUBMITTED state or beyond. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638947#comment-13638947 ] Hudson commented on YARN-549: - Integrated in Hadoop-Yarn-trunk #192 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/192/]) YARN-549. YarnClient.submitApplication should wait for application to be accepted by the RM (Zhijie Shen via bikas) (Revision 1470797) Result = SUCCESS bikas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1470797 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ClientRMProtocol.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/YarnClient.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/YarnClientImpl.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/TestYarnClient.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml > YarnClient.submitApplication should wait for application to be accepted by > the RM > - > > Key: YARN-549 > URL: https://issues.apache.org/jira/browse/YARN-549 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen > Fix For: 2.0.5-beta > > Attachments: Proposal of Asynchronous Application Submission_v1.pdf, > YARN-549.1.patch, YARN-549.2.patch, YARN-549.3.patch, YARN-549.4.patch > > > Currently, when submitting an application, storeApplication will be called > for recovery. However, it is a blocking API, and is likely to block > concurrent application submissions. Therefore, it is good to make application > submission asynchronous, and postpone storeApplication. YarnClient needs to > change to wait for the whole operation to complete so that clients can be > notified after the application is really submitted. YarnClient needs to wait > for application to reach SUBMITTED state or beyond. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638742#comment-13638742 ] Hudson commented on YARN-549: - Integrated in Hadoop-trunk-Commit #3648 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/3648/]) YARN-549. YarnClient.submitApplication should wait for application to be accepted by the RM (Zhijie Shen via bikas) (Revision 1470797) Result = SUCCESS bikas : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1470797 Files : * /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ClientRMProtocol.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/YarnClient.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/YarnClientImpl.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/TestYarnClient.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java * /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml > YarnClient.submitApplication should wait for application to be accepted by > the RM > - > > Key: YARN-549 > URL: https://issues.apache.org/jira/browse/YARN-549 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen > Fix For: 2.0.5-beta > > Attachments: Proposal of Asynchronous Application Submission_v1.pdf, > YARN-549.1.patch, YARN-549.2.patch, YARN-549.3.patch, YARN-549.4.patch > > > Currently, when submitting an application, storeApplication will be called > for recovery. However, it is a blocking API, and is likely to block > concurrent application submissions. Therefore, it is good to make application > submission asynchronous, and postpone storeApplication. YarnClient needs to > change to wait for the whole operation to complete so that clients can be > notified after the application is really submitted. YarnClient needs to wait > for application to reach SUBMITTED state or beyond. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM
[
https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638556#comment-13638556
]
Hadoop QA commented on YARN-549:
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12579921/YARN-549.4.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/798//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/798//console
This message is automatically generated.
> YarnClient.submitApplication should wait for application to be accepted by
> the RM
> -
>
> Key: YARN-549
> URL: https://issues.apache.org/jira/browse/YARN-549
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Zhijie Shen
>Assignee: Zhijie Shen
> Attachments: Proposal of Asynchronous Application Submission_v1.pdf,
> YARN-549.1.patch, YARN-549.2.patch, YARN-549.3.patch, YARN-549.4.patch
>
>
> Currently, when submitting an application, storeApplication will be called
> for recovery. However, it is a blocking API, and is likely to block
> concurrent application submissions. Therefore, it is good to make application
> submission asynchronous, and postpone storeApplication. YarnClient needs to
> change to wait for the whole operation to complete so that clients can be
> notified after the application is really submitted. YarnClient needs to wait
> for application to reach SUBMITTED state or beyond.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM
[
https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638513#comment-13638513
]
Zhijie Shen commented on YARN-549:
--
{code}
Is there a jira opened to track the server side work?
{code}
I've documented the server-side issue in YARN-599.
> YarnClient.submitApplication should wait for application to be accepted by
> the RM
> -
>
> Key: YARN-549
> URL: https://issues.apache.org/jira/browse/YARN-549
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Zhijie Shen
>Assignee: Zhijie Shen
> Attachments: Proposal of Asynchronous Application Submission_v1.pdf,
> YARN-549.1.patch, YARN-549.2.patch, YARN-549.3.patch
>
>
> Currently, when submitting an application, storeApplication will be called
> for recovery. However, it is a blocking API, and is likely to block
> concurrent application submissions. Therefore, it is good to make application
> submission asynchronous, and postpone storeApplication. YarnClient needs to
> change to wait for the whole operation to complete so that clients can be
> notified after the application is really submitted. YarnClient needs to wait
> for application to reach SUBMITTED state or beyond.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13638504#comment-13638504 ] Bikas Saha commented on YARN-549: - Can you please update the patch to add javadoc to the ClientRMProtocol saying ClientRMProtocol.submitApplication needs to be followed by getApplicationReport to be sure that the application got properly submitted. Thanks! > YarnClient.submitApplication should wait for application to be accepted by > the RM > - > > Key: YARN-549 > URL: https://issues.apache.org/jira/browse/YARN-549 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Zhijie Shen >Assignee: Zhijie Shen > Attachments: Proposal of Asynchronous Application Submission_v1.pdf, > YARN-549.1.patch, YARN-549.2.patch, YARN-549.3.patch > > > Currently, when submitting an application, storeApplication will be called > for recovery. However, it is a blocking API, and is likely to block > concurrent application submissions. Therefore, it is good to make application > submission asynchronous, and postpone storeApplication. YarnClient needs to > change to wait for the whole operation to complete so that clients can be > notified after the application is really submitted. YarnClient needs to wait > for application to reach SUBMITTED state or beyond. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
