[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15619392#comment-15619392
]
Varun Saxena commented on YARN-5773:
Committed to trunk, branch-2 and branch-2.8
Thanks
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15619387#comment-15619387
]
Varun Saxena commented on YARN-5773:
Thanks [~bibinchundatt] for providing branch-2.8 patch.
Test
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15618682#comment-15618682
]
Bibin A Chundatt commented on YARN-5773:
{format}
JDK v1.8.0_111 Failed junit tests
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15618650#comment-15618650
]
Hadoop QA commented on YARN-5773:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15618620#comment-15618620
]
Hadoop QA commented on YARN-5773:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15617973#comment-15617973
]
Varun Saxena commented on YARN-5773:
[~bibinchundatt], patch does not apply cleanly on branch-2.8
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15617736#comment-15617736
]
Hudson commented on YARN-5773:
--
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10727 (See
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15617705#comment-15617705
]
Varun Saxena commented on YARN-5773:
+1.
Will commit it shortly.
> RM recovery too slow due to
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15617397#comment-15617397
]
Hadoop QA commented on YARN-5773:
-
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15617353#comment-15617353
]
Bibin A Chundatt commented on YARN-5773:
Uploaded patch after fixing UT
> RM recovery too slow due
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616843#comment-15616843
]
Varun Saxena commented on YARN-5773:
[~bibinchundatt], TestClientRMService failure is related. It times
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616786#comment-15616786
]
Hadoop QA commented on YARN-5773:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616557#comment-15616557
]
Varun Saxena commented on YARN-5773:
Thanks [~bibinchundatt] for the patch.
Changes look fine to me.
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616214#comment-15616214
]
Sunil G commented on YARN-5773:
---
Yes. +1 for fixing UT cases here.
> RM recovery too slow due to
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616073#comment-15616073
]
Wangda Tan commented on YARN-5773:
--
Thanks [~bibinchundatt] updating the patch and all others for reviews.
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614950#comment-15614950
]
Bibin A Chundatt commented on YARN-5773:
[~sunilg]/[~varun_saxena]
Details of Failure
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614316#comment-15614316
]
Bibin A Chundatt commented on YARN-5773:
[~varun_saxena]
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612898#comment-15612898
]
Varun Saxena commented on YARN-5773:
[~bibinchundatt], few if not all the test failures are related.
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612728#comment-15612728
]
Hadoop QA commented on YARN-5773:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612695#comment-15612695
]
Bibin A Chundatt commented on YARN-5773:
Attached patch removing num of apps check
> RM recovery
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612443#comment-15612443
]
Naganarasimha G R commented on YARN-5773:
-
I too agree to not to have just 1 app to be in activated
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612408#comment-15612408
]
Varun Saxena commented on YARN-5773:
bq. I did verify the same when cluster resource is empty and
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612297#comment-15612297
]
Bibin A Chundatt commented on YARN-5773:
{quote}
When cluster resource is 0, this is unlikely to be
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611663#comment-15611663
]
Sunil G commented on YARN-5773:
---
I also think {{getNumActiveApplications}} is not needed to be checked during
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611658#comment-15611658
]
Varun Saxena commented on YARN-5773:
bq. Earlier implementation also followed the same. if i understand
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611264#comment-15611264
]
Hadoop QA commented on YARN-5773:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611052#comment-15611052
]
Hadoop QA commented on YARN-5773:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610886#comment-15610886
]
Bibin A Chundatt commented on YARN-5773:
[~varun_saxena]
Earlier implementation also followed the
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610879#comment-15610879
]
Varun Saxena commented on YARN-5773:
[~bibinchundatt],
Below check for getNumActiveApplications is not
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610875#comment-15610875
]
Bibin A Chundatt commented on YARN-5773:
[~varun_saxena]
Thank you for review comment. Attached
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610374#comment-15610374
]
Bibin A Chundatt commented on YARN-5773:
IIUC SchedulerApplicationAttempt#isRecovering is set only
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609208#comment-15609208
]
Varun Saxena commented on YARN-5773:
bq. Now the question here is to invoke activateApplications after
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15608433#comment-15608433
]
Hadoop QA commented on YARN-5773:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607750#comment-15607750
]
Bibin A Chundatt commented on YARN-5773:
[~sunilg] have raise JIRA YARN-5781 for the same.
> RM
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607655#comment-15607655
]
Sunil G commented on YARN-5773:
---
In scheduler, as of now there are no event/apis to know whether recovery is
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607493#comment-15607493
]
Bibin A Chundatt commented on YARN-5773:
{quote}
we could only invoke activateApplications once
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607225#comment-15607225
]
Sunil G commented on YARN-5773:
---
Currently we are trying to invoke activateApplications while recovering
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604720#comment-15604720
]
Varun Saxena commented on YARN-5773:
bq. Optimizing activateApplication() can be handled in new JIRA.
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604718#comment-15604718
]
Varun Saxena commented on YARN-5773:
Is there any need to activate applications on recovery ? Cluster
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604710#comment-15604710
]
Bibin A Chundatt commented on YARN-5773:
Thank you [~sunilg],Wangda,Varun
Recovery scenario will
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604287#comment-15604287
]
Bibin A Chundatt commented on YARN-5773:
{quote}
3. As mentioned by Bibin A Chundatt, when each app
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604144#comment-15604144
]
Sunil G commented on YARN-5773:
---
*Issues in Recovery of apps:*
1. activateApplications works under a write
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603964#comment-15603964
]
Rohith Sharma K S commented on YARN-5773:
-
Thanks folks for discussion..
I went through overall
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603947#comment-15603947
]
Bibin A Chundatt commented on YARN-5773:
{quote}
If a given app's AM resource amount > AM headroom,
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603373#comment-15603373
]
Varun Saxena commented on YARN-5773:
[~sunilg], we still need to add the apps to pendingOrderingPolicy.
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603166#comment-15603166
]
Wangda Tan commented on YARN-5773:
--
I feel we may need a overhaul to existing activateApplication:
If we
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602941#comment-15602941
]
Bibin A Chundatt commented on YARN-5773:
[~sunilg]
Till then, only one app will activated and rest
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602907#comment-15602907
]
Sunil G commented on YARN-5773:
---
bq.1.If cluster resource is zero don't check AM limit. 2. Skip all apps if
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602871#comment-15602871
]
Bibin A Chundatt commented on YARN-5773:
Thank you [~leftnoteasy] for review comment.
{quote}
I'm
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602831#comment-15602831
]
Hadoop QA commented on YARN-5773:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602776#comment-15602776
]
Wangda Tan commented on YARN-5773:
--
Thanks [~bibinchundatt] for reporting and working on this issue.
I'm
[
https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602665#comment-15602665
]
Hadoop QA commented on YARN-5773:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
52 matches
Mail list logo
