[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020623#comment-15020623
]
Varun Saxena commented on YARN-3878:
[~sjlee0], yes this exists in branch-2.6 too.
I will help in
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020632#comment-15020632
]
Varun Saxena commented on YARN-3878:
[~sjlee0], I have backported the changes and updated a branch-2.6
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15019117#comment-15019117
]
Sangjin Lee commented on YARN-3878:
---
Does this issue exist in 2.6.x? Should this be backported to
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637049#comment-14637049
]
Hudson commented on YARN-3878:
--
SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #261 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637087#comment-14637087
]
Hudson commented on YARN-3878:
--
SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2210 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636673#comment-14636673
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Yarn-trunk #994 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636700#comment-14636700
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #264 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636742#comment-14636742
]
Varun Saxena commented on YARN-3878:
Thanks [~jianhe] for the commit and several others
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636995#comment-14636995
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #253 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636976#comment-14636976
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk #2191 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635892#comment-14635892
]
Anubhav Dhoot commented on YARN-3878:
-
Agree this is ok to ignore
AsyncDispatcher can
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635897#comment-14635897
]
Jian He commented on YARN-3878:
---
thanks ! committing this.
AsyncDispatcher can hang while
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635927#comment-14635927
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-trunk-Commit #8197 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632787#comment-14632787
]
Varun Saxena commented on YARN-3878:
Thanks [~adhoot] for the review. I agree there
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631816#comment-14631816
]
Hadoop QA commented on YARN-3878:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
||
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631849#comment-14631849
]
Jian He commented on YARN-3878:
---
Anubhav, thanks for reviewing the patch. I think given that
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628530#comment-14628530
]
Anubhav Dhoot commented on YARN-3878:
-
LGTM. Unrelated to this patch there is an
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625953#comment-14625953
]
Varun Saxena commented on YARN-3878:
[~jianhe], [~kasha], [~devaraj.k], kindly review.
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625946#comment-14625946
]
Hadoop QA commented on YARN-3878:
-
\\
\\
| (/) *{color:green}+1 overall{color}* |
\\
\\
||
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626242#comment-14626242
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Yarn-trunk #986 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626232#comment-14626232
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #256 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626453#comment-14626453
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk #2202 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626493#comment-14626493
]
Hudson commented on YARN-3878:
--
SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #254 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626388#comment-14626388
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk #2183 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626404#comment-14626404
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #244 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627238#comment-14627238
]
Jian He commented on YARN-3878:
---
latest patch looks good to me, will commit if no comments
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625826#comment-14625826
]
Varun Saxena commented on YARN-3878:
[~jianhe], will update a patch soon.
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624769#comment-14624769
]
Varun Saxena commented on YARN-3878:
[~jianhe] / [~kasha], added an addendum patch.
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624834#comment-14624834
]
Varun Saxena commented on YARN-3878:
Should I reopen the issue ?
AsyncDispatcher can
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625396#comment-14625396
]
Jian He commented on YARN-3878:
---
re-opened this, also reverted the previous patch.
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625436#comment-14625436
]
Hudson commented on YARN-3878:
--
SUCCESS: Integrated in Hadoop-trunk-Commit #8157 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622126#comment-14622126
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Yarn-trunk #982 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622117#comment-14622117
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #252 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622285#comment-14622285
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk #2179 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622295#comment-14622295
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk #2198 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622367#comment-14622367
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #240 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622430#comment-14622430
]
Hudson commented on YARN-3878:
--
SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #250 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620836#comment-14620836
]
Hudson commented on YARN-3878:
--
FAILURE: Integrated in Hadoop-trunk-Commit #8140 (See
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621786#comment-14621786
]
Varun Saxena commented on YARN-3878:
Thanks [~kasha] for the commit and review.
Thanks
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618738#comment-14618738
]
Varun Saxena commented on YARN-3878:
Yeah but we still need to check the thread state.
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14619478#comment-14619478
]
Karthik Kambatla commented on YARN-3878:
+1, pending Jenkins.
Will go ahead and
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618101#comment-14618101
]
Karthik Kambatla commented on YARN-3878:
bq. If we want have a more reliable way to
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618067#comment-14618067
]
Varun Saxena commented on YARN-3878:
Ok. Will update a patch with 2 seconds sleep by
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14619551#comment-14619551
]
Hadoop QA commented on YARN-3878:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
||
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616315#comment-14616315
]
Tsuyoshi Ozawa commented on YARN-3878:
--
FYI, I found a news which has impacts against
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617097#comment-14617097
]
Varun Saxena commented on YARN-3878:
[~jianhe] / [~devaraj.k] / [~kasha],
Checking for
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617093#comment-14617093
]
Varun Saxena commented on YARN-3878:
Thanks a lot for sharing the info [~ozawa].
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617199#comment-14617199
]
Varun Saxena commented on YARN-3878:
[~jianhe], we have a {{DrainDispatcher}} class
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617200#comment-14617200
]
Varun Saxena commented on YARN-3878:
Or have a protected function returning reference
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617174#comment-14617174
]
Jian He commented on YARN-3878:
---
You may try creating a new test sub class which extends
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617681#comment-14617681
]
Jian He commented on YARN-3878:
---
bq. Or have a protected function returning reference to
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617683#comment-14617683
]
Jian He commented on YARN-3878:
---
Given dispatcher is a sensitive piece of code, waiting 2-3
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617944#comment-14617944
]
Devaraj K commented on YARN-3878:
-
bq. Given dispatcher is a sensitive piece of code,
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615714#comment-14615714
]
Jian He commented on YARN-3878:
---
bq. I don't convince that it is a right way to modify the
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614375#comment-14614375
]
Hadoop QA commented on YARN-3878:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
||
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614398#comment-14614398
]
Hadoop QA commented on YARN-3878:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
||
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614355#comment-14614355
]
Varun Saxena commented on YARN-3878:
Thanks for the review [~kasha]
Will add a method
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614431#comment-14614431
]
Karthik Kambatla commented on YARN-3878:
{{hasNoPendingEvents}} seems a little
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614538#comment-14614538
]
Devaraj K commented on YARN-3878:
-
Adding to [~kasha] comment,
1. Can you add
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614560#comment-14614560
]
Hadoop QA commented on YARN-3878:
-
\\
\\
| (/) *{color:green}+1 overall{color}* |
\\
\\
||
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613661#comment-14613661
]
Hadoop QA commented on YARN-3878:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
||
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613933#comment-14613933
]
Devaraj K commented on YARN-3878:
-
Thanks [~varun_saxena] for the updated patch.
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614097#comment-14614097
]
Hadoop QA commented on YARN-3878:
-
\\
\\
| (/) *{color:green}+1 overall{color}* |
\\
\\
||
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614100#comment-14614100
]
Karthik Kambatla commented on YARN-3878:
Thanks for reporting and working on this
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613959#comment-14613959
]
Varun Saxena commented on YARN-3878:
Yeah had seen that in checkstyle report. Will fix
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613009#comment-14613009
]
Varun Saxena commented on YARN-3878:
Thanks for the review [~devaraj.k]
bq. I think
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613049#comment-14613049
]
Devaraj K commented on YARN-3878:
-
bq. Although as currently isdrained is not checked
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613055#comment-14613055
]
Varun Saxena commented on YARN-3878:
bq. I agree both do the same but we can avoid the
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612511#comment-14612511
]
Jian He commented on YARN-3878:
---
ah, sorry, I overlooked.
lgtm, thanks !
AsyncDispatcher
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612729#comment-14612729
]
Devaraj K commented on YARN-3878:
-
Thanks [~varun_saxena] for the patch and [~jianhe] for
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612320#comment-14612320
]
Jian He commented on YARN-3878:
---
Hi [~varun_saxena], the test seems not adequate. It doesn't
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612342#comment-14612342
]
Varun Saxena commented on YARN-3878:
[~jianhe], the test case as such is adequate.
I
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611484#comment-14611484
]
Jian He commented on YARN-3878:
---
[~varun_saxena], thanks for reporting this. Mind adding a
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611376#comment-14611376
]
Hadoop QA commented on YARN-3878:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
||
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611249#comment-14611249
]
Varun Saxena commented on YARN-3878:
According to me, {{drained}} flag is unnecessary.
[
https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611245#comment-14611245
]
Varun Saxena commented on YARN-3878:
The reason for this issue is as under :
* On call
76 matches
Mail list logo