[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13853107#comment-13853107
]
Hudson commented on YARN-1307:
--
FAILURE: Integrated in Hadoop-Yarn-trunk #426 (See
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13853202#comment-13853202
]
Hudson commented on YARN-1307:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk #1643 (See
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13853220#comment-13853220
]
Hudson commented on YARN-1307:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk #1617 (See
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852446#comment-13852446
]
Hadoop QA commented on YARN-1307:
-
{color:green}+1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852545#comment-13852545
]
Tsuyoshi OZAWA commented on YARN-1307:
--
Thank you, Vinod, Karthik, Jian, and Bikas!
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852567#comment-13852567
]
Hudson commented on YARN-1307:
--
SUCCESS: Integrated in Hadoop-trunk-Commit #4916 (See
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851390#comment-13851390
]
Hadoop QA commented on YARN-1307:
-
{color:green}+1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851417#comment-13851417
]
Tsuyoshi OZAWA commented on YARN-1307:
--
Created YARN-1514 for benchmark utility. I'll
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13849248#comment-13849248
]
Tsuyoshi OZAWA commented on YARN-1307:
--
Thank you for the comment, Bikas and Vinod.
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13848641#comment-13848641
]
Bikas Saha commented on YARN-1307:
--
its going to help scale zk store now that we are
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845365#comment-13845365
]
Tsuyoshi OZAWA commented on YARN-1307:
--
@Jian He, could you check the latest patch?
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845647#comment-13845647
]
Jian He commented on YARN-1307:
---
patch looks good to me, thanks for the updating
Rethink
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842489#comment-13842489
]
Hadoop QA commented on YARN-1307:
-
{color:green}+1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842517#comment-13842517
]
Tsuyoshi OZAWA commented on YARN-1307:
--
{quote}
Rebased on trunk and added to check to
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13839027#comment-13839027
]
Hadoop QA commented on YARN-1307:
-
{color:green}+1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13839348#comment-13839348
]
Jian He commented on YARN-1307:
---
Sorry for the late response, patch looks good overall. one
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13839350#comment-13839350
]
Jian He commented on YARN-1307:
---
Also can you please run on a single node cluster and make
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13839704#comment-13839704
]
Tsuyoshi OZAWA commented on YARN-1307:
--
Thank you for your comment, Jian. OK, I'll
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13838486#comment-13838486
]
Hadoop QA commented on YARN-1307:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13838514#comment-13838514
]
Hadoop QA commented on YARN-1307:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837200#comment-13837200
]
Tsuyoshi OZAWA commented on YARN-1307:
--
*ping* any comments are welcome.
Rethink
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834957#comment-13834957
]
Tsuyoshi OZAWA commented on YARN-1307:
--
[~jianhe] and [~bikassaha], do you have
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834442#comment-13834442
]
Hadoop QA commented on YARN-1307:
-
{color:green}+1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832573#comment-13832573
]
Tsuyoshi OZAWA commented on YARN-1307:
--
[~jianhe], I'm sorry for delay, because of my
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832335#comment-13832335
]
Hadoop QA commented on YARN-1307:
-
{color:green}+1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13827754#comment-13827754
]
Tsuyoshi OZAWA commented on YARN-1307:
--
[~jianhe], OK, I'll update a patch to remove
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13826595#comment-13826595
]
Tsuyoshi OZAWA commented on YARN-1307:
--
[~jianhe] and [~bikassaha], could you review
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13826925#comment-13826925
]
Jian He commented on YARN-1307:
---
Sorry for the late response.
Patch looks good.
One minor
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13822359#comment-13822359
]
Tsuyoshi OZAWA commented on YARN-1307:
--
On recovery time, you're correct - your
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13822736#comment-13822736
]
Jian He commented on YARN-1307:
---
Sorry for being unclear. I agree that we can separate
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13822742#comment-13822742
]
Bikas Saha commented on YARN-1307:
--
My understanding was the under rm-root-znod we have
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13822743#comment-13822743
]
Bikas Saha commented on YARN-1307:
--
so it would look like
{noformat}
rm-root-znode
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13822796#comment-13822796
]
Jian He commented on YARN-1307:
---
Just looked at the code again. the current patch is doing
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13823062#comment-13823062
]
Tsuyoshi OZAWA commented on YARN-1307:
--
[~kkambatl], there were no big problems
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13823093#comment-13823093
]
Hadoop QA commented on YARN-1307:
-
{color:green}+1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13821192#comment-13821192
]
Hadoop QA commented on YARN-1307:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13821219#comment-13821219
]
Tsuyoshi OZAWA commented on YARN-1307:
--
The latest patch doesn't include any tests,
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13821489#comment-13821489
]
Karthik Kambatla commented on YARN-1307:
Went through the patch superficially.
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13821878#comment-13821878
]
Tsuyoshi OZAWA commented on YARN-1307:
--
[~kkambatl], thank you for review. OK, I'm
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13821892#comment-13821892
]
Jian He commented on YARN-1307:
---
correct me if I'm wrong, while we are removing attempts, we
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13822098#comment-13822098
]
Tsuyoshi OZAWA commented on YARN-1307:
--
Oops, this is my bad. Thank you for pointing
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13822106#comment-13822106
]
Tsuyoshi OZAWA commented on YARN-1307:
--
In RMStateStoreTestBase, removeApplicationId
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13822152#comment-13822152
]
Jian He commented on YARN-1307:
---
One question, any particular reason for creating one more
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13822176#comment-13822176
]
Tsuyoshi OZAWA commented on YARN-1307:
--
We can reduce the cost of getChildren against
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13822196#comment-13822196
]
Jian He commented on YARN-1307:
---
Don't we just call getChildren against RM_APP_ROOT once and
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13820762#comment-13820762
]
Jian He commented on YARN-1307:
---
Thanks [~ozawa] for taking this jira, some comments:
- This
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13818891#comment-13818891
]
Hadoop QA commented on YARN-1307:
-
{color:green}+1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819415#comment-13819415
]
Tsuyoshi OZAWA commented on YARN-1307:
--
Now the compile passed. [~bikassaha], could
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819901#comment-13819901
]
Bikas Saha commented on YARN-1307:
--
[~jianhe], [~kkambatl] Can you please help review the
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13814755#comment-13814755
]
Hadoop QA commented on YARN-1307:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13815605#comment-13815605
]
Tsuyoshi OZAWA commented on YARN-1307:
--
I'm now analysing the reason why Jenkins fails
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813796#comment-13813796
]
Hadoop QA commented on YARN-1307:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13814078#comment-13814078
]
Bikas Saha commented on YARN-1307:
--
YARN-891 changed a lot of stuff
Rethink znode
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813689#comment-13813689
]
Bikas Saha commented on YARN-1307:
--
This probably needs major rebasing after recent
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13805105#comment-13805105
]
Bikas Saha commented on YARN-1307:
--
After looking at the code I understand what you mean
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13805111#comment-13805111
]
Tsuyoshi OZAWA commented on YARN-1307:
--
Yes, you're right. Thanks for your feedback!
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13805978#comment-13805978
]
Hadoop QA commented on YARN-1307:
-
{color:green}+1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804088#comment-13804088
]
Tsuyoshi OZAWA commented on YARN-1307:
--
{quote}
When the data size exceeds the size of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804382#comment-13804382
]
Bikas Saha commented on YARN-1307:
--
Not quite sure what you mean by encoding. There is
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804383#comment-13804383
]
Bikas Saha commented on YARN-1307:
--
btw, for the purpose of this jira we can postpone the
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804752#comment-13804752
]
Tsuyoshi OZAWA commented on YARN-1307:
--
{code}
Not quite sure what you mean by
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804777#comment-13804777
]
Bikas Saha commented on YARN-1307:
--
[~jianhe] Please correct me if I am wrong.
The
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804823#comment-13804823
]
Tsuyoshi OZAWA commented on YARN-1307:
--
IIUC, You're correct, Bikas. What I'd like to
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804830#comment-13804830
]
Bikas Saha commented on YARN-1307:
--
Encryption is probably not required. We depend on ZK
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804837#comment-13804837
]
Tsuyoshi OZAWA commented on YARN-1307:
--
OK. This is the my thought of znode structure.
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803148#comment-13803148
]
Bikas Saha commented on YARN-1307:
--
It is fine to store a batch of delegation token in the
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801620#comment-13801620
]
Tsuyoshi OZAWA commented on YARN-1307:
--
Fixed typo:
{code}
ROOT_DIR_PATH
|---
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801619#comment-13801619
]
Tsuyoshi OZAWA commented on YARN-1307:
--
The latest znode structure is as follows:
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801640#comment-13801640
]
Hadoop QA commented on YARN-1307:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801679#comment-13801679
]
Hadoop QA commented on YARN-1307:
-
{color:green}+1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13801995#comment-13801995
]
Bikas Saha commented on YARN-1307:
--
To be clear, each app, app attempt, delegation token,
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802089#comment-13802089
]
Tsuyoshi OZAWA commented on YARN-1307:
--
{code}
About delegation token and secret key,
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798061#comment-13798061
]
Karthik Kambatla commented on YARN-1307:
[~ozawa], if you haven't already started
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798067#comment-13798067
]
Tsuyoshi OZAWA commented on YARN-1307:
--
Thanks for your review, Vinod and Jian!
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798070#comment-13798070
]
Tsuyoshi OZAWA commented on YARN-1307:
--
[~kkambatl], sure, no problem.
Rethink znode
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798120#comment-13798120
]
Bikas Saha commented on YARN-1307:
--
I dont see much value in creating extra hierarchy for
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798122#comment-13798122
]
Bikas Saha commented on YARN-1307:
--
Jira messed up the tree in previous comment. Here it
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798273#comment-13798273
]
Tsuyoshi OZAWA commented on YARN-1307:
--
OK, the design by Bikas looks good to me. I'll
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13797118#comment-13797118
]
Tsuyoshi OZAWA commented on YARN-1307:
--
I'm creating summary of proposal in YARN-1222
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13797346#comment-13797346
]
Tsuyoshi OZAWA commented on YARN-1307:
--
This is the summary of current znode
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13797470#comment-13797470
]
Vinod Kumar Vavilapalli commented on YARN-1307:
---
Just read through the
[
https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13797548#comment-13797548
]
Jian He commented on YARN-1307:
---
RMDelegationToken is not application specific, user can also
82 matches
Mail list logo
