[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665887#comment-16665887
]
Hudson commented on YARN-8569:
--
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15328 (See
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665803#comment-16665803
]
Hadoop QA commented on YARN-8569:
-
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664254#comment-16664254
]
Eric Yang commented on YARN-8569:
-
The failed test cases are not related to this patch.
> Create an
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664143#comment-16664143
]
Hadoop QA commented on YARN-8569:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662884#comment-16662884
]
Billie Rinaldi commented on YARN-8569:
--
Thanks [~eyang]! I am +1 for patch 16, pending precommit
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662826#comment-16662826
]
Eric Yang commented on YARN-8569:
-
[~billie.rinaldi] Thank you for the review. Patch 16 includes your
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662804#comment-16662804
]
Billie Rinaldi commented on YARN-8569:
--
Thanks, [~eyang]. I tested out patch 15 in an insecure
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659797#comment-16659797
]
Hadoop QA commented on YARN-8569:
-
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659618#comment-16659618
]
Eric Yang commented on YARN-8569:
-
Patch 015 rebased on YARN-8922.
> Create an interface to provide
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657452#comment-16657452
]
Eric Yang commented on YARN-8569:
-
[~rkanter] Thank you for filing the problem as separate JIRA. I will
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657385#comment-16657385
]
Robert Kanter commented on YARN-8569:
-
[~eyang], I think I've come up with the proper fix for the
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657311#comment-16657311
]
Hadoop QA commented on YARN-8569:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657208#comment-16657208
]
Robert Kanter commented on YARN-8569:
-
[~eyang], I tried it out and with the YARN-8569 014 patch,
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657096#comment-16657096
]
Robert Kanter commented on YARN-8569:
-
Sorry about that. I had to fix a number of problems with
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657077#comment-16657077
]
Eric Yang commented on YARN-8569:
-
Patch 14 includes the test-container-executor hot fix to pass
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657073#comment-16657073
]
Eric Yang commented on YARN-8569:
-
Unit test failure is caused by YARN-8448, where
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657027#comment-16657027
]
Eric Yang commented on YARN-8569:
-
Node manager unit test failure is caused by YARN-8449 where the tmp
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656163#comment-16656163
]
Hadoop QA commented on YARN-8569:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656050#comment-16656050
]
Eric Yang commented on YARN-8569:
-
Patch 13 addressed issues to run this patch in non-secure cluster.
>
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654432#comment-16654432
]
Billie Rinaldi commented on YARN-8569:
--
Adding a file name parameter later wouldn't need to be an
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647222#comment-16647222
]
Hadoop QA commented on YARN-8569:
-
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647030#comment-16647030
]
Eric Yang commented on YARN-8569:
-
[~leftnoteasy] . Patch 12 includes set_user fix, and added sysfs path
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645324#comment-16645324
]
Eric Yang commented on YARN-8569:
-
{quote}If you will do #1, IIUC, the #2 has to be done, otherwise as a
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644427#comment-16644427
]
Wangda Tan commented on YARN-8569:
--
[~eyang],
{quote}In sync_yarn_sysfs, check_nm_local_dir make sure
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644277#comment-16644277
]
Eric Yang commented on YARN-8569:
-
{quote}
1) We use use set_user before the method to drop privileges.
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644223#comment-16644223
]
Wangda Tan commented on YARN-8569:
--
Discussed with [~eyang]/[~suma.shivaprasad] offline,
Several
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644071#comment-16644071
]
Suma Shivaprasad commented on YARN-8569:
[~eyang] Thanks for updating the patch. +1
> Create an
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643972#comment-16643972
]
Hadoop QA commented on YARN-8569:
-
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642483#comment-16642483
]
Suma Shivaprasad commented on YARN-8569:
[~eyang] Patch 10 Looks good. A few minor checkstyle
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642465#comment-16642465
]
Hadoop QA commented on YARN-8569:
-
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642226#comment-16642226
]
Eric Yang commented on YARN-8569:
-
Patch10 renamed YARN_CONTAINER_RUNTIME_YARN_SYSFS to
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640484#comment-16640484
]
Suma Shivaprasad commented on YARN-8569:
[~eyang] YARN_CONTAINER_RUNTIME_YARN_SYSFS_ENABLE sounds
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640461#comment-16640461
]
Eric Yang commented on YARN-8569:
-
[~suma.shivaprasad] Good catch that handleYarnSysFSUpdate method was
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640432#comment-16640432
]
Suma Shivaprasad commented on YARN-8569:
Thanks [~eyang] for updating the patch.
Looks like
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640392#comment-16640392
]
Hadoop QA commented on YARN-8569:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640262#comment-16640262
]
Eric Yang commented on YARN-8569:
-
[~suma.shivaprasad] Patch 009 includes the following fix:
-
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640186#comment-16640186
]
Eric Yang commented on YARN-8569:
-
[~suma.shivaprasad] The list of hosts required the update is normalized
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640094#comment-16640094
]
Suma Shivaprasad commented on YARN-8569:
[~eyang] Missed this earlier. There could be potential
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639178#comment-16639178
]
Eric Yang commented on YARN-8569:
-
[~suma.shivaprasad] Thanks for the review, appinfo.json is probably
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639205#comment-16639205
]
Suma Shivaprasad commented on YARN-8569:
[~eyang] app.json sounds good. Thanks
> Create an
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639012#comment-16639012
]
Suma Shivaprasad commented on YARN-8569:
Thanks [~eyang] . I agree with [~leftnoteasy] that the
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609755#comment-16609755
]
Hadoop QA commented on YARN-8569:
-
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609645#comment-16609645
]
Eric Yang commented on YARN-8569:
-
Patch 008 fixed more check style issues, and change sync sysfs api to
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608313#comment-16608313
]
Hadoop QA commented on YARN-8569:
-
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607802#comment-16607802
]
Hadoop QA commented on YARN-8569:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607714#comment-16607714
]
Eric Yang commented on YARN-8569:
-
[~leftnoteasy] Patch 6 addressed the following:
- Use localizer to
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604686#comment-16604686
]
Eric Yang commented on YARN-8569:
-
YARN localizer only support tarball, archive, and individual file. It
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603707#comment-16603707
]
Wangda Tan commented on YARN-8569:
--
Thanks [~eyang],
And forgot to mention: if we're going to add new
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603686#comment-16603686
]
Eric Yang commented on YARN-8569:
-
[~leftnoteasy] {quote}How we can make it available prior to container
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603680#comment-16603680
]
Wangda Tan commented on YARN-8569:
--
[~eyang],
How we can make it available prior to container launch?
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602513#comment-16602513
]
Eric Yang commented on YARN-8569:
-
{quote}As mentioned in the doc, the info appears with possible delay
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602350#comment-16602350
]
Wangda Tan commented on YARN-8569:
--
And in implementation, AM should have ability to write files to an
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602345#comment-16602345
]
Wangda Tan commented on YARN-8569:
--
[~eyang],
I still think it is a bad idea to support "sys info" by
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599318#comment-16599318
]
genericqa commented on YARN-8569:
-
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599266#comment-16599266
]
Eric Yang commented on YARN-8569:
-
Patch 005 fixed white space and findbugs issues.
> Create an interface
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598002#comment-16598002
]
Eric Yang commented on YARN-8569:
-
Patch 004 minor code clean up and added unit test for
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597940#comment-16597940
]
Eric Yang commented on YARN-8569:
-
Patch 003 added the following improvements:
- unit tests for
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596578#comment-16596578
]
Eric Yang commented on YARN-8569:
-
{quote}There were tons of debates regarding to yarn user should be
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596014#comment-16596014
]
Wangda Tan commented on YARN-8569:
--
[~eyang],
{quote}Unless malicious user already hacked into yarn user
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595986#comment-16595986
]
Eric Yang commented on YARN-8569:
-
{quote}
1) Frequently syncing service spec could cause cluster
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595949#comment-16595949
]
Wangda Tan commented on YARN-8569:
--
[~eyang],
As we discussed offline, the use case is not clear to me.
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595777#comment-16595777
]
Eric Yang commented on YARN-8569:
-
Patch 2 is a fully working implementation. When YARN service become
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589430#comment-16589430
]
Eric Yang commented on YARN-8569:
-
>From today's docker meetup discussion, distributed cache is not ideal
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16586769#comment-16586769
]
Eric Yang commented on YARN-8569:
-
First patch for demo what the interface looks like. Here is my testing
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576681#comment-16576681
]
Shane Kumpf commented on YARN-8569:
---
Thanks for filing this [~eyang]. I have a use case that could
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575445#comment-16575445
]
Eric Yang commented on YARN-8569:
-
Sysfs is a pseudo file system provided by Linux Kernel to expose system
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556348#comment-16556348
]
Eric Yang commented on YARN-8569:
-
[~oliverhuh...@gmail.com] Your approach works fine for application that
[
https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556244#comment-16556244
]
Keqiu Hu commented on YARN-8569:
I can see the value of sharing some information between cluster nodes
68 matches
Mail list logo