[jira] [Commented] (YARN-2402) NM restart: Container recovery for Windows

2017-08-14 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126783#comment-16126783 ] Yuqi Wang commented on YARN-2402: - [~jlowe] When the NM is down, if the container process exit with exit

[jira] [Commented] (YARN-6885) AllocationFileLoaderService.loadQueue() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126776#comment-16126776 ] Hadoop QA commented on YARN-6885: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5978) ContainerScheduler and ContainerManager changes to support ExecType update

2017-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126760#comment-16126760 ] Hudson commented on YARN-5978: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12186 (See

[jira] [Updated] (YARN-5978) ContainerScheduler and ContainerManager changes to support ExecType update

2017-08-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5978: -- Summary: ContainerScheduler and ContainerManager changes to support ExecType update (was:

[jira] [Commented] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126745#comment-16126745 ] Hadoop QA commented on YARN-6900: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6885) AllocationFileLoaderService.loadQueue() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-14 Thread Yu-Tang Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Tang Lin updated YARN-6885: -- Attachment: YARN-6885.007.patch > AllocationFileLoaderService.loadQueue() should use a switch statement

[jira] [Commented] (YARN-6882) AllocationFileLoaderService.reloadAllocations() should use the diamond operator

2017-08-14 Thread Larry Lo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126740#comment-16126740 ] Larry Lo commented on YARN-6882: Is there anything I can do to fix it ? >

[jira] [Updated] (YARN-7007) NPE in RM while using YarnClientImpl.getApplications() ot get all applications

2017-08-14 Thread Lingfeng Su (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingfeng Su updated YARN-7007: -- Description: {code:java} java.lang.NullPointerException: java.lang.NullPointerException at

[jira] [Commented] (YARN-6361) FairScheduler: FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues

2017-08-14 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126727#comment-16126727 ] YunFan Zhou commented on YARN-6361: --- [~yufeigu] [~sunilg] Could you please help me review my idea and

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-14 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-6900: -- Attachment: YARN-6900-010.patch Fixing XML. > ZooKeeper based implementation of the

[jira] [Commented] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126703#comment-16126703 ] Hadoop QA commented on YARN-6900: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7011) yarn-daemon.sh is not respecting --config option

2017-08-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126692#comment-16126692 ] Allen Wittenauer commented on YARN-7011: For completeness, with a fresh build: {code} $

[jira] [Comment Edited] (YARN-7011) yarn-daemon.sh is not respecting --config option

2017-08-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126689#comment-16126689 ] Allen Wittenauer edited comment on YARN-7011 at 8/15/17 1:02 AM: - What does

[jira] [Commented] (YARN-7011) yarn-daemon.sh is not respecting --config option

2017-08-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126689#comment-16126689 ] Allen Wittenauer commented on YARN-7011: What does yarn-daemon.sh --debug say? > yarn-daemon.sh is

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-14 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-6900: -- Attachment: YARN-6900-009.patch Adding missing key in {{yarn-default.xml}}. > ZooKeeper based

[jira] [Commented] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126661#comment-16126661 ] Hadoop QA commented on YARN-6900: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6789) new api to get all supported resources from RM

2017-08-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126632#comment-16126632 ] Wangda Tan commented on YARN-6789: -- bq. I this we need to look for NULL as per me. I could handle this

[jira] [Commented] (YARN-6594) [API] Introduce SchedulingRequest object

2017-08-14 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126623#comment-16126623 ] Konstantinos Karanasos commented on YARN-6594: -- bq. I just checked the latest patch, beyond

[jira] [Commented] (YARN-6851) Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat

2017-08-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126619#comment-16126619 ] Wangda Tan commented on YARN-6851: -- +1, thanks [~ywskycn]! > Capacity Scheduler: document configs for

[jira] [Created] (YARN-7011) yarn-daemon.sh is not respecting --config option

2017-08-14 Thread Sumana Sathish (JIRA)
Sumana Sathish created YARN-7011: Summary: yarn-daemon.sh is not respecting --config option Key: YARN-7011 URL: https://issues.apache.org/jira/browse/YARN-7011 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-14 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-6900: -- Attachment: YARN-6900-008.patch Fixing unit tests. > ZooKeeper based implementation of the

[jira] [Commented] (YARN-5434) Add -client|server argument for graceful decom

2017-08-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126567#comment-16126567 ] Robert Kanter commented on YARN-5434: - [~sunilg], could it be that 127.0.0.1:25003 wasn't doing

[jira] [Commented] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2017-08-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126554#comment-16126554 ] Yufei Gu commented on YARN-6995: Thanks for the new patch. The message looks really good. Only one thing:

[jira] [Commented] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2017-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126507#comment-16126507 ] Hadoop QA commented on YARN-6995: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126468#comment-16126468 ] Hadoop QA commented on YARN-6610: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-14 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126465#comment-16126465 ] Vrushali C commented on YARN-6820: -- Ah, yes, so it's YARN-5355_branch2 I believe. cc [~varun_saxena] is

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126463#comment-16126463 ] Jason Lowe commented on YARN-6820: -- Oh sorry, I missed that branch. I noticed there's both a

[jira] [Commented] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-08-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126433#comment-16126433 ] Daniel Templeton commented on YARN-6610: [~yufeigu], yeah, you're right about unit tests. There is

[jira] [Updated] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-14 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6820: - Attachment: YARN-6820-YARN-5355_branch_2.patch Attaching patch for YARN_5355_branch_2 Hi [~jlowe] We

[jira] [Updated] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-08-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6610: --- Attachment: YARN-6610.YARN-3926.005.patch I added a handler for the exception. >

[jira] [Commented] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2017-08-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126408#comment-16126408 ] Daniel Templeton commented on YARN-6995: CC [~sunilg] > Improve use of ResourceNotFoundException

[jira] [Updated] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2017-08-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6995: --- Attachment: YARN-6995.YARN-3926.004.patch I reworked the message a bit, and simplified the

[jira] [Commented] (YARN-2402) NM restart: Container recovery for Windows

2017-08-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126396#comment-16126396 ] Jason Lowe commented on YARN-2402: -- bq. Container recovery for Windows has been fully verified on Windows.

[jira] [Commented] (YARN-6903) Yarn-native-service framework core rewrite

2017-08-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126394#comment-16126394 ] Jian He commented on YARN-6903: --- I'll fix the rest of the jenkins issues in a followup patch, as this patch

[jira] [Created] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)

2017-08-14 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-7010: -- Summary: Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps) Key: YARN-7010 URL:

[jira] [Commented] (YARN-6903) Yarn-native-service framework core rewrite

2017-08-14 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126391#comment-16126391 ] Billie Rinaldi commented on YARN-6903: -- I have done some basic testing of this patch and I think it's

[jira] [Commented] (YARN-6917) Queue path is recomputed from scratch on every allocation

2017-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126382#comment-16126382 ] Hudson commented on YARN-6917: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12183 (See

[jira] [Commented] (YARN-6923) Metrics for Federation Router

2017-08-14 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126388#comment-16126388 ] Giovanni Matteo Fumarola commented on YARN-6923: Hey [~asuresh] can you take a look of

[jira] [Commented] (YARN-7006) [ATSv2 Security] Changes for authentication for CollectorNodemanagerProtocol

2017-08-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126358#comment-16126358 ] Jian He commented on YARN-7006: --- looks good to me, one question, why is this change required? {code} -

[jira] [Commented] (YARN-6917) Queue path is recomputed from scratch on every allocation

2017-08-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126354#comment-16126354 ] Jason Lowe commented on YARN-6917: -- The unit test failures are unrelated. +1 lgtm. Committing this. >

[jira] [Commented] (YARN-6987) Log app attempt during InvalidStateTransition

2017-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126337#comment-16126337 ] Hudson commented on YARN-6987: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12182 (See

[jira] [Commented] (YARN-6923) Metrics for Federation Router

2017-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126328#comment-16126328 ] Hadoop QA commented on YARN-6923: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient by caching resource usage

2017-08-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126324#comment-16126324 ] Yufei Gu commented on YARN-4090: Yes, at least I hope so, but the patch is not ready. > Make

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient by caching resource usage

2017-08-14 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126309#comment-16126309 ] Ashwin Shankar commented on YARN-4090: -- [~zsl2007] [~yufeigu] is this patch going to be committed?

[jira] [Commented] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2017-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126308#comment-16126308 ] Hadoop QA commented on YARN-6995: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2017-08-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126306#comment-16126306 ] Yufei Gu commented on YARN-6995: Looks good to me generally. Pending on Jenkins. One typo: "avaliability"

[jira] [Commented] (YARN-6881) LOG is unused in AllocationConfiguration

2017-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126302#comment-16126302 ] Hudson commented on YARN-6881: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12181 (See

[jira] [Commented] (YARN-6885) AllocationFileLoaderService.loadQueue() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126298#comment-16126298 ] Daniel Templeton commented on YARN-6885: I think it's also OK to drop the blocks when the only

[jira] [Commented] (YARN-6885) AllocationFileLoaderService.loadQueue() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126297#comment-16126297 ] Daniel Templeton commented on YARN-6885: Can we pull the breaks into the blocks so that the

[jira] [Updated] (YARN-6923) Metrics for Federation Router

2017-08-14 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6923: --- Attachment: YARN-6923.v2.patch > Metrics for Federation Router >

[jira] [Updated] (YARN-6890) If UI is not secured, we allow user to kill other users' job even yarn cluster is secured.

2017-08-14 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-6890: -- Fix Version/s: 2.8.2 3.0.0-beta1 > If UI is not secured, we

[jira] [Commented] (YARN-6987) Log app attempt during InvalidStateTransition

2017-08-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126283#comment-16126283 ] Jason Lowe commented on YARN-6987: -- +1 lgtm. Committing this. > Log app attempt during

[jira] [Commented] (YARN-6905) Multiple HBaseTimelineStorage test failures due to missing FastNumberFormat

2017-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126268#comment-16126268 ] Hudson commented on YARN-6905: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12180 (See

[jira] [Commented] (YARN-6871) Add additional deSelects params in getAppReport

2017-08-14 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126261#comment-16126261 ] Giovanni Matteo Fumarola commented on YARN-6871: +1 LGTM. [~sunilg] Can you review it? >

[jira] [Commented] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-14 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126237#comment-16126237 ] Subru Krishnan commented on YARN-6900: -- [~elgoiri], to answer your question, I feel we should update

[jira] [Commented] (YARN-6917) Queue path is recomputed from scratch on every allocation

2017-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126230#comment-16126230 ] Hadoop QA commented on YARN-6917: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6996) Change javax.cache library implementation from JSR107 to Apache Geronimo

2017-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126231#comment-16126231 ] Hudson commented on YARN-6996: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12179 (See

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126228#comment-16126228 ] Hadoop QA commented on YARN-6623: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6905) Multiple HBaseTimelineStorage test failures due to missing FastNumberFormat

2017-08-14 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6905: - Fix Version/s: 3.0.0-beta1 > Multiple HBaseTimelineStorage test failures due to missing FastNumberFormat >

[jira] [Updated] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2017-08-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6995: --- Attachment: YARN-6995.YARN-3926.003.patch Rebased > Improve use of ResourceNotFoundException

[jira] [Commented] (YARN-6905) Multiple HBaseTimelineStorage test failures due to missing FastNumberFormat

2017-08-14 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126214#comment-16126214 ] Vrushali C commented on YARN-6905: -- Thanks [~haibo.chen] , committed to trunk as part of

[jira] [Commented] (YARN-5536) Multiple format support (JSON, etc.) for exclude node file in NM graceful decommission with timeout

2017-08-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126194#comment-16126194 ] Robert Kanter commented on YARN-5536: - To put a few more details on the work required here from the

[jira] [Commented] (YARN-6987) Log app attempt during InvalidStateTransition

2017-08-14 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126189#comment-16126189 ] Jonathan Eagles commented on YARN-6987: --- Test failure and timeout are unrelated to this logging jira.

[jira] [Commented] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126183#comment-16126183 ] Hudson commented on YARN-6959: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12178 (See

[jira] [Created] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-08-14 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7009: Summary: TestNMClient.testNMClientNoCleanupOnStop is flaky by design Key: YARN-7009 URL: https://issues.apache.org/jira/browse/YARN-7009 Project: Hadoop YARN

[jira] [Commented] (YARN-5978) ContainerScheduler and Container state machine changes to support ExecType update

2017-08-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126178#comment-16126178 ] Arun Suresh commented on YARN-5978: --- Thanks for the updated patch [~kartheek] +1, will commit this EOD if

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-08-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126174#comment-16126174 ] Robert Kanter commented on YARN-5464: - Sounds good. Thanks! > Server-Side NM Graceful Decommissioning

[jira] [Commented] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-08-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126169#comment-16126169 ] Daniel Templeton commented on YARN-6610: Thanks for the review. I don't see how to avoid sorting

[jira] [Commented] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2017-08-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126160#comment-16126160 ] Yufei Gu commented on YARN-6995: Thanks for filing this, [~templedf]. It does't apply to the branch. Can

[jira] [Commented] (YARN-6994) Remove last uses of Long from resource types code

2017-08-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126146#comment-16126146 ] Yufei Gu commented on YARN-6994: Thanks for the patch, [~templedf]. Committed to branch branch-yarn-3926.

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-08-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126139#comment-16126139 ] Junping Du commented on YARN-5464: -- I tried to find the bandwidth to do in next 2 weeks. Let's give it a

[jira] [Updated] (YARN-7006) [ATSv2 Security] Changes for authentication for CollectorNodemanagerProtocol

2017-08-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-7006: --- Description: Communication between Collector and NM is via RPC. We would do kerberos based

[jira] [Commented] (YARN-6994) Remove last uses of Long from resource types code

2017-08-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126132#comment-16126132 ] Yufei Gu commented on YARN-6994: +1 > Remove last uses of Long from resource types code >

[jira] [Commented] (YARN-7006) [ATSv2 Security] Changes for authentication for CollectorNodemanagerProtocol

2017-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126126#comment-16126126 ] Hadoop QA commented on YARN-7006: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-08-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126119#comment-16126119 ] Robert Kanter edited comment on YARN-5464 at 8/14/17 6:08 PM: -- This is

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-08-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126119#comment-16126119 ] Robert Kanter commented on YARN-5464: - This is currently a blocker for Hadoop 3 beta 1. [~djp] do you

[jira] [Commented] (YARN-6972) Adding RM ClusterId in AppInfo

2017-08-14 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126117#comment-16126117 ] Giovanni Matteo Fumarola commented on YARN-6972: +1 LGTM. [~asuresh] Can you please review

[jira] [Commented] (YARN-6687) Validate that the duration of the periodic reservation is less than the periodicity

2017-08-14 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126111#comment-16126111 ] Subru Krishnan commented on YARN-6687: -- Thanks [~curino], I cherry-picked it back to branch-2 cleanly.

[jira] [Updated] (YARN-6687) Validate that the duration of the periodic reservation is less than the periodicity

2017-08-14 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6687: - Fix Version/s: 2.9.0 > Validate that the duration of the periodic reservation is less than the >

[jira] [Commented] (YARN-6933) ResourceUtils.DISALLOWED_NAMES and ResourceUtils.checkMandatoryResources() are duplicating work

2017-08-14 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126094#comment-16126094 ] Manikandan R commented on YARN-6933: [~sunilg] Thanks for the review. 1. I was under the impression

[jira] [Commented] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-08-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126093#comment-16126093 ] Jian He commented on YARN-6959: --- [~yqwang], yep, I've committed to trunk and branch-2, branch-2.8 doesn't

[jira] [Commented] (YARN-6908) ResourceProfilesManagerImpl is missing @Overrides on methods

2017-08-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126091#comment-16126091 ] Daniel Templeton commented on YARN-6908: Thanks for the patch, [~sunilg]. The checkstyle warnings

[jira] [Commented] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-08-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126090#comment-16126090 ] Yufei Gu commented on YARN-6610: Thanks [~templedf]'s patch and [~sunilg]'s review. The patch looks much

[jira] [Commented] (YARN-6905) Multiple HBaseTimelineStorage test failures due to missing FastNumberFormat

2017-08-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126076#comment-16126076 ] Haibo Chen commented on YARN-6905: -- Thanks [~vrushalic] for your review! > Multiple HBaseTimelineStorage

[jira] [Updated] (YARN-3050) [Data Serving] Implement new flow-based ATS queries in the new ATS design

2017-08-14 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3050: - Fix Version/s: YARN-5355-branch-2 YARN-5355 > [Data Serving] Implement new flow-based

[jira] [Resolved] (YARN-3050) [Data Serving] Implement new flow-based ATS queries in the new ATS design

2017-08-14 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C resolved YARN-3050. -- Resolution: Implemented I would like to resolve this as "Implemented" since ATSv2 now has a bunch of

[jira] [Commented] (YARN-6881) LOG is unused in AllocationConfiguration

2017-08-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126069#comment-16126069 ] Daniel Templeton commented on YARN-6881: LGTM +1 > LOG is unused in AllocationConfiguration >

[jira] [Updated] (YARN-6780) ResourceWeights.toString() cleanup

2017-08-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6780: --- Description: The {{toString()}} method should have {{@Override}} and should use a

[jira] [Commented] (YARN-6780) ResourceWeights.toString() cleanup

2017-08-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126067#comment-16126067 ] Daniel Templeton commented on YARN-6780: The patch doesn't compile, because the annotation is

[jira] [Updated] (YARN-6996) Change javax.cache library implementation from JSR107 to Apache Geronimo

2017-08-14 Thread vijay (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vijay updated YARN-6996: Priority: Blocker (was: Major) > Change javax.cache library implementation from JSR107 to Apache Geronimo >

[jira] [Assigned] (YARN-6880) FSQueue.reservedResource can be final

2017-08-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-6880: -- Assignee: HondaWei > FSQueue.reservedResource can be final >

[jira] [Updated] (YARN-6917) Queue path is recomputed from scratch on every allocation

2017-08-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6917: - Attachment: YARN-6917.002.patch Thanks [~jlowe]. Uploading patch YARN-6917.002.patch that makes {{String

[jira] [Commented] (YARN-6851) Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat

2017-08-14 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126015#comment-16126015 ] Wei Yan commented on YARN-6851: --- [~sunilg], [~wangda], any comments? > Capacity Scheduler: document configs

[jira] [Resolved] (YARN-6783) DominantResourceCalculator.resourceNames should be a constant

2017-08-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-6783. --- Resolution: Duplicate This is no longer needed post YARN-6892 > DominantResourceCalculator.resourceNames

[jira] [Commented] (YARN-6984) DominantResourceCalculator.isAnyMajorResourceZero() should test all resources

2017-08-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126005#comment-16126005 ] Sunil G commented on YARN-6984: --- Thanks [~templedf] I will help to share a patch here. >

[jira] [Assigned] (YARN-6984) DominantResourceCalculator.isAnyMajorResourceZero() should test all resources

2017-08-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-6984: - Assignee: Sunil G > DominantResourceCalculator.isAnyMajorResourceZero() should test all resources >

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2017-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16125991#comment-16125991 ] Hadoop QA commented on YARN-5764: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2017-08-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16125987#comment-16125987 ] Miklos Szegedi commented on YARN-5764: -- Thank you, [~devaraj.k] for the patch. I have a few quick

[jira] [Updated] (YARN-7006) [ATSv2 Security] Changes for authentication for CollectorNodemanagerProtocol

2017-08-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-7006: --- Attachment: YARN-7006-YARN-5355.02.patch Fixed findbugs issue. > [ATSv2 Security] Changes for

[jira] [Commented] (YARN-6988) container-executor fails for docker when command length > 4096 B

2017-08-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16125926#comment-16125926 ] Varun Vasudev commented on YARN-6988: - [~ebadger] - I'm increasing the EXECUTOR_PATH_MAX to 128K as

  1   2   >