[jira] [Commented] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141133#comment-16141133 ] Li Lu commented on YARN-6999: - Patch LGTM. The patch is trivial for unit tests. Findbugs warning appears to be

[jira] [Commented] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception

2017-08-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141115#comment-16141115 ] Sunil G commented on YARN-7051: --- Thanks [~eepayne] for clarification. Adding to same thought,

[jira] [Resolved] (YARN-5244) Documentation required for DNS Server implementation

2017-08-24 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha resolved YARN-5244. - Resolution: Fixed plugged into the site documentation and committed > Documentation required for DNS

[jira] [Commented] (YARN-7079) to support nodemanager ports management

2017-08-24 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141072#comment-16141072 ] 田娟娟 commented on YARN-7079: --- Yeah, available ports management in NM is also enforced here。 available ports

[jira] [Updated] (YARN-7099) ResourceHandlerModule.parseConfiguredCGroupPath only works for privileged yarn users.

2017-08-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7099: - Attachment: YARN-7099.000.patch > ResourceHandlerModule.parseConfiguredCGroupPath only works for

[jira] [Assigned] (YARN-5244) Documentation required for DNS Server implementation

2017-08-24 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha reassigned YARN-5244: --- Assignee: Jonathan Maron > Documentation required for DNS Server implementation >

[jira] [Updated] (YARN-5244) Documentation required for DNS Server implementation

2017-08-24 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-5244: Target Version/s: yarn-native-services > Documentation required for DNS Server implementation >

[jira] [Commented] (YARN-7072) Add a new log aggregation file format controller

2017-08-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141034#comment-16141034 ] Wangda Tan commented on YARN-7072: -- Thanks [~xgong], Comments: Overall suggestion: - Please check

[jira] [Commented] (YARN-7049) FSAppAttempt preemption related fields have confusing names

2017-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141025#comment-16141025 ] Hudson commented on YARN-7049: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12239 (See

[jira] [Updated] (YARN-7099) ResourceHandlerModule.parseConfiguredCGroupPath only works for privileged yarn users.

2017-08-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7099: - Description: canWrite is failing below: {code} if (candidate.isDirectory() &&

[jira] [Created] (YARN-7099) ResourceHandlerModule.parseConfiguredCGroupPath only works for privileged yarn users.

2017-08-24 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7099: Summary: ResourceHandlerModule.parseConfiguredCGroupPath only works for privileged yarn users. Key: YARN-7099 URL: https://issues.apache.org/jira/browse/YARN-7099

[jira] [Commented] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-24 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141015#comment-16141015 ] Yeliang Cang commented on YARN-7047: Thanks [~ajisakaa] for the review! > Moving logging APIs over to

[jira] [Created] (YARN-7098) LocalizerRunner should immediately send heartbeat response LocalizerStatus.DIE when the Container transitions from LOCALIZING to KILLING

2017-08-24 Thread Brook Zhou (JIRA)
Brook Zhou created YARN-7098: Summary: LocalizerRunner should immediately send heartbeat response LocalizerStatus.DIE when the Container transitions from LOCALIZING to KILLING Key: YARN-7098 URL:

[jira] [Commented] (YARN-7049) FSAppAttempt preemption related fields have confusing names

2017-08-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141009#comment-16141009 ] Yufei Gu commented on YARN-7049: +1. Thanks for the patch, [~kasha]. Committed to trunk and branch2. >

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140970#comment-16140970 ] Hadoop QA commented on YARN-6612: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6550) Capture launch_container.sh logs

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140940#comment-16140940 ] Hadoop QA commented on YARN-6550: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140929#comment-16140929 ] Hadoop QA commented on YARN-6877: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7097) Federation: routing REST invocations transparently to multiple RMs (part 5 - getNode)

2017-08-24 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reassigned YARN-7097: -- Assignee: Giovanni Matteo Fumarola > Federation: routing REST

[jira] [Created] (YARN-7097) Federation: routing REST invocations transparently to multiple RMs (part 5 - getNode)

2017-08-24 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-7097: -- Summary: Federation: routing REST invocations transparently to multiple RMs (part 5 - getNode) Key: YARN-7097 URL:

[jira] [Created] (YARN-7096) Federation: routing REST invocations transparently to multiple RMs (part 4 - getMetrics)

2017-08-24 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-7096: -- Summary: Federation: routing REST invocations transparently to multiple RMs (part 4 - getMetrics) Key: YARN-7096 URL:

[jira] [Assigned] (YARN-7096) Federation: routing REST invocations transparently to multiple RMs (part 4 - getMetrics)

2017-08-24 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reassigned YARN-7096: -- Assignee: Giovanni Matteo Fumarola > Federation: routing REST

[jira] [Created] (YARN-7095) Federation: routing REST invocations transparently to multiple RMs (part 3 - getNodes)

2017-08-24 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-7095: -- Summary: Federation: routing REST invocations transparently to multiple RMs (part 3 - getNodes) Key: YARN-7095 URL:

[jira] [Assigned] (YARN-7095) Federation: routing REST invocations transparently to multiple RMs (part 3 - getNodes)

2017-08-24 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reassigned YARN-7095: -- Assignee: Giovanni Matteo Fumarola > Federation: routing REST

[jira] [Commented] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140892#comment-16140892 ] Hadoop QA commented on YARN-7051: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6640) AM heartbeat stuck when responseId overflows MAX_INT

2017-08-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140857#comment-16140857 ] Wangda Tan commented on YARN-6640: -- +1, thanks [~botong]. > AM heartbeat stuck when responseId overflows

[jira] [Commented] (YARN-7094) Document that server-side graceful decom is currently not recommended

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140855#comment-16140855 ] Hadoop QA commented on YARN-7094: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140846#comment-16140846 ] Daniel Templeton commented on YARN-6964: Well, crap. Looks like I have some unit tests to fix. >

[jira] [Commented] (YARN-7052) RM SchedulingMonitor gives no indication why the spawned thread crashed.

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140838#comment-16140838 ] Hadoop QA commented on YARN-7052: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-08-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6612: --- Attachment: YARN-6612.YARN-3926.006.patch Turns out the unit test failures were from the bad

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140831#comment-16140831 ] Hadoop QA commented on YARN-6964: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7072) Add a new log aggregation file format controller

2017-08-24 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7072: Attachment: YARN-7072.trunk.002.patch > Add a new log aggregation file format controller >

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-08-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140813#comment-16140813 ] Daniel Templeton commented on YARN-6612: Thanks, [~yufeigu]. bq. Would it be easier to understand

[jira] [Updated] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception

2017-08-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7051: - Attachment: YARN-7051.002.patch bq. so this won't be changing while createTempAppForResCalculation is

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140761#comment-16140761 ] Hadoop QA commented on YARN-6623: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7094) Document that server-side graceful decom is currently not recommended

2017-08-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140759#comment-16140759 ] Junping Du commented on YARN-7094: -- Sure. I will look at it today. Thanks Robert. > Document that

[jira] [Updated] (YARN-6877) Create an abstract log reader for extendability

2017-08-24 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6877: Attachment: YARN-6877-trunk.002.patch > Create an abstract log reader for extendability >

[jira] [Comment Edited] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception

2017-08-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140730#comment-16140730 ] Eric Payne edited comment on YARN-7051 at 8/24/17 9:28 PM: --- Hi [~sunilg]. Thanks

[jira] [Commented] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception

2017-08-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140730#comment-16140730 ] Eric Payne commented on YARN-7051: -- Hi [~sunilg]. Thanks for the review and the detailed reply. {quote} I

[jira] [Commented] (YARN-7057) FSAppAttempt#getResourceUsage doesn't need to consider resources queued for preemption

2017-08-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140723#comment-16140723 ] Daniel Templeton commented on YARN-7057: Yep, capacity scheduler failure is unrelated. Looks like

[jira] [Updated] (YARN-7094) Document that server-side graceful decom is currently not recommended

2017-08-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-7094: Attachment: YARN-7094.001.patch The 001 patch adds a note to the CLI help text and the docs page.

[jira] [Commented] (YARN-7077) TestAMSimulator and TestNMSimulator fail

2017-08-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140704#comment-16140704 ] Yufei Gu commented on YARN-7077: [~ajisakaa], my bad. I missed that part. What about setting monitor for CS

[jira] [Commented] (YARN-6876) Create an abstract log writer for extendability

2017-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140690#comment-16140690 ] Hudson commented on YARN-6876: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12238 (See

[jira] [Updated] (YARN-7052) RM SchedulingMonitor gives no indication why the spawned thread crashed.

2017-08-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7052: - Attachment: YARN-7052.001.patch > RM SchedulingMonitor gives no indication why the spawned thread crashed.

[jira] [Updated] (YARN-7052) RM SchedulingMonitor gives no indication why the spawned thread crashed.

2017-08-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7052: - Target Version/s: 2.8.2 Priority: Critical (was: Major) bq. I suggest that another solution

[jira] [Updated] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-08-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-5464: Description: Make sure to remove the note added by YARN-7094 about RM HA failover not working right.

[jira] [Updated] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-08-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-5464: Description: Make sure to undo the changes made by YARN-7094 as part of this. > Server-Side NM

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-08-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140661#comment-16140661 ] Robert Kanter commented on YARN-5464: - Ok. I've made this no longer a blocker for 3b1 and created

[jira] [Created] (YARN-7094) Document that server-side graceful decom is currently not recommended

2017-08-24 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-7094: --- Summary: Document that server-side graceful decom is currently not recommended Key: YARN-7094 URL: https://issues.apache.org/jira/browse/YARN-7094 Project: Hadoop YARN

[jira] [Updated] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-08-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-5464: Priority: Critical (was: Blocker) > Server-Side NM Graceful Decommissioning with RM HA >

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140640#comment-16140640 ] Daniel Templeton commented on YARN-6964: I can't tell if the capacity scheduler issues are related.

[jira] [Updated] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-08-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-2497: --- Attachment: YARN-2499.WIP01.patch I've rebased [~Tao Jie]'s original patch (more or less).

[jira] [Assigned] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-08-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-2497: -- Assignee: Daniel Templeton > Changes for fair scheduler to support allocate resource

[jira] [Commented] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140615#comment-16140615 ] Hadoop QA commented on YARN-6999: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-24 Thread Linlin Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linlin Zhou updated YARN-6999: -- Attachment: yarn-6999.003.patch > Add log about how to solve Error: Could not find or load main class >

[jira] [Commented] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140543#comment-16140543 ] Hadoop QA commented on YARN-6999: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7087) NM failed to perform log aggregation due to absent container

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140536#comment-16140536 ] Hadoop QA commented on YARN-7087: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-24 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.006.patch Thank you for the review [~ebadger]! bq. Should we fix the no

[jira] [Commented] (YARN-7079) to support nodemanager ports management

2017-08-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140521#comment-16140521 ] Wangda Tan commented on YARN-7079: -- [~tianjuan], Thanks for working on this feature. I took a very

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140499#comment-16140499 ] Hadoop QA commented on YARN-6964: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-24 Thread Linlin Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linlin Zhou updated YARN-6999: -- Attachment: yarn-6999.002.patch > Add log about how to solve Error: Could not find or load main class >

[jira] [Commented] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140488#comment-16140488 ] Hadoop QA commented on YARN-6999: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-24 Thread Linlin Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linlin Zhou updated YARN-6999: -- Attachment: (was: yarn-6999.002.patch) > Add log about how to solve Error: Could not find or load

[jira] [Commented] (YARN-7047) Moving logging APIs over to slf4j in hadoop-yarn-server-nodemanager

2017-08-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140475#comment-16140475 ] Akira Ajisaka commented on YARN-7047: - +1, checking this in. > Moving logging APIs over to slf4j in

[jira] [Updated] (YARN-7087) NM failed to perform log aggregation due to absent container

2017-08-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7087: - Attachment: YARN-7087.002.patch Updating the patch to fix the checkstyle issues. The TestContainerManager

[jira] [Comment Edited] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)

2017-08-24 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140445#comment-16140445 ] Giovanni Matteo Fumarola edited comment on YARN-7010 at 8/24/17 6:16 PM:

[jira] [Commented] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)

2017-08-24 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140445#comment-16140445 ] Giovanni Matteo Fumarola commented on YARN-7010: The failed test is not related to the

[jira] [Commented] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-24 Thread Linlin Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140395#comment-16140395 ] Linlin Zhou commented on YARN-6999: --- Thanks for the advice [~gtCarrera]. I have rename the patch and fix

[jira] [Updated] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-24 Thread Linlin Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linlin Zhou updated YARN-6999: -- Attachment: yarn-6999.002.patch > Add log about how to solve Error: Could not find or load main class >

[jira] [Commented] (YARN-7090) testRMRestartAfterNodeLabelDisabled get failed when CapacityScheduler is configured

2017-08-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140377#comment-16140377 ] Wangda Tan commented on YARN-7090: -- Thanks [~yeshavora] for reporting this issue and thanks [~djp]'s

[jira] [Commented] (YARN-7093) Improve log message in ResourceUtils

2017-08-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140374#comment-16140374 ] Wangda Tan commented on YARN-7093: -- +1, committing, thanks [~sunilg] and review from [~templedf] >

[jira] [Updated] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-24 Thread Linlin Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linlin Zhou updated YARN-6999: -- Attachment: (was: yarn-6999.patch.002) > Add log about how to solve Error: Could not find or load

[jira] [Commented] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140353#comment-16140353 ] Li Lu commented on YARN-6999: - This looks much better, thanks for the work [~littlestone00]! Could you please

[jira] [Commented] (YARN-7093) Improve log message in ResourceUtils

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140341#comment-16140341 ] Hadoop QA commented on YARN-7093: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6964: --- Attachment: YARN-6964.007.patch OK, added unit tests. > Fair scheduler misuses Resources

[jira] [Commented] (YARN-7087) NM failed to perform log aggregation due to absent container

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140302#comment-16140302 ] Hadoop QA commented on YARN-7087: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7093) Improve log message in ResourceUtils

2017-08-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140299#comment-16140299 ] Daniel Templeton commented on YARN-7093: +1. I also made that change in my patch for YARN-6612. >

[jira] [Comment Edited] (YARN-7086) Release all containers aynchronously

2017-08-24 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140295#comment-16140295 ] Arun Suresh edited comment on YARN-7086 at 8/24/17 4:51 PM: Thanks for chiming

[jira] [Updated] (YARN-7093) Improve log message in ResourceUtils

2017-08-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7093: -- Attachment: YARN-7093.YARN-3926.001.patch Trivial log correction. Removed an exception from info.

[jira] [Commented] (YARN-7086) Release all containers aynchronously

2017-08-24 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140295#comment-16140295 ] Arun Suresh commented on YARN-7086: --- Thanks for chiming in folks. And yes, I agree with [~jlowe] too. To

[jira] [Created] (YARN-7093) Improve log message in ResourceUtils

2017-08-24 Thread Sunil G (JIRA)
Sunil G created YARN-7093: - Summary: Improve log message in ResourceUtils Key: YARN-7093 URL: https://issues.apache.org/jira/browse/YARN-7093 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-7087) NM failed to perform log aggregation due to absent container

2017-08-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7087: - Attachment: YARN-7087.001.patch Attaching a patch that adds the container type to the log aggregation

[jira] [Commented] (YARN-7019) Ability for applications to notify YARN about container reuse

2017-08-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140216#comment-16140216 ] Sunil G commented on YARN-7019: --- So containers which are scored highest/lowest (as per choice) will be

[jira] [Commented] (YARN-7019) Ability for applications to notify YARN about container reuse

2017-08-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140193#comment-16140193 ] Jason Lowe commented on YARN-7019: -- bq. I think the challenge will be to multiply an app or framework

[jira] [Commented] (YARN-7074) Fix NM state store update comment

2017-08-24 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140175#comment-16140175 ] Botong Huang commented on YARN-7074: Cool, thanks [~bibinchundatt] and [~kasha]! > Fix NM state store

[jira] [Commented] (YARN-7019) Ability for applications to notify YARN about container reuse

2017-08-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140140#comment-16140140 ] Sunil G commented on YARN-7019: --- bq.It would be nice if the NM could be proactively told during container

[jira] [Commented] (YARN-7079) to support nodemanager ports management

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140127#comment-16140127 ] Hadoop QA commented on YARN-7079: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7091) Rename application to service in yarn-native-services

2017-08-24 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140119#comment-16140119 ] Billie Rinaldi commented on YARN-7091: -- [~jianhe], I am very happy about the effects of these changes.

[jira] [Updated] (YARN-7091) Rename application to service in yarn-native-services

2017-08-24 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7091: - Summary: Rename application to service in yarn-native-services (was: Some rename changes in

[jira] [Commented] (YARN-7074) Fix NM state store update comment

2017-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139921#comment-16139921 ] Hudson commented on YARN-7074: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12236 (See

[jira] [Commented] (YARN-7091) Some rename changes in yarn-native-services

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139918#comment-16139918 ] Hadoop QA commented on YARN-7091: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7070) some of local cache files for yarn can't be deleted

2017-08-24 Thread Changyao Ye (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139762#comment-16139762 ] Changyao Ye commented on YARN-7070: --- [~jlowe] [~shaneku...@gmail.com] Thank you guys so much. I'll try

[jira] [Updated] (YARN-7091) Some rename changes in yarn-native-services

2017-08-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7091: -- Attachment: YARN-7091.yarn-native-services.01.patch > Some rename changes in yarn-native-services >

[jira] [Created] (YARN-7092) [YARN-3368] Log viewer in application page in yarn-ui-v2

2017-08-24 Thread Akhil PB (JIRA)
Akhil PB created YARN-7092: -- Summary: [YARN-3368] Log viewer in application page in yarn-ui-v2 Key: YARN-7092 URL: https://issues.apache.org/jira/browse/YARN-7092 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7079) to support nodemanager ports management

2017-08-24 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139603#comment-16139603 ] Feng Yuan commented on YARN-7079: - [~tianjuan],Thanks your work on this very much. > to support