[jira] [Commented] (YARN-4617) LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110522#comment-15110522 ] Hadoop QA commented on YARN-4617: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4584) RM startup failure when AM attempts greater than max-attempts

2016-01-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4584: --- Attachment: 0006-YARN-4584.patch Attaching patch after correction > RM startup failure when

[jira] [Updated] (YARN-4618) RM Stops allocating containers if large number of pending containers

2016-01-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4618: --- Description: In one of the test found that when RM is having so many pending container

[jira] [Commented] (YARN-4622) TestDistributedShell fails for v2 test cases after modifications for 1.5

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110562#comment-15110562 ] Hadoop QA commented on YARN-4622: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4622) TestDistributedShell fails for v2 test cases after modifications for 1.5

2016-01-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4622: Attachment: YARN-4622-YARN-2928.v1.001.patch Attaching a simple fix for the same, >

[jira] [Commented] (YARN-3215) Respect labels in CapacityScheduler when computing headroom

2016-01-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110625#comment-15110625 ] Sunil G commented on YARN-3215: --- Thanks [~Naganarasimha Garla] for sharing the patch. {{headroom}} will be

[jira] [Commented] (YARN-4584) RM startup failure when AM attempts greater than max-attempts

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110537#comment-15110537 ] Hadoop QA commented on YARN-4584: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4618) RM Stops allocating containers if large number of pending containers

2016-01-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4618: --- Description: In one of the test found that when RM is having so many pending container

[jira] [Commented] (YARN-4496) Improve HA ResourceManager Failover detection on the client

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110464#comment-15110464 ] Hadoop QA commented on YARN-4496: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-4622) TestDistributedShell fails for v2 test cases after modifications for 1.5

2016-01-21 Thread Naganarasimha G R (JIRA)
Naganarasimha G R created YARN-4622: --- Summary: TestDistributedShell fails for v2 test cases after modifications for 1.5 Key: YARN-4622 URL: https://issues.apache.org/jira/browse/YARN-4622 Project:

[jira] [Updated] (YARN-4584) RM startup failure when AM attempts greater than max-attempts

2016-01-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4584: --- Attachment: 0005-YARN-4584.patch > RM startup failure when AM attempts greater than

[jira] [Commented] (YARN-4618) RM Stops allocating containers if large number of pending containers

2016-01-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110270#comment-15110270 ] Bibin A Chundatt commented on YARN-4618: [~Naganarasimha] Thanks for looking into the issue . For

[jira] [Updated] (YARN-4617) LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy

2016-01-21 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4617: Attachment: 0001-YARN-4617.patch > LeafQueue#pendingOrderingPolicy should always use fixed

[jira] [Commented] (YARN-4584) RM startup failure when AM attempts greater than max-attempts

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110363#comment-15110363 ] Hadoop QA commented on YARN-4584: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4613) TestClientRMService#testGetClusterNodes fails occasionally

2016-01-21 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated YARN-4613: -- Attachment: YARN-4613.1.patch > TestClientRMService#testGetClusterNodes fails occasionally >

[jira] [Commented] (YARN-4613) TestClientRMService#testGetClusterNodes fails occasionally

2016-01-21 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110286#comment-15110286 ] Takashi Ohnishi commented on YARN-4613: --- I think this fails by too early checking before the node

[jira] [Commented] (YARN-4617) LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy

2016-01-21 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110358#comment-15110358 ] Rohith Sharma K S commented on YARN-4617: - Updated the patch with following changes # Created

[jira] [Updated] (YARN-4623) TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE

2016-01-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4623: Attachment: YARN-4623-branch-2.7.v1.001.patch [~jlowe] & [~djp], seems like the complete

[jira] [Commented] (YARN-4623) TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE

2016-01-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110678#comment-15110678 ] Jason Lowe commented on YARN-4623: -- Test failure appears to have been introduced by YARN-4452.

[jira] [Updated] (YARN-4492) Add documentation for preemption supported in Capacity scheduler

2016-01-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4492: - Issue Type: Improvement (was: Bug) Sorry for the delay. +1 for the branch-2.7 patch. Committing this.

[jira] [Commented] (YARN-4584) RM startup failure when AM attempts greater than max-attempts

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110637#comment-15110637 ] Hadoop QA commented on YARN-4584: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4618) RM Stops allocating containers if large number of pending containers

2016-01-21 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110648#comment-15110648 ] Jun Gong commented on YARN-4618: hi [~Naganarasimha], we have met same problem in our cluster. We use

[jira] [Created] (YARN-4623) TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE

2016-01-21 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-4623: Summary: TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE Key: YARN-4623 URL: https://issues.apache.org/jira/browse/YARN-4623 Project:

[jira] [Assigned] (YARN-4623) TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE

2016-01-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-4623: --- Assignee: Naganarasimha G R >

[jira] [Commented] (YARN-4623) TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE

2016-01-21 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110825#comment-15110825 ] Rohith Sharma K S commented on YARN-4623: - [~Naganarasimha] can you check in branch-2.6 also for

[jira] [Commented] (YARN-4492) Add documentation for preemption supported in Capacity scheduler

2016-01-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110801#comment-15110801 ] Hudson commented on YARN-4492: -- FAILURE: Integrated in Hadoop-trunk-Commit #9149 (See

[jira] [Commented] (YARN-4610) Reservations continue looking for one app causes other apps to starve

2016-01-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110674#comment-15110674 ] Jason Lowe commented on YARN-4610: -- Whitespace complaints are bogus, and test failures are unrelated. The

[jira] [Commented] (YARN-4610) Reservations continue looking for one app causes other apps to starve

2016-01-21 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110778#comment-15110778 ] Thomas Graves commented on YARN-4610: - +1 for branch 2.7. After investigating this some more the

[jira] [Commented] (YARN-4622) TestDistributedShell fails for v2 test cases after modifications for 1.5

2016-01-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110669#comment-15110669 ] Naganarasimha G R commented on YARN-4622: - [~gtCarrera], I faced This issue while testing

[jira] [Commented] (YARN-4623) TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE

2016-01-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110765#comment-15110765 ] Naganarasimha G R commented on YARN-4623: - Thanks for reporting [~jlowe], am working on it will

[jira] [Commented] (YARN-4623) TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE

2016-01-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110764#comment-15110764 ] Naganarasimha G R commented on YARN-4623: - Thanks for reporting [~jlowe], am working on it will

[jira] [Commented] (YARN-4623) TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE

2016-01-21 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110870#comment-15110870 ] Rohith Sharma K S commented on YARN-4623: - +1 LGTM too >

[jira] [Commented] (YARN-4578) Directories that are mounted in docker containers need to be more restrictive/container-specific

2016-01-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110918#comment-15110918 ] Varun Vasudev commented on YARN-4578: - The patch doesn't apply cleanly on trunk, there's a conflict in

[jira] [Commented] (YARN-4623) TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE

2016-01-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110854#comment-15110854 ] Junping Du commented on YARN-4623: -- Thanks [~jlowe] for reporting on this and Naga give a quick patch

[jira] [Commented] (YARN-4603) FairScheduler should mention user requested queuename in error message when failed in queue ACL check

2016-01-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110909#comment-15110909 ] Hudson commented on YARN-4603: -- FAILURE: Integrated in Hadoop-trunk-Commit #9150 (See

[jira] [Commented] (YARN-4605) Spelling mistake in the help message of "yarn applicationattempt" command

2016-01-21 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110885#comment-15110885 ] Akira AJISAKA commented on YARN-4605: - Thanks [~cheersyang] for fixing typos. The patch modifies HDFS

[jira] [Updated] (YARN-4576) Pluggable blacklist/whitelist policies in launching AM

2016-01-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4576: - Attachment: EnhancementAMLaunchingBlacklist.pdf Draft these thoughts in attached proposal. Review/Comments

[jira] [Commented] (YARN-4618) RM Stops allocating containers if large number of pending containers

2016-01-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110933#comment-15110933 ] Sunil G commented on YARN-4618: --- Thanks [~bibinchundatt]. As [~Naganarasimha Garla] mentioned, I also feel

[jira] [Updated] (YARN-4608) Redundant code statement in WritingYarnApplications

2016-01-21 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-4608: Labels: (was: documentation) > Redundant code statement in WritingYarnApplications >

[jira] [Commented] (YARN-4608) Redundant code statement in WritingYarnApplications

2016-01-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110956#comment-15110956 ] Hudson commented on YARN-4608: -- FAILURE: Integrated in Hadoop-trunk-Commit #9151 (See

[jira] [Commented] (YARN-4623) TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE

2016-01-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110849#comment-15110849 ] Naganarasimha G R commented on YARN-4623: - Thanks for pointing it out [~rohithsharma], Code is

[jira] [Commented] (YARN-4623) TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE

2016-01-21 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110871#comment-15110871 ] Rohith Sharma K S commented on YARN-4623: - Thanks for confirmation.. +1 >

[jira] [Commented] (YARN-4576) Enhancement for tracking Blacklist in AM Launching

2016-01-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110961#comment-15110961 ] Sunil G commented on YARN-4576: --- Thanks [~djp] for sharing the proposal fast. Skimmed through the doc and it

[jira] [Commented] (YARN-4603) FairScheduler should mention user requested queuename in error message when failed in queue ACL check

2016-01-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110875#comment-15110875 ] Karthik Kambatla commented on YARN-4603: +1, checking this in. > FairScheduler should mention

[jira] [Commented] (YARN-4608) Redundant code statement in WritingYarnApplications

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110924#comment-15110924 ] Hadoop QA commented on YARN-4608: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4492) Add documentation for preemption supported in Capacity scheduler

2016-01-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110995#comment-15110995 ] Jason Lowe commented on YARN-4492: -- bq. but Jira is not resolved, any thing pending/missed ? Sorry, I

[jira] [Commented] (YARN-3215) Respect labels in CapacityScheduler when computing headroom

2016-01-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111003#comment-15111003 ] Naganarasimha G R commented on YARN-3215: - Thanks for the comments and the testing [~sunilg], Yes

[jira] [Commented] (YARN-4578) Directories that are mounted in docker containers need to be more restrictive/container-specific

2016-01-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110976#comment-15110976 ] Varun Vasudev commented on YARN-4578: - Latest patch applies cleanly. +1 pending jenkins. > Directories

[jira] [Commented] (YARN-4610) Reservations continue looking for one app causes other apps to starve

2016-01-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111084#comment-15111084 ] Hudson commented on YARN-4610: -- FAILURE: Integrated in Hadoop-trunk-Commit #9153 (See

[jira] [Updated] (YARN-4578) Directories that are mounted in docker containers need to be more restrictive/container-specific

2016-01-21 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-4578: Attachment: YARN-4578.002.patch Thanks, [~vvasudev]. It looks like a different patch that

[jira] [Commented] (YARN-4610) Reservations continue looking for one app causes other apps to starve

2016-01-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111048#comment-15111048 ] Jason Lowe commented on YARN-4610: -- Thanks for the reviews! Committing this. > Reservations continue

[jira] [Commented] (YARN-4623) TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111072#comment-15111072 ] Hadoop QA commented on YARN-4623: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4578) Directories that are mounted in docker containers need to be more restrictive/container-specific

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111090#comment-15111090 ] Hadoop QA commented on YARN-4578: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1974) add args for DistributedShell to specify a set of nodes on which the tasks run

2016-01-21 Thread gaurav gupta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1510#comment-1510 ] gaurav gupta commented on YARN-1974: I am trying to use FairScheduler but I am having issues. I am

[jira] [Created] (YARN-4624) NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI

2016-01-21 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created YARN-4624: -- Summary: NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI Key: YARN-4624 URL: https://issues.apache.org/jira/browse/YARN-4624 Project:

[jira] [Updated] (YARN-4624) NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI

2016-01-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-4624: --- Attachment: YARN-4624.patch > NPE in PartitionQueueCapacitiesInfo while accessing

[jira] [Commented] (YARN-4624) NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI

2016-01-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1599#comment-1599 ] Brahma Reddy Battula commented on YARN-4624: Because of auto-boxing for

[jira] [Commented] (YARN-4622) TestDistributedShell fails for v2 test cases after modifications for 1.5

2016-01-21 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110857#comment-15110857 ] Varun Saxena commented on YARN-4622: Thanks [~Naganarasimha] for raising this issue. Changes LGTM.

[jira] [Commented] (YARN-4492) Add documentation for preemption supported in Capacity scheduler

2016-01-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110877#comment-15110877 ] Naganarasimha G R commented on YARN-4492: - Thanks for the review and commit [~jlowe], [~templedf] &

[jira] [Commented] (YARN-4608) Redundant code statement in WritingYarnApplications

2016-01-21 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110911#comment-15110911 ] Akira AJISAKA commented on YARN-4608: - +1 pending Jenkins. I just started Jenkins job manually. >

[jira] [Commented] (YARN-4617) LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy

2016-01-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110926#comment-15110926 ] Sunil G commented on YARN-4617: --- Thanks [~rohithsharma] for the patch. Overall looks good. Minor nits: 1.

[jira] [Commented] (YARN-4608) Redundant code statement in WritingYarnApplications

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110925#comment-15110925 ] Hadoop QA commented on YARN-4608: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4576) Enhancement for tracking Blacklist in AM Launching

2016-01-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4576: - Summary: Enhancement for tracking Blacklist in AM Launching (was: Pluggable blacklist/whitelist policies

[jira] [Updated] (YARN-4622) TestDistributedShell fails for v2 test cases after modifications for 1.5

2016-01-21 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4622: --- Labels: test (was: ) > TestDistributedShell fails for v2 test cases after modifications for 1.5 >

[jira] [Commented] (YARN-4622) TestDistributedShell fails for v2 test cases after modifications for 1.5

2016-01-21 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111233#comment-15111233 ] Varun Saxena commented on YARN-4622: I have committed this to YARN-2928 branch. Thanks [~Naganarasimha]

[jira] [Updated] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

2016-01-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4545: Attachment: (was: YARN-4545-trunk.002.patch) > Allow YARN distributed shell to use ATS v1.5 APIs >

[jira] [Commented] (YARN-4224) Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARN

2016-01-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111491#comment-15111491 ] Li Lu commented on YARN-4224: - Thanks [~varun_saxena]. The latest patch generally LGTM. Some minor comments:

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-01-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111605#comment-15111605 ] Eric Payne commented on YARN-4108: -- Thanks for the updated patch, [~leftnoteasy]. I'm still working my

[jira] [Commented] (YARN-4496) Improve HA ResourceManager Failover detection on the client

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111577#comment-15111577 ] Hadoop QA commented on YARN-4496: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4496) Improve HA ResourceManager Failover detection on the client

2016-01-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4496: -- Attachment: YARN-4496.6.patch > Improve HA ResourceManager Failover detection on the client >

[jira] [Commented] (YARN-4497) RM might fail to restart when recovering apps whose attempts are missing

2016-01-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111507#comment-15111507 ] Jian He commented on YARN-4497: --- looks good to me, minor comments is I think setRecoveredFinalState and

[jira] [Updated] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

2016-01-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4545: Attachment: YARN-4545-trunk.002.patch Let me quickly flip the 002 patch to include the missing ASF license. >

[jira] [Commented] (YARN-4624) NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI

2016-01-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111826#comment-15111826 ] Sunil G commented on YARN-4624: --- {{maxAMLimitPercentage}} is set to null only in case of ParentQueue. For

[jira] [Commented] (YARN-4623) TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE

2016-01-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111840#comment-15111840 ] Naganarasimha G R commented on YARN-4623: - Thanks for the review and commit [~djp], [~jlowe] &

[jira] [Commented] (YARN-4618) RM Stops allocating containers if large number of pending containers

2016-01-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111761#comment-15111761 ] Wangda Tan commented on YARN-4618: -- Nice catching [~bibinchundatt], I'm not entirely sure if changing int

[jira] [Commented] (YARN-4624) NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI

2016-01-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111795#comment-15111795 ] Sunil G commented on YARN-4624: --- Please discard my prior suggestion, it will still carry maxAMLimitPercentage

[jira] [Commented] (YARN-4624) NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI

2016-01-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111801#comment-15111801 ] Sunil G commented on YARN-4624: --- Hi [~brahmareddy] I have installed trunk and tested UI with labels and w/o

[jira] [Commented] (YARN-4605) Spelling mistake in the help message of "yarn applicationattempt" command

2016-01-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111822#comment-15111822 ] Weiwei Yang commented on YARN-4605: --- Hello [~ajisakaa] Thanks for the suggestion. I exclude HDFS changes

[jira] [Commented] (YARN-4624) NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI

2016-01-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111783#comment-15111783 ] Sunil G commented on YARN-4624: --- Hi [~brahmareddy] I suggest we can do like below in

[jira] [Resolved] (YARN-4620) getApplicationAttemptReport could throw exception in the case of unmanaged app

2016-01-21 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma resolved YARN-4620. --- Resolution: Duplicate Thanks [~rohithsharma]! Yes it is dup. I have verified the patch in YARN-4411 has fixed

[jira] [Commented] (YARN-4411) ResourceManager IllegalArgumentException error

2016-01-21 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111835#comment-15111835 ] Rohith Sharma K S commented on YARN-4411: - [~yarntime] do you mind updating the patch if you are

[jira] [Commented] (YARN-4584) RM startup failure when AM attempts greater than max-attempts

2016-01-21 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111897#comment-15111897 ] Rohith Sharma K S commented on YARN-4584: - +1 LGTM, committing shortly > RM startup failure when

[jira] [Commented] (YARN-4624) NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI

2016-01-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111766#comment-15111766 ] Sunil G commented on YARN-4624: --- Oh. Thanks for raising and for the patch. We used Float for REST o/p

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111791#comment-15111791 ] Hadoop QA commented on YARN-4545: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-4625) Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent

2016-01-21 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-4625: --- Summary: Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent Key: YARN-4625 URL: https://issues.apache.org/jira/browse/YARN-4625 Project:

[jira] [Updated] (YARN-4625) Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent

2016-01-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4625: Attachment: YARN-4625.20160121.1.patch > Make ApplicationSubmissionContext and

[jira] [Updated] (YARN-4605) Spelling mistake in the help message of "yarn applicationattempt" command

2016-01-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-4605: -- Attachment: YARN-4605.003.patch Exclude changes in HDFS project, patch 003 only contains typo fixes for

[jira] [Updated] (YARN-4497) RM might fail to restart when recovering apps whose attempts are missing

2016-01-21 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-4497: --- Attachment: YARN-4497.03.patch > RM might fail to restart when recovering apps whose attempts are missing >

[jira] [Commented] (YARN-4497) RM might fail to restart when recovering apps whose attempts are missing

2016-01-21 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111823#comment-15111823 ] Jun Gong commented on YARN-4497: [~jianhe] Thanks for review. Attach a new patch to address above problems.

[jira] [Commented] (YARN-4622) TestDistributedShell fails for v2 test cases after modifications for 1.5

2016-01-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111842#comment-15111842 ] Naganarasimha G R commented on YARN-4622: - Thanks [~varun_saxena], for the review and the commit !

[jira] [Commented] (YARN-4624) NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI

2016-01-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111927#comment-15111927 ] Sunil G commented on YARN-4624: --- Offline synced with Naga and got the scenario: - Node labels are enabled in

[jira] [Updated] (YARN-4621) Job failed if time on one NM is out of sync even other nodes are sync'd

2016-01-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-4621: -- Attachment: terasort_job_failed.log > Job failed if time on one NM is out of sync even other nodes are

[jira] [Commented] (YARN-4618) RM Stops allocating containers if large number of pending containers

2016-01-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111964#comment-15111964 ] Bibin A Chundatt commented on YARN-4618: [~leftnoteasy]/[~hex108]/[~Naganarasimha] Thank you for

[jira] [Updated] (YARN-4618) RM Stops allocating containers if large number of pending containers

2016-01-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4618: --- Description: In one of the test found that when RM is having so many pending container

[jira] [Updated] (YARN-4484) Available Resource calculation for a queue is not correct when used with labels

2016-01-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4484: -- Description: To calculate available resource for a queue, we have to get the total resource allocated for all

[jira] [Commented] (YARN-4497) RM might fail to restart when recovering apps whose attempts are missing

2016-01-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15112023#comment-15112023 ] Jian He commented on YARN-4497: --- +1, thanks > RM might fail to restart when recovering apps whose attempts

[jira] [Updated] (YARN-4621) Job failed if time on one NM is out of sync even other nodes are sync'd

2016-01-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-4621: -- Description: RM tried allocated more than 10 containers on a NM (on which time is out of sync), they

[jira] [Commented] (YARN-4625) Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111904#comment-15111904 ] Hadoop QA commented on YARN-4625: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4626) Scheduler UI make queue invisible for partition if not mapped with label

2016-01-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111922#comment-15111922 ] Bibin A Chundatt commented on YARN-4626: Hi [~sunilg] Not a problem. please continue. > Scheduler

[jira] [Commented] (YARN-4497) RM might fail to restart when recovering apps whose attempts are missing

2016-01-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111943#comment-15111943 ] Hadoop QA commented on YARN-4497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >