[jira] [Commented] (YARN-4529) Yarn CLI killing applications in batch

2015-12-30 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075689#comment-15075689 ] Naganarasimha G R commented on YARN-4529: - IMO both are usefull and required, if i want to kill all

[jira] [Commented] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2015-12-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075733#comment-15075733 ] Karthik Kambatla commented on YARN-1014: bq. We were actually planning on getting the

[jira] [Updated] (YARN-4530) LocalizedResource trigger a NPE Cause the NodeManager exit

2015-12-30 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tangshangwen updated YARN-4530: --- Attachment: YARN-4530.1.patch I found 2.7.1 have the same problem´╝îI submitted a patch. >

[jira] [Commented] (YARN-4530) LocalizedResource trigger a NPE Cause the NodeManager exit

2015-12-30 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075794#comment-15075794 ] Rohith Sharma K S commented on YARN-4530: - +1 LGTM, pending jenkins > LocalizedResource trigger a

[jira] [Commented] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075798#comment-15075798 ] Hadoop QA commented on YARN-4304: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1382) Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak

2015-12-30 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075705#comment-15075705 ] Rohith Sharma K S commented on YARN-1382: - thanks [~djp] for committing the patch:-) > Remove

[jira] [Commented] (YARN-3870) Providing raw container request information for fine scheduling

2015-12-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075740#comment-15075740 ] Karthik Kambatla commented on YARN-3870: bq. I think this JIRA and YARN-4485 are different: bq. I

[jira] [Updated] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-12-30 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4024: --- Assignee: Hong Zhiguo (was: Varun Saxena) > YARN RM should avoid unnecessary resolving IP when NMs

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-12-30 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075797#comment-15075797 ] Varun Saxena commented on YARN-4024: Sorry assigned JIRA to myself by mistake. Assigned it back to

[jira] [Commented] (YARN-4530) LocalizedResource trigger a NPE Cause the NodeManager exit

2015-12-30 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075711#comment-15075711 ] tangshangwen commented on YARN-4530: I think I can fix it > LocalizedResource trigger a NPE Cause the

[jira] [Commented] (YARN-4528) decreaseContainer Message maybe lost if NM restart

2015-12-30 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075772#comment-15075772 ] sandflee commented on YARN-4528: since in most cases container size is not changed, so I propose to pending

[jira] [Commented] (YARN-4530) LocalizedResource trigger a NPE Cause the NodeManager exit

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075815#comment-15075815 ] Hadoop QA commented on YARN-4530: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-12-30 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-4024: -- Assignee: Varun Saxena (was: Hong Zhiguo) > YARN RM should avoid unnecessary resolving IP when

[jira] [Updated] (YARN-2575) Consider creating separate ACLs for Reservation create/update/delete/list ops

2015-12-30 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-2575: -- Attachment: YARN-2575.v4.patch Thanks Subru, I addressed your comments in this latest patch. The one comment I

[jira] [Commented] (YARN-4529) Yarn CLI killing applications in batch

2015-12-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075127#comment-15075127 ] Sunil G commented on YARN-4529: --- Possibly a duplicate of YARN-4371. [~linyiqun], cud u pls check that once. I

[jira] [Commented] (YARN-4506) Application was killed by a resourcemanager, In the JobHistory Can't see the job detail

2015-12-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075135#comment-15075135 ] Junping Du commented on YARN-4506: -- 2.2 is too old. It is highly possible that we could already fix this

[jira] [Commented] (YARN-4522) Queue acl can be checked at app submission

2015-12-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075160#comment-15075160 ] Sunil G commented on YARN-4522: --- Also one more point, earlier we were storing APP_REJECTED cases in

[jira] [Commented] (YARN-4497) RM might fail to restart when recovering apps whose attempts are missing

2015-12-30 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075118#comment-15075118 ] Jun Gong commented on YARN-4497: In the patch, it deals with two cases: 1. attempt is missed When

[jira] [Commented] (YARN-4527) Possible thread leak if TimelineClient.start() get called multiple times.

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075148#comment-15075148 ] Hadoop QA commented on YARN-4527: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075149#comment-15075149 ] Sunil G commented on YARN-4479: --- Sorry I didnt meant FairScheduler, I was trying to mention

[jira] [Commented] (YARN-1382) Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak

2015-12-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075139#comment-15075139 ] Hudson commented on YARN-1382: -- FAILURE: Integrated in Hadoop-trunk-Commit #9038 (See

[jira] [Commented] (YARN-4506) Application was killed by a resourcemanager, In the JobHistory Can't see the job detail

2015-12-30 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075140#comment-15075140 ] tangshangwen commented on YARN-4506: Ok, I'll try to fix it > Application was killed by a

[jira] [Commented] (YARN-4529) Yarn CLI killing applications in batch

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075228#comment-15075228 ] Hadoop QA commented on YARN-4529: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075138#comment-15075138 ] Sunil G commented on YARN-4479: --- HI [~rohithsharma] This new fix will also introduce RecoveryComparator to

[jira] [Commented] (YARN-4522) Queue acl can be checked at app submission

2015-12-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075153#comment-15075153 ] Sunil G commented on YARN-4522: --- Hi [~jianhe] With this patch, we throw back {{YarnException}} now. Earlier

[jira] [Updated] (YARN-1382) Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak

2015-12-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1382: - Hadoop Flags: Reviewed > Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get > rid

[jira] [Updated] (YARN-1382) Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak

2015-12-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1382: - Summary: Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak

[jira] [Commented] (YARN-4029) Update LogAggregationStatus to store on finish

2015-12-30 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075151#comment-15075151 ] Rohith Sharma K S commented on YARN-4029: - Thanks [~bibinchundatt] for providing patch, overall

[jira] [Commented] (YARN-4029) Update LogAggregationStatus to store on finish

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075192#comment-15075192 ] Hadoop QA commented on YARN-4029: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2015-12-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075232#comment-15075232 ] Sunil G commented on YARN-4304: --- Hi [~leftnoteasy] Thank you very much for sharing the comments. I have few

[jira] [Commented] (YARN-4497) RM might fail to restart when recovering apps whose attempts are missing

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075257#comment-15075257 ] Hadoop QA commented on YARN-4497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2015-12-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075367#comment-15075367 ] Wangda Tan commented on YARN-4304: -- Hi [~sunilg], Thanks for replying, make sense to me. Is there any

[jira] [Commented] (YARN-4172) Extend DominantResourceCalculator to account for all resources

2015-12-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075384#comment-15075384 ] Wangda Tan commented on YARN-4172: -- Hi [~vvasudev], Patch generally looks good, is there any issue or

[jira] [Commented] (YARN-4510) SLS startup failure and webpage broken

2015-12-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075330#comment-15075330 ] Wangda Tan commented on YARN-4510: -- Looks good, +1, thanks [~bibinchundatt]. > SLS startup failure and

[jira] [Commented] (YARN-4522) Queue acl can be checked at app submission

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075331#comment-15075331 ] Hadoop QA commented on YARN-4522: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4495) add a way to tell AM container increase/decrease request is invalid

2015-12-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075380#comment-15075380 ] Wangda Tan commented on YARN-4495: -- Thanks for investigations, [~sandflee]. I feel we should make this

[jira] [Commented] (YARN-4522) Queue acl can be checked at app submission

2015-12-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075296#comment-15075296 ] Jian He commented on YARN-4522: --- Hi [~sunilg], thanks for your review ! bq. Earlier in logs we could see

[jira] [Commented] (YARN-4522) Queue acl can be checked at app submission

2015-12-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075304#comment-15075304 ] Sunil G commented on YARN-4522: --- Thanks [~jianhe]. Latest patch looks fine. > Queue acl can be checked at

[jira] [Commented] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2015-12-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075329#comment-15075329 ] Arun Suresh commented on YARN-1014: --- Thanks for taking this up [~kasha].. Id think this would be

[jira] [Updated] (YARN-4522) Queue acl can be checked at app submission

2015-12-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4522: -- Attachment: YARN-4522.4.patch > Queue acl can be checked at app submission >

[jira] [Updated] (YARN-4522) Queue acl can be checked at app submission

2015-12-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4522: -- Attachment: YARN-4522.3.patch > Queue acl can be checked at app submission >

[jira] [Commented] (YARN-4526) Make SystemClock singleton so AppSchedulingInfo could use it

2015-12-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075322#comment-15075322 ] Arun Suresh commented on YARN-4526: --- Agreed, it does seem wasteful... Thanks for the patch [~kasha].. I

[jira] [Updated] (YARN-4495) add a way to tell AM container increase/decrease request is invalid

2015-12-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4495: - Target Version/s: 2.9.0 > add a way to tell AM container increase/decrease request is invalid >

[jira] [Commented] (YARN-4524) Cleanup AppSchedulingInfo

2015-12-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075529#comment-15075529 ] Hudson commented on YARN-4524: -- FAILURE: Integrated in Hadoop-trunk-Commit #9041 (See

[jira] [Commented] (YARN-4510) Fix SLS startup failure caused by NPE

2015-12-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075530#comment-15075530 ] Hudson commented on YARN-4510: -- FAILURE: Integrated in Hadoop-trunk-Commit #9041 (See

[jira] [Commented] (YARN-4495) add a way to tell AM container increase/decrease request is invalid

2015-12-30 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075570#comment-15075570 ] sandflee commented on YARN-4495: thanks [~wangda], hoping more suggestions > add a way to tell AM

[jira] [Commented] (YARN-4522) Queue acl can be checked at app submission

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075505#comment-15075505 ] Hadoop QA commented on YARN-4522: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4516) [YARN-3368] Use em-table to better render tables

2015-12-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075509#comment-15075509 ] Li Lu commented on YARN-4516: - [~Sreenath] Never mind, I figured out how to feed models to an em-table by

[jira] [Updated] (YARN-4510) Fix SLS startup failure caused by NPE

2015-12-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4510: - Summary: Fix SLS startup failure caused by NPE (was: SLS startup failure and webpage broken) > Fix SLS

[jira] [Commented] (YARN-4522) Queue acl can be checked at app submission

2015-12-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075525#comment-15075525 ] Hudson commented on YARN-4522: -- FAILURE: Integrated in Hadoop-trunk-Commit #9040 (See

[jira] [Commented] (YARN-4526) Make SystemClock singleton so AppSchedulingInfo could use it

2015-12-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075133#comment-15075133 ] Sunil G commented on YARN-4526: --- Hi [~ka...@cloudera.com] YARN-4403 introduced MonotonicClock and its

[jira] [Commented] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075452#comment-15075452 ] Jian He commented on YARN-4479: --- sorry, I missed this part, the recovered app need to be respected first

[jira] [Commented] (YARN-2885) Create AMRMProxy request interceptor for distributed scheduling decisions for queueable containers

2015-12-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075600#comment-15075600 ] Arun Suresh commented on YARN-2885: --- Thanks for the review [~leftnoteasy], bq. Do you have real use case

[jira] [Commented] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2015-12-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075607#comment-15075607 ] Subru Krishnan commented on YARN-4195: -- Thanks [~curino] for the patch. I looked at it (excluding the

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-12-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075619#comment-15075619 ] Ming Ma commented on YARN-4024: --- Thanks for the good improvement [~leftnoteasy], [~zhiguohong], [~sunilg],

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-12-30 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075626#comment-15075626 ] Hong Zhiguo commented on YARN-4024: --- Thanks for your good point. Yes I can do it. Should I reopen this

[jira] [Commented] (YARN-4352) Timeout for tests in TestYarnClient, TestAMRMClient and TestNMClient

2015-12-30 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075737#comment-15075737 ] Rohith Sharma K S commented on YARN-4352: - Thanks for updating the patch, I am +1. And I would

[jira] [Commented] (YARN-4393) TestResourceLocalizationService#testFailedDirsResourceRelease fails intermittently

2015-12-30 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075766#comment-15075766 ] Rohith Sharma K S commented on YARN-4393: - [~ozawa] would you have look at this please, do you have

[jira] [Commented] (YARN-4524) Cleanup AppSchedulingInfo

2015-12-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075819#comment-15075819 ] Karthik Kambatla commented on YARN-4524: Thanks for the prompt review, Wangda. Appreciate it. >

[jira] [Updated] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2015-12-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4304: -- Attachment: REST_and_UI.zip > AM max resource configuration per partition to be displayed/updated correctly >

[jira] [Updated] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2015-12-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4304: -- Attachment: (was: REST_and_UI.zip) > AM max resource configuration per partition to be displayed/updated

[jira] [Updated] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2015-12-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4304: -- Attachment: 0008-YARN-4304.patch Thank you [~leftnoteasy] for the comments. Addressing the first comment in new

[jira] [Updated] (YARN-4530) LocalizedResource trigger a NPE Cause the NodeManager exit

2015-12-30 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tangshangwen updated YARN-4530: --- Affects Version/s: 2.7.1 > LocalizedResource trigger a NPE Cause the NodeManager exit >

[jira] [Updated] (YARN-4510) SLS startup failure and webpage broken

2015-12-30 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4510: --- Attachment: 0001-YARN-4510.patch Attaching patch for fixing start up failure of SLS and

[jira] [Commented] (YARN-4510) SLS startup failure and webpage broken

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074928#comment-15074928 ] Hadoop QA commented on YARN-4510: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4510) SLS startup failure and webpage broken

2015-12-30 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074963#comment-15074963 ] Bibin A Chundatt commented on YARN-4510: Attached patch after checkstyle patch > SLS startup

[jira] [Commented] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-30 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074779#comment-15074779 ] Rohith Sharma K S commented on YARN-4479: - I think we can just relay on isAppRecovering flag which

[jira] [Updated] (YARN-4510) SLS clusterapps and scheduler page broken

2015-12-30 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4510: --- Description: Configure Start SLS check cluster apps page {noformat} 15/12/27 07:40:22 INFO

[jira] [Commented] (YARN-1382) NodeListManager has a memory leak, unusableRMNodesConcurrentSet is never purged

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074892#comment-15074892 ] Hadoop QA commented on YARN-1382: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4510) SLS startup failure and webpage broken

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074894#comment-15074894 ] Hadoop QA commented on YARN-4510: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4526) Make SystemClock singleton so AppSchedulingInfo could use it

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074790#comment-15074790 ] Hadoop QA commented on YARN-4526: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4510) SLS startup failure and webpage broken

2015-12-30 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4510: --- Priority: Critical (was: Major) Description: Configure Fair scheduler in yarn site

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074819#comment-15074819 ] Hadoop QA commented on YARN-3933: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4232) TopCLI console shows exceptions for help command

2015-12-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074891#comment-15074891 ] Varun Vasudev commented on YARN-4232: - Adding support for HA is probably the right thing to do. Good

[jira] [Updated] (YARN-4510) SLS startup failure and webpage broken

2015-12-30 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4510: --- Attachment: 0002-YARN-4510.patch > SLS startup failure and webpage broken >

[jira] [Commented] (YARN-4495) add a way to tell AM container increase/decrease request is invalid

2015-12-30 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075043#comment-15075043 ] sandflee commented on YARN-4495: Hi, [~leftnoteasy], I do a simple test throwing a exception with

[jira] [Updated] (YARN-4232) TopCLI console support for HA mode

2015-12-30 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4232: --- Issue Type: Improvement (was: Bug) Summary: TopCLI console support for HA mode (was:

[jira] [Commented] (YARN-4232) TopCLI console shows exceptions for help command

2015-12-30 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075005#comment-15075005 ] Bibin A Chundatt commented on YARN-4232: [~vvasudev] Will add support for HA mode. i will update

[jira] [Commented] (YARN-1382) NodeListManager has a memory leak, unusableRMNodesConcurrentSet is never purged

2015-12-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075017#comment-15075017 ] Junping Du commented on YARN-1382: -- +1. Latest patch LGTM. Committing it in. > NodeListManager has a

[jira] [Updated] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-30 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4479: Attachment: 0003-YARN-4479.patch Attaching the updated patch, kindly review > Retrospect

[jira] [Commented] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075069#comment-15075069 ] Hadoop QA commented on YARN-4479: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-4527) Possible thread leak if TimelineClient.start() get called multiple times.

2015-12-30 Thread Junping Du (JIRA)
Junping Du created YARN-4527: Summary: Possible thread leak if TimelineClient.start() get called multiple times. Key: YARN-4527 URL: https://issues.apache.org/jira/browse/YARN-4527 Project: Hadoop YARN

[jira] [Created] (YARN-4528) decreaseConainer Message maybe lost if NM restart

2015-12-30 Thread sandflee (JIRA)
sandflee created YARN-4528: -- Summary: decreaseConainer Message maybe lost if NM restart Key: YARN-4528 URL: https://issues.apache.org/jira/browse/YARN-4528 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-4528) decreaseContainer Message maybe lost if NM restart

2015-12-30 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee updated YARN-4528: --- Summary: decreaseContainer Message maybe lost if NM restart (was: decreaseConainer Message maybe lost if NM

[jira] [Created] (YARN-4529) Yarn CLI killing applications in batch

2015-12-30 Thread Lin Yiqun (JIRA)
Lin Yiqun created YARN-4529: --- Summary: Yarn CLI killing applications in batch Key: YARN-4529 URL: https://issues.apache.org/jira/browse/YARN-4529 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-4529) Yarn CLI killing applications in batch

2015-12-30 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated YARN-4529: Attachment: YARN-4529.001.patch > Yarn CLI killing applications in batch >

[jira] [Commented] (YARN-4529) Yarn CLI killing applications in batch

2015-12-30 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075088#comment-15075088 ] Naganarasimha G R commented on YARN-4529: - Hi [~linyiqun], Seems like a usefull feature, but few

[jira] [Created] (YARN-4530) LocalizedResource trigger a NPE Cause the NodeManager exit

2015-12-30 Thread tangshangwen (JIRA)
tangshangwen created YARN-4530: -- Summary: LocalizedResource trigger a NPE Cause the NodeManager exit Key: YARN-4530 URL: https://issues.apache.org/jira/browse/YARN-4530 Project: Hadoop YARN

[jira] [Updated] (YARN-4497) RM might fail to restart when recovering apps whose attempts are missing

2015-12-30 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-4497: --- Attachment: YARN-4497.01.patch > RM might fail to restart when recovering apps whose attempts are missing >

[jira] [Commented] (YARN-4530) LocalizedResource trigger a NPE Cause the NodeManager exit

2015-12-30 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075106#comment-15075106 ] tangshangwen commented on YARN-4530: when the assoc is null and the completed.get() throw a

[jira] [Commented] (YARN-4516) [YARN-3368] Use em-table to better render tables

2015-12-30 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075107#comment-15075107 ] Sreenath Somarajapuram commented on YARN-4516: -- You can pass any ember array as rows to the

[jira] [Updated] (YARN-4527) Possible thread leak if TimelineClient.start() get called multiple times.

2015-12-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4527: - Attachment: YARN-4527.patch Upload a quick patch to fix it. It is quite straightforward so no unit test is