[jira] [Commented] (YARN-4497) RM might fail to restart when recovering apps whose attempts are missing

2015-12-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069443#comment-15069443 ] Rohith Sharma K S commented on YARN-4497: - Thinking when it can happen attempt1 is stored ,

[jira] [Commented] (YARN-4497) RM might fail to restart when recovering apps whose attempts are missing

2015-12-23 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069454#comment-15069454 ] Jun Gong commented on YARN-4497: In *RMStateStore#notifyStoreOperationFailedInternal*, RMStateStore might

[jira] [Commented] (YARN-4497) RM might fail to restart when recovering apps whose attempts are missing

2015-12-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069470#comment-15069470 ] Rohith Sharma K S commented on YARN-4497: - Currently, If any errors happened while storing into

[jira] [Commented] (YARN-4497) RM might fail to restart when recovering apps whose attempts are missing

2015-12-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069477#comment-15069477 ] Rohith Sharma K S commented on YARN-4497: - I got your point, if RM HA is not configured and fail

[jira] [Commented] (YARN-4497) RM might fail to restart when recovering apps whose attempts are missing

2015-12-23 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069480#comment-15069480 ] Jun Gong commented on YARN-4497: Yes, it is the problem. > RM might fail to restart when recovering apps

[jira] [Commented] (YARN-4352) Timeout for tests in TestYarnClient, TestAMRMClient and TestNMClient

2015-12-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069537#comment-15069537 ] Sunil G commented on YARN-4352: --- Yes.Its related. I ll fix the same.. > Timeout for tests in TestYarnClient,

[jira] [Commented] (YARN-4098) Document ApplicationPriority feature

2015-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069717#comment-15069717 ] Hadoop QA commented on YARN-4098: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-4501) Document new put APIs in TimelineClient for ATS 1.5

2015-12-23 Thread Junping Du (JIRA)
Junping Du created YARN-4501: Summary: Document new put APIs in TimelineClient for ATS 1.5 Key: YARN-4501 URL: https://issues.apache.org/jira/browse/YARN-4501 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069621#comment-15069621 ] Hudson commented on YARN-4234: -- FAILURE: Integrated in Hadoop-trunk-Commit #9018 (See

[jira] [Commented] (YARN-4098) Document ApplicationPriority feature

2015-12-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069744#comment-15069744 ] Sunil G commented on YARN-4098: --- Looks good for me. Will wait for [~jianhe] comments also. > Document

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-12-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069625#comment-15069625 ] Junping Du commented on YARN-4234: -- Forget to mention, I think we need to document new APIs that we are

[jira] [Commented] (YARN-4098) Document ApplicationPriority feature

2015-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069702#comment-15069702 ] Hadoop QA commented on YARN-4098: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

2015-12-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069629#comment-15069629 ] Junping Du commented on YARN-4265: -- I just commit YARN-4234. [~gtCarrera9], would you rebase your patch on

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

2015-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069633#comment-15069633 ] Hadoop QA commented on YARN-4265: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4098) Document ApplicationPriority feature

2015-12-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4098: Attachment: 0003-YARN-4098.patch > Document ApplicationPriority feature >

[jira] [Commented] (YARN-4098) Document ApplicationPriority feature

2015-12-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069723#comment-15069723 ] Rohith Sharma K S commented on YARN-4098: - bq. -1 asflicense No new files are added, and for the

[jira] [Commented] (YARN-4098) Document ApplicationPriority feature

2015-12-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069726#comment-15069726 ] Rohith Sharma K S commented on YARN-4098: - [~sunilg]/[~jianhe] kindly review the patch > Document

[jira] [Commented] (YARN-4098) Document ApplicationPriority feature

2015-12-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069691#comment-15069691 ] Rohith Sharma K S commented on YARN-4098: - Updated the patch fixing review comments. > Document

[jira] [Updated] (YARN-4098) Document ApplicationPriority feature

2015-12-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4098: Attachment: 0002-YARN-4098.patch > Document ApplicationPriority feature >

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070006#comment-15070006 ] Sangjin Lee commented on YARN-4224: --- Sorry I am catching up with the discussion. Just to put my opinions

[jira] [Updated] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4479: Attachment: 0002-YARN-4479.patch > Retrospect app-priority in pendingOrderingPolicy during

[jira] [Updated] (YARN-4352) Timeout for tests in TestYarnClient, TestAMRMClient and TestNMClient

2015-12-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4352: -- Attachment: 0002-YARN-4352.patch Attaching an updated patch addressing test fails. > Timeout for tests in

[jira] [Commented] (YARN-4352) Timeout for tests in TestYarnClient, TestAMRMClient and TestNMClient

2015-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070013#comment-15070013 ] Hadoop QA commented on YARN-4352: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4400) AsyncDispatcher.waitForDrained should be final

2015-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069883#comment-15069883 ] Hudson commented on YARN-4400: -- FAILURE: Integrated in Hadoop-trunk-Commit #9019 (See

[jira] [Commented] (YARN-3367) Replace starting a separate thread for post entity with event loop in TimelineClient

2015-12-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070009#comment-15070009 ] Naganarasimha G R commented on YARN-3367: - thanks [~djp] for looking into this issue. bq. Sounds

[jira] [Commented] (YARN-4400) AsyncDispatcher.waitForDrained should be final

2015-12-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069849#comment-15069849 ] Junping Du commented on YARN-4400: -- Nice catch, [~templedf]! +1 on the patch, committing it now. >

[jira] [Commented] (YARN-3367) Replace starting a separate thread for post entity with event loop in TimelineClient

2015-12-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069952#comment-15069952 ] Junping Du commented on YARN-3367: -- Thanks Naga for updating the patch! Quickly go through your patch but

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069951#comment-15069951 ] Varun Saxena commented on YARN-4224: To aid in tonight's discussion, I will jot down the REST endpoints

[jira] [Updated] (YARN-3976) Catch ApplicationNotFoundException instead of parent YarnException in YarnClient and AppReportFetcher

2015-12-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3976: -- Fix Version/s: (was: 2.7.2) > Catch ApplicationNotFoundException instead of

[jira] [Commented] (YARN-3870) Providing raw container request information for fine scheduling

2015-12-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070186#comment-15070186 ] Wangda Tan commented on YARN-3870: -- Hi [~grey], Thanks for raising this, we definitely need such

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070229#comment-15070229 ] Li Lu commented on YARN-4224: - Actually I think the /ws/v2/timeline/apps/{app UID}/entities?entityType=...

[jira] [Commented] (YARN-2882) Add ExecutionType to denote if a container execution is GUARANTEED or OPPORTUNISTIC

2015-12-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070329#comment-15070329 ] Wangda Tan commented on YARN-2882: -- Hi [~asuresh], Thanks for answering my question , but I still may not

[jira] [Commented] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070521#comment-15070521 ] Naganarasimha G R commented on YARN-4479: - Hi [~rohithsharma], Thanks for the patch, New approach

[jira] [Commented] (YARN-4098) Document ApplicationPriority feature

2015-12-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070336#comment-15070336 ] Jian He commented on YARN-4098: --- looks good overall - this feature allows applications to be submitted and

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

2015-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070353#comment-15070353 ] Hadoop QA commented on YARN-4265: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4156) TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacityScheduler

2015-12-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070387#comment-15070387 ] Karthik Kambatla commented on YARN-4156: +1 >

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-12-23 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070495#comment-15070495 ] Masatake Iwasaki commented on YARN-4234: [~djp], file named "q" seemed to be accidentally added to

[jira] [Commented] (YARN-4138) Roll back container resource allocation after resource increase token expires

2015-12-23 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070534#comment-15070534 ] MENG DING commented on YARN-4138: - Hi [~jianhe], which file(s) are you referring to in particular? > Roll

[jira] [Commented] (YARN-4156) TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacityScheduler

2015-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070492#comment-15070492 ] Hudson commented on YARN-4156: -- FAILURE: Integrated in Hadoop-trunk-Commit #9021 (See

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070575#comment-15070575 ] Sangjin Lee commented on YARN-4224: --- Regarding the ambiguity between /ws/v2/timeline/apps/\{app

[jira] [Commented] (YARN-4353) Provide short circuit user group mapping for NM/AM

2015-12-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070358#comment-15070358 ] Karthik Kambatla commented on YARN-4353: bq. If secure LDAP is configured for group mapping, then

[jira] [Created] (YARN-4503) Allow for a pluggable policy to decide if a ResourceRequest is GUARANTEED or not

2015-12-23 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-4503: - Summary: Allow for a pluggable policy to decide if a ResourceRequest is GUARANTEED or not Key: YARN-4503 URL: https://issues.apache.org/jira/browse/YARN-4503 Project:

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-23 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070337#comment-15070337 ] Gera Shegalov commented on YARN-2934: - Hi [~Naganarasimha]. Thanks for updating the patch. Things we

[jira] [Commented] (YARN-2882) Add ExecutionType to denote if a container execution is GUARANTEED or OPPORTUNISTIC

2015-12-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070360#comment-15070360 ] Arun Suresh commented on YARN-2882: --- Hey [~leftnoteasy], bq. If opportunistic/guaranteed is solely

[jira] [Updated] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-12-23 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-4234: --- Attachment: YARN-4234.addendum.patch > New put APIs in TimelineClient for ats v1.5 >

[jira] [Commented] (YARN-4098) Document ApplicationPriority feature

2015-12-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070526#comment-15070526 ] Rohith Sharma K S commented on YARN-4098: - bq. may be this feature allows applications to be

[jira] [Commented] (YARN-4462) FairScheduler: Disallow preemption from a queue

2015-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070557#comment-15070557 ] Hadoop QA commented on YARN-4462: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070556#comment-15070556 ] Rohith Sharma K S commented on YARN-4479: - I had 2 options in doing this in fifoordering policy. I

[jira] [Commented] (YARN-4496) Improve HA ResourceManager Failover detection on the client

2015-12-23 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070140#comment-15070140 ] Subru Krishnan commented on YARN-4496: -- +1. Thanks [~asuresh] for initiating this. To add more

[jira] [Commented] (YARN-3870) Providing raw container request information for fine scheduling

2015-12-23 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070178#comment-15070178 ] Subru Krishnan commented on YARN-3870: -- +1 on this. Thanks [~grey] for raising this. I have been

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070212#comment-15070212 ] Varun Saxena commented on YARN-4224: Thanks [~leftnoteasy]. For entities endpoint would

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070218#comment-15070218 ] Varun Saxena commented on YARN-4224: Another option would be to make entities endpoint as

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070243#comment-15070243 ] Li Lu commented on YARN-4224: - Yes, I think this is fine for entities. The root cause of this is that entities

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070302#comment-15070302 ] Wangda Tan commented on YARN-4224: -- Hi [~varun_saxena], [~gtCarrera], bq. Currently query without entity

[jira] [Comment Edited] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070302#comment-15070302 ] Wangda Tan edited comment on YARN-4224 at 12/23/15 11:13 PM: - Hi

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070141#comment-15070141 ] Varun Saxena commented on YARN-4224: Sorry for entities, we cannot really have an endpoint as

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

2015-12-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265-trunk.001.patch Thanks [~djp]! I just rebased my patch to the latest trunk. > Provide new

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

2015-12-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: (was: YARN-4265-trunk.poc_001.patch) > Provide new timeline plugin storage to support fine-grained

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070198#comment-15070198 ] Wangda Tan commented on YARN-4224: -- Thanks [~varun_saxena], Synced with [~gtCarrera] about this, I think

[jira] [Comment Edited] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070198#comment-15070198 ] Wangda Tan edited comment on YARN-4224 at 12/23/15 9:11 PM: Thanks

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070232#comment-15070232 ] Varun Saxena commented on YARN-4224: Well for hierarchical endpoint, we have something like

[jira] [Commented] (YARN-3870) Providing raw container request information for fine scheduling

2015-12-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070279#comment-15070279 ] Arun Suresh commented on YARN-3870: --- [~leftnoteasy], With respect to the AM, I was thinking.. just having

[jira] [Updated] (YARN-4502) Sometimes Two AM containers get launched

2015-12-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4502: - Labels: 2.6.4-candidate (was: ) > Sometimes Two AM containers get launched >

[jira] [Updated] (YARN-4502) Sometimes Two AM containers get launched

2015-12-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4502: - Labels: (was: 2.6.4-candidate) > Sometimes Two AM containers get launched >

[jira] [Commented] (YARN-4083) Add a discovery mechanism for the scheduler address

2015-12-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070131#comment-15070131 ] Arun Suresh commented on YARN-4083: --- Hoping to get some consensus on this.. since it is required for

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070133#comment-15070133 ] Varun Saxena commented on YARN-4224: Based on tonight's discussion, UID endpoints can look as under :

[jira] [Commented] (YARN-4424) Fix deadlock in RMAppImpl

2015-12-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070180#comment-15070180 ] Vinod Kumar Vavilapalli commented on YARN-4424: --- This originally never made it to

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070246#comment-15070246 ] Li Lu commented on YARN-4224: - After all these discussion, I think it will be helpful to come up with a write

[jira] [Updated] (YARN-4502) Sometimes Two AM containers get launched

2015-12-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4502: - Target Version/s: 2.6.4 > Sometimes Two AM containers get launched >

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2015-12-23 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070185#comment-15070185 ] Vrushali C commented on YARN-3995: -- Hi [~Naganarasimha] Thanks for the thoughts on the jira. I was

[jira] [Assigned] (YARN-4502) Sometimes Two AM containers get launched

2015-12-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-4502: Assignee: Wangda Tan > Sometimes Two AM containers get launched >

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070306#comment-15070306 ] Li Lu commented on YARN-4224: - Thanks [~leftnoteasy]! I agree that we should separate the semantics and

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070221#comment-15070221 ] Varun Saxena commented on YARN-4224: Correction - "For UID, we can put entity type as query param and

[jira] [Commented] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070242#comment-15070242 ] Hadoop QA commented on YARN-4479: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070240#comment-15070240 ] Varun Saxena commented on YARN-4224: Pls note this is specific to entities endpoint only. > Change the

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070248#comment-15070248 ] Varun Saxena commented on YARN-4224: Yes, we can have a writeup. This will be useful during eventual

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070237#comment-15070237 ] Varun Saxena commented on YARN-4224: Or we can let it clash. If string has decided delimiters, we

[jira] [Commented] (YARN-4343) Need to support Application History Server on ATSV2

2015-12-23 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070239#comment-15070239 ] Vrushali C commented on YARN-4343: -- Hi [~Naganarasimha] Towards the end of today's call, you had

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070256#comment-15070256 ] Varun Saxena commented on YARN-4224: bq. For UID based queries we can pass type as a query parameter.

[jira] [Created] (YARN-4502) Sometimes Two AM containers get launched

2015-12-23 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-4502: Summary: Sometimes Two AM containers get launched Key: YARN-4502 URL: https://issues.apache.org/jira/browse/YARN-4502 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070266#comment-15070266 ] Varun Saxena commented on YARN-4224: An important point. For entity table, the row keys are not sorted

[jira] [Commented] (YARN-4502) Sometimes Two AM containers get launched

2015-12-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070289#comment-15070289 ] Wangda Tan commented on YARN-4502: -- Thanks for [~yeshavora] reported this issue. Looked at this issue

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070295#comment-15070295 ] Li Lu commented on YARN-4224: - Well, return first 100 entities is just one example (we can even say return one

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070632#comment-15070632 ] Varun Saxena commented on YARN-4224: bq. At any rate, I agree that due to the possibility of omission

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070658#comment-15070658 ] Varun Saxena commented on YARN-4224: BTW, even in ATSv1 REST endpoint for fetching multiple entities

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2015-12-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070635#comment-15070635 ] Naganarasimha G R commented on YARN-3995: - Thanks for the comments [~sjlee0], IIUC 2nd point is

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070634#comment-15070634 ] Varun Saxena commented on YARN-4224: In short, limit to number of entities to return wont have any

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070649#comment-15070649 ] Varun Saxena commented on YARN-4224: bq. For API design, we don't want implementations to affect our

[jira] [Commented] (YARN-3367) Replace starting a separate thread for post entity with event loop in TimelineClient

2015-12-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070652#comment-15070652 ] Naganarasimha G R commented on YARN-3367: - Thanks for the comments [~sjlee0], bq. I would very much

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2015-12-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070709#comment-15070709 ] Naganarasimha G R commented on YARN-3995: - bq. If I recall, this window of opportunity is going to

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2015-12-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070690#comment-15070690 ] Sangjin Lee commented on YARN-3995: --- If I recall, this window of opportunity is going to be quite small

[jira] [Commented] (YARN-4462) FairScheduler: Disallow preemption from a queue

2015-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070707#comment-15070707 ] Hadoop QA commented on YARN-4462: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2015-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070716#comment-15070716 ] Varun Saxena commented on YARN-3995: bq. what i am trying to suggest is close/remove the collector only

[jira] [Commented] (YARN-3367) Replace starting a separate thread for post entity with event loop in TimelineClient

2015-12-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070715#comment-15070715 ] Sangjin Lee commented on YARN-3367: --- I haven't fully digested the code so I might be off-base. But when I

[jira] [Commented] (YARN-4138) Roll back container resource allocation after resource increase token expires

2015-12-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070594#comment-15070594 ] Jian He commented on YARN-4138: --- sorry, my bad. I don't why the AllocationExpirationInfo.java previously

[jira] [Commented] (YARN-4343) Need to support Application History Server on ATSV2

2015-12-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070600#comment-15070600 ] Naganarasimha G R commented on YARN-4343: - Hi [~vrushalic], thanks for getting back on this, may be

[jira] [Commented] (YARN-3367) Replace starting a separate thread for post entity with event loop in TimelineClient

2015-12-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070611#comment-15070611 ] Sangjin Lee commented on YARN-3367: --- Thanks for the patch [~Naganarasimha]! I took a fairly quick look at

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2015-12-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070660#comment-15070660 ] Naganarasimha G R commented on YARN-3995: - Oops, Sorry my mistake , Thanks [~sjlee0] for correcting

[jira] [Commented] (YARN-2599) Standby RM should also expose some jmx and metrics

2015-12-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070678#comment-15070678 ] Rohith Sharma K S commented on YARN-2599: - Gearing up on this issue, I assume that just avoiding

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2015-12-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070723#comment-15070723 ] Sangjin Lee commented on YARN-3995: --- bq. This is true in most of the cases, unless and untill AM doesn't

  1   2   >