[jira] [Commented] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2016-03-14 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193577#comment-15193577 ] Robert Joseph Evans commented on YARN-4757: --- I am +1 on the idea of using DNS for long lived

[jira] [Commented] (YARN-4517) [YARN-3368] Add nodes page

2016-03-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193451#comment-15193451 ] Varun Saxena commented on YARN-4517: Thanks [~gtCarrera9] for the review. bq. One main question: maybe

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193505#comment-15193505 ] Hadoop QA commented on YARN-4686: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

2016-03-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193458#comment-15193458 ] Junping Du commented on YARN-4545: -- LGTM too. +1. Committing it now. > Allow YARN distributed shell to

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

2016-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193474#comment-15193474 ] Hudson commented on YARN-4545: -- FAILURE: Integrated in Hadoop-trunk-Commit #9458 (See

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193476#comment-15193476 ] Varun Vasudev commented on YARN-4785: - [~jhsenjaliya] - Sorry to annoy you about this - can you give me

[jira] [Updated] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-14 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-4686: -- Attachment: YARN-4686.005.patch I moved the total capacity check out of the waitForNodeManagersToConnect

[jira] [Created] (YARN-4811) Generate histograms for actual container resource usage

2016-03-14 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4811: --- Summary: Generate histograms for actual container resource usage Key: YARN-4811 URL: https://issues.apache.org/jira/browse/YARN-4811 Project: Hadoop YARN

[jira] [Commented] (YARN-4809) De-duplicate container completion across schedulers

2016-03-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192791#comment-15192791 ] Sunil G commented on YARN-4809: --- Hi [~kasha] I could help in taking this. Pls let me know if you have

[jira] [Commented] (YARN-2670) Adding feedback capability to capacity scheduler from external systems

2016-03-14 Thread Ha Son Hai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192982#comment-15192982 ] Ha Son Hai commented on YARN-2670: -- Is there any news on this JIRA? I'm also very interested in this. >

[jira] [Created] (YARN-4810) NM applicationpage cause internal error 500

2016-03-14 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-4810: -- Summary: NM applicationpage cause internal error 500 Key: YARN-4810 URL: https://issues.apache.org/jira/browse/YARN-4810 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-4810) NM applicationpage cause internal error 500

2016-03-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4810: --- Description: Use url /node/application/ *Case 1* {noformat} Caused by:

[jira] [Commented] (YARN-4783) Log aggregation failure for application when Nodemanager is restarted

2016-03-14 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192988#comment-15192988 ] Surendra Singh Lilhore commented on YARN-4783: -- Thanks [~jlowe] for comment.. bq. in the

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193732#comment-15193732 ] Sangjin Lee commented on YARN-4712: --- I also think that {{cpuUsagePercentPerCore}} might be a better

[jira] [Updated] (YARN-4794) Distributed shell app gets stuck on stopping containers after App completes

2016-03-14 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4794: -- Target Version/s: 2.8.0, 2.7.3, 2.9.0 Tentatively targeting all unreleased

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193857#comment-15193857 ] Wangda Tan commented on YARN-4719: -- +1, thanks [~kasha]. > Add a helper library to maintain node state

[jira] [Created] (YARN-4812) TestFairScheduler#testContinuousScheduling fails intermittently

2016-03-14 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-4812: -- Summary: TestFairScheduler#testContinuousScheduling fails intermittently Key: YARN-4812 URL: https://issues.apache.org/jira/browse/YARN-4812 Project: Hadoop YARN

[jira] [Updated] (YARN-4812) TestFairScheduler#testContinuousScheduling fails intermittently

2016-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4812: --- Description: This test has failed in the past, and there seem to be more issues. {noformat}

[jira] [Commented] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2016-03-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193627#comment-15193627 ] Allen Wittenauer commented on YARN-4757: bq. As far as I know there is no standard for including

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193764#comment-15193764 ] Sangjin Lee commented on YARN-4712: --- Also some quick comments on the latest patch:

[jira] [Updated] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2016-03-14 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4771: -- Priority: Critical (was: Major) Sounds bad given also the high possibility of

[jira] [Updated] (YARN-1547) Prevent DoS of ApplicationMasterProtocol by putting in limits

2016-03-14 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-1547: --- Attachment: (was: YARN-1547.pdf) > Prevent DoS of

[jira] [Commented] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2016-03-14 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193769#comment-15193769 ] Robert Joseph Evans commented on YARN-4757: --- [~aw], I am not expert on DNS so it is good to hear

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-03-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193832#comment-15193832 ] Eric Payne commented on YARN-4751: -- Thanks, [~sunilg]. I will look into trunk's version of

[jira] [Commented] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2016-03-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193930#comment-15193930 ] Allen Wittenauer commented on YARN-4757: bq. I am not expert on DNS so it is good to hear that you

[jira] [Commented] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2016-03-14 Thread Jonathan Maron (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194047#comment-15194047 ] Jonathan Maron commented on YARN-4757: -- I'm trying to address all of these issues/concerns in the

[jira] [Commented] (YARN-4809) De-duplicate container completion across schedulers

2016-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194119#comment-15194119 ] Karthik Kambatla commented on YARN-4809: Please feel free to take up. I might be able to review.

[jira] [Updated] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-14 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-4686: -- Target Version/s: 3.0.0, 2.8.0, 2.7.3 (was: 2.7.3) > MiniYARNCluster.start() returns before cluster is

[jira] [Updated] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-03-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4766: - Attachment: (was: yarn4766.001.patch) > NM should not aggregate logs older than the retention policy >

[jira] [Updated] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-03-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4766: - Attachment: (was: yarn4766.001.patch) > NM should not aggregate logs older than the retention policy >

[jira] [Updated] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-03-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4766: - Attachment: yarn4766.001.patch > NM should not aggregate logs older than the retention policy >

[jira] [Updated] (YARN-4812) TestFairScheduler#testContinuousScheduling fails intermittently

2016-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4812: --- Attachment: yarn-4812-1.patch Moved testContinuousScheduling to a separate class that uses

[jira] [Updated] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-03-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4766: - Attachment: (was: yarn4766.001.patch) > NM should not aggregate logs older than the retention policy >

[jira] [Created] (YARN-4813) TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently

2016-03-14 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-4813: -- Summary: TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently Key: YARN-4813 URL: https://issues.apache.org/jira/browse/YARN-4813

[jira] [Commented] (YARN-4812) TestFairScheduler#testContinuousScheduling fails intermittently

2016-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194170#comment-15194170 ] Karthik Kambatla commented on YARN-4812: I ran it a few thousand times, and didn't see it fail.

[jira] [Commented] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

2016-03-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194274#comment-15194274 ] Robert Kanter commented on YARN-4805: - +1 > Don't go through all schedulers in ParameterizedTestBase >

[jira] [Commented] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194303#comment-15194303 ] Hadoop QA commented on YARN-4766: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-14 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-4814: --- Summary: ATS 1.5 timelineclient impl call flush after every event write Key: YARN-4814 URL: https://issues.apache.org/jira/browse/YARN-4814 Project: Hadoop YARN

[jira] [Commented] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194161#comment-15194161 ] Xuan Gong commented on YARN-4814: - Looks like the flush happens in ObjectMapper#writeValue. {code}

[jira] [Commented] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194162#comment-15194162 ] Xuan Gong commented on YARN-4814: - The simple fix could be: config Feature.FLUSH_AFTER_WRITE_VALUE as false

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194316#comment-15194316 ] Hudson commented on YARN-4719: -- FAILURE: Integrated in Hadoop-trunk-Commit #9460 (See

[jira] [Created] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-14 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-4815: --- Summary: ATS 1.5 timelineclinet impl try to create attempt directory for every event call Key: YARN-4815 URL: https://issues.apache.org/jira/browse/YARN-4815 Project: Hadoop

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-14 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194235#comment-15194235 ] Eric Badger commented on YARN-4686: --- As per my comment above: TestYarnCLI, TestAMRMClient,

[jira] [Commented] (YARN-4816) SystemClock API broken in 2.9.0

2016-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194325#comment-15194325 ] Karthik Kambatla commented on YARN-4816: My bad. Thanks for catching and fixing this, Sid. +1.

[jira] [Updated] (YARN-4817) Change Log Level to DEBUG for putDomain call in ATS 1.5

2016-03-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4817: Priority: Trivial (was: Major) > Change Log Level to DEBUG for putDomain call in ATS 1.5 >

[jira] [Updated] (YARN-4817) Change Log Level to DEBUG for putDomain call in ATS 1.5

2016-03-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4817: Attachment: YARN-4817.1.patch > Change Log Level to DEBUG for putDomain call in ATS 1.5 >

[jira] [Commented] (YARN-4817) Change Log Level to DEBUG for putDomain call in ATS 1.5

2016-03-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194329#comment-15194329 ] Xuan Gong commented on YARN-4817: - trivial patch > Change Log Level to DEBUG for putDomain call in ATS 1.5

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-03-14 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194342#comment-15194342 ] Vinod Kumar Vavilapalli commented on YARN-3854: --- [~sidharta-s], this one's old but is it a

[jira] [Commented] (YARN-4816) SystemClock API broken in 2.9.0

2016-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194475#comment-15194475 ] Hadoop QA commented on YARN-4816: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194480#comment-15194480 ] Hadoop QA commented on YARN-4814: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-03-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4766: - Attachment: yarn4766.002.patch Addressed checkstyle issues > NM should not aggregate logs older than the

[jira] [Updated] (YARN-4736) Issues with HBaseTimelineWriterImpl

2016-03-14 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4736: Attachment: NM_Hang_hbase1.0.3.tar.gz I was able to reproduce Issue 2 with Hbase 1.0.3 too,

[jira] [Commented] (YARN-4736) Issues with HBaseTimelineWriterImpl

2016-03-14 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194418#comment-15194418 ] Naganarasimha G R commented on YARN-4736: - Also seems like [~anoop.hbase] has got the cause for

[jira] [Updated] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4815: Attachment: YARN-4815.1.patch > ATS 1.5 timelineclinet impl try to create attempt directory for every event

[jira] [Commented] (YARN-3150) [Documentation] Documenting the timeline service v2

2016-03-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194487#comment-15194487 ] Sangjin Lee commented on YARN-3150: --- This is to start the discussion. The main documentation for Timeline

[jira] [Assigned] (YARN-4809) De-duplicate container completion across schedulers

2016-03-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-4809: - Assignee: Sunil G > De-duplicate container completion across schedulers >

[jira] [Commented] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194270#comment-15194270 ] Xuan Gong commented on YARN-4814: - [~gtCarrera9] Could you review it, please ? > ATS 1.5 timelineclient

[jira] [Updated] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4814: Attachment: YARN-4814.1.patch > ATS 1.5 timelineclient impl call flush after every event write >

[jira] [Created] (YARN-4816) SystemClock API broken in 2.9.0

2016-03-14 Thread Siddharth Seth (JIRA)
Siddharth Seth created YARN-4816: Summary: SystemClock API broken in 2.9.0 Key: YARN-4816 URL: https://issues.apache.org/jira/browse/YARN-4816 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-4245) Clean up container-executor invocation interface

2016-03-14 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194345#comment-15194345 ] Vinod Kumar Vavilapalli commented on YARN-4245: --- bq. We need a better mechanism to deal with

[jira] [Updated] (YARN-4245) Clean up container-executor binary invocation interface

2016-03-14 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4245: -- Summary: Clean up container-executor binary invocation interface (was: Clean up

[jira] [Assigned] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-4815: --- Assignee: Xuan Gong > ATS 1.5 timelineclinet impl try to create attempt directory for every event >

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194534#comment-15194534 ] Jian He commented on YARN-4108: --- - revert RMAppAttemptMetrics changes. - remove setIsAlive method - remove

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-14 Thread Jayesh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194535#comment-15194535 ] Jayesh commented on YARN-4785: -- prod env: linux 2.6.32-431.el6.x86_64 ( jdk 1.7.0_79) more info: I have

[jira] [Commented] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194563#comment-15194563 ] Li Lu commented on YARN-4814: - Oops I didn't look at the patch when posting the last comment. What a big

[jira] [Updated] (YARN-4711) NM is going down with NPE's due to single thread processing of events by Timeline client

2016-03-14 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4711: Attachment: 4711Analysis.txt Hi [~sjlee0], Sorry for the long delay ! >From the analysis i

[jira] [Commented] (YARN-4812) TestFairScheduler#testContinuousScheduling fails intermittently

2016-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194658#comment-15194658 ] Hadoop QA commented on YARN-4812: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194670#comment-15194670 ] Hadoop QA commented on YARN-4766: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-4816) SystemClock API broken in 2.9.0

2016-03-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned YARN-4816: Assignee: Siddharth Seth > SystemClock API broken in 2.9.0 >

[jira] [Commented] (YARN-4816) SystemClock API broken in 2.9.0

2016-03-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194673#comment-15194673 ] Siddharth Seth commented on YARN-4816: -- Thanks for the review [~kasha] - committing to master and

[jira] [Updated] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-14 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-4686: -- Attachment: YARN-4686.004.patch The new patch changes the waitForNodeManagersToConnect method in

[jira] [Updated] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-14 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4712: Attachment: YARN-4712-YARN-2928.v1.006.patch Hi [~sjlee0], Have fixed your comments please

[jira] [Updated] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4108: - Attachment: YARN-4108.10.patch Thanks [~jianhe] for such detailed reviews. Attached ver.10 patch

[jira] [Updated] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4108: - Attachment: YARN-4108.11.patch Removed unrelated changes. (ver.11) > CapacityScheduler: Improve

[jira] [Commented] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194708#comment-15194708 ] Hadoop QA commented on YARN-4815: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4816) SystemClock API broken in 2.9.0

2016-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194726#comment-15194726 ] Hudson commented on YARN-4816: -- FAILURE: Integrated in Hadoop-trunk-Commit #9462 (See

[jira] [Updated] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4108: - Attachment: YARN-4108.10.patch > CapacityScheduler: Improve preemption to preempt only those containers

[jira] [Updated] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4108: - Attachment: (was: YARN-4108.10.patch) > CapacityScheduler: Improve preemption to preempt only those

[jira] [Commented] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194562#comment-15194562 ] Li Lu commented on YARN-4814: - Sure. Will take a look at it soon. > ATS 1.5 timelineclient impl call flush

[jira] [Created] (YARN-4818) AggregatedLogFormat.LogValue writes only in blocks of buffer size

2016-03-14 Thread Brook Zhou (JIRA)
Brook Zhou created YARN-4818: Summary: AggregatedLogFormat.LogValue writes only in blocks of buffer size Key: YARN-4818 URL: https://issues.apache.org/jira/browse/YARN-4818 Project: Hadoop YARN

[jira] [Commented] (YARN-3150) [Documentation] Documenting the timeline service v2

2016-03-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194571#comment-15194571 ] Li Lu commented on YARN-3150: - Thanks [~sjlee0]! Currently both [~xgong] and I are still waiting for some free

[jira] [Updated] (YARN-4818) AggregatedLogFormat.LogValue writes only in blocks of buffer size

2016-03-14 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brook Zhou updated YARN-4818: - Description: AggregatedLogFormat.LogValue.write() currently has a bug where it only writes in blocks of

[jira] [Commented] (YARN-4817) Change Log Level to DEBUG for putDomain call in ATS 1.5

2016-03-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194564#comment-15194564 ] Li Lu commented on YARN-4817: - LGTM. +1. > Change Log Level to DEBUG for putDomain call in ATS 1.5 >

[jira] [Commented] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194569#comment-15194569 ] Li Lu commented on YARN-4815: - OK, one question, why we're not using the Guava LRU cache here? Thanks! > ATS

[jira] [Commented] (YARN-4817) Change Log Level to DEBUG for putDomain call in ATS 1.5

2016-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194568#comment-15194568 ] Hadoop QA commented on YARN-4817: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4818) AggregatedLogFormat.LogValue.write() incorrectly truncates files

2016-03-14 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brook Zhou updated YARN-4818: - Summary: AggregatedLogFormat.LogValue.write() incorrectly truncates files (was:

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194145#comment-15194145 ] Hadoop QA commented on YARN-4686: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4816) SystemClock API broken in 2.9.0

2016-03-14 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated YARN-4816: - Attachment: YARN-4816.1.txt Trivial patch. Re-introduces the public constructor and marks it as

[jira] [Commented] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

2016-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194326#comment-15194326 ] Karthik Kambatla commented on YARN-4805: Thanks Robert. Will check this in tomorrow if I don't hear

[jira] [Created] (YARN-4817) Change Log Level to DEBUG for putDomain call in ATS 1.5

2016-03-14 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-4817: --- Summary: Change Log Level to DEBUG for putDomain call in ATS 1.5 Key: YARN-4817 URL: https://issues.apache.org/jira/browse/YARN-4817 Project: Hadoop YARN Issue Type: