[jira] [Updated] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2016-02-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4062: - Attachment: YARN-4062-feature-YARN-2928.03.patch > Add the flush and compaction functionality via

[jira] [Updated] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2016-02-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4062: - Attachment: (was: YARN-4062-feature-YARN-2928.03.patch) > Add the flush and compaction functionality

[jira] [Updated] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2016-02-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4062: - Attachment: YARN-4062-feature-YARN-2928.03.patch Uploading patch v3. Have tried to address all the

[jira] [Commented] (YARN-2225) Turn the virtual memory check to be off by default

2016-02-19 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155388#comment-15155388 ] Tsuyoshi Ozawa commented on YARN-2225: -- It's a bit too aggressive to disable vmem-check as discussed

[jira] [Updated] (YARN-4697) NM aggregation thread pool is not bound by limits

2016-02-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4697: - Attachment: yarn4697.003.patch Thanks very much for you guys' comments. I have updated the patch

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

2016-02-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155207#comment-15155207 ] Li Lu commented on YARN-4545: - bq. Regarding where the checks go, the key thing is "not in YarnConfiguration".

[jira] [Updated] (YARN-4701) When task logs are not available, port 8041 is referenced instead of port 8042

2016-02-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4701: - Attachment: yarn4701.002.patch Thanks for the comments. Addressed. > When task logs are not available,

[jira] [Commented] (YARN-4697) NM aggregation thread pool is not bound by limits

2016-02-19 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155015#comment-15155015 ] Robert Kanter commented on YARN-4697: - Besides [~wilfreds]'s comments, I have some feedback on the unit

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154989#comment-15154989 ] Steve Loughran commented on YARN-4696: -- This is another iteration with some other things needed to

[jira] [Updated] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-4696: - Attachment: YARN-4696-005.patch Patch -005 (there was an -004, but I Don't think I submitted it)

[jira] [Updated] (YARN-4705) ATS 1.5 parse pipeline to consider handling open() events recoverably

2016-02-19 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4705: Issue Type: Sub-task (was: Bug) Parent: YARN-4233 > ATS 1.5 parse pipeline to consider handling

[jira] [Commented] (YARN-4705) ATS 1.5 parse pipeline to consider handling open() events recoverably

2016-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154688#comment-15154688 ] Steve Loughran commented on YARN-4705: -- .. adding a check to skip 0-byte files stops the stack I've

[jira] [Commented] (YARN-4705) ATS 1.5 parse pipeline to consider handling open() events recoverably

2016-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154667#comment-15154667 ] Steve Loughran commented on YARN-4705: -- stack attached. Looking at the code, I'm not sure what the

[jira] [Updated] (YARN-4465) SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled

2016-02-19 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4465: --- Attachment: 0006-YARN-4465.patch > SchedulerUtils#validateRequest for Label check should

[jira] [Created] (YARN-4705) ATS 1.5 parse pipeline to consider handling open() events recoverably

2016-02-19 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-4705: Summary: ATS 1.5 parse pipeline to consider handling open() events recoverably Key: YARN-4705 URL: https://issues.apache.org/jira/browse/YARN-4705 Project: Hadoop

[jira] [Updated] (YARN-4465) SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled

2016-02-19 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4465: --- Attachment: (was: 0005-YARN-4465.patch) > SchedulerUtils#validateRequest for Label check

[jira] [Updated] (YARN-4465) SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled

2016-02-19 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4465: --- Attachment: 0005-YARN-4465.patch [~sunilg] Thank you for reviewing patch. Point 4: Havnt

[jira] [Commented] (YARN-4692) [Umbrella] Simplified and first-class support for services in YARN

2016-02-19 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154548#comment-15154548 ] Konstantinos Karanasos commented on YARN-4692: -- Thanks [~vinodkv] for the document -- I think

[jira] [Commented] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

2016-02-19 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154519#comment-15154519 ] Kuhu Shukla commented on YARN-4386: --- Thank you [~djp]! Will wait for your comments. >

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-02-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154466#comment-15154466 ] Sunil G commented on YARN-4108: --- Thanks [~leftnoteasy] for the updated patch bq.Do you think is there any

[jira] [Commented] (YARN-4465) SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled

2016-02-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154303#comment-15154303 ] Sunil G commented on YARN-4465: --- Hi [~bibinchundatt] Thanks for updating patch. Few comments.: 1. Comment

[jira] [Commented] (YARN-4634) Scheduler UI/Metrics need to consider cases like non-queue label mappings

2016-02-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154206#comment-15154206 ] Sunil G commented on YARN-4634: --- Hi [~leftnoteasy] Thank you for the clarification. Pls correct me if I am

[jira] [Updated] (YARN-4678) Cluster used capacity is > 100 when container reserved

2016-02-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4678: -- Attachment: 0002-YARN-4678.patch > Cluster used capacity is > 100 when container reserved >

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

2016-02-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154059#comment-15154059 ] Steve Loughran commented on YARN-4545: -- regarding dependencies, I now understand. You are right: no

[jira] [Commented] (YARN-4328) Findbugs warning in resourcemanager in branch-2.7 and branch-2.6

2016-02-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154027#comment-15154027 ] Hadoop QA commented on YARN-4328: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4678) Cluster used capacity is > 100 when container reserved

2016-02-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154016#comment-15154016 ] Sunil G commented on YARN-4678: --- Thanks [~brahmareddy]. Yes, it will result in test case failure. I will

[jira] [Updated] (YARN-4328) Findbugs warning in resourcemanager in branch-2.7 and branch-2.6

2016-02-19 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-4328: Attachment: YARN-4328.branch-2.7.00.patch Attaching the same patch again to run tests on branch-2.7.