[jira] [Updated] (YARN-5824) Verify app starvation under custom preemption thresholds and timeouts

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5824: --- Parent Issue: YARN-5990 (was: YARN-4752) > Verify app starvation under custom preemption

[jira] [Updated] (YARN-5832) Preemption should consider multiple resource-requests of a starved app as needed

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5832: --- Parent Issue: YARN-5990 (was: YARN-4752) > Preemption should consider multiple

[jira] [Updated] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5829: --- Parent Issue: YARN-5990 (was: YARN-4752) > FS preemption should reserve a node before

[jira] [Updated] (YARN-4752) FairScheduler should preempt for a ResourceRequest and all preempted containers should be on the same node

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Summary: FairScheduler should preempt for a ResourceRequest and all preempted containers

[jira] [Updated] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups

2016-12-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5849: - Attachment: YARN-5849.008.patch > Automatically create YARN control group for pre-mounted cgroups

[jira] [Commented] (YARN-4457) Cleanup unchecked types for EventHandler

2016-12-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736895#comment-15736895 ] Robert Kanter commented on YARN-4457: - Nevermind. I was using master instead of trunk \*facepalm\*. >

[jira] [Updated] (YARN-5536) Multiple format support (JSON, etc.) for exclude node file in NM graceful decommission with timeout

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5536: -- Priority: Major (was: Blocker) I'm going to downgrade this to Major, since it sounds like this

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737328#comment-15737328 ] Hadoop QA commented on YARN-3866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5989) hadoop build to allow hadoop version property to be explicitly set (YARN test)

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737409#comment-15737409 ] Hadoop QA commented on YARN-5989: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736696#comment-15736696 ] Hadoop QA commented on YARN-5709: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

2016-12-09 Thread Clay B. (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736764#comment-15736764 ] Clay B. commented on YARN-5910: --- This conversation has been very educational for me; thank you! I am

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736904#comment-15736904 ] Andrew Wang commented on YARN-4126: --- I'd like to revert this change while discussion continues (using

[jira] [Updated] (YARN-5963) Spelling errors in logging and exceptions for node manager, client, web-proxy, common, and app history code

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5963: -- Fix Version/s: 3.0.0-alpha2 2.9.0 > Spelling errors in logging and exceptions for

[jira] [Created] (YARN-5990) [Umbrella] Follow-up (phase-2) FairScheduler preemption improvements

2016-12-09 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5990: -- Summary: [Umbrella] Follow-up (phase-2) FairScheduler preemption improvements Key: YARN-5990 URL: https://issues.apache.org/jira/browse/YARN-5990 Project: Hadoop

[jira] [Updated] (YARN-5798) Handle FSPreemptionThread crashing due to a RuntimeException

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5798: --- Parent Issue: YARN-5990 (was: YARN-4752) > Handle FSPreemptionThread crashing due to a

[jira] [Commented] (YARN-5986) Adding YARN configuration entries to ContainerLaunchContext

2016-12-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736578#comment-15736578 ] Sangjin Lee commented on YARN-5986: --- Thanks for the clarification. If it is used only rarely for a

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2016-12-09 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736672#comment-15736672 ] Konstantinos Karanasos commented on YARN-1042: -- [~leftnoteasy], I think you are right that

[jira] [Commented] (YARN-5667) Move HBase backend code in ATS v2 into its separate module

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736883#comment-15736883 ] Andrew Wang commented on YARN-5667: --- Ping [~haibochen], any update on this JIRA? > Move HBase backend

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736886#comment-15736886 ] Jian He commented on YARN-5709: --- branch-2, and trunk is committed. Unfortunately, there seems quite some

[jira] [Commented] (YARN-4457) Cleanup unchecked types for EventHandler

2016-12-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736888#comment-15736888 ] Robert Kanter commented on YARN-4457: - Looks like it's already too late. I can't get it to apply

[jira] [Updated] (YARN-4457) Cleanup unchecked types for EventHandler

2016-12-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-4457: Fix Version/s: 3.0.0-alpha2 > Cleanup unchecked types for EventHandler >

[jira] [Commented] (YARN-5982) Simplifying opportunistic container parameters and metrics

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736805#comment-15736805 ] Hadoop QA commented on YARN-5982: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736827#comment-15736827 ] Jian He commented on YARN-5709: --- +1, committing > Cleanup leader election configs and pluggability >

[jira] [Commented] (YARN-5982) Simplifying opportunistic container parameters and metrics

2016-12-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736829#comment-15736829 ] Arun Suresh commented on YARN-5982: --- Committing this to trunk shortly. Thanks for working on this

[jira] [Commented] (YARN-5925) Extract hbase-backend-exclusive utility methods from TimelineStorageUtil

2016-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736833#comment-15736833 ] Hudson commented on YARN-5925: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10980 (See

[jira] [Updated] (YARN-5982) Simplify opportunistic container parameters and metrics

2016-12-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5982: -- Summary: Simplify opportunistic container parameters and metrics (was: Simplifying opportunistic

[jira] [Commented] (YARN-4457) Cleanup unchecked types for EventHandler

2016-12-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736929#comment-15736929 ] Robert Kanter commented on YARN-4457: - +1 > Cleanup unchecked types for EventHandler >

[jira] [Reopened] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

2016-12-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-2009: -- I'm backporting this to 2.8. Reopening so that I can put it back into patch available so it will kick a

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736679#comment-15736679 ] Hadoop QA commented on YARN-5709: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736794#comment-15736794 ] Hadoop QA commented on YARN-5849: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5975) Remove the agent - slider AM ssl related code

2016-12-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736894#comment-15736894 ] Jian He commented on YARN-5975: --- Since they are not needed at this point, and those code introduced a lot

[jira] [Updated] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-09 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Sharma updated YARN-5216: Attachment: YARN-5216-YARN-5972.001.patch Posting a patch based on YARN-5972. > Expose configurable

[jira] [Updated] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: yarn-5709.4.patch We can't directly call the method on EmbeddedElector as it can

[jira] [Assigned] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-5829: -- Assignee: Karthik Kambatla > FS preemption should reserve a node before considering

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-12-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736967#comment-15736967 ] Jian He commented on YARN-4126: --- bq. Assuming that Oozie wants to keep supporting 2.x releases there must be

[jira] [Updated] (YARN-5761) Separate QueueManager from Scheduler

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5761: -- Fix Version/s: 3.0.0-alpha2 2.9.0 > Separate QueueManager from Scheduler >

[jira] [Updated] (YARN-5830) Avoid preempting AM containers

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5830: --- Parent Issue: YARN-5990 (was: YARN-4752) > Avoid preempting AM containers >

[jira] [Updated] (YARN-5982) Simplifying opportunistic container parameters and metrics

2016-12-09 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5982: - Attachment: YARN-5982.003.patch Fixing remaining issues, including a checkstyle

[jira] [Updated] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5831: --- Parent Issue: YARN-5990 (was: YARN-4752) > Propagate allowPreemptionFrom flag all the way

[jira] [Updated] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

2016-12-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2009: - Attachment: YARN-2009.branch-2.8.001.patch > CapacityScheduler: Add intra-queue preemption for app

[jira] [Commented] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups

2016-12-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736662#comment-15736662 ] Miklos Szegedi commented on YARN-5849: -- Thank you, [~bibinchundatt] for the review! I addressed the

[jira] [Assigned] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-4752: -- Assignee: Karthik Kambatla > [Umbrella] FairScheduler: Improve preemption >

[jira] [Commented] (YARN-5982) Simplify opportunistic container parameters and metrics

2016-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736872#comment-15736872 ] Hudson commented on YARN-5982: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10981 (See

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736918#comment-15736918 ] Hudson commented on YARN-5709: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10982 (See

[jira] [Commented] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736964#comment-15736964 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5893) Experiment with using PriorityQueue for storing starved applications

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5893: --- Parent Issue: YARN-5990 (was: YARN-4752) > Experiment with using PriorityQueue for storing

[jira] [Commented] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736650#comment-15736650 ] Wangda Tan commented on YARN-5959: -- Look at overall changes and discussed with [~asuresh] offline. A

[jira] [Commented] (YARN-4457) Cleanup unchecked types for EventHandler

2016-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736955#comment-15736955 ] Hudson commented on YARN-4457: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10983 (See

[jira] [Commented] (YARN-5925) Extract hbase-backend-exclusive utility methods from TimelineStorageUtil

2016-12-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736745#comment-15736745 ] Sangjin Lee commented on YARN-5925: --- LGTM. Committing shortly. > Extract hbase-backend-exclusive utility

[jira] [Comment Edited] (YARN-4457) Cleanup unchecked types for EventHandler

2016-12-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736888#comment-15736888 ] Robert Kanter edited comment on YARN-4457 at 12/10/16 1:07 AM: --- Looks like

[jira] [Updated] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5709: -- Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 2.8.0) > Cleanup leader election configs and pluggability >

[jira] [Updated] (YARN-5989) hadoop build to allow hadoop version property to be explicitly set (YARN test)

2016-12-09 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-5989: Attachment: YARN-5989-testing.patch Edited all the YARN modules to run all the YARN tests. Precommit

[jira] [Commented] (YARN-5988) RM unable to start in secure setup

2016-12-09 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734801#comment-15734801 ] Ajith S commented on YARN-5988: --- {code}2016-12-09 14:54:27,028 ERROR [Thread-788]

[jira] [Updated] (YARN-5988) RM unable to start in secure setup

2016-12-09 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated YARN-5988: -- Priority: Blocker (was: Major) > RM unable to start in secure setup > -- > >

[jira] [Updated] (YARN-5988) RM unable to start in secure setup

2016-12-09 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated YARN-5988: -- Target Version/s: 2.9.0, 3.0.0-alpha2 (was: 2.8.0, 2.9.0, 2.7.4, 3.0.0-alpha2, 2.6.6) > RM unable to start in

[jira] [Updated] (YARN-5988) RM unable to start in secure setup

2016-12-09 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5988: --- Affects Version/s: 2.9.0 3.0.0-alpha1 > RM unable to start in secure setup >

[jira] [Commented] (YARN-5912) [YARN-3368] Fix breadcrumb issues in yarn-node page in new YARN UI

2016-12-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734876#comment-15734876 ] Sunil G commented on YARN-5912: --- Similar issue is observed in Application page as well. Pls fix that also

[jira] [Updated] (YARN-5983) [Umbrella] Support for FPGA as a Resource in YARN

2016-12-09 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated YARN-5983: Description: As various big data workload running on YARN, CPU will no longer scale eventually and

[jira] [Commented] (YARN-5988) RM unable to start in secure setup

2016-12-09 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734808#comment-15734808 ] Naganarasimha G R commented on YARN-5988: - Thanks for raising the issue [~ajithshetty] As discussed

[jira] [Commented] (YARN-5988) RM unable to start in secure setup

2016-12-09 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734825#comment-15734825 ] Naganarasimha G R commented on YARN-5988: - Updated target versions as it impacts after YARN-5333

[jira] [Commented] (YARN-5988) RM unable to start in secure setup

2016-12-09 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734863#comment-15734863 ] Ajith S commented on YARN-5988: --- {code}java.lang.NullPointerException at

[jira] [Updated] (YARN-5988) RM unable to start in secure setup

2016-12-09 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated YARN-5988: -- Attachment: YARN-5988.01.patch Attaching initial patch. will add test case soon. > RM unable to start in secure

[jira] [Commented] (YARN-5988) RM unable to start in secure setup

2016-12-09 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735059#comment-15735059 ] Rohith Sharma K S commented on YARN-5988: - thanks Ajith for the patch.. Approach looks fine to me.

[jira] [Created] (YARN-5989) hadoop build to allow hadoop version property to be explicitly set (YARN test)

2016-12-09 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-5989: Summary: hadoop build to allow hadoop version property to be explicitly set (YARN test) Key: YARN-5989 URL: https://issues.apache.org/jira/browse/YARN-5989 Project:

[jira] [Updated] (YARN-5970) Validate application update timeout request parameters

2016-12-09 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5970: Attachment: YARN-5970-branch-2.0001.patch uploaded branch-2 patch > Validate application

[jira] [Updated] (YARN-5989) hadoop build to allow hadoop version property to be explicitly set (YARN test)

2016-12-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-5989: - Attachment: HADOOP-13582-003.patch > hadoop build to allow hadoop version property to be

[jira] [Updated] (YARN-5989) hadoop build to allow hadoop version property to be explicitly set (YARN test)

2016-12-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-5989: - Priority: Minor (was: Major) > hadoop build to allow hadoop version property to be explicitly set

[jira] [Created] (YARN-5988) RM unable to start in secure setup

2016-12-09 Thread Ajith S (JIRA)
Ajith S created YARN-5988: - Summary: RM unable to start in secure setup Key: YARN-5988 URL: https://issues.apache.org/jira/browse/YARN-5988 Project: Hadoop YARN Issue Type: Bug Reporter:

[jira] [Updated] (YARN-5988) RM unable to start in secure setup

2016-12-09 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5988: Target Version/s: 2.8.0, 2.9.0, 2.7.4, 3.0.0-alpha2, 2.6.6 > RM unable to start in secure

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2016-12-09 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735583#comment-15735583 ] Varun Saxena commented on YARN-2962: Sorry have been keeping busy lately. Give me a week. Will update

[jira] [Comment Edited] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2016-12-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735648#comment-15735648 ] Arun Suresh edited comment on YARN-5292 at 12/9/16 3:52 PM: Committed to

[jira] [Commented] (YARN-5989) hadoop build to allow hadoop version property to be explicitly set (YARN test)

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735484#comment-15735484 ] Hadoop QA commented on YARN-5989: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2016-12-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15731526#comment-15731526 ] Arun Suresh edited comment on YARN-5292 at 12/9/16 3:46 PM: Hi [~kasha], the

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3866: - Attachment: YARN-3866-branch-2.8.addendum.1.patch Attached addendum.1 patch to fix the issue. We need two

[jira] [Assigned] (YARN-5953) Create CLI for changing YARN configurations

2016-12-09 Thread Ye Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ye Zhou reassigned YARN-5953: - Assignee: Ye Zhou > Create CLI for changing YARN configurations >

[jira] [Commented] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2016-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736005#comment-15736005 ] Wangda Tan commented on YARN-5734: -- bq. f the reinitialization fails (i.e. scheduler.reinitialize(X+1)),

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736065#comment-15736065 ] Arun Suresh commented on YARN-3866: --- Thanks for working on the [~leftnoteasy], In,

[jira] [Commented] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2016-12-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735638#comment-15735638 ] Arun Suresh commented on YARN-5292: --- Committing this to branch YARN-5972 shortly. Regarding [~subru]'s

[jira] [Commented] (YARN-5970) Validate application update timeout request parameters

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735679#comment-15735679 ] Hadoop QA commented on YARN-5970: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5304) Ship single node HBase config option with single startup command

2016-12-09 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735772#comment-15735772 ] Vrushali C commented on YARN-5304: -- Thanks Joep, I will take a look at this along with YARN-5980, might

[jira] [Commented] (YARN-5986) Adding YARN configuration entries to ContainerLaunchContext

2016-12-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735826#comment-15735826 ] Miklos Szegedi commented on YARN-5986: -- Thank you for the comment [~sjlee0]! No, I am talking only

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736114#comment-15736114 ] Hadoop QA commented on YARN-3866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2016-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736084#comment-15736084 ] Wangda Tan commented on YARN-1042: -- Thanks [~kkaranasos] for these suggestions. I agree to merge the

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-12-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736080#comment-15736080 ] Eric Payne commented on YARN-4390: -- {quote} bq. the patch LGTM except the javac warning: getMemory()

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736088#comment-15736088 ] Wangda Tan commented on YARN-4390: -- +1, thanks [~eepayne] > Do surgical preemption based on reserved

[jira] [Commented] (YARN-3409) Add constraint node labels

2016-12-09 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736246#comment-15736246 ] Lei Guo commented on YARN-3409: --- So far, can we all agree on the following? - Boolean type constraint is

[jira] [Updated] (YARN-5257) Fix all Bad Practices

2016-12-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5257: --- Description: The following code contain potential problems: {code} Unreleased Resource: Streams

[jira] [Updated] (YARN-5257) Fix all Bad Practices

2016-12-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5257: --- Assignee: Daniel Templeton (was: Yufei Gu) > Fix all Bad Practices > - > >

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3866: - Attachment: YARN-3866-branch-2.8.addendum.1.patch Looks like Jenkins uses a wrong branch to run, reattach

[jira] [Commented] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-12-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736448#comment-15736448 ] Daniel Templeton commented on YARN-4266: I don't have an issue taking the usermod path, assuming

[jira] [Assigned] (YARN-5257) Fix all Bad Practices

2016-12-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-5257: -- Assignee: Yufei Gu (was: Daniel Templeton) > Fix all Bad Practices > - > >

[jira] [Updated] (YARN-5257) Fix all Bad Practices

2016-12-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5257: --- Description: The following code contain potential problems: {code} Unreleased Resource: Streams