[jira] [Commented] (YARN-6056) Yarn NM using LCE shows a failure when trying to delete a non-existing dir

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800557#comment-15800557 ] Hadoop QA commented on YARN-6056: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6056) Yarn NM using LCE shows a failure when trying to delete a non-existing dir

2017-01-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-6056: Attachment: YARN-6056-branch-2.6.1.patch patch just for branch-2.6 > Yarn NM using

[jira] [Commented] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

2017-01-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800488#comment-15800488 ] Wilfred Spiegelenburg commented on YARN-2902: - Oops yes branch-2.6 was the broken one, it has a

[jira] [Created] (YARN-6056) Yarn NM using LCE shows a failure when trying to delete a non-existing dir

2017-01-04 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-6056: --- Summary: Yarn NM using LCE shows a failure when trying to delete a non-existing dir Key: YARN-6056 URL: https://issues.apache.org/jira/browse/YARN-6056

[jira] [Commented] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2017-01-04 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800448#comment-15800448 ] Sangjin Lee commented on YARN-5585: --- At least Varun's proposal for fromIdPrefix contains the following

[jira] [Commented] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2017-01-04 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800380#comment-15800380 ] Rohith Sharma K S commented on YARN-5585: - I am confused, [~sjlee0] would you clarify it please? >

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959.005.patch Attaching trunk patch.. Thanks for the review [~leftnoteasy]. > RM

[jira] [Commented] (YARN-5547) NMLeveldbStateStore should be more tolerant of unknown keys

2017-01-04 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800306#comment-15800306 ] Varun Vasudev commented on YARN-5547: - [~ajithshetty] - any updates on this? > NMLeveldbStateStore

[jira] [Commented] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800282#comment-15800282 ] Hadoop QA commented on YARN-6050: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6009) RM fails to start during an upgrade - Failed to load/recover state (YarnException: Invalid application timeout, value=0 for type=LIFETIME)

2017-01-04 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800249#comment-15800249 ] Rohith Sharma K S commented on YARN-6009: - bq. What is the impact of allowing an app to be

[jira] [Commented] (YARN-4779) Fix AM container allocation logic in SLS

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800225#comment-15800225 ] Hadoop QA commented on YARN-4779: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4899) Queue metrics of SLS capacity scheduler only activated after app submit to the queue

2017-01-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800216#comment-15800216 ] Hudson commented on YARN-4899: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11073 (See

[jira] [Commented] (YARN-4779) Fix AM container allocation logic in SLS

2017-01-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800173#comment-15800173 ] Sunil G commented on YARN-4779: --- Path looks fine for me. I ll help to rebase the same. > Fix AM container

[jira] [Commented] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800162#comment-15800162 ] Hadoop QA commented on YARN-5959: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4899) Queue metrics of SLS capacity scheduler only activated after app submit to the queue

2017-01-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800148#comment-15800148 ] Wangda Tan commented on YARN-4899: -- Committing... > Queue metrics of SLS capacity scheduler only

[jira] [Updated] (YARN-4899) Queue metrics of SLS capacity scheduler only activated after app submit to the queue

2017-01-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4899: - Assignee: Jonathan Hung (was: Wangda Tan) > Queue metrics of SLS capacity scheduler only activated after

[jira] [Commented] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-01-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800128#comment-15800128 ] Wangda Tan commented on YARN-6050: -- Thanks [~rkanter] for updating patch. A couple of comments/questions:

[jira] [Commented] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800110#comment-15800110 ] Wangda Tan commented on YARN-5959: -- +1, pending Jenkins, will wait 1 day before commit. [~asuresh], could

[jira] [Commented] (YARN-6027) Support fromId for flows/flowrun apps

2017-01-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800030#comment-15800030 ] Varun Saxena commented on YARN-6027: bq. We could consider the fromId as (user + flow), right? Yes, we

[jira] [Commented] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-04 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799978#comment-15799978 ] Yufei Gu commented on YARN-5831: Thanks [~kasha] for the review. I uploaded new patch for your comments. >

[jira] [Updated] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-04 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5831: --- Attachment: YARN-5831.003.patch > Propagate allowPreemptionFrom flag all the way down to the app >

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799926#comment-15799926 ] Hadoop QA commented on YARN-5554: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959-YARN-5085.005.patch Updating patch v005 Some minor updates: Moved

[jira] [Updated] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-01-04 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-6050: Attachment: YARN-6050.003.patch The 003 patch address the latest comments from [~leftnoteasy] and

[jira] [Updated] (YARN-1279) Expose a client API to allow clients to figure if log aggregation is complete

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1279: - Fix Version/s: (was: 2.8.0) > Expose a client API to allow clients to figure if log aggregation is

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959-YARN-5085.004.patch Updated patch. Do give it another review [~leftnoteasy] bq.

[jira] [Comment Edited] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799772#comment-15799772 ] Arun Suresh edited comment on YARN-5959 at 1/5/17 12:06 AM: Updated patch. Do

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2017-01-04 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799765#comment-15799765 ] Daniel Templeton commented on YARN-5554: One more detail: in the new comment on the old

[jira] [Commented] (YARN-5980) Update documentation for single node hbase deploy

2017-01-04 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799761#comment-15799761 ] Sangjin Lee commented on YARN-5980: --- Thanks for the patch [~vrushalic]! One small nit: let's properly

[jira] [Updated] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2017-01-04 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-5554: Attachment: YARN-5554.13.patch Fixed up the comments as per the feedback >

[jira] [Commented] (YARN-5830) Avoid preempting AM containers

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799749#comment-15799749 ] Hadoop QA commented on YARN-5830: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4164) Retrospect update ApplicationPriority API return type

2017-01-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799750#comment-15799750 ] Jian He commented on YARN-4164: --- merged the patch to 2.8 too > Retrospect update ApplicationPriority API

[jira] [Updated] (YARN-4164) Retrospect update ApplicationPriority API return type

2017-01-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4164: -- Fix Version/s: 2.8.0 > Retrospect update ApplicationPriority API return type >

[jira] [Commented] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799690#comment-15799690 ] Junping Du commented on YARN-3225: -- Sorry for missing this. I felt the same pain now in releasing 2.8.0.

[jira] [Updated] (YARN-3667) Fix findbugs warning Inconsistent synchronization of org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore.isHDFS

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3667: - Fix Version/s: (was: 2.8.0) > Fix findbugs warning Inconsistent synchronization of >

[jira] [Commented] (YARN-3737) Add support for recovery of reserved apps (running under dynamic queues) to Fair Scheduler

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799686#comment-15799686 ] Junping Du commented on YARN-3737: -- Please mark fix version only when patch get committed in. thx! > Add

[jira] [Updated] (YARN-3737) Add support for recovery of reserved apps (running under dynamic queues) to Fair Scheduler

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3737: - Fix Version/s: (was: 2.8.0) > Add support for recovery of reserved apps (running under dynamic queues)

[jira] [Updated] (YARN-3752) TestRMFailover fails due to intermittent UnknownHostException

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3752: - Fix Version/s: (was: 2.8.0) > TestRMFailover fails due to intermittent UnknownHostException >

[jira] [Updated] (YARN-3843) Fair Scheduler should not accept apps with space keys as queue name

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3843: - Fix Version/s: (was: 2.8.0) > Fair Scheduler should not accept apps with space keys as queue name >

[jira] [Commented] (YARN-4164) Retrospect update ApplicationPriority API return type

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799668#comment-15799668 ] Junping Du commented on YARN-4164: -- This patch goes to branch-2 only instead of branch-2.8, set 2.9 as fix

[jira] [Updated] (YARN-4164) Retrospect update ApplicationPriority API return type

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4164: - Fix Version/s: (was: 2.8.0) 2.9.0 > Retrospect update ApplicationPriority API

[jira] [Commented] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799661#comment-15799661 ] Junping Du commented on YARN-4329: -- This patch goes to branch-2 only instead of branch-2.8, set 2.9 as fix

[jira] [Updated] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4329: - Fix Version/s: (was: 2.8.0) 2.9.0 > Allow fetching exact reason as to why a

[jira] [Commented] (YARN-4832) NM side resource value should get updated if change applied in RM side

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799650#comment-15799650 ] Junping Du commented on YARN-4832: -- This patch get missed in branch-2.8 and I just backport it.

[jira] [Created] (YARN-6055) ContainersMonitorImpl need be adjusted when NM resource changed.

2017-01-04 Thread Junping Du (JIRA)
Junping Du created YARN-6055: Summary: ContainersMonitorImpl need be adjusted when NM resource changed. Key: YARN-6055 URL: https://issues.apache.org/jira/browse/YARN-6055 Project: Hadoop YARN

[jira] [Commented] (YARN-5864) YARN Capacity Scheduler - Queue Priorities

2017-01-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799628#comment-15799628 ] Wangda Tan commented on YARN-5864: -- Thanks [~eepayne] to review the design doc. bq. My understanding is

[jira] [Commented] (YARN-5864) YARN Capacity Scheduler - Queue Priorities

2017-01-04 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799610#comment-15799610 ] Eric Payne commented on YARN-5864: -- Thanks [~leftnoteasy] for the design doc. It makes sense, and I just

[jira] [Commented] (YARN-6040) Remove usage of ResourceRequest from AppSchedulerInfo / SchedulerApplicationAttempt

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799601#comment-15799601 ] Hadoop QA commented on YARN-6040: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2017-01-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3866: - Target Version/s: 2.9.0 (was: 2.8.0) > AM-RM protocol changes to support container resizing >

[jira] [Commented] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-01-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799582#comment-15799582 ] Wangda Tan commented on YARN-6050: -- [~templedf], it is not only for AM, all existing ResourceRequest

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2017-01-04 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799573#comment-15799573 ] Daniel Templeton commented on YARN-6022: Fair point. Fine, let's just get this in. +1 I'll

[jira] [Commented] (YARN-5136) Error in handling event type APP_ATTEMPT_REMOVED to the scheduler

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799558#comment-15799558 ] Junping Du commented on YARN-5136: -- This patch goes to branch-2 only instead of branch-2.8, set 2.9 as fix

[jira] [Updated] (YARN-5136) Error in handling event type APP_ATTEMPT_REMOVED to the scheduler

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5136: - Fix Version/s: (was: 2.8.0) 2.9.0 > Error in handling event type

[jira] [Commented] (YARN-5176) More test cases for queuing of containers at the NM

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799555#comment-15799555 ] Junping Du commented on YARN-5176: -- This patch goes to branch-2 only instead of branch-2.8, set 2.9 as fix

[jira] [Updated] (YARN-5176) More test cases for queuing of containers at the NM

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5176: - Fix Version/s: (was: 2.8.0) 2.9.0 > More test cases for queuing of containers at

[jira] [Updated] (YARN-5337) Fix OOM issue in DistributedShell. AM failed with "java.lang.OutOfMemoryError: GC overhead limit exceeded"

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5337: - Summary: Fix OOM issue in DistributedShell. AM failed with "java.lang.OutOfMemoryError: GC overhead limit

[jira] [Updated] (YARN-5840) Yarn queues not being tracked correctly by Yarn Timeline

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5840: - Fix Version/s: (was: 3.0.0-alpha1) (was: 2.8.0) > Yarn queues not being

[jira] [Commented] (YARN-5851) TestContainerManagerSecurity testContainerManager[1] failed

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799540#comment-15799540 ] Junping Du commented on YARN-5851: -- This patch goes to branch-2 only instead of branch-2.8, set 2.9 as fix

[jira] [Updated] (YARN-5851) TestContainerManagerSecurity testContainerManager[1] failed

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5851: - Fix Version/s: (was: 2.8.0) 2.9.0 > TestContainerManagerSecurity

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2017-01-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799539#comment-15799539 ] Wangda Tan commented on YARN-6022: -- [~templedf], I'm afraid not, since ResourceRequest doesn't have accept

[jira] [Commented] (YARN-5890) FairScheduler should log information about AM-resource-usage and max-AM-share for queues

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799530#comment-15799530 ] Junping Du commented on YARN-5890: -- This patch goes to branch-2 only instead of 2.8, set 2.9 as fix

[jira] [Updated] (YARN-5890) FairScheduler should log information about AM-resource-usage and max-AM-share for queues

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5890: - Fix Version/s: (was: 2.8.0) 2.9.0 > FairScheduler should log information about

[jira] [Updated] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5901: - Fix Version/s: (was: 2.8.0) 2.9.0 > Fix race condition in TestGetGroups beforeclass

[jira] [Commented] (YARN-5929) Missing scheduling policy in the FS queue metric.

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799525#comment-15799525 ] Junping Du commented on YARN-5929: -- This patch goes to branch-2 only instead of 2.8, set 2.9 as fix

[jira] [Commented] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799528#comment-15799528 ] Junping Du commented on YARN-5901: -- This patch goes to branch-2 only instead of 2.8, set 2.9 as fix

[jira] [Updated] (YARN-5929) Missing scheduling policy in the FS queue metric.

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5929: - Fix Version/s: (was: 2.8.0) 2.9.0 > Missing scheduling policy in the FS queue

[jira] [Commented] (YARN-5942) "Overridden" is misspelled as "overriden" in FairScheduler.md

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799523#comment-15799523 ] Junping Du commented on YARN-5942: -- This patch goes to branch-2 only instead of 2.8, set 2.9 as fix

[jira] [Updated] (YARN-5942) "Overridden" is misspelled as "overriden" in FairScheduler.md

2017-01-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5942: - Fix Version/s: (was: 2.8.0) 2.9.0 > "Overridden" is misspelled as "overriden" in

[jira] [Commented] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799512#comment-15799512 ] Wangda Tan commented on YARN-5959: -- Thanks [~asuresh] for update the patch, generally looks good, some

[jira] [Commented] (YARN-5830) Avoid preempting AM containers

2017-01-04 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799497#comment-15799497 ] Yufei Gu commented on YARN-5830: Thanks [~kasha] for the review and suggestion. I've uploaded the new patch

[jira] [Updated] (YARN-5830) Avoid preempting AM containers

2017-01-04 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5830: --- Attachment: YARN-5830.003.patch > Avoid preempting AM containers > -- > >

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2017-01-04 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799480#comment-15799480 ] Daniel Templeton commented on YARN-5554: Thanks, [~wilfreds]. Can you move that {{checkAccess()}}

[jira] [Commented] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-01-04 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799469#comment-15799469 ] Daniel Templeton commented on YARN-6050: I don't love that we're only taking the node label

[jira] [Updated] (YARN-6040) Remove usage of ResourceRequest from AppSchedulerInfo / SchedulerApplicationAttempt

2017-01-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6040: - Attachment: YARN-6040.005.patch Attached ver.5 patch addressed comments. Now added API to get

[jira] [Commented] (YARN-5724) [Umbrella] Better Queue Management in YARN

2017-01-04 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799431#comment-15799431 ] Naganarasimha G R commented on YARN-5724: - I have added some

[jira] [Commented] (YARN-6009) RM fails to start during an upgrade - Failed to load/recover state (YarnException: Invalid application timeout, value=0 for type=LIFETIME)

2017-01-04 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799419#comment-15799419 ] Daniel Templeton commented on YARN-6009: What is the impact of allowing an app to be recovered with

[jira] [Commented] (YARN-5556) Support for deleting queues without requiring a RM restart

2017-01-04 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799398#comment-15799398 ] Naganarasimha G R commented on YARN-5556: - Hi [~xgong] and [~wangda], I have few queries based on

[jira] [Commented] (YARN-6027) Support fromId for flows/flowrun apps

2017-01-04 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799386#comment-15799386 ] Sangjin Lee commented on YARN-6027: --- bq. At least pagination should be supported for single day flow

[jira] [Commented] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-01-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799324#comment-15799324 ] Ravi Prakash commented on YARN-6054: Thanks to Jason's pointer for repairing the LevelDb

[jira] [Created] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-01-04 Thread Ravi Prakash (JIRA)
Ravi Prakash created YARN-6054: -- Summary: TimelineServer fails to start when some LevelDb state files are missing. Key: YARN-6054 URL: https://issues.apache.org/jira/browse/YARN-6054 Project: Hadoop

[jira] [Updated] (YARN-5724) [Umbrella] Better Queue Management in YARN

2017-01-04 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5724: Component/s: capacity scheduler > [Umbrella] Better Queue Management in YARN >

[jira] [Updated] (YARN-5923) Unable to access logs for a running application if YARN_ACL_ENABLE is enabled

2017-01-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5923: -- Fix Version/s: 3.0.0-alpha2 > Unable to access logs for a running application if YARN_ACL_ENABLE is

[jira] [Updated] (YARN-5999) AMRMClientAsync will stop if any exceptions thrown on allocate call

2017-01-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5999: -- Fix Version/s: 3.0.0-alpha2 > AMRMClientAsync will stop if any exceptions thrown on allocate call >

[jira] [Commented] (YARN-6009) RM fails to start during an upgrade - Failed to load/recover state (YarnException: Invalid application timeout, value=0 for type=LIFETIME)

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799125#comment-15799125 ] Hadoop QA commented on YARN-6009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2017-01-04 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799053#comment-15799053 ] Daniel Templeton commented on YARN-6022: The last patch looks clean. Looking at it, though,

[jira] [Commented] (YARN-6009) RM fails to start during an upgrade - Failed to load/recover state (YarnException: Invalid application timeout, value=0 for type=LIFETIME)

2017-01-04 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799037#comment-15799037 ] Rohith Sharma K S commented on YARN-6009: - There is open JIRA for test failure i.e YARN-5548. Test

[jira] [Commented] (YARN-6040) Remove usage of ResourceRequest from AppSchedulerInfo / SchedulerApplicationAttempt

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798997#comment-15798997 ] Arun Suresh commented on YARN-6040: --- Thanks for the patch [~leftnoteasy], Couple of comments: # Maybe

[jira] [Commented] (YARN-6009) RM fails to start during an upgrade - Failed to load/recover state (YarnException: Invalid application timeout, value=0 for type=LIFETIME)

2017-01-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798965#comment-15798965 ] Jian He commented on YARN-6009: --- patch looks good to me. The UT failure passed locally for me. Retry the

[jira] [Commented] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798859#comment-15798859 ] Hadoop QA commented on YARN-5959: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6041) Opportunistic containers : Combined patch for branch-2

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6041: -- Attachment: YARN-6041-branch-2.003.patch Updating patch based on [~kasha]'s suggestions > Opportunistic

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959-YARN-5085.003.patch Updating patch. Thanks for the detailed review

[jira] [Comment Edited] (YARN-6027) Support fromId for flows/flowrun apps

2017-01-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798450#comment-15798450 ] Varun Saxena edited comment on YARN-6027 at 1/4/17 3:24 PM: Yes, flow activity

[jira] [Comment Edited] (YARN-6027) Support fromId for flows/flowrun apps

2017-01-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798450#comment-15798450 ] Varun Saxena edited comment on YARN-6027 at 1/4/17 2:59 PM: Yes, flow activity

[jira] [Commented] (YARN-6027) Support fromId for flows/flowrun apps

2017-01-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798450#comment-15798450 ] Varun Saxena commented on YARN-6027: Yes, flow activity is meant to display activity for a day. So if a

[jira] [Commented] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

2017-01-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798347#comment-15798347 ] Jason Lowe commented on YARN-2902: -- bq. In trunk we "ignore" a non existing directory in delete_as_user()

[jira] [Commented] (YARN-5980) Update documentation for single node hbase deploy

2017-01-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798326#comment-15798326 ] Varun Saxena commented on YARN-5980: Thanks [~vrushalic] for the patch. Not related to the patch but we

[jira] [Commented] (YARN-6027) Support fromId for flows/flowrun apps

2017-01-04 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798315#comment-15798315 ] Rohith Sharma K S commented on YARN-6027: - Thanks folks for the discussion. I had offline talk

[jira] [Commented] (YARN-6033) Add support for sections in container-executor configuration file

2017-01-04 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798202#comment-15798202 ] Varun Vasudev commented on YARN-6033: - [~sunilg], [~sidharta-s] - can you please take a look? Thanks!

[jira] [Commented] (YARN-6052) Yarn RM UI % of Queue at application level is wrong

2017-01-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798205#comment-15798205 ] Sunil G commented on YARN-6052: --- Looks like a bug. [~Prabhu Joseph], could you please provide a patch. I can

[jira] [Updated] (YARN-6053) RM Web Service shows startedTime , finsihedTime as zero when RM is kerberized and ACL is setup

2017-01-04 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-6053: Attachment: RM_UI_ACL.png RM_WEB_SERVICE_start_stop.png

  1   2   >