[jira] [Commented] (YARN-1326) RM should log using RMStore at startup time

[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111952#comment-14111952 ] Tsuyoshi OZAWA commented on YARN-1326: -- Thanks for your review, Karthik :-) RM

[jira] [Created] (YARN-2458) Add file handling features to the Windows Secure Container Executor LRPC service

Remus Rusanu created YARN-2458: -- Summary: Add file handling features to the Windows Secure Container Executor LRPC service Key: YARN-2458 URL: https://issues.apache.org/jira/browse/YARN-2458 Project:

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112028#comment-14112028 ] Gera Shegalov commented on YARN-2405: - +1 for not masking NPE bugs. It's a performance

[jira] [Updated] (YARN-2440) Cgroups should allow YARN containers to be limited to allocated cores

[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2440: Attachment: apache-yarn-2440.3.patch Uploaded new patch which addresses [~jlowe] comments. 1.

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112044#comment-14112044 ] Tsuyoshi OZAWA commented on YARN-2405: -- Thanks for your comment, Gera. Yes, I'm

[jira] [Updated] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2405: - Attachment: YARN-2405.1.patch Attached a first patch. NPE in FairSchedulerAppsBlock (scheduler

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112083#comment-14112083 ] Hadoop QA commented on YARN-2405: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2440) Cgroups should allow YARN containers to be limited to allocated cores

[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112084#comment-14112084 ] Hadoop QA commented on YARN-2440: - {color:green}+1 overall{color}. Here are the results of

[jira] [Assigned] (YARN-2442) ResourceManager JMX UI does not give HA State

[ https://issues.apache.org/jira/browse/YARN-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-2442: Assignee: Rohith ResourceManager JMX UI does not give HA State

[jira] [Updated] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2405: - Attachment: YARN-2405.2.patch It seems build process is killed. Let me try attaching a patch

[jira] [Commented] (YARN-2442) ResourceManager JMX UI does not give HA State

[ https://issues.apache.org/jira/browse/YARN-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112134#comment-14112134 ] Rohith commented on YARN-2442: -- This can be taken as Improvement, not really a bug. In

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112139#comment-14112139 ] Tsuyoshi OZAWA commented on YARN-1879: -- Investigating why the test fails. Mark

[jira] [Updated] (YARN-2440) Cgroups should allow YARN containers to be limited to allocated cores

[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2440: Attachment: apache-yarn-2440.4.patch Uploaded a new patch that missed use case where usage was

[jira] [Commented] (YARN-2440) Cgroups should allow YARN containers to be limited to allocated cores

[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112350#comment-14112350 ] Hadoop QA commented on YARN-2440: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2442) ResourceManager JMX UI does not give HA State

[ https://issues.apache.org/jira/browse/YARN-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112369#comment-14112369 ] Karthik Kambatla commented on YARN-2442: Host-ports come from the config and

[jira] [Commented] (YARN-2453) TestProportionalCapacityPreemptionPolicy is failed for FairScheduler

[ https://issues.apache.org/jira/browse/YARN-2453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112374#comment-14112374 ] Eric Payne commented on YARN-2453: -- [~zxu], thank you for your work on this issue. I'm a

[jira] [Commented] (YARN-2453) TestProportionalCapacityPreemptionPolicy is failed for FairScheduler

[ https://issues.apache.org/jira/browse/YARN-2453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112435#comment-14112435 ] zhihai xu commented on YARN-2453: - [~eepayne] Because the default scheduler used in trunk

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112447#comment-14112447 ] Maysam Yabandeh commented on YARN-2405: --- LGTM. A minor comment: I was thinking that

[jira] [Commented] (YARN-2453) TestProportionalCapacityPreemptionPolicy is failed for FairScheduler

[ https://issues.apache.org/jira/browse/YARN-2453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112603#comment-14112603 ] Eric Payne commented on YARN-2453: -- [~zxu] I see. Thank you for your explanation. +1

[jira] [Updated] (YARN-560) If AM fails due to overrunning resource limits, error not visible through UI sometimes

[ https://issues.apache.org/jira/browse/YARN-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated YARN-560: -- Assignee: (was: Ravi Prakash) If AM fails due to overrunning resource limits, error not visible

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112657#comment-14112657 ] Eric Payne commented on YARN-2056: -- [~leftnoteasy], Thank you for helping review this

[jira] [Updated] (YARN-1708) Add a public API to reserve resources (part of YARN-1051)

[ https://issues.apache.org/jira/browse/YARN-1708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Krishnan updated YARN-1708: --- Attachment: YARN-1708.patch Thanks [~vinodkv] for taking the time to review and for

[jira] [Commented] (YARN-1708) Add a public API to reserve resources (part of YARN-1051)

[ https://issues.apache.org/jira/browse/YARN-1708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112694#comment-14112694 ] Hadoop QA commented on YARN-1708: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1372) Ensure all completed containers are reported to the AMs across RM restart

[ https://issues.apache.org/jira/browse/YARN-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-1372: Attachment: YARN-1372.002_RMHandlesCompletedApp.patch Failure seems unrelated. Reuploading the same

[jira] [Updated] (YARN-2102) More generalized timeline ACLs

[ https://issues.apache.org/jira/browse/YARN-2102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2102: -- Attachment: YARN-2102.5.patch In the new patch, I modified reader and writer of TimelineNamespace to be

[jira] [Commented] (YARN-2395) FairScheduler: Preemption timeout should be configurable per queue

[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112772#comment-14112772 ] Karthik Kambatla commented on YARN-2395: I ll commit this later today if no one has

[jira] [Commented] (YARN-1372) Ensure all completed containers are reported to the AMs across RM restart

[ https://issues.apache.org/jira/browse/YARN-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112830#comment-14112830 ] Jian He commented on YARN-1372: --- bq. I looked into an alternate approach where the RM acks

[jira] [Commented] (YARN-2327) YARN should warn about nodes with poor clock synchronization

[ https://issues.apache.org/jira/browse/YARN-2327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112861#comment-14112861 ] Vinod Kumar Vavilapalli commented on YARN-2327: --- YARN itself depends on clock

[jira] [Created] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

Mayank Bansal created YARN-2459: --- Summary: RM crashes if App gets rejected for any reason and HA is enabled Key: YARN-2459 URL: https://issues.apache.org/jira/browse/YARN-2459 Project: Hadoop YARN

[jira] [Updated] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-2459: Attachment: YARN-2459-1.patch Updating patch , Adding app to state store in App reject event to

[jira] [Commented] (YARN-800) Clicking on an AM link for a running app leads to a HTTP 500

[ https://issues.apache.org/jira/browse/YARN-800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112981#comment-14112981 ] Matt Foley commented on YARN-800: - [~cwelch] fixed this as part of YARN-1994. Clicking on

[jira] [Commented] (YARN-800) Clicking on an AM link for a running app leads to a HTTP 500

[ https://issues.apache.org/jira/browse/YARN-800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112983#comment-14112983 ] Matt Foley commented on YARN-800: - [~arpitgupta], can you please mark it resolved? I lack

[jira] [Updated] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-2459: Description: If RM HA is enabled and used Zookeeper store for RM State Store. If for any reason Any

[jira] [Updated] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2459: --- Description: If RM HA is enabled and used Zookeeper store for RM State Store. If for any

[jira] [Commented] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113067#comment-14113067 ] Karthik Kambatla commented on YARN-2459: Stack Trace from Mayank: {noformat}

[jira] [Commented] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113071#comment-14113071 ] Hadoop QA commented on YARN-2459: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1506) Replace set resource change on RMNode/SchedulerNode directly with event notification.

[ https://issues.apache.org/jira/browse/YARN-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1506: - Attachment: YARN-1506-v14.patch Thanks for your review and comments, [~jianhe]! bq. Move the following to

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113124#comment-14113124 ] Wangda Tan commented on YARN-2056: -- Hi [~eepayne], Really sorry to come late, thanks for

[jira] [Assigned] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Krishnan reassigned YARN-1051: -- Assignee: Subramaniam Krishnan (was: Carlo Curino) YARN Admission

[jira] [Commented] (YARN-1506) Replace set resource change on RMNode/SchedulerNode directly with event notification.

[ https://issues.apache.org/jira/browse/YARN-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113134#comment-14113134 ] Hadoop QA commented on YARN-1506: - {color:red}-1 overall{color}. Here are the results of

[jira] [Assigned] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-1051: -- Assignee: Carlo Curino (was: Subramaniam Krishnan) YARN Admission Control/Planner: enhancing

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113147#comment-14113147 ] Wangda Tan commented on YARN-1707: -- Hi [~curino], Thanks for updating, I think current

[jira] [Updated] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2405: - Attachment: YARN-2405.3.patch Thanks for your suggestion, Maysam. Updated a patch to handle

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113175#comment-14113175 ] Carlo Curino commented on YARN-1707: I share the uncertainty towards getQueueName

[jira] [Commented] (YARN-2182) Update ContainerId#toString() to avoid conflicts before and after RM restart

[ https://issues.apache.org/jira/browse/YARN-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113180#comment-14113180 ] Tsuyoshi OZAWA commented on YARN-2182: -- Thanks for your review, Jian! Update

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113187#comment-14113187 ] Wangda Tan commented on YARN-1707: -- Thanks for sharing this, Carlo! It's very helpful to

[jira] [Commented] (YARN-2454) The function compareTo of variable UNBOUNDED in org.apache.hadoop.yarn.util.resource.Resources is definited wrong.

[ https://issues.apache.org/jira/browse/YARN-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113192#comment-14113192 ] Tsuyoshi OZAWA commented on YARN-2454: -- Thanks for your updating, [~yxls123123]. It

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113228#comment-14113228 ] Hadoop QA commented on YARN-2405: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113240#comment-14113240 ] Tsuyoshi OZAWA commented on YARN-2405: -- [~kkambatl], could you reivew a latest patch?

[jira] [Commented] (YARN-2395) FairScheduler: Preemption timeout should be configurable per queue

[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113290#comment-14113290 ] Ashwin Shankar commented on YARN-2395: -- [~kasha], I'm fine with the plan. However I'm

[jira] [Commented] (YARN-2394) Fair Scheduler : ability to configure fairSharePreemptionThreshold per queue

[ https://issues.apache.org/jira/browse/YARN-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113323#comment-14113323 ] Ashwin Shankar commented on YARN-2394: -- [~ywskycn], [~kasha] Inheriting

[jira] [Created] (YARN-2460) Remove obsolete entries from yarn-default.xml

Ray Chiang created YARN-2460: Summary: Remove obsolete entries from yarn-default.xml Key: YARN-2460 URL: https://issues.apache.org/jira/browse/YARN-2460 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1879: - Attachment: YARN-1879.11.patch Mark Idempotent/AtMostOnce annotations to

[jira] [Commented] (YARN-2448) RM should expose the name of the ResourceCalculator being used when AMs register

[ https://issues.apache.org/jira/browse/YARN-2448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113344#comment-14113344 ] Jian He commented on YARN-2448: --- looks good overall, thinking if it makes sense to use enum

[jira] [Commented] (YARN-2394) Fair Scheduler : ability to configure fairSharePreemptionThreshold per queue

[ https://issues.apache.org/jira/browse/YARN-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113355#comment-14113355 ] Hadoop QA commented on YARN-2394: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2461) Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfiguration

[ https://issues.apache.org/jira/browse/YARN-2461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2461: - Attachment: YARN-2461-01.patch Easy fix. Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in

[jira] [Created] (YARN-2461) Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfiguration

Ray Chiang created YARN-2461: Summary: Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfiguration Key: YARN-2461 URL: https://issues.apache.org/jira/browse/YARN-2461 Project: Hadoop YARN