[jira] [Commented] (YARN-6420) RM startup failure due to wrong order in nodelabel editlog

2017-04-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953267#comment-15953267 ] Varun Saxena commented on YARN-6420: Thanks [~bibinchundatt] for the patch. You have added write locks

[jira] [Updated] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-04-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5548: --- Attachment: YARN-5548.0014.patch [~varun_saxena] Thank you for review.. Handled checkstyle

[jira] [Commented] (YARN-6428) Queue AM limit is not honored in CS always

2017-04-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953231#comment-15953231 ] Bibin A Chundatt commented on YARN-6428: [~sunilg] Could you please review patch attached > Queue

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-04-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953258#comment-15953258 ] Varun Saxena commented on YARN-5548: Thanks [~bibinchundatt] for the patch. Can you have a look at the

[jira] [Commented] (YARN-6428) Queue AM limit is not honored in CS always

2017-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953150#comment-15953150 ] Hadoop QA commented on YARN-6428: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6421) Build failure in Yarn-UI on ppc64le

2017-04-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953098#comment-15953098 ] Sunil G commented on YARN-6421: --- Thanks [~ajisakaa], I will start a mailing thread for same. > Build failure

[jira] [Commented] (YARN-6389) [ATSv2] metricslimit query parameter do not work

2017-04-03 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953307#comment-15953307 ] Rohith Sharma K S commented on YARN-6389: - I verified in HBase-1.2.5, still the same issue. I took

[jira] [Commented] (YARN-6141) ppc64le on Linux doesn't trigger __linux get_executable codepath

2017-04-03 Thread Ayappan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953185#comment-15953185 ] Ayappan commented on YARN-6141: --- [~aw] Any update on this ? > ppc64le on Linux doesn't trigger __linux

[jira] [Assigned] (YARN-6402) Move 'Long Running Services' to an independent tab at top level for new Yarn UI

2017-04-03 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB reassigned YARN-6402: -- Assignee: Akhil PB (was: Sunil G) > Move 'Long Running Services' to an independent tab at top level

[jira] [Commented] (YARN-6365) slsrun.sh creating random html directories

2017-04-03 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954332#comment-15954332 ] Yufei Gu commented on YARN-6365: Shouldn't be a lot work. Take this and will update soon. > slsrun.sh

[jira] [Commented] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2017-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954438#comment-15954438 ] Hadoop QA commented on YARN-4757: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6432) FS preemption should reserve a node before considering containers on it for preemption

2017-04-03 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6432: Summary: FS preemption should reserve a node before considering containers on it for preemption Key: YARN-6432 URL: https://issues.apache.org/jira/browse/YARN-6432

[jira] [Created] (YARN-6434) When setting environment variables, can't use comma for a list of value in key = value pairs.

2017-04-03 Thread Jaeboo Jeong (JIRA)
Jaeboo Jeong created YARN-6434: -- Summary: When setting environment variables, can't use comma for a list of value in key = value pairs. Key: YARN-6434 URL: https://issues.apache.org/jira/browse/YARN-6434

[jira] [Commented] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954557#comment-15954557 ] Hadoop QA commented on YARN-6403: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6406) Garbage Collect unused SchedulerRequestKeys

2017-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954339#comment-15954339 ] Hadoop QA commented on YARN-6406: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6432) FS preemption should reserve a node before considering containers on it for preemption

2017-04-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954486#comment-15954486 ] Miklos Szegedi commented on YARN-6432: -- YARN-5829 keeps pulling a previous version of the pull request

[jira] [Commented] (YARN-6406) Garbage Collect unused SchedulerRequestKeys

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954485#comment-15954485 ] Wangda Tan commented on YARN-6406: -- LGTM, +1. Thanks [~asuresh], will commit tomorrow. > Garbage Collect

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954403#comment-15954403 ] Hadoop QA commented on YARN-6344: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6432) FS preemption should reserve a node before considering containers on it for preemption

2017-04-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6432: - Attachment: YARN-6432.000.patch > FS preemption should reserve a node before considering

[jira] [Commented] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-04-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954530#comment-15954530 ] Miklos Szegedi commented on YARN-6384: -- Thank you, [~dengkai] for the clarification. Would it help, if

[jira] [Comment Edited] (YARN-6382) Address race condition on TimelineWriter.flush() caused by buffer-sized flush

2017-04-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954358#comment-15954358 ] Haibo Chen edited comment on YARN-6382 at 4/3/17 11:55 PM: --- Thanks for the nice

[jira] [Commented] (YARN-6382) Address race condition on TimelineWriter.flush() caused by buffer-sized flush

2017-04-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954358#comment-15954358 ] Haibo Chen commented on YARN-6382: -- Thanks for the nice summary [~jrottinghuis]! bq. This write causes

[jira] [Created] (YARN-6433) Only accessible cgroup mount directories should be selected for a controller

2017-04-03 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6433: Summary: Only accessible cgroup mount directories should be selected for a controller Key: YARN-6433 URL: https://issues.apache.org/jira/browse/YARN-6433 Project:

[jira] [Commented] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2017-04-03 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954431#comment-15954431 ] Sidharta Seethana commented on YARN-4757: - As per the comment above, It looks like the YARN-4757

[jira] [Updated] (YARN-6434) When setting environment variables, can't use comma for a list of value in key = value pairs.

2017-04-03 Thread Jaeboo Jeong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaeboo Jeong updated YARN-6434: --- Attachment: YARN-6434.001.patch > When setting environment variables, can't use comma for a list of

[jira] [Updated] (YARN-6433) Only accessible cgroup mount directories should be selected for a controller

2017-04-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6433: - Attachment: YARN-6433.000.patch > Only accessible cgroup mount directories should be selected for

[jira] [Commented] (YARN-6433) Only accessible cgroup mount directories should be selected for a controller

2017-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954542#comment-15954542 ] Hadoop QA commented on YARN-6433: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6245) Add FinalResource object to reduce overhead of Resource class instancing

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954489#comment-15954489 ] Wangda Tan commented on YARN-6245: -- yeah, so basically if there's any interacts to other processes like

[jira] [Updated] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-04-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6403: --- Attachment: YARN-6403.004.patch YARN-6403.branch-2.8.004.patch Thanks [~jlowe] for your

[jira] [Commented] (YARN-6432) FS preemption should reserve a node before considering containers on it for preemption

2017-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954532#comment-15954532 ] Hadoop QA commented on YARN-6432: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-6365) slsrun.sh creating random html directories

2017-04-03 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-6365: -- Assignee: Yufei Gu > slsrun.sh creating random html directories >

[jira] [Updated] (YARN-6381) FSAppAttempt has several variables that should be final

2017-04-03 Thread Ameet Zaveri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ameet Zaveri updated YARN-6381: --- Attachment: YARN-6381.001.patch > FSAppAttempt has several variables that should be final >

[jira] [Commented] (YARN-6245) Add FinalResource object to reduce overhead of Resource class instancing

2017-04-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954477#comment-15954477 ] Karthik Kambatla commented on YARN-6245: One other thing. The scheduler should probably only use

[jira] [Updated] (YARN-5703) ReservationAgents are not correctly configured

2017-04-03 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5703: Hadoop Flags: Reviewed > ReservationAgents are not correctly configured >

[jira] [Updated] (YARN-5703) ReservationAgents are not correctly configured

2017-04-03 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5703: Fix Version/s: 3.0.0-alpha3 2.8.1 > ReservationAgents are not correctly

[jira] [Commented] (YARN-5703) ReservationAgents are not correctly configured

2017-04-03 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954526#comment-15954526 ] Naganarasimha G R commented on YARN-5703: - Thanks [~bibindeve...@gmail.com], did not realize this

[jira] [Commented] (YARN-6382) Address race condition on TimelineWriter.flush() caused by buffer-sized flush

2017-04-03 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954009#comment-15954009 ] Joep Rottinghuis commented on YARN-6382: Thanks for pointing this out [~haibochen]. Yes, with

[jira] [Commented] (YARN-6109) Add an ability to convert ChildQueue to ParentQueue

2017-04-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954141#comment-15954141 ] Subru Krishnan commented on YARN-6109: -- Thanks [~xgong] for considering my feedback. I am OK with

[jira] [Commented] (YARN-6202) Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded

2017-04-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954140#comment-15954140 ] Haibo Chen commented on YARN-6202: -- Per offline discussion with Yufei, post to YARN-2917, AsyncDispatcher

[jira] [Updated] (YARN-6316) Provide help information and documentation for TimelineSchemaCreator

2017-04-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6316: - Attachment: YARN-6316.prelim.patch Update a preliminary patch for suggestion on unit test and help message

[jira] [Commented] (YARN-6402) Move 'Long Running Services' to an independent tab at top level for new Yarn UI

2017-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953457#comment-15953457 ] Hadoop QA commented on YARN-6402: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-04-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953639#comment-15953639 ] Eric Payne commented on YARN-5892: -- Thanks [~leftnoteasy] for your detailed review. I really appreciate

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953461#comment-15953461 ] Hadoop QA commented on YARN-5548: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6402) Move 'Long Running Services' to an independent tab at top level for new Yarn UI

2017-04-03 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-6402: --- Attachment: YARN-6402.0003.patch v3 patch. > Move 'Long Running Services' to an independent tab at top level

[jira] [Updated] (YARN-6402) Move 'Long Running Services' to an independent tab at top level for new Yarn UI

2017-04-03 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-6402: --- Attachment: YARN-6402.0002.patch v2 patch. Thanks [~sunilg] for the initial patch. > Move 'Long Running

[jira] [Commented] (YARN-6415) On YarnCommands page, "overrides" is written as "overwrites" in the Overview section

2017-04-03 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953380#comment-15953380 ] Gergely Novák commented on YARN-6415: - Uploaded trivial patches for trunk and branch-2.8. > On

[jira] [Updated] (YARN-6415) On YarnCommands page, "overrides" is written as "overwrites" in the Overview section

2017-04-03 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-6415: Attachment: YARN-6415.branch-2.8.001.patch YARN-6415.001.patch > On YarnCommands

[jira] [Commented] (YARN-6428) Queue AM limit is not honored in CS always

2017-04-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953405#comment-15953405 ] Bibin A Chundatt commented on YARN-6428: [~varun_saxena] Thank you for looking into the issue. The

[jira] [Commented] (YARN-6428) Queue AM limit is not honored in CS always

2017-04-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953360#comment-15953360 ] Varun Saxena commented on YARN-6428: Thanks [~bibinchundatt] for the patch. The said issue due to

[jira] [Assigned] (YARN-6415) On YarnCommands page, "overrides" is written as "overwrites" in the Overview section

2017-04-03 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák reassigned YARN-6415: --- Assignee: Gergely Novák > On YarnCommands page, "overrides" is written as "overwrites" in the

[jira] [Comment Edited] (YARN-6428) Queue AM limit is not honored in CS always

2017-04-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953405#comment-15953405 ] Bibin A Chundatt edited comment on YARN-6428 at 4/3/17 12:43 PM: -

[jira] [Comment Edited] (YARN-6428) Queue AM limit is not honored in CS always

2017-04-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953068#comment-15953068 ] Bibin A Chundatt edited comment on YARN-6428 at 4/3/17 12:44 PM: -

[jira] [Commented] (YARN-6366) Refactor the NodeManager DeletionService to support additional DeletionTask types.

2017-04-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953705#comment-15953705 ] Shane Kumpf commented on YARN-6366: --- Fixing unnecessary import reorgs. > Refactor the NodeManager

[jira] [Commented] (YARN-6366) Refactor the NodeManager DeletionService to support additional DeletionTask types.

2017-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953768#comment-15953768 ] Hadoop QA commented on YARN-6366: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-04-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953800#comment-15953800 ] Miklos Szegedi commented on YARN-5829: -- I think Jenkins got confused on the pull request. The patch

[jira] [Updated] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-04-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5829: - Attachment: YARN-5829.002.patch Retrying the same patch. Hopefully it gets selected this time. >

[jira] [Commented] (YARN-6366) Refactor the NodeManager DeletionService to support additional DeletionTask types.

2017-04-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953780#comment-15953780 ] Shane Kumpf commented on YARN-6366: --- The two remaining checkstyle issues are due to several test methods

[jira] [Updated] (YARN-6405) Verify the configuration for yarn-native-services works

2017-04-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6405: -- Attachment: YARN-6405.yarn-native-services.01.patch POC patch to run through jenkins, will give more details on

[jira] [Updated] (YARN-6366) Refactor the NodeManager DeletionService to support additional DeletionTask types.

2017-04-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-6366: -- Attachment: YARN-6366.004.patch > Refactor the NodeManager DeletionService to support additional

[jira] [Commented] (YARN-6405) Verify the configuration for yarn-native-services works

2017-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953763#comment-15953763 ] Hadoop QA commented on YARN-6405: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953861#comment-15953861 ] Wangda Tan commented on YARN-5952: -- [~jhung], it seems we were committing this at the same time, could you

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953876#comment-15953876 ] Wangda Tan commented on YARN-5892: -- [~eepayne], bq. I think it's good to allow setting user weights at

[jira] [Commented] (YARN-6245) Add FinalResource object to reduce overhead of Resource class instancing

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953885#comment-15953885 ] Wangda Tan commented on YARN-6245: -- [~roniburd], All your suggestions make sense to me. In addition to

[jira] [Commented] (YARN-6406) Garbage Collect unused SchedulerRequestKeys

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953889#comment-15953889 ] Wangda Tan commented on YARN-6406: -- bq. I think the right approach is to fix the test case (which might be

[jira] [Commented] (YARN-5568) Fix issues Rumen to SLS converter

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953906#comment-15953906 ] Wangda Tan commented on YARN-5568: -- I don't have bandwidth to finish it now, unassigned myself, please

[jira] [Assigned] (YARN-5568) Fix issues Rumen to SLS converter

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-5568: Assignee: (was: Wangda Tan) > Fix issues Rumen to SLS converter >

[jira] [Commented] (YARN-6428) Queue AM limit is not honored in CS always

2017-04-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953940#comment-15953940 ] Bibin A Chundatt commented on YARN-6428: {{DefaultResourceCalculator}} any idea why {{0.5}} is

[jira] [Created] (YARN-6430) Better unit test coverage required for SLS

2017-04-03 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-6430: Summary: Better unit test coverage required for SLS Key: YARN-6430 URL: https://issues.apache.org/jira/browse/YARN-6430 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-6109) Add an ability to convert ChildQueue to ParentQueue

2017-04-03 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953971#comment-15953971 ] Xuan Gong commented on YARN-6109: - Have created a separate ticket

[jira] [Commented] (YARN-6109) Add an ability to convert ChildQueue to ParentQueue

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953834#comment-15953834 ] Wangda Tan commented on YARN-6109: -- Agree [~xgong], if no opposite opinions, I will commit the patch

[jira] [Comment Edited] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953870#comment-15953870 ] Wangda Tan edited comment on YARN-5952 at 4/3/17 5:24 PM: -- [~jhung], what I did is

[jira] [Commented] (YARN-5366) Add support for toggling the removal of completed and failed docker containers

2017-04-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953872#comment-15953872 ] Shane Kumpf commented on YARN-5366: --- Thanks [~vinodkv]! Responses below. {quote} Signal.QUIT handling is

[jira] [Assigned] (YARN-5067) Support specifying resources for AM containers in SLS

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-5067: Assignee: Yufei Gu (was: Wangda Tan) > Support specifying resources for AM containers in SLS >

[jira] [Created] (YARN-6431) make DELETE/STOP/CONVERT queues work in reservation system

2017-04-03 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-6431: --- Summary: make DELETE/STOP/CONVERT queues work in reservation system Key: YARN-6431 URL: https://issues.apache.org/jira/browse/YARN-6431 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954000#comment-15954000 ] Hadoop QA commented on YARN-5829: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6202) Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded

2017-04-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953830#comment-15953830 ] Haibo Chen commented on YARN-6202: -- AsyncDispatcher are also used in a lot of other tests besides MockRM,

[jira] [Updated] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-04-03 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-5952: Fix Version/s: YARN-5734 > Create REST API for changing YARN scheduler configurations >

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-04-03 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953864#comment-15953864 ] Jonathan Hung commented on YARN-5952: - Oh, sorry about that. I'll remove my commit and do a force push.

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953870#comment-15953870 ] Wangda Tan commented on YARN-5952: -- [~jhung], what I did is a force push. So please check if you need to

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-04-03 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953877#comment-15953877 ] Jonathan Hung commented on YARN-5952: - Thanks [~leftnoteasy], everything looks fine. > Create REST API

[jira] [Commented] (YARN-5067) Support specifying resources for AM containers in SLS

2017-04-03 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953910#comment-15953910 ] Yufei Gu commented on YARN-5067: Thanks, [~wangda]! > Support specifying resources for AM containers in

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953961#comment-15953961 ] Wangda Tan commented on YARN-6363: -- [~curino], If it is not change with causes possible compatible

[jira] [Commented] (YARN-6430) Better unit test coverage required for SLS

2017-04-03 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953967#comment-15953967 ] Yufei Gu commented on YARN-6430: Totally agree! YARN-5654 parameterized unit tests TestAMSimulator and

[jira] [Commented] (YARN-6424) TimelineCollector is not stopped when an app finishes in RM

2017-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953990#comment-15953990 ] Vrushali C commented on YARN-6424: -- Thanks [~varun_saxena]. No, we don't need to make more changes. Let's

[jira] [Created] (YARN-6428) Queue AM limit is not honoured in cs

2017-04-03 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-6428: -- Summary: Queue AM limit is not honoured in cs Key: YARN-6428 URL: https://issues.apache.org/jira/browse/YARN-6428 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-6428) Queue AM limit is not honored in cs

2017-04-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6428: --- Summary: Queue AM limit is not honored in cs (was: Queue AM limit is not honoured in cs )

[jira] [Commented] (YARN-6428) Queue AM limit is not honored in cs

2017-04-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953068#comment-15953068 ] Bibin A Chundatt commented on YARN-6428: {{ResourceCalculator#multiplyAndNormalizeUp}} using double

[jira] [Updated] (YARN-6428) Queue AM limit is not honored in cs

2017-04-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6428: --- Attachment: YARN-6428.0001.patch Attaching patch for the same > Queue AM limit is not honored

[jira] [Updated] (YARN-6428) Queue AM limit is not honored in CS always

2017-04-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6428: --- Summary: Queue AM limit is not honored in CS always (was: Queue AM limit is not honored in

[jira] [Commented] (YARN-6424) TimelineCollector is not stopped when an app finishes in RM

2017-04-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953854#comment-15953854 ] Haibo Chen commented on YARN-6424: -- Agree with [~varun_saxena] on that it should be an

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-04-03 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953856#comment-15953856 ] Jonathan Hung commented on YARN-5952: - Thanks [~leftnoteasy] and [~xgong] for reviews, committed this

[jira] [Comment Edited] (YARN-5366) Add support for toggling the removal of completed and failed docker containers

2017-04-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953872#comment-15953872 ] Shane Kumpf edited comment on YARN-5366 at 4/3/17 5:25 PM: --- Thanks [~vinodkv]!

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953879#comment-15953879 ] Wangda Tan commented on YARN-5952: -- [~jhung], cool thx. > Create REST API for changing YARN scheduler

[jira] [Commented] (YARN-6406) Garbage Collect unused SchedulerRequestKeys

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953895#comment-15953895 ] Wangda Tan commented on YARN-6406: -- Filed YARN-6429 and will work on that once this patch is done. >

[jira] [Created] (YARN-6429) Revisit implementation of LocalitySchedulingPlacementSet to avoid invoke methods of AppSchedulingInfo

2017-04-03 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-6429: Summary: Revisit implementation of LocalitySchedulingPlacementSet to avoid invoke methods of AppSchedulingInfo Key: YARN-6429 URL: https://issues.apache.org/jira/browse/YARN-6429

[jira] [Commented] (YARN-5067) Support specifying resources for AM containers in SLS

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953903#comment-15953903 ] Wangda Tan commented on YARN-5067: -- [~yufeigu], it's yours now :). > Support specifying resources for AM

[jira] [Resolved] (YARN-4900) SLS MRAMSimulator should include scheduledMappers/Reducers when re-request failed tasks

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-4900. -- Resolution: Duplicate This one is resolved with YARN-4779, we don't need to do anything here. > SLS

[jira] [Comment Edited] (YARN-6428) Queue AM limit is not honored in CS always

2017-04-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953940#comment-15953940 ] Bibin A Chundatt edited comment on YARN-6428 at 4/3/17 6:18 PM:

[jira] [Commented] (YARN-6202) Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded

2017-04-03 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953948#comment-15953948 ] Yufei Gu commented on YARN-6202: It won't hide code bugs since the unit tests won't pass if AsyncDispatcher

[jira] [Commented] (YARN-6430) Better unit test coverage required for SLS

2017-04-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953979#comment-15953979 ] Wangda Tan commented on YARN-6430: -- [~yufeigu], yeah, in addition to that, we need better end-to-end unit

  1   2   >