[jira] [Comment Edited] (YARN-7406) Moving logging APIs over to slf4j in hadoop-yarn-api

2017-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245217#comment-16245217 ] Bibin A Chundatt edited comment on YARN-7406 at 11/9/17 9:25 AM: - [~Cyl]

[jira] [Commented] (YARN-7452) Decommissioning node: NaN issue

2017-11-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245431#comment-16245431 ] Sunil G commented on YARN-7452: --- Patch looks straight forward. Committing shortly if no objections. >

[jira] [Updated] (YARN-7452) Decommissioning node: NaN issue

2017-11-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7452: -- Priority: Trivial (was: Major) > Decommissioning node: NaN issue > --- > >

[jira] [Updated] (YARN-6918) Remove acls after queue delete to avoid memory leak

2017-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6918: --- Description: Acl for deleted queue need to removed from allAcls to avoid leak

[jira] [Commented] (YARN-7445) Render filters on Applications and Services page

2017-11-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245427#comment-16245427 ] Sunil G commented on YARN-7445: --- Patch looks fine to me. [~vasduevanskm], Progress column has a rendering

[jira] [Commented] (YARN-7406) Moving logging APIs over to slf4j in hadoop-yarn-api

2017-11-09 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245506#comment-16245506 ] Akira Ajisaka commented on YARN-7406: - bq. Thoughts on adding marker for fatal The marker does not work

[jira] [Comment Edited] (YARN-6918) Remove acls after queue delete to avoid memory leak

2017-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240602#comment-16240602 ] Bibin A Chundatt edited comment on YARN-6918 at 11/9/17 9:05 AM: -

[jira] [Commented] (YARN-5366) Improve handling of the Docker container life cycle

2017-11-09 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245588#comment-16245588 ] Shane Kumpf commented on YARN-5366: --- I've updated the title and description of the issue to better

[jira] [Updated] (YARN-5366) Improve handling of the Docker container life cycle

2017-11-09 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-5366: -- Summary: Improve handling of the Docker container life cycle (was: Add support for toggling the removal

[jira] [Updated] (YARN-5366) Improve handling of the Docker container life cycle

2017-11-09 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-5366: -- Description: There are several paths that need to be improved with regard to the Docker container

[jira] [Updated] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-11-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6909: -- Attachment: YARN-6909.006.patch Fixing test cases > The performance advantages of YARN-6679 are lost when

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246084#comment-16246084 ] Sunil G commented on YARN-7119: --- Looks good in general. I will wait for couple of days for other folks also

[jira] [Commented] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246123#comment-16246123 ] Sunil G commented on YARN-7330: --- Thank you, I am checking this and will share my comments if any. > Add

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246122#comment-16246122 ] Robert Kanter commented on YARN-7388: - +1 LGTM > TestAMRestart should be scheduler agnostic >

[jira] [Updated] (YARN-6078) Containers stuck in Localizing state

2017-11-09 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6078: - Target Version/s: 3.1.0, 2.9.1 > Containers stuck in Localizing state >

[jira] [Updated] (YARN-6232) Update resource usage and preempted resource calculations to take into account all resource types

2017-11-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6232: - Fix Version/s: 3.0.0 Updating the fix version since this was committed to branch-3.0 at some point. >

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246038#comment-16246038 ] Eric Yang commented on YARN-7430: - [~ebadger] My understanding is the container stderr, stdout are

[jira] [Updated] (YARN-7455) quote_and_append_arg can overflow buffer

2017-11-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7455: - Summary: quote_and_append_arg can overflow buffer (was: add_mounts can overrun temporary buffer) The

[jira] [Commented] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246131#comment-16246131 ] Yufei Gu commented on YARN-7143: Thanks for the patch. The findbug issue isn't introduced by the path. +1.

[jira] [Commented] (YARN-7454) RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double lookup

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245911#comment-16245911 ] Hudson commented on YARN-7454: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13210 (See

[jira] [Updated] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-11-09 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7466: Attachment: YARN-7466.001.patch Changed the default value of {{allocatonRequestId}} to -1 in

[jira] [Updated] (YARN-7454) RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double lookup

2017-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-7454: --- Fix Version/s: (was: 3.1.0) > RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to

[jira] [Commented] (YARN-5366) Improve handling of the Docker container life cycle

2017-11-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246006#comment-16246006 ] Eric Badger commented on YARN-5366: --- Hey [~shaneku...@gmail.com], thanks for the response. I have a few

[jira] [Updated] (YARN-7454) RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double lookup

2017-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-7454: --- Fix Version/s: 3.1.0 > RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double

[jira] [Comment Edited] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-11-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246068#comment-16246068 ] Sunil G edited comment on YARN-6909 at 11/9/17 5:08 PM: Thanks [~leftnoteasy].

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-11-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246083#comment-16246083 ] Sunil G commented on YARN-7159: --- Thanks. I am good with latest patch. [~leftnoteasy] [~templedf], any

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246313#comment-16246313 ] Arun Suresh commented on YARN-1015: --- I am fine with approach of the patch - but do give me a day or so to

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-11-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246329#comment-16246329 ] Jian He commented on YARN-7466: --- lgtm, committing soon > ResourceRequest has a different default for

[jira] [Commented] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246351#comment-16246351 ] Miklos Szegedi commented on YARN-7460: -- Thank you for the patch [~haibochen]. The callers are

[jira] [Commented] (YARN-7453) Fix issue where RM fails to switch to active after first successful start

2017-11-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246371#comment-16246371 ] Subru Krishnan commented on YARN-7453: -- Thanks [~rohithsharma], [~jhung], [~asuresh], [~leftnoteasy],

[jira] [Updated] (YARN-7205) Log improvements for the ResourceUtils

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7205: --- Fix Version/s: 3.0.0 Backported into branch-3.0 > Log improvements for the ResourceUtils >

[jira] [Created] (YARN-7467) FSLeafQueue unnecessarily calls ComputeFairShares.computeShare() to calculate fair share for apps

2017-11-09 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7467: -- Summary: FSLeafQueue unnecessarily calls ComputeFairShares.computeShare() to calculate fair share for apps Key: YARN-7467 URL: https://issues.apache.org/jira/browse/YARN-7467

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246308#comment-16246308 ] Miklos Szegedi commented on YARN-7337: -- Thank you for the patch [~haibochen]. {code} 168* Get

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246310#comment-16246310 ] Hudson commented on YARN-7388: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13212 (See

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246410#comment-16246410 ] Subru Krishnan commented on YARN-6128: -- Thanks [~botong] for addressing my comments, the latest patch

[jira] [Commented] (YARN-7465) start-yarn.sh fails to start ResourceManager unless running as root

2017-11-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246273#comment-16246273 ] Andrew Wang commented on YARN-7465: --- +1 thanks Sean! > start-yarn.sh fails to start ResourceManager

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246296#comment-16246296 ] Haibo Chen commented on YARN-7388: -- [~subru] Let me know if it is still ok to cherry-pick this into 2.9.0.

[jira] [Commented] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246360#comment-16246360 ] Hadoop QA commented on YARN-7143: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246403#comment-16246403 ] Daniel Templeton commented on YARN-7143: Nevermind on the branch-3.0 patch. Backporting YARN-7205

[jira] [Updated] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7143: --- Attachment: YARN-7143.branch-3.0.001.patch Here's a branch-3.0 patch. > FileNotFound handling

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246247#comment-16246247 ] Haibo Chen commented on YARN-7388: -- Thanks [~rkanter] for the review. Will commit it shortly >

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246305#comment-16246305 ] Daniel Templeton commented on YARN-7442: Seems a fine idea, [~andrew.wang]. I'm generally OK with

[jira] [Comment Edited] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246305#comment-16246305 ] Daniel Templeton edited comment on YARN-7442 at 11/9/17 7:10 PM: - Seems a

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246336#comment-16246336 ] Daniel Templeton commented on YARN-7461: Just noticed that this patch is assuming that if the rhs

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246270#comment-16246270 ] Miklos Szegedi commented on YARN-1015: -- [~asuresh], do you have more comments on this patch?

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246269#comment-16246269 ] Andrew Wang commented on YARN-7442: --- Hey, is this JIRA moving forwards? It's our last blocker for GA. Is

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246266#comment-16246266 ] Hadoop QA commented on YARN-7466: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246323#comment-16246323 ] Wangda Tan commented on YARN-7442: -- [~templedf], I agree with the simplified version, except one minor

[jira] [Updated] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7442: - Attachment: YARN-7442.001.patch Attached ver.1 patch, [~templedf] could u please review? > [YARN-7069]

[jira] [Updated] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7143: --- Attachment: YARN-7143.branch-3.0.002.patch Here's a functional branch-3.0 patch >

[jira] [Commented] (YARN-7458) TestContainerManagerSecurity is still flakey

2017-11-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246253#comment-16246253 ] Robert Kanter commented on YARN-7458: - Thanks [~templedf] and [~jlowe] > TestContainerManagerSecurity

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246282#comment-16246282 ] Wangda Tan commented on YARN-7442: -- [~andrew.wang], I will start it now and hopefully finish it by this

[jira] [Updated] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7413: --- Labels: ready-to-commit (was: ) > Support resource type in SLS >

[jira] [Commented] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246340#comment-16246340 ] Hadoop QA commented on YARN-6909: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246339#comment-16246339 ] Daniel Templeton commented on YARN-7413: LGTM +1 > Support resource type in SLS >

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246375#comment-16246375 ] Daniel Templeton commented on YARN-7442: Oh, crap, you're right. Redo:

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246376#comment-16246376 ] Subru Krishnan commented on YARN-7388: -- [~haibo.chen], thanks for fixing this and [~rkanter] for the

[jira] [Commented] (YARN-7386) Duplicate Strings in various places in Yarn memory

2017-11-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246413#comment-16246413 ] Robert Kanter commented on YARN-7386: - {{TestSubmitApplicationWithRMHA}} time out is unrelated

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246485#comment-16246485 ] Wangda Tan commented on YARN-7437: -- The failed unit test is not related to the patch. > Give

[jira] [Commented] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246488#comment-16246488 ] Wangda Tan commented on YARN-6909: -- Patch looks good, will commit by end of today if no opposite opinions.

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246563#comment-16246563 ] Haibo Chen commented on YARN-7388: -- Sounds good. Thanks for the update! > TestAMRestart should be

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246561#comment-16246561 ] Wangda Tan commented on YARN-7442: -- Thanks [~templedf], Will address #1/#2. And regarding to the doc,

[jira] [Created] (YARN-7468) Provide means for container network policy control

2017-11-09 Thread Clay B. (JIRA)
Clay B. created YARN-7468: - Summary: Provide means for container network policy control Key: YARN-7468 URL: https://issues.apache.org/jira/browse/YARN-7468 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-09 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246500#comment-16246500 ] Konstantinos Karanasos commented on YARN-7437: -- Yeah, was checking it now, committing. > Give

[jira] [Commented] (YARN-7386) Duplicate Strings in various places in Yarn memory

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246587#comment-16246587 ] Hudson commented on YARN-7386: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13213 (See

[jira] [Commented] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246585#comment-16246585 ] Hudson commented on YARN-7143: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13213 (See

[jira] [Commented] (YARN-6595) [API] Add Placement Constraints at the application level

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246517#comment-16246517 ] Wangda Tan commented on YARN-6595: -- [~asuresh], thanks for the patch. Could you add javadocs with examples

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246565#comment-16246565 ] Daniel Templeton commented on YARN-7442: Seems like a good enough reason. > [YARN-7069] Limit

[jira] [Commented] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246574#comment-16246574 ] Haibo Chen commented on YARN-7460: -- This is so that read of the container numbers does not need to grab a

[jira] [Commented] (YARN-7437) Rename PlacementSet and SchedulingPlacementSet

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246588#comment-16246588 ] Hudson commented on YARN-7437: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13213 (See

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246586#comment-16246586 ] Hudson commented on YARN-7413: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13213 (See

[jira] [Commented] (YARN-7369) Improve the resource types docs

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246651#comment-16246651 ] Daniel Templeton commented on YARN-7369: Thanks. I'll commit it along with YARN-7442. > Improve

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246647#comment-16246647 ] Daniel Templeton commented on YARN-7442: LGTM, +1 pending Jenkins. > [YARN-7069] Limit format of

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246483#comment-16246483 ] Hadoop QA commented on YARN-7437: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7442: - Attachment: YARN-7442.002.patch Attached ver.2 patch using latest pattern from Daniel. > [YARN-7069]

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-11-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246522#comment-16246522 ] Subru Krishnan commented on YARN-7466: -- FWIW, +1 from my side too. Thanks [~csingh]/[~jianhe]. >

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246528#comment-16246528 ] Daniel Templeton commented on YARN-7442: Thanks, [~leftnoteasy]. Two comments: #

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246571#comment-16246571 ] Haibo Chen commented on YARN-7337: -- Thanks for the review, [~miklos.szeg...@cloudera.com]. bq. naming a

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246580#comment-16246580 ] Daniel Templeton commented on YARN-7442: I updated YARN-7369. Wanna review it so we can get it

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246610#comment-16246610 ] Yufei Gu commented on YARN-7413: Committed to branch-3.0. > Support resource type in SLS >

[jira] [Commented] (YARN-7468) Provide means for container network policy control

2017-11-09 Thread Clay B. (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246626#comment-16246626 ] Clay B. commented on YARN-7468: --- For the driving use-case, I run secure clusters (secured on the inside to

[jira] [Commented] (YARN-5422) ContainerLocalizer log should be logged in separate log file.

2017-11-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1624#comment-1624 ] Junping Du commented on YARN-5422: -- CC [~suma.shivaprasad]. Suma, does your previous work of separating

[jira] [Updated] (YARN-7437) Rename PlacementSet and SchedulingPlacementSet

2017-11-09 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-7437: - Summary: Rename PlacementSet and SchedulingPlacementSet (was: Give

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246529#comment-16246529 ] Yufei Gu commented on YARN-7413: Thanks for the review and commit, [~templedf]! > Support resource type in

[jira] [Updated] (YARN-7369) Improve the resource types docs

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7369: --- Attachment: YARN-7369.004.patch Updated to reflect YARN-7442, > Improve the resource types

[jira] [Commented] (YARN-6505) Define the strings used in SLS JSON input file format

2017-11-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246606#comment-16246606 ] Yufei Gu commented on YARN-6505: Committed to branch-3.0 > Define the strings used in SLS JSON input file

[jira] [Updated] (YARN-6505) Define the strings used in SLS JSON input file format

2017-11-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6505: --- Fix Version/s: 3.0.0 > Define the strings used in SLS JSON input file format >

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246630#comment-16246630 ] Hadoop QA commented on YARN-7442: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7369) Improve the resource types docs

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246636#comment-16246636 ] Wangda Tan commented on YARN-7369: -- +1 for the latest patch. > Improve the resource types docs >

[jira] [Commented] (YARN-7437) Rename PlacementSet and SchedulingPlacementSet

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246614#comment-16246614 ] Wangda Tan commented on YARN-7437: -- Thanks [~kkaranasos]/[~asuresh]/[~subru] for review and commit! >

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246618#comment-16246618 ] Daniel Templeton commented on YARN-7413: The patch didn't apply for me on branch-3.0. How did you

[jira] [Commented] (YARN-7080) TestSubmitApplicationWithRMHA times out

2017-11-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246628#comment-16246628 ] Jason Lowe commented on YARN-7080: -- I think this may be essentially a duplicate of YARN-6647. I've seen

[jira] [Updated] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7442: - Attachment: YARN-7442.003.patch Attached ver.3 patch. > [YARN-7069] Limit format of resource type name >

[jira] [Updated] (YARN-7413) Support resource type in SLS

2017-11-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7413: --- Fix Version/s: 3.0.0 > Support resource type in SLS > > > Key:

[jira] [Updated] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7469: - Attachment: UnitTestToShowStarvedUser.patch Uploading a unit test that demonstrates this. > Capacity

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246731#comment-16246731 ] Daniel Templeton commented on YARN-7119: I have just a few comments: # The new public methods in

[jira] [Commented] (YARN-6078) Containers stuck in Localizing state

2017-11-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246713#comment-16246713 ] Junping Du commented on YARN-6078: -- Thanks [~billie.rinaldi] for updating the patch! A quick question

[jira] [Updated] (YARN-6909) Use LightWeightedResource when number of resource types more than two

2017-11-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6909: - Summary: Use LightWeightedResource when number of resource types more than two (was: The performance

[jira] [Commented] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246750#comment-16246750 ] Hadoop QA commented on YARN-7442: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246789#comment-16246789 ] Haibo Chen commented on YARN-7337: -- That sounds good to me. Will address it in the next patch. > Expose

  1   2   >