[jira] [Commented] (YARN-6958) Moving logging APIs over to slf4j in hadoop-yarn-server-timelineservice

2017-08-08 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119441#comment-16119441 ] Yeliang Cang commented on YARN-6958: Submit patch002 to remove LOG in TimelineStorageUtils.java. >

[jira] [Commented] (YARN-6971) Clean up different ways to create resources

2017-08-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119442#comment-16119442 ] Sunil G commented on YARN-6971: --- Post YARN-6775, we use SimpleResource for Resource.newInstance(). So for all

[jira] [Updated] (YARN-6958) Moving logging APIs over to slf4j in hadoop-yarn-server-timelineservice

2017-08-08 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-6958: --- Attachment: YARN-6958.002.patch > Moving logging APIs over to slf4j in

[jira] [Commented] (YARN-6033) Add support for sections in container-executor configuration file

2017-08-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119438#comment-16119438 ] Sunil G commented on YARN-6033: --- I am fine with latest patch. Thanks. > Add support for sections in

[jira] [Commented] (YARN-3254) HealthReport should include disk full information

2017-08-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119415#comment-16119415 ] Sunil G commented on YARN-3254: --- Thanks [~suma.shivaprasad] Latest patch seems fine to me. I will commit the

[jira] [Updated] (YARN-3254) HealthReport should include disk full information

2017-08-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3254: -- Fix Version/s: (was: 3.0.0-beta1) > HealthReport should include disk full information >

[jira] [Commented] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-08-08 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119366#comment-16119366 ] Yuqi Wang commented on YARN-6959: - Anyway, as YARN-5197, executing a double check to avoid potential race

[jira] [Comment Edited] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-08-08 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119337#comment-16119337 ] Yuqi Wang edited comment on YARN-6959 at 8/9/17 2:47 AM: - Attach RM log for this

[jira] [Comment Edited] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-08-08 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119337#comment-16119337 ] Yuqi Wang edited comment on YARN-6959 at 8/9/17 2:46 AM: - Attach RM log for this

[jira] [Updated] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-08-08 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqi Wang updated YARN-6959: Attachment: YARN-6959.yarn_rm.log.zip RM log for this bug. > RM may allocate wrong AM Container for new

[jira] [Commented] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-08-08 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119334#comment-16119334 ] Yuqi Wang commented on YARN-6959: - [~jianhe] Reproduce the race condition during below segment pipeline of

[jira] [Commented] (YARN-6885) AllocationFileLoaderService.loadQueue() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-08 Thread Yu-Tang Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119322#comment-16119322 ] Yu-Tang Lin commented on YARN-6885: --- I noticed that reloadAllocations had the similar code, both will be

[jira] [Commented] (YARN-6967) Limit application attempt's diagnostic message size thoroughly

2017-08-08 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119291#comment-16119291 ] Chengbing Liu commented on YARN-6967: - Hi [~templedf], I don't think the message will be any longer. In

[jira] [Commented] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-08-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119277#comment-16119277 ] Miklos Szegedi commented on YARN-6852: -- +1 (non-binding) Thanks for the latest patch [~wangda]. >

[jira] [Comment Edited] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs

2017-08-08 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119263#comment-16119263 ] Carlo Curino edited comment on YARN-6896 at 8/9/17 12:57 AM: - Thaks

[jira] [Commented] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs

2017-08-08 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119263#comment-16119263 ] Carlo Curino commented on YARN-6896: Thaks [~giovanni.fumarola] for the contribution. Yetus seems

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119232#comment-16119232 ] Rohith Sharma K S commented on YARN-6820: - thanks for the patch! quick nit on the patch. #

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119227#comment-16119227 ] Hadoop QA commented on YARN-6820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6789) new api to get all supported resources from RM

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119174#comment-16119174 ] Hadoop QA commented on YARN-6789: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6133) [ATSv2 Security] Renew delegation token for app automatically if an app collector is active

2017-08-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119168#comment-16119168 ] Jian He commented on YARN-6133: --- lgtm overall, minor comments: - log the new expiration time also ? in case

[jira] [Commented] (YARN-6323) Rolling upgrade/config change is broken on timeline v2.

2017-08-08 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119165#comment-16119165 ] Vrushali C commented on YARN-6323: -- Any thoughts on this [~rohithsharma] [~varun_saxena] [~haibo.chen] >

[jira] [Commented] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-08-08 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119164#comment-16119164 ] Ravi Prakash commented on YARN-6054: Sure Junping! I took the liberty of cherry-picking the change into

[jira] [Updated] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-08-08 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated YARN-6054: --- Fix Version/s: 2.8.2 > TimelineServer fails to start when some LevelDb state files are missing. >

[jira] [Updated] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-08-08 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated YARN-6054: --- Target Version/s: 2.9.0, 2.8.2 (was: 2.9.0) > TimelineServer fails to start when some LevelDb state

[jira] [Updated] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-08 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6820: - Attachment: YARN-6820-YARN-5355.003.patch Attaching patch 003 that addresses the review suggestions. -

[jira] [Assigned] (YARN-6466) Provide shaded framework jar for containers

2017-08-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-6466: Assignee: Haibo Chen > Provide shaded framework jar for containers >

[jira] [Commented] (YARN-6956) preemption may only consider resource requests for one node

2017-08-08 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119135#comment-16119135 ] Steven Rand commented on YARN-6956: --- Hi [~kasha], thanks for the suggestions. I would definitely like to

[jira] [Updated] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-08-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6054: - Priority: Critical (was: Major) > TimelineServer fails to start when some LevelDb state files are

[jira] [Commented] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-08-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119128#comment-16119128 ] Junping Du commented on YARN-6054: -- We actually hit this problem recently. Bump up to Critical as the

[jira] [Updated] (YARN-6970) Add PoolInitializationException as retriable exception in FederationFacade

2017-08-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6970: - Component/s: federation > Add PoolInitializationException as retriable exception in

[jira] [Commented] (YARN-6550) Capture launch_container.sh logs

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119069#comment-16119069 ] Hadoop QA commented on YARN-6550: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6892) Improve API implementation in Resources and DominantResourceCalculator in align to ResourceInformation

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119066#comment-16119066 ] Hadoop QA commented on YARN-6892: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6974) Make CuratorBasedElectorService the default

2017-08-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6974: --- Priority: Critical (was: Major) > Make CuratorBasedElectorService the default >

[jira] [Commented] (YARN-6974) Make CuratorBasedElectorService the default

2017-08-08 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119054#comment-16119054 ] Robert Kanter commented on YARN-6974: - [~jianhe], have you tried out the

[jira] [Created] (YARN-6974) Make CuratorBasedElectorService the default

2017-08-08 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-6974: --- Summary: Make CuratorBasedElectorService the default Key: YARN-6974 URL: https://issues.apache.org/jira/browse/YARN-6974 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-6892) Improve API implementation in Resources and DominantResourceCalculator in align to ResourceInformation

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119043#comment-16119043 ] Hadoop QA commented on YARN-6892: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6970) Add PoolInitializationException as retriable exception in FederationFacade

2017-08-08 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119039#comment-16119039 ] Giovanni Matteo Fumarola commented on YARN-6970: {{SQLException}} in

[jira] [Created] (YARN-6973) Adding RM Cluster Id in ApplicationReport

2017-08-08 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-6973: -- Summary: Adding RM Cluster Id in ApplicationReport Key: YARN-6973 URL: https://issues.apache.org/jira/browse/YARN-6973 Project: Hadoop YARN

[jira] [Commented] (YARN-6970) Add PoolInitializationException as retriable exception in FederationFacade

2017-08-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119026#comment-16119026 ] Subru Krishnan commented on YARN-6970: -- Thanks [~giovanni.fumarola] for contributing the patch. IIRC,

[jira] [Updated] (YARN-6550) Capture launch_container.sh logs

2017-08-08 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-6550: --- Attachment: YARN-6550.003.patch Attached patch with review comments addressed. These are the

[jira] [Updated] (YARN-6972) Adding RM ClusterId in AppInfo

2017-08-08 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6972: --- Summary: Adding RM ClusterId in AppInfo (was: Adding SubClusterId in AppInfo)

[jira] [Commented] (YARN-6033) Add support for sections in container-executor configuration file

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119013#comment-16119013 ] Hadoop QA commented on YARN-6033: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6970) Add PoolInitializationException as retriable exception in FederationFacade

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119009#comment-16119009 ] Hadoop QA commented on YARN-6970: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6972) Adding SubClusterId in AppInfo

2017-08-08 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-6972: -- Summary: Adding SubClusterId in AppInfo Key: YARN-6972 URL: https://issues.apache.org/jira/browse/YARN-6972 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2017-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118999#comment-16118999 ] ASF GitHub Bot commented on YARN-6668: -- Github user szegedim closed the pull request at:

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118998#comment-16118998 ] Hadoop QA commented on YARN-6668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6897) Refactoring RMWebServices by moving some util methods to RMWebAppUtil

2017-08-08 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118987#comment-16118987 ] Giovanni Matteo Fumarola commented on YARN-6897: I just run the 4 failed tests in my dev

[jira] [Updated] (YARN-6879) TestLeafQueue.testDRFUserLimits() has commented out code

2017-08-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6879: --- Affects Version/s: 2.8.1 > TestLeafQueue.testDRFUserLimits() has commented out code >

[jira] [Updated] (YARN-6668) Use cgroup to get container resource utilization

2017-08-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6668: - Attachment: YARN-6668.007.patch I rebased the patch on top of trunk instead of YARN-1011 > Use

[jira] [Commented] (YARN-6471) Support to add min/max resource configuration for a queue

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118980#comment-16118980 ] Hadoop QA commented on YARN-6471: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6892) Improve API implementation in Resources and DominantResourceCalculator in align to ResourceInformation

2017-08-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118970#comment-16118970 ] Wangda Tan commented on YARN-6892: -- Rekicked Jenkins, [~sunilg], looked at the patch again, the biggest

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118972#comment-16118972 ] Hadoop QA commented on YARN-6964: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6897) Refactoring RMWebServices by moving some util methods to RMWebAppUtil

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118968#comment-16118968 ] Hadoop QA commented on YARN-6897: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6970) Add PoolInitializationException as retriable exception in FederationFacade

2017-08-08 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6970: --- Description: During an execution we found that Hikari can throw a

[jira] [Updated] (YARN-6970) Add PoolInitializationException as retriable exception in FederationFacade

2017-08-08 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6970: --- Attachment: YARN-6970.v1.patch > Add PoolInitializationException as retriable

[jira] [Commented] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118959#comment-16118959 ] Hadoop QA commented on YARN-6896: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6033) Add support for sections in container-executor configuration file

2017-08-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6033: - Attachment: YARN-6033.014.patch Rebased after commit of YARN-6726. (014) > Add support for sections in

[jira] [Created] (YARN-6971) Clean up different ways to create resources

2017-08-08 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6971: -- Summary: Clean up different ways to create resources Key: YARN-6971 URL: https://issues.apache.org/jira/browse/YARN-6971 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-08-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6726: - Fix Version/s: 3.0.0-beta1 > Fix issues with docker commands executed by container-executor >

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-08-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118939#comment-16118939 ] Wangda Tan commented on YARN-6726: -- Committed to trunk, thanks [~shaneku...@gmail.com] and thanks reviews

[jira] [Updated] (YARN-6971) Clean up different ways to create resources

2017-08-08 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6971: --- Description: There are several ways to create a {{resource}} object, e.g., BuilderUtils.newResource() and

[jira] [Created] (YARN-6970) Add PoolInitializationException as retriable exception in FederationFacade

2017-08-08 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-6970: -- Summary: Add PoolInitializationException as retriable exception in FederationFacade Key: YARN-6970 URL: https://issues.apache.org/jira/browse/YARN-6970

[jira] [Assigned] (YARN-6970) Add PoolInitializationException as retriable exception in FederationFacade

2017-08-08 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reassigned YARN-6970: -- Assignee: Giovanni Matteo Fumarola > Add PoolInitializationException as

[jira] [Updated] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs

2017-08-08 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6896: --- Attachment: YARN-6896.v1.patch > Federation: routing REST invocations

[jira] [Assigned] (YARN-5604) Add versioning for FederationStateStore

2017-08-08 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reassigned YARN-5604: -- Assignee: (was: Giovanni Matteo Fumarola) > Add versioning for

[jira] [Updated] (YARN-6811) [ATS1.5] All history logs should be kept under its own User Directory.

2017-08-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6811: - Hadoop Flags: Reviewed > [ATS1.5] All history logs should be kept under its own User Directory. >

[jira] [Commented] (YARN-6811) [ATS1.5] All history logs should be kept under its own User Directory.

2017-08-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118930#comment-16118930 ] Junping Du commented on YARN-6811: -- Thanks [~rohithsharma]. I have commit the patch to trunk and branch-2.

[jira] [Assigned] (YARN-6905) Multiple test failures due to FastNumberFormat

2017-08-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-6905: Assignee: Haibo Chen > Multiple test failures due to FastNumberFormat >

[jira] [Commented] (YARN-6905) Multiple test failures due to FastNumberFormat

2017-08-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118924#comment-16118924 ] Haibo Chen commented on YARN-6905: -- The hadoop-yarn-server-timelineservice-hbase-tests module uses

[jira] [Commented] (YARN-6875) New aggregated log file format for YARN log aggregation.

2017-08-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118925#comment-16118925 ] Wangda Tan commented on YARN-6875: -- [~jlowe], make sense. > New aggregated log file format for YARN log

[jira] [Commented] (YARN-6879) TestLeafQueue.testDRFUserLimits() has commented out code

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118923#comment-16118923 ] Hadoop QA commented on YARN-6879: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6875) New aggregated log file format for YARN log aggregation.

2017-08-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118917#comment-16118917 ] Jason Lowe commented on YARN-6875: -- As long as the extra index file is only going to be used for the

[jira] [Updated] (YARN-6905) Multiple test failures due to FastNumberFormat

2017-08-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6905: - Issue Type: Sub-task (was: Bug) Parent: YARN-5355 > Multiple test failures due to

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118878#comment-16118878 ] Hadoop QA commented on YARN-6964: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118864#comment-16118864 ] Hadoop QA commented on YARN-6668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6033) Add support for sections in container-executor configuration file

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118863#comment-16118863 ] Hadoop QA commented on YARN-6033: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6969) Remove method getMinShareMemoryFraction and getPendingContainers in class FairSchedulerQueueInfo

2017-08-08 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6969: --- Issue Type: Task (was: Bug) > Remove method getMinShareMemoryFraction and getPendingContainers in class >

[jira] [Updated] (YARN-6969) Remove method getMinShareMemoryFraction and getPendingContainers in class FairSchedulerQueueInfo

2017-08-08 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6969: --- Labels: newbie++ (was: ) > Remove method getMinShareMemoryFraction and getPendingContainers in class >

[jira] [Created] (YARN-6969) Remove method getMinShareMemoryFraction and getPendingContainers in class FairSchedulerQueueInfo

2017-08-08 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6969: -- Summary: Remove method getMinShareMemoryFraction and getPendingContainers in class FairSchedulerQueueInfo Key: YARN-6969 URL: https://issues.apache.org/jira/browse/YARN-6969

[jira] [Updated] (YARN-6668) Use cgroup to get container resource utilization

2017-08-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6668: - Attachment: YARN-6668.006.patch > Use cgroup to get container resource utilization >

[jira] [Commented] (YARN-6033) Add support for sections in container-executor configuration file

2017-08-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118843#comment-16118843 ] Wangda Tan commented on YARN-6033: -- [~sunilg]/[~vvasudev], could one of you help bless the latest patch.

[jira] [Commented] (YARN-6875) New aggregated log file format for YARN log aggregation.

2017-08-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118840#comment-16118840 ] Wangda Tan commented on YARN-6875: -- [~jlowe], make sense, it looks like we have to come back to solution

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118837#comment-16118837 ] Hadoop QA commented on YARN-6668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-08-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118836#comment-16118836 ] Jian He commented on YARN-6959: --- [~yqwang], thanks for the patch. one question is I'm wondering under what

[jira] [Commented] (YARN-6033) Add support for sections in container-executor configuration file

2017-08-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118834#comment-16118834 ] Miklos Szegedi commented on YARN-6033: -- +1 (non-binding). Thank you for the fixes, [~wangda]. Note:

[jira] [Commented] (YARN-6926) FSSchedulerNode reservation conflict

2017-08-08 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118831#comment-16118831 ] Yufei Gu commented on YARN-6926: Looking more deeply, this isn't a issue since method

[jira] [Resolved] (YARN-6926) FSSchedulerNode reservation conflict

2017-08-08 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-6926. Resolution: Invalid > FSSchedulerNode reservation conflict > > >

[jira] [Commented] (YARN-6879) TestLeafQueue.testDRFUserLimits() has commented out code

2017-08-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118825#comment-16118825 ] Daniel Templeton commented on YARN-6879: LGTM +1 > TestLeafQueue.testDRFUserLimits() has commented

[jira] [Updated] (YARN-6879) TestLeafQueue.testDRFUserLimits() has commented out code

2017-08-08 Thread Angela Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Angela Wang updated YARN-6879: -- Attachment: YARN-6879.001.patch > TestLeafQueue.testDRFUserLimits() has commented out code >

[jira] [Commented] (YARN-6789) new api to get all supported resources from RM

2017-08-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118819#comment-16118819 ] Wangda Tan commented on YARN-6789: -- Thanks [~sunilg], One comments regarding to ResourceTypeInfo: There's

[jira] [Updated] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6964: --- Attachment: YARN-6964.005.patch Fixed whitespace issue. > Fair scheduler misuses Resources

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118809#comment-16118809 ] Hadoop QA commented on YARN-6964: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118804#comment-16118804 ] Hadoop QA commented on YARN-6964: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-08-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118801#comment-16118801 ] Eric Badger commented on YARN-6930: --- Hey [~shaneku...@gmail.com], thanks for the patch! I have a few

[jira] [Updated] (YARN-6033) Add support for sections in container-executor configuration file

2017-08-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6033: - Attachment: YARN-6033.013.patch Thanks [~miklos.szeg...@cloudera.com], I attached ver.013 patch. For the

[jira] [Commented] (YARN-5695) New ResourceCalculator implementation that operates on vector of resources, but respect sum of ratios

2017-08-08 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118795#comment-16118795 ] Tanuj Nayak commented on YARN-5695: --- Hello I would like to throw out an idea for implementing the ratio

[jira] [Updated] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-08-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6757: --- Fix Version/s: 2.9.0 > Refactor the usage of >

[jira] [Commented] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-08-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118781#comment-16118781 ] Daniel Templeton commented on YARN-6757: Also committed to branch-2. > Refactor the usage of >

[jira] [Updated] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-08-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6757: --- Affects Version/s: 2.8.1 > Refactor the usage of >

[jira] [Updated] (YARN-6471) Support to add min/max resource configuration for a queue

2017-08-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6471: -- Attachment: YARN-6471-YARN-5881.003.patch seems there were some more test issues. > Support to add min/max

  1   2   >