[jira] [Commented] (YARN-7170) Investigate bower dependencies for YARN UI v2

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203317#comment-16203317 ] Sunil G commented on YARN-7170: --- I tried this command with v2 patch. I could see that dependency is lesser

[jira] [Commented] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203513#comment-16203513 ] Hadoop QA commented on YARN-7254: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7170) Investigate bower dependencies for YARN UI v2

2017-10-13 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203531#comment-16203531 ] Sreenath Somarajapuram commented on YARN-7170: -- +1 As pointed out by [~sunilg], v2 patch helps

[jira] [Commented] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203425#comment-16203425 ] Hadoop QA commented on YARN-7169: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7318) Fix shell check warnings of SLS.

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203502#comment-16203502 ] Hadoop QA commented on YARN-7318: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7180) Remove class ResourceType

2017-10-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203323#comment-16203323 ] Hudson commented on YARN-7180: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #13080 (See

[jira] [Assigned] (YARN-7318) Fix shell check warnings of SLS.

2017-10-13 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák reassigned YARN-7318: --- Assignee: Gergely Novák > Fix shell check warnings of SLS. >

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.007.patch Several test cases are failing and its been tracked in YARN-7324 and

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.008.patch one more test case correction. updating v8 patch. > UI and metrics

[jira] [Comment Edited] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203868#comment-16203868 ] Sunil G edited comment on YARN-7270 at 10/13/17 5:07 PM: - Yes. Correct. Fine from

[jira] [Commented] (YARN-7325) Remove unused container variable in DockerLinuxContainerRuntime for branch-2.8

2017-10-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203735#comment-16203735 ] Shane Kumpf commented on YARN-7325: --- No test is included as this is removing an unused variable. The

[jira] [Updated] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-10-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7270: --- Attachment: YARN-7270.005.patch Thanks [~wangda]. Uploaded patch v5 for your comment. >

[jira] [Commented] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203727#comment-16203727 ] Sunil G commented on YARN-7270: --- javac warning is related. In {{TestResourcePBImpl}}, please use

[jira] [Commented] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-10-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203845#comment-16203845 ] Yufei Gu commented on YARN-7270: It is related. This patch intends to test {{getMemory()}} instead of

[jira] [Commented] (YARN-7321) Backport container-executor changes from YARN-6852 to branch-2

2017-10-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203849#comment-16203849 ] Wangda Tan commented on YARN-7321: -- Thanks [~vvasudev] for reporting the testing result, I will commit the

[jira] [Commented] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203868#comment-16203868 ] Sunil G commented on YARN-7270: --- Yes. Correct. Fine from end as well. Thanks. > Resource#getVirtualCores()

[jira] [Commented] (YARN-6505) Define the strings used in SLS JSON input file format

2017-10-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203881#comment-16203881 ] Yufei Gu commented on YARN-6505: Resubmit patch to kick off Jenkins. > Define the strings used in SLS

[jira] [Commented] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-10-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203847#comment-16203847 ] Wangda Tan commented on YARN-7270: -- [~sunilg], bq. please use res.getMemorySize instead of res.getMemory

[jira] [Commented] (YARN-7246) Fix the default docker binary path

2017-10-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204143#comment-16204143 ] Jason Lowe commented on YARN-7246: -- Thanks for updating the patch! +1 lgtm. Committing this. > Fix the

[jira] [Commented] (YARN-7270) Fix unsafe casting from long to int for class Resource and its sub-classes

2017-10-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204199#comment-16204199 ] Hudson commented on YARN-7270: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13081 (See

[jira] [Commented] (YARN-7326) Some issues in RegistryDNS

2017-10-13 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204208#comment-16204208 ] Allen Wittenauer commented on YARN-7326: Without looking too hard at the current state (so I

[jira] [Updated] (YARN-7323) Data structure update in service REST API

2017-10-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7323: Description: Unix terminology implies daemon process, such as httpd as a service. In Hadoop terminology,

[jira] [Commented] (YARN-7326) Some issues in RegistryDNS

2017-10-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204241#comment-16204241 ] Jian He commented on YARN-7326: --- Thanks [~aw], bq. For 3) Integrate the yarn service commands into yarn

[jira] [Commented] (YARN-7323) Data structure update in service REST API

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204331#comment-16204331 ] Hadoop QA commented on YARN-7323: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7327) Allocate containers asynchronously by default

2017-10-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7327: -- Summary: Allocate containers asynchronously by default (was: Launch containers asynchronously by

[jira] [Commented] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204382#comment-16204382 ] Hadoop QA commented on YARN-7066: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204441#comment-16204441 ] Hadoop QA commented on YARN-7102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7127) Merge yarn-native-service branch into trunk

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204400#comment-16204400 ] Hadoop QA commented on YARN-7127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204484#comment-16204484 ] Hadoop QA commented on YARN-7254: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7286) Add support for docker to have no capabilities

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204423#comment-16204423 ] Hadoop QA commented on YARN-7286: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.009.patch Fixing findbugs > UI and metrics changes related to absolute resource

[jira] [Updated] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-10-13 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7102: --- Attachment: YARN-7102.v9.patch Sorry a bit occupied recently. v9 patch uploaded addressing [~jlowe]'s

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204439#comment-16204439 ] Hadoop QA commented on YARN-6608: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7325) Remove unused container variable in DockerLinuxContainerRuntime for branch-2.8

2017-10-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7325: -- Attachment: YARN-7325-branch-2.8.001.patch > Remove unused container variable in

[jira] [Created] (YARN-7325) Remove unused container variable in DockerLinuxContainerRuntime for branch-2.8

2017-10-13 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7325: - Summary: Remove unused container variable in DockerLinuxContainerRuntime for branch-2.8 Key: YARN-7325 URL: https://issues.apache.org/jira/browse/YARN-7325 Project: Hadoop

[jira] [Commented] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203719#comment-16203719 ] Hadoop QA commented on YARN-7270: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7325) Remove unused container variable in DockerLinuxContainerRuntime for branch-2.8

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203725#comment-16203725 ] Hadoop QA commented on YARN-7325: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7318) Fix shell check warnings of SLS.

2017-10-13 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203576#comment-16203576 ] Gergely Novák commented on YARN-7318: - [~leftnoteasy] Is this what you had in mind? > Fix shell check

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203720#comment-16203720 ] Jason Lowe commented on YARN-7244: -- Thanks for updating the patch! The test failure appears to be

[jira] [Commented] (YARN-7326) Some issues in RegistryDNS

2017-10-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204181#comment-16204181 ] Eric Yang commented on YARN-7326: - Sounds like dns java is misconfigured to use itself as the upstream dns

[jira] [Updated] (YARN-7217) PUT method for update service for Service API doesn't function correctly

2017-10-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7217: Attachment: YARN-7217.yarn-native-services.001.patch This patch modifies the PUT method to have

[jira] [Assigned] (YARN-7217) PUT method for update service for Service API doesn't function correctly

2017-10-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7217: --- Assignee: Eric Yang > PUT method for update service for Service API doesn't function correctly >

[jira] [Commented] (YARN-7311) TestRMWebServicesReservation doesn't really test fair scheduler

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204314#comment-16204314 ] Hadoop QA commented on YARN-7311: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7328) ResourceUtils allows yarn.nodemanager.resource-types.memory-mb and .vcores to override yarn.nodemanager.resource.memory-mb and .cpu-vcores

2017-10-13 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7328: -- Summary: ResourceUtils allows yarn.nodemanager.resource-types.memory-mb and .vcores to override yarn.nodemanager.resource.memory-mb and .cpu-vcores Key: YARN-7328 URL:

[jira] [Commented] (YARN-7170) Investigate bower dependencies for YARN UI v2

2017-10-13 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204211#comment-16204211 ] Vrushali C commented on YARN-7170: -- Thanks Sunil! Will wait for this to get committed and pick it up right

[jira] [Commented] (YARN-7217) PUT method for update service for Service API doesn't function correctly

2017-10-13 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204278#comment-16204278 ] Gour Saha commented on YARN-7217: - {quote} Scenario 1 A user retrieves Service object from getService call,

[jira] [Commented] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-10-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204321#comment-16204321 ] Eric Yang commented on YARN-7066: - [~ebadger] Security restriction will be enforced by: # Check for sudo

[jira] [Commented] (YARN-7286) Add support for docker to have no capabilities

2017-10-13 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204341#comment-16204341 ] Sidharta Seethana commented on YARN-7286: - [~ebadger], thanks for the updated patch. I'll wait for

[jira] [Commented] (YARN-7327) CapacityScheduler: Allocate containers asynchronously by default

2017-10-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204359#comment-16204359 ] Eric Yang commented on YARN-7327: - The purpose of the artificial synchronous delay was to ensure all nodes

[jira] [Updated] (YARN-7189) Container-executor doesn't remove Docker containers that error out early

2017-10-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7189: -- Summary: Container-executor doesn't remove Docker containers that error out early (was: Docker doesn't

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-13 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204183#comment-16204183 ] Vrushali C commented on YARN-7190: -- Thanks for the dummy patch 002, [~varun_saxena] ! Looks like the same

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-13 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204232#comment-16204232 ] Carlo Curino commented on YARN-6608: [~wangda] thanks for the proposed fix. In the version of the

[jira] [Commented] (YARN-5366) Add support for toggling the removal of completed and failed docker containers

2017-10-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204230#comment-16204230 ] Eric Badger commented on YARN-5366: --- Hey [~shaneku...@gmail.com], reading over this JIRA again and found

[jira] [Updated] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6608: - Attachment: YARN-6608-branch-2.v9.patch [~curino], updated patch (v9), there was a bug in slsrun.sh. It

[jira] [Updated] (YARN-7286) Add support for docker to have no capabilities

2017-10-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7286: -- Attachment: YARN-7286.004.patch bq. With respect to mixing "NONE" and other capabilities, how about

[jira] [Commented] (YARN-7217) PUT method for update service for Service API doesn't function correctly

2017-10-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204375#comment-16204375 ] Eric Yang commented on YARN-7217: - [~gsaha] {quote} What do you mean by it does not increase the count?

[jira] [Updated] (YARN-7323) Data structure update in service REST API

2017-10-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7323: Description: Data structure for Yarnfile organized state at service level. > Data structure update in

[jira] [Updated] (YARN-7323) Data structure update in service REST API

2017-10-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7323: Summary: Data structure update in service REST API (was: Some changes in service REST API) > Data

[jira] [Commented] (YARN-7310) TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler

2017-10-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204305#comment-16204305 ] Haibo Chen commented on YARN-7310: -- +1, will commit it shortly unless there is objection >

[jira] [Updated] (YARN-7327) Launch containers asynchronously by default

2017-10-13 Thread Craig Ingram (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Ingram updated YARN-7327: --- Description: I was recently doing some research into Spark on YARN's startup time and observed slow,

[jira] [Comment Edited] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-10-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204321#comment-16204321 ] Eric Yang edited comment on YARN-7066 at 10/13/17 11:08 PM: [~ebadger] Security

[jira] [Updated] (YARN-7327) Launch containers asynchronously by default

2017-10-13 Thread Craig Ingram (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Ingram updated YARN-7327: --- Attachment: yarn-async-scheduling.png Plot showing asynchronous vs synchronous scheduling of

[jira] [Commented] (YARN-7327) CapacityScheduler: Allocate containers asynchronously by default

2017-10-13 Thread Craig Ingram (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204352#comment-16204352 ] Craig Ingram commented on YARN-7327: Thanks Arun. I'll look into what it'll take to get a test

[jira] [Commented] (YARN-7310) TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler

2017-10-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204356#comment-16204356 ] Hudson commented on YARN-7310: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13083 (See

[jira] [Commented] (YARN-7327) Launch containers asynchronously by default

2017-10-13 Thread Vadim Semenov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204201#comment-16204201 ] Vadim Semenov commented on YARN-7327: - Thanks for putting your results. Could you correct the `conf`

[jira] [Commented] (YARN-7217) PUT method for update service for Service API doesn't function correctly

2017-10-13 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204284#comment-16204284 ] Gour Saha commented on YARN-7217: - Also, the patch contains solr specific changes and cannot be reviewed in

[jira] [Updated] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-10-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7066: Attachment: YARN-7066.002.patch Rebase patch on trunk code. > Add ability to specify volumes to mount for

[jira] [Commented] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-10-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204291#comment-16204291 ] Eric Badger commented on YARN-7066: --- Hi [~eyang]. I took a quick look at the patch and it looks like the

[jira] [Commented] (YARN-7327) Allocate containers asynchronously by default

2017-10-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204337#comment-16204337 ] Arun Suresh commented on YARN-7327: --- Changed the tile : It looks like this is more related to the RM

[jira] [Updated] (YARN-7327) CapacityScheduler: Allocate containers asynchronously by default

2017-10-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7327: -- Summary: CapacityScheduler: Allocate containers asynchronously by default (was: Allocate containers

[jira] [Commented] (YARN-7311) TestRMWebServicesReservation doesn't really test fair scheduler

2017-10-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204361#comment-16204361 ] Yufei Gu commented on YARN-7311: Verified all test failures locally. There are all unrelated. -

[jira] [Commented] (YARN-7217) PUT method for update service for Service API doesn't function correctly

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204378#comment-16204378 ] Hadoop QA commented on YARN-7217: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7272) Enable timeline collector fault tolerance

2017-10-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203096#comment-16203096 ] Vinod Kumar Vavilapalli commented on YARN-7272: --- bq. In 1st cases, there will be outstanding

[jira] [Updated] (YARN-7323) Some changes in service REST API

2017-10-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7323: -- Attachment: (was: YARN-7323.yarn-native-services.01.patch) > Some changes in service REST API >

[jira] [Commented] (YARN-7323) Some changes in service REST API

2017-10-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203102#comment-16203102 ] Jian He commented on YARN-7323: --- Changes include: - removed the functionality of creating default component

[jira] [Updated] (YARN-7323) Some changes in service REST API

2017-10-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7323: -- Attachment: YARN-7323.yarn-native-services.01.patch > Some changes in service REST API >

[jira] [Comment Edited] (YARN-7323) Some changes in service REST API

2017-10-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203102#comment-16203102 ] Jian He edited comment on YARN-7323 at 10/13/17 6:09 AM: - Changes include: -

[jira] [Updated] (YARN-7322) Remove annotations from org.apache.hadoop.yarn.server classes

2017-10-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-7322: - Attachment: YARN-7322.001.patch > Remove annotations from org.apache.hadoop.yarn.server classes >

[jira] [Commented] (YARN-7321) Backport container-executor changes from YARN-6852 to branch-2

2017-10-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203108#comment-16203108 ] Varun Vasudev commented on YARN-7321: - Thank for the review [~leftnoteasy]! I've verified that the

[jira] [Created] (YARN-7324) TestCapacitySchedulerWithMultiResourceTypes.testBasicCapacitySchedulerWithProfile fails in trunk

2017-10-13 Thread Sunil G (JIRA)
Sunil G created YARN-7324: - Summary: TestCapacitySchedulerWithMultiResourceTypes.testBasicCapacitySchedulerWithProfile fails in trunk Key: YARN-7324 URL: https://issues.apache.org/jira/browse/YARN-7324

[jira] [Commented] (YARN-6505) Define the strings used in SLS JSON input file format

2017-10-13 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203385#comment-16203385 ] Gergely Novák commented on YARN-6505: - [~yufeigu] fixed "duration.ms." All the failed tests pass for

[jira] [Updated] (YARN-7318) Fix shell check warnings of SLS.

2017-10-13 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-7318: Attachment: YARN-7318.001.patch > Fix shell check warnings of SLS. >

[jira] [Created] (YARN-7327) Launch containers asynchronously by default

2017-10-13 Thread Craig Ingram (JIRA)
Craig Ingram created YARN-7327: -- Summary: Launch containers asynchronously by default Key: YARN-7327 URL: https://issues.apache.org/jira/browse/YARN-7327 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204032#comment-16204032 ] Hadoop QA commented on YARN-7270: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7322) Remove annotations from org.apache.hadoop.yarn.server classes

2017-10-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204037#comment-16204037 ] Daniel Templeton commented on YARN-7322: I disagree. The annotations are there so that users and

[jira] [Commented] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204050#comment-16204050 ] Hadoop QA commented on YARN-7275: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7323) Some changes in service REST API

2017-10-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7323: -- Attachment: YARN-7323.yarn-native-services.02.patch > Some changes in service REST API >

[jira] [Commented] (YARN-7109) Extend aggregation operation for new ATS design

2017-10-13 Thread Linlin Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203115#comment-16203115 ] Linlin Zhou commented on YARN-7109: --- Totally 7 aggregation functions are added in the patch, they are:

[jira] [Comment Edited] (YARN-7109) Extend aggregation operation for new ATS design

2017-10-13 Thread Linlin Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203115#comment-16203115 ] Linlin Zhou edited comment on YARN-7109 at 10/13/17 6:42 AM: - Totally 7

[jira] [Commented] (YARN-7323) Some changes in service REST API

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203123#comment-16203123 ] Hadoop QA commented on YARN-7323: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7314) Multiple Resource manager test cases failing

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203138#comment-16203138 ] Sunil G commented on YARN-7314: --- Looks like YARN-7270 is tracking the same. [~yufeigu] > Multiple Resource

[jira] [Commented] (YARN-7270) Resource#getVirtualCores() does unsafe casting from long to int.

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203144#comment-16203144 ] Sunil G commented on YARN-7270: --- I am good with latest patch. Will wait for jenkins. >

[jira] [Updated] (YARN-7311) TestRMWebServicesReservation doesn't really test fair scheduler

2017-10-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7311: --- Attachment: YARN-7311.002.patch > TestRMWebServicesReservation doesn't really test fair scheduler >

[jira] [Updated] (YARN-7109) Extend aggregation operation for new ATS design

2017-10-13 Thread Linlin Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linlin Zhou updated YARN-7109: -- Attachment: yarn-7109.patch > Extend aggregation operation for new ATS design >

[jira] [Comment Edited] (YARN-7109) Extend aggregation operation for new ATS design

2017-10-13 Thread Linlin Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203115#comment-16203115 ] Linlin Zhou edited comment on YARN-7109 at 10/13/17 6:44 AM: - Totally 7

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203124#comment-16203124 ] Hadoop QA commented on YARN-7159: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7272) Enable timeline collector fault tolerance

2017-10-13 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203129#comment-16203129 ] Rohith Sharma K S commented on YARN-7272: - Update : I had offline discussion with Vinod and his

[jira] [Comment Edited] (YARN-7314) Multiple Resource manager test cases failing

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203127#comment-16203127 ] Sunil G edited comment on YARN-7314 at 10/13/17 6:53 AM: - Adding more analysis from

[jira] [Commented] (YARN-7314) Multiple Resource manager test cases failing

2017-10-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203127#comment-16203127 ] Sunil G commented on YARN-7314: --- Adding more analysis from end here. I could these test cases fails in trunk

[jira] [Commented] (YARN-7314) Multiple Resource manager test cases failing

2017-10-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203140#comment-16203140 ] Yufei Gu commented on YARN-7314: Most them should be related to YARN-7270. Please help review. Thanks. >

  1   2   >