[jira] [Updated] (YARN-7331) Change in few metrics in new YARN UI related to native-services

2017-10-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7331: -- Attachment: YARN-7331.yarn-native-services.001.patch attaching an initial version of patch. cc/ [~jianhe]

[jira] [Created] (YARN-7331) Change in few metrics in new YARN UI related to native-services

2017-10-16 Thread Sunil G (JIRA)
Sunil G created YARN-7331: - Summary: Change in few metrics in new YARN UI related to native-services Key: YARN-7331 URL: https://issues.apache.org/jira/browse/YARN-7331 Project: Hadoop YARN Issue

[jira] [Comment Edited] (YARN-5516) Add REST API for periodicity

2017-10-16 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205492#comment-16205492 ] Sean Po edited comment on YARN-5516 at 10/16/17 7:01 AM: - Verified that the tests

[jira] [Updated] (YARN-5516) Add REST API for periodicity

2017-10-16 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-5516: -- Attachment: YARN-5516.v002.patch Verified that the tests that failed in the last run were unrelated to the

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-16 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1620#comment-1620 ] Rohith Sharma K S commented on YARN-7190: - Since TestTimelineReaderWebServices is failing without

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623-branch-2.013.patch Attached a patch for branch-2. > Add support to turn off

[jira] [Updated] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-7190: --- Attachment: YARN-7190-YARN-5355_branch2.03.patch Patch no longer applies cleanly. Updating a new

[jira] [Updated] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-7190: --- Attachment: (was: YARN-7190-YARN-5355_branch2.02.patch) > Ensure only NM classpath in 2.x gets

[jira] [Updated] (YARN-7307) Revisit resource-types.xml loading behaviors

2017-10-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7307: -- Attachment: YARN-7307.002.patch Thanks [~leftnoteasy]. Updating v2 patch after addressing the comments. Ideally

[jira] [Created] (YARN-7332) Compute effectiveCapacity per each resource vector

2017-10-16 Thread Sunil G (JIRA)
Sunil G created YARN-7332: - Summary: Compute effectiveCapacity per each resource vector Key: YARN-7332 URL: https://issues.apache.org/jira/browse/YARN-7332 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7308) TestApplicationACLs fails with FairScheduler

2017-10-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205578#comment-16205578 ] Yufei Gu commented on YARN-7308: Thanks [~rkanter] for working on this. Looks good to me overall. Nits: #

[jira] [Commented] (YARN-5516) Add REST API for periodicity

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205623#comment-16205623 ] Hadoop QA commented on YARN-5516: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205697#comment-16205697 ] Hadoop QA commented on YARN-6623: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-16 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-7244: -- Attachment: YARN-7244.009.patch > ShuffleHandler is not aware of disks that are added >

[jira] [Commented] (YARN-7307) Revisit resource-types.xml loading behaviors

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205818#comment-16205818 ] Hadoop QA commented on YARN-7307: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205847#comment-16205847 ] Hadoop QA commented on YARN-7190: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7333) container-executor fails to remove entries from a directory that is not writable or executable

2017-10-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7333: - Attachment: YARN-7333.001.patch Attaching a patch that avoids opening the file unless we believe it is a

[jira] [Commented] (YARN-7230) Document DockerContainerRuntime for branch-2.8 with proper scope and claim as an experimental feature

2017-10-16 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206139#comment-16206139 ] Shane Kumpf commented on YARN-7230: --- [~templedf], given you wrote these docs for trunk and this patch is

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205969#comment-16205969 ] Hadoop QA commented on YARN-7244: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7333) container-executor fails to remove entries from a directory that is not writable or executable

2017-10-16 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7333: Summary: container-executor fails to remove entries from a directory that is not writable or executable Key: YARN-7333 URL: https://issues.apache.org/jira/browse/YARN-7333

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623-branch-2.015.patch New version(branch-2.015.patch) with compile fix. > Add

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206061#comment-16206061 ] Hadoop QA commented on YARN-6623: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-16 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205971#comment-16205971 ] Kuhu Shukla commented on YARN-7244: --- [~jlowe], request for review/comments on the latest patch. Thanks

[jira] [Commented] (YARN-6927) Add support for individual resource types requests in MapReduce

2017-10-16 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206035#comment-16206035 ] Gergo Repas commented on YARN-6927: --- Thanks - good points. I started to amend my patch according to the

[jira] [Commented] (YARN-7333) container-executor fails to remove entries from a directory that is not writable or executable

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206088#comment-16206088 ] Hadoop QA commented on YARN-7333: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7217) PUT method for update service for Service API doesn't function correctly

2017-10-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206108#comment-16206108 ] Eric Yang commented on YARN-7217: - The unit tests failure are not related to this patch. It looks like the

[jira] [Commented] (YARN-7333) container-executor fails to remove entries from a directory that is not writable or executable

2017-10-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206102#comment-16206102 ] Jason Lowe commented on YARN-7333: -- The TestDistributedScheduler failure is an unrelated, known issue

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-16 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206156#comment-16206156 ] Vrushali C commented on YARN-7190: -- Should also go into trunk I think. > Ensure only NM classpath in 2.x

[jira] [Created] (YARN-7336) Unsafe cast from long to int hashCode() methods for Resource, LightweightResource, and ResourcePBImpl

2017-10-16 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7336: -- Summary: Unsafe cast from long to int hashCode() methods for Resource, LightweightResource, and ResourcePBImpl Key: YARN-7336 URL:

[jira] [Commented] (YARN-7318) Fix shell check warnings of SLS.

2017-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206381#comment-16206381 ] Wangda Tan commented on YARN-7318: -- Thanks [~GergelyNovak] for the quick fix. I will try to run it to see

[jira] [Commented] (YARN-7230) Document DockerContainerRuntime for branch-2.8 with proper scope and claim as an experimental feature

2017-10-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206330#comment-16206330 ] Eric Badger commented on YARN-7230: --- Should we also have

[jira] [Commented] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2017-10-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206327#comment-16206327 ] Yufei Gu commented on YARN-4859: This is how I reproduce it. I failed to reproduce it with SLS. So I create

[jira] [Commented] (YARN-7307) Revisit resource-types.xml loading behaviors

2017-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206347#comment-16206347 ] Wangda Tan commented on YARN-7307: -- Thanks [~sunilg] for updating the patch, Few comments: 1) Could we

[jira] [Comment Edited] (YARN-7307) Revisit resource-types.xml loading behaviors

2017-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206347#comment-16206347 ] Wangda Tan edited comment on YARN-7307 at 10/16/17 6:25 PM: Thanks [~sunilg]

[jira] [Updated] (YARN-7335) Unsafe cast to from long to int in DominantResourceCalculator.computeAvailableContainers()

2017-10-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7335: --- Target Version/s: 3.1.0 (was: 3.0.0-beta1) > Unsafe cast to from long to int in >

[jira] [Comment Edited] (YARN-7217) PUT method for update service for Service API doesn't function correctly

2017-10-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206108#comment-16206108 ] Eric Yang edited comment on YARN-7217 at 10/16/17 4:59 PM: --- The recent

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206193#comment-16206193 ] Varun Saxena commented on YARN-7190: That will be a different patch...Maybe we can raise a separate

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206297#comment-16206297 ] Wangda Tan commented on YARN-4511: -- Thanks [~haibo.chen] for the explanation. bq. I am thinking of

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206325#comment-16206325 ] Carlo Curino commented on YARN-6608: [~wangda] the v9 patch runs cleanly from scripts to me, and the

[jira] [Created] (YARN-7334) Add documentation of oversubscription

2017-10-16 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7334: Summary: Add documentation of oversubscription Key: YARN-7334 URL: https://issues.apache.org/jira/browse/YARN-7334 Project: Hadoop YARN Issue Type: Bug Affects

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206376#comment-16206376 ] Wangda Tan commented on YARN-6608: -- Thanks [~curino] for the additional tests. The ASF warning looks like

[jira] [Commented] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206220#comment-16206220 ] Arun Suresh commented on YARN-7275: --- Thanks for the update [~kartheek]. +1, the latest patch lgtm. The

[jira] [Updated] (YARN-7230) Document DockerContainerRuntime for branch-2.8 with proper scope and claim as an experimental feature

2017-10-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7230: --- Labels: ready-to-commit (was: ) > Document DockerContainerRuntime for branch-2.8 with proper

[jira] [Commented] (YARN-7230) Document DockerContainerRuntime for branch-2.8 with proper scope and claim as an experimental feature

2017-10-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206201#comment-16206201 ] Daniel Templeton commented on YARN-7230: LGTM. +1 I'll let others have a chance to review before I

[jira] [Updated] (YARN-7335) Unsafe cast to from long to int in DominantResourceCalculator.computeAvailableContainers()

2017-10-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7335: --- Affects Version/s: (was: 3.0.0-beta1) 3.1.0 > Unsafe cast to from

[jira] [Commented] (YARN-7230) Document DockerContainerRuntime for branch-2.8 with proper scope and claim as an experimental feature

2017-10-16 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206294#comment-16206294 ] Shane Kumpf commented on YARN-7230: --- Thanks for the review, [~templedf]! Sounds good to me. > Document

[jira] [Commented] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-10-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206295#comment-16206295 ] Miklos Szegedi commented on YARN-6384: -- Thank you for the patch [~lolee_k],

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7254: - Fix Version/s: YARN-5881 > UI and metrics changes related to absolute resource configuration >

[jira] [Updated] (YARN-7334) Add documentation of oversubscription

2017-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7334: - Issue Type: Sub-task (was: Bug) Parent: YARN-1011 > Add documentation of oversubscription >

[jira] [Commented] (YARN-7124) LogAggregationTFileController deletes/renames while file is open

2017-10-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206360#comment-16206360 ] Junping Du commented on YARN-7124: -- Sorry for coming late on this as just back from vacation. The patch

[jira] [Resolved] (YARN-4943) Add support to collect actual resource usage from cgroups

2017-10-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi resolved YARN-4943. -- Resolution: Duplicate > Add support to collect actual resource usage from cgroups >

[jira] [Commented] (YARN-6546) SLS is slow while loading 10k queues

2017-10-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206260#comment-16206260 ] Miklos Szegedi commented on YARN-6546: -- Thank you for the patch [~yufeigu]. {code} 245 if

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206358#comment-16206358 ] Haibo Chen commented on YARN-4511: -- Yep, I have created YARN-7334 as a blocker to document the API/proto

[jira] [Created] (YARN-7335) Unsafe cast to from long to int in DominantResourceCalculator.computeAvailableContainers()

2017-10-16 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7335: -- Summary: Unsafe cast to from long to int in DominantResourceCalculator.computeAvailableContainers() Key: YARN-7335 URL: https://issues.apache.org/jira/browse/YARN-7335

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2017-10-16 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206622#comment-16206622 ] Devaraj K commented on YARN-5764: - Thanks [~miklos.szeg...@cloudera.com] for the review. bq. I see

[jira] [Updated] (YARN-7295) Backport ATSv2 to branch-2

2017-10-16 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7295: - Attachment: YARN-7295-branch-2.02.patch > Backport ATSv2 to branch-2 > -- > >

[jira] [Updated] (YARN-7295) Backport ATSv2 to branch-2

2017-10-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-7295: --- Attachment: YARN-7295-branch-2.02.patch > Backport ATSv2 to branch-2 > -- > >

[jira] [Updated] (YARN-7295) Backport ATSv2 to branch-2

2017-10-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-7295: --- Attachment: (was: YARN-7295-YARN-5355_branch2.03.patch) > Backport ATSv2 to branch-2 >

[jira] [Updated] (YARN-7286) Add support for docker to have no capabilities

2017-10-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7286: -- Attachment: YARN-7286.006.patch Attaching new patch to fix checkstyle > Add support for docker to have

[jira] [Updated] (YARN-7308) TestApplicationACLs fails with FairScheduler

2017-10-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7308: --- Description: emphasized text{{TestApplicationACLs}} fails when using FairScheduler: {noformat} Tests run: 1,

[jira] [Commented] (YARN-7308) TestApplicationACLs fails with FairScheduler

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206628#comment-16206628 ] Hadoop QA commented on YARN-7308: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-16 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-7244: -- Attachment: YARN-7244.010.patch Attaching revised patch that address review comments. Thanks a lot ! >

[jira] [Commented] (YARN-7308) TestApplicationACLs fails with FairScheduler

2017-10-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206641#comment-16206641 ] Yufei Gu commented on YARN-7308: +1 > TestApplicationACLs fails with FairScheduler >

[jira] [Updated] (YARN-7336) Unsafe cast from long to int Resource.hashCode() method

2017-10-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-7336: -- Target Version/s: 3.0.0, 3.1.0 (was: 3.0.0-beta1, 3.1.0) > Unsafe cast from long to int

[jira] [Commented] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2017-10-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206499#comment-16206499 ] Yufei Gu commented on YARN-4859: I didn't test with YARN-7311. Did more tests. That issue happens only you

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206505#comment-16206505 ] Hadoop QA commented on YARN-6623: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206540#comment-16206540 ] Hadoop QA commented on YARN-7169: - (!) A patch to the testing environment has been detected. Re-executing

[jira] [Commented] (YARN-7295) Backport ATSv2 to branch-2

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206606#comment-16206606 ] Hadoop QA commented on YARN-7295: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7295) Backport ATSv2 to branch-2

2017-10-16 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7295: - Attachment: (was: YARN-7295-branch2.02.patch) > Backport ATSv2 to branch-2 >

[jira] [Updated] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4511: - Attachment: YARN-4511-YARN-1011.04.patch > Common scheduler changes supporting scheduler-specific

[jira] [Updated] (YARN-7295) Backport ATSv2 to branch-2

2017-10-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-7295: --- Attachment: YARN-7295-YARN-5355_branch2.03.patch As discussed offline, attaching a new patch >

[jira] [Updated] (YARN-7295) Backport ATSv2 to branch-2

2017-10-16 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7295: - Attachment: (was: YARN-7295-branch-2.02.patch) > Backport ATSv2 to branch-2 >

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206632#comment-16206632 ] Haibo Chen commented on YARN-4511: -- Patch updated to address the follow major issues: 1) rename

[jira] [Updated] (YARN-7308) TestApplicationACLs fails with FairScheduler

2017-10-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7308: --- Description: {{TestApplicationACLs}} fails when using FairScheduler: {noformat} Tests run: 1, Failures: 1,

[jira] [Commented] (YARN-7124) LogAggregationTFileController deletes/renames while file is open

2017-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206648#comment-16206648 ] Hudson commented on YARN-7124: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13092 (See

[jira] [Commented] (YARN-7230) Document DockerContainerRuntime for branch-2.8 with proper scope and claim as an experimental feature

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206657#comment-16206657 ] Hadoop QA commented on YARN-7230: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7230) Document DockerContainerRuntime for branch-2.8 with proper scope and claim as an experimental feature

2017-10-16 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7230: -- Attachment: YARN-7230.branch-2.8.003.patch > Document DockerContainerRuntime for branch-2.8 with proper

[jira] [Created] (YARN-7338) Support same origin policy for cross site scripting prevention.

2017-10-16 Thread Vrushali C (JIRA)
Vrushali C created YARN-7338: Summary: Support same origin policy for cross site scripting prevention. Key: YARN-7338 URL: https://issues.apache.org/jira/browse/YARN-7338 Project: Hadoop YARN

[jira] [Commented] (YARN-7295) Backport ATSv2 to branch-2

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206680#comment-16206680 ] Hadoop QA commented on YARN-7295: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-16 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206679#comment-16206679 ] Vrushali C commented on YARN-7169: -- Linking YARN-7338 as blocker for merge > Backport new yarn-ui to

[jira] [Commented] (YARN-7230) Document DockerContainerRuntime for branch-2.8 with proper scope and claim as an experimental feature

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206730#comment-16206730 ] Hadoop QA commented on YARN-7230: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206736#comment-16206736 ] Eric Yang commented on YARN-6623: - [~vvasudev] How is the C++ test case getting triggered? mvn clean test

[jira] [Created] (YARN-7339) LocalityMulticastAMRMProxyPolicy should handle cancel request properly

2017-10-16 Thread Botong Huang (JIRA)
Botong Huang created YARN-7339: -- Summary: LocalityMulticastAMRMProxyPolicy should handle cancel request properly Key: YARN-7339 URL: https://issues.apache.org/jira/browse/YARN-7339 Project: Hadoop YARN

[jira] [Updated] (YARN-7339) LocalityMulticastAMRMProxyPolicy should handle cancel request properly

2017-10-16 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7339: --- Attachment: YARN-7339-v1.patch > LocalityMulticastAMRMProxyPolicy should handle cancel request

[jira] [Commented] (YARN-7308) TestApplicationACLs fails with FairScheduler

2017-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206758#comment-16206758 ] Hudson commented on YARN-7308: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13094 (See

[jira] [Commented] (YARN-7333) container-executor fails to remove entries from a directory that is not writable or executable

2017-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206757#comment-16206757 ] Hudson commented on YARN-7333: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13094 (See

[jira] [Updated] (YARN-7340) Missing the time stamp in exception message in Class NoOverCommitPolicy

2017-10-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7340: --- Labels: newbie++ (was: ) > Missing the time stamp in exception message in Class NoOverCommitPolicy >

[jira] [Created] (YARN-7340) Missing the time stamp in exception message in Class NoOverCommitPolicy

2017-10-16 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-7340: -- Summary: Missing the time stamp in exception message in Class NoOverCommitPolicy Key: YARN-7340 URL: https://issues.apache.org/jira/browse/YARN-7340 Project: Hadoop YARN

[jira] [Commented] (YARN-7217) PUT method for update service for Service API doesn't function correctly

2017-10-16 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206773#comment-16206773 ] Gour Saha commented on YARN-7217: - {quote} For changing number of containers with in a service, the api

[jira] [Comment Edited] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-10-16 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206771#comment-16206771 ] Jonathan Hung edited comment on YARN-6852 at 10/16/17 11:30 PM: Hi

[jira] [Created] (YARN-7341) TestRouterWebServiceUtil#testMergeMetrics is flakey

2017-10-16 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-7341: --- Summary: TestRouterWebServiceUtil#testMergeMetrics is flakey Key: YARN-7341 URL: https://issues.apache.org/jira/browse/YARN-7341 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-6623: Attachment: cetest.stderr cetest.stdout [~vvasudev] Here are the output of the failed test.

[jira] [Commented] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2017-10-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206825#comment-16206825 ] Yufei Gu commented on YARN-4859: [~asuresh], thanks for the explanation. I tested either drf and fair

[jira] [Commented] (YARN-7217) PUT method for update service for Service API doesn't function correctly

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206827#comment-16206827 ] Hadoop QA commented on YARN-7217: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7339) LocalityMulticastAMRMProxyPolicy should handle cancel request properly

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206829#comment-16206829 ] Hadoop QA commented on YARN-7339: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7340) Missing the time stamp in exception message in Class NoOverCommitPolicy

2017-10-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7340: --- Description: It could be easily figured out by reading code. {code} throw new

[jira] [Commented] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-10-16 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206771#comment-16206771 ] Jonathan Hung commented on YARN-6852: - Hi [~leftnoteasy], in

[jira] [Updated] (YARN-7341) TestRouterWebServiceUtil#testMergeMetrics is flakey

2017-10-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-7341: Affects Version/s: (was: 2.9.0) Target Version/s: 3.0.0 (was: 2.9.0, 3.0.0) >

[jira] [Commented] (YARN-7286) Add support for docker to have no capabilities

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206797#comment-16206797 ] Hadoop QA commented on YARN-7286: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206815#comment-16206815 ] Hadoop QA commented on YARN-4511: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >