[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094237#comment-16094237 ] Vrushali C commented on YARN-4455: -- bq. From above discussion I understand that only flow run entity table

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-07-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094234#comment-16094234 ] Vrushali C commented on YARN-6820: -- Thinking out loud: Wondering if we can make use HBase visibility

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-19 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094209#comment-16094209 ] Rohith Sharma K S commented on YARN-4455: - [~vrushalic] [~varun_saxena] From above discussion I

[jira] [Commented] (YARN-6844) AMRMClientImpl.checkNodeLabelExpression() has wrong error message

2017-07-19 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094186#comment-16094186 ] Manikandan R commented on YARN-6844: [~templedf] Attached patch. Please review. >

[jira] [Assigned] (YARN-6844) AMRMClientImpl.checkNodeLabelExpression() has wrong error message

2017-07-19 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R reassigned YARN-6844: -- Assignee: Manikandan R > AMRMClientImpl.checkNodeLabelExpression() has wrong error message >

[jira] [Updated] (YARN-6844) AMRMClientImpl.checkNodeLabelExpression() has wrong error message

2017-07-19 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6844: --- Attachment: YARN-6844.001.patch > AMRMClientImpl.checkNodeLabelExpression() has wrong error message >

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094183#comment-16094183 ] Vrushali C commented on YARN-6733: -- bq. Btw, as discussion made in YARN-4455 regarding timestamp

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-19 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094180#comment-16094180 ] Rohith Sharma K S commented on YARN-6733: - Thanks [~vrushalic] for the patch.. I am +1 for the

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094167#comment-16094167 ] Vrushali C commented on YARN-6733: -- Gentle ping for review [~rohithsharma] [~varun_saxena] I have made all

[jira] [Commented] (YARN-6847) [ATSv2] NPE in RM while starting timeline collector on recovery after explicit failover

2017-07-19 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094098#comment-16094098 ] Rohith Sharma K S commented on YARN-6847: - [~varun_saxena] thanks for the creating this issue. I

[jira] [Created] (YARN-6849) NMContainerStatus should have the Container ExecutionType.

2017-07-19 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-6849: - Summary: NMContainerStatus should have the Container ExecutionType. Key: YARN-6849 URL: https://issues.apache.org/jira/browse/YARN-6849 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6223) [Umbrella] Natively support GPU configuration/discovery/scheduling/isolation on YARN

2017-07-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094074#comment-16094074 ] Chris Douglas commented on YARN-6223: - [~leftnoteasy], could you summarize the implementation a bit?

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094052#comment-16094052 ] Chris Douglas commented on YARN-6593: - I like the {{T accept(Visitor visitor)}} pattern and composing

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094022#comment-16094022 ] Hadoop QA commented on YARN-6612: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6685) Add job count in to SLS JSON input format

2017-07-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094010#comment-16094010 ] Haibo Chen commented on YARN-6685: -- Thank Yufei for the update. One more knit, can we rephrase the comment

[jira] [Commented] (YARN-6840) Leverage RMStateStore to store scheduler configuration updates

2017-07-19 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094007#comment-16094007 ] Naganarasimha G R commented on YARN-6840: - [~wangda], bq. Diff of config update should be small,

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2017-07-19 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094003#comment-16094003 ] Naganarasimha G R commented on YARN-6492: - Thanks [~maniraj...@gmail.com] for the patch, and sorry

[jira] [Updated] (YARN-5219) When an export var command fails in launch_container.sh, the full container launch should fail

2017-07-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-5219: -- Issue Type: Sub-task (was: Bug) Parent: YARN-522 > When an export var

[jira] [Commented] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-07-19 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093976#comment-16093976 ] Daniel Templeton commented on YARN-6610: [~sunilg], I don't think we can ignore everything except

[jira] [Commented] (YARN-6628) Unexpected jackson-core-2.2.3 dependency introduced

2017-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093940#comment-16093940 ] Hadoop QA commented on YARN-6628: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-07-19 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6612: --- Attachment: YARN-6612.YARN-3926.002.patch Here's a rebased patch. > Update fair scheduler

[jira] [Commented] (YARN-6848) Move Router ClientRMServices Interceptor and chain into yarn api and common package

2017-07-19 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093925#comment-16093925 ] Subru Krishnan commented on YARN-6848: -- +1 on the proposal. > Move Router ClientRMServices

[jira] [Commented] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

2017-07-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093909#comment-16093909 ] Jason Lowe commented on YARN-6846: -- Sample log from a 2.8-based release. In this case I believe nftw is

[jira] [Created] (YARN-6848) Move Router ClientRMServices Interceptor and chain into yarn api and common package

2017-07-19 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-6848: - Summary: Move Router ClientRMServices Interceptor and chain into yarn api and common package Key: YARN-6848 URL: https://issues.apache.org/jira/browse/YARN-6848 Project:

[jira] [Updated] (YARN-6847) [ATSv2] NPE in RM while starting timeline collector on recovery after explicit failover

2017-07-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6847: --- Summary: [ATSv2] NPE in RM while starting timeline collector on recovery after explicit failover

[jira] [Updated] (YARN-6847) NPE in RM while starting timeline collector on recovery after explicit failover

2017-07-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6847: --- Issue Type: Sub-task (was: Bug) Parent: YARN-5355 > NPE in RM while starting timeline

[jira] [Comment Edited] (YARN-6847) NPE in RM while starting timeline collector on recovery after explicit failover

2017-07-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093898#comment-16093898 ] Varun Saxena edited comment on YARN-6847 at 7/19/17 10:25 PM: -- Found this

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093897#comment-16093897 ] Hadoop QA commented on YARN-4161: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6847) NPE in RM while starting timeline collector on recovery after explicit failover

2017-07-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093898#comment-16093898 ] Varun Saxena commented on YARN-6847: Found this issue while writing tests for YARN-6130. NPE is because

[jira] [Created] (YARN-6847) NPE in RM while starting timeline collector on recovery after explicit failover

2017-07-19 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-6847: -- Summary: NPE in RM while starting timeline collector on recovery after explicit failover Key: YARN-6847 URL: https://issues.apache.org/jira/browse/YARN-6847 Project:

[jira] [Created] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

2017-07-19 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-6846: Summary: Nodemanager can fail to fully delete application local directories when applications are killed Key: YARN-6846 URL: https://issues.apache.org/jira/browse/YARN-6846

[jira] [Commented] (YARN-6845) Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue.

2017-07-19 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093875#comment-16093875 ] Yufei Gu commented on YARN-6845: No test is needed. Unit test failure is unrelated. > Variable scheduler

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-07-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093868#comment-16093868 ] Wangda Tan commented on YARN-4161: -- Thanks [~ywskycn], in general the patch looks good to me. And could

[jira] [Updated] (YARN-6842) Implement a new access type for queue

2017-07-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6842: - Priority: Major (was: Blocker) Target Version/s: 2.8.2 (was: 2.8.1) Lowering the priority of

[jira] [Commented] (YARN-6845) Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue.

2017-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093841#comment-16093841 ] Hadoop QA commented on YARN-6845: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6840) Leverage RMStateStore to store scheduler configuration updates

2017-07-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093827#comment-16093827 ] Wangda Tan commented on YARN-6840: -- User has to make a choice: either using queue-refresh (reloading XML

[jira] [Commented] (YARN-6768) Improve performance of yarn api record toString and fromString

2017-07-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093803#comment-16093803 ] Jason Lowe commented on YARN-6768: -- Thanks for updating the patch! Nice to see the state fall away and

[jira] [Commented] (YARN-6413) Decouple Yarn Registry API from ZK

2017-07-19 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093802#comment-16093802 ] Jian He commented on YARN-6413: --- In RegistryDNSServer, all the methods removed are essential to registryDNS -

[jira] [Updated] (YARN-6721) container-executor should have stack checking

2017-07-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-6721: -- Target Version/s: 2.7.4, 3.0.0-beta1, 2.8.2 (was: 3.0.0-beta1) >

[jira] [Updated] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-07-19 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-4161: -- Attachment: YARN-4161.005.patch > Capacity Scheduler : Assign single or multiple containers per heart beat >

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093777#comment-16093777 ] Hadoop QA commented on YARN-4161: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6768) Improve performance of yarn api record toString and fromString

2017-07-19 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093762#comment-16093762 ] Jonathan Eagles commented on YARN-6768: --- Test failure from

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-07-19 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093760#comment-16093760 ] Shane Kumpf commented on YARN-6726: --- [~vvasudev], [~wangda], [~jianhe], [~sunilg], [~chris.douglas] any

[jira] [Updated] (YARN-6698) Backport YARN-5121 to branch-2.7

2017-07-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-6698: -- Fix Version/s: 2.7.4 > Backport YARN-5121 to branch-2.7 >

[jira] [Updated] (YARN-6845) Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue.

2017-07-19 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6845: --- Attachment: YARN-6845.001.patch > Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue.

[jira] [Updated] (YARN-6845) Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue.

2017-07-19 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6845: --- Summary: Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue. (was: Variable scheduler

[jira] [Updated] (YARN-6845) Variable scheduler in FSLeafQueue duplicate the one of its parent FSQueue

2017-07-19 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6845: --- Summary: Variable scheduler in FSLeafQueue duplicate the one of its parent FSQueue (was: Variable scheduler

[jira] [Commented] (YARN-6840) Leverage RMStateStore to store scheduler configuration updates

2017-07-19 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093740#comment-16093740 ] Daniel Templeton commented on YARN-6840: Just curious, how do you plan to deal with updates to the

[jira] [Created] (YARN-6845) Variable scheduler in FSLeafQueue duplicate the one in FSQueue

2017-07-19 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6845: -- Summary: Variable scheduler in FSLeafQueue duplicate the one in FSQueue Key: YARN-6845 URL: https://issues.apache.org/jira/browse/YARN-6845 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-07-19 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-4161: -- Attachment: YARN-4161.004.patch Update patch to fix checkstyle issues. The test errors look not related to this

[jira] [Commented] (YARN-6777) Support for ApplicationMasterService processing chain of interceptors

2017-07-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093688#comment-16093688 ] Hudson commented on YARN-6777: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12035 (See

[jira] [Commented] (YARN-6777) Support for ApplicationMasterService processing chain of interceptors

2017-07-19 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093645#comment-16093645 ] Subru Krishnan commented on YARN-6777: -- Thanks [~asuresh] for updating the patch, +1 on the latest rev

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.008.patch Please consider v8 patch for review. v7 has some local unit tests file

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.007.patch Fixed all comments from [~dan...@cloudera.com] with below points open.

[jira] [Updated] (YARN-2162) Fair Scheduler :ability to optionally configure minResources and maxResources in terms of percentage

2017-07-19 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-2162: --- Component/s: fairscheduler > Fair Scheduler :ability to optionally configure minResources and maxResources >

[jira] [Commented] (YARN-3409) Add constraint node labels

2017-07-19 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093622#comment-16093622 ] Daniel Templeton commented on YARN-3409: The big advantage I see is that we don't have two

[jira] [Updated] (YARN-6843) Add unit test for NM to preempt OPPORTUNISTIC containers under high utilization

2017-07-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6843: - Summary: Add unit test for NM to preempt OPPORTUNISTIC containers under high utilization (was: Add unit

[jira] [Commented] (YARN-6768) Improve performance of yarn api record toString and fromString

2017-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093569#comment-16093569 ] Hadoop QA commented on YARN-6768: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6628) Unexpected jackson-core-2.2.3 dependency introduced

2017-07-19 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-6628: -- Attachment: YARN-6628.4-branch-2.patch > Unexpected jackson-core-2.2.3 dependency introduced >

[jira] [Commented] (YARN-6777) Support for ApplicationMasterService processing chain of interceptors

2017-07-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093556#comment-16093556 ] Arun Suresh commented on YARN-6777: --- The testcase failure is unrelated. > Support for

[jira] [Updated] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-19 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6802: --- Component/s: (was: yarn) fairscheduler > Support view leaf queue am resource usage in RM

[jira] [Updated] (YARN-6844) AMRMClientImpl.checkNodeLabelExpression() has wrong error message

2017-07-19 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6844: --- Labels: newbie (was: ) > AMRMClientImpl.checkNodeLabelExpression() has wrong error message >

[jira] [Created] (YARN-6844) AMRMClientImpl.checkNodeLabelExpression() has wrong error message

2017-07-19 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6844: -- Summary: AMRMClientImpl.checkNodeLabelExpression() has wrong error message Key: YARN-6844 URL: https://issues.apache.org/jira/browse/YARN-6844 Project: Hadoop

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093485#comment-16093485 ] Hadoop QA commented on YARN-4161: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-19 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093427#comment-16093427 ] Daniel Templeton commented on YARN-6791: If you're abandoning this JIRA, do you want to close it as

[jira] [Commented] (YARN-6842) Implement a new access type for queue

2017-07-19 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093425#comment-16093425 ] Daniel Templeton commented on YARN-6842: It sounds like you're suggesting that YARN queues should

[jira] [Updated] (YARN-6768) Improve performance of yarn api record toString and fromString

2017-07-19 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-6768: -- Attachment: YARN-6768.4.patch > Improve performance of yarn api record toString and fromString >

[jira] [Updated] (YARN-6843) Add unit test for NM to preemption OPPORTUNISTIC containers under high utilization

2017-07-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6843: - Issue Type: Sub-task (was: Bug) Parent: YARN-1011 > Add unit test for NM to preemption

[jira] [Created] (YARN-6843) Add unit test for NM to preemption OPPORTUNISTIC containers under high utilization

2017-07-19 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6843: Summary: Add unit test for NM to preemption OPPORTUNISTIC containers under high utilization Key: YARN-6843 URL: https://issues.apache.org/jira/browse/YARN-6843 Project:

[jira] [Updated] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-07-19 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-4161: -- Attachment: YARN-4161.003.patch rebase the patch > Capacity Scheduler : Assign single or multiple containers

[jira] [Commented] (YARN-6837) When the LocalResource's visibility is null, the NodeManager will shutdown

2017-07-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093326#comment-16093326 ] Hadoop QA commented on YARN-6837: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6842) Implement a new access type for queue

2017-07-19 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093282#comment-16093282 ] YunFan Zhou commented on YARN-6842: --- [~sunilg] Thank for your attention, any questions are welcome. >

[jira] [Updated] (YARN-6842) Implement a new access type for queue

2017-07-19 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6842: -- Description: When we want to access applications of a queue, only we can do is become the administer

[jira] [Commented] (YARN-6842) Implement a new access type for queue

2017-07-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093252#comment-16093252 ] Sunil G commented on YARN-6842: --- Could you please share more details. > Implement a new access type for

[jira] [Comment Edited] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-19 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093248#comment-16093248 ] YunFan Zhou edited comment on YARN-6791 at 7/19/17 3:16 PM: The solution of

[jira] [Commented] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-19 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093248#comment-16093248 ] YunFan Zhou commented on YARN-6791: --- The solution of this problem is not perfect, and I have already come

[jira] [Comment Edited] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-19 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093248#comment-16093248 ] YunFan Zhou edited comment on YARN-6791 at 7/19/17 3:15 PM: The solution of

[jira] [Created] (YARN-6842) Implement a new access type for queue

2017-07-19 Thread YunFan Zhou (JIRA)
YunFan Zhou created YARN-6842: - Summary: Implement a new access type for queue Key: YARN-6842 URL: https://issues.apache.org/jira/browse/YARN-6842 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-6223) [Umbrella] Natively support GPU configuration/discovery/scheduling/isolation on YARN

2017-07-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093148#comment-16093148 ] Zhankun Tang commented on YARN-6223: [~wangda], sorry for the late reply. Great thanks for the ver.3

[jira] [Comment Edited] (YARN-6223) [Umbrella] Natively support GPU configuration/discovery/scheduling/isolation on YARN

2017-07-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093148#comment-16093148 ] Zhankun Tang edited comment on YARN-6223 at 7/19/17 2:19 PM: - [~wangda], sorry

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-07-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093145#comment-16093145 ] Eric Badger commented on YARN-5534: --- bq. IMO, I think that feature might be better suited as a separate

[jira] [Commented] (YARN-6771) Use classloader inside configuration class to make new classes

2017-07-19 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093124#comment-16093124 ] Jongyoul Lee commented on YARN-6771: I've linked ZEPPELIN-2040 as a related issue to it. And I'll fix

[jira] [Commented] (YARN-6771) Use classloader inside configuration class to make new classes

2017-07-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093116#comment-16093116 ] Sangjin Lee commented on YARN-6771: --- Do you have a JIRA on the Zeppelin side that describes the actual

[jira] [Commented] (YARN-6507) Support FPGA abstraction framework on NM side

2017-07-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093079#comment-16093079 ] Zhankun Tang commented on YARN-6507: [~wangda], Yeah. agree with that the recovery module in NM is a

[jira] [Updated] (YARN-6507) Support FPGA abstraction framework on NM side

2017-07-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-6507: --- Attachment: YARN-6507-branch-YARN-3926.002.patch Decouple the vendor FPGA plugin from the framework.

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-07-19 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093026#comment-16093026 ] Shane Kumpf commented on YARN-5534: --- Thanks [~ebadger] and [~templedf] for the feedback. {quote}I was

Hive query taking long time in reduce phase

2017-07-19 Thread Khireswar Kalita
I am getting an issue on a production cluster where Mapreduce Job taking long time in reduce phase while running a Hive query, approximately 2 hrs for one reduce task. Hardware specification of the cluster : Number of nodes:22 Number of Master nodes4 Number of data nodes:18 Core per nodes:24

[jira] [Commented] (YARN-5728) TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout

2017-07-19 Thread Sonia Garudi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092886#comment-16092886 ] Sonia Garudi commented on YARN-5728: Any update on this? This still fails in trunk. >

[jira] [Updated] (YARN-6837) When the LocalResource's visibility is null, the NodeManager will shutdown

2017-07-19 Thread Jinjiang Ling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinjiang Ling updated YARN-6837: Attachment: YARN-6837-1.patch [~jlowe] Thanks for your suggestion. It seems that

[jira] [Created] (YARN-6841) TestOpportunisticContainerAllocatorAMService fails intermittently on trunk

2017-07-19 Thread Sonia Garudi (JIRA)
Sonia Garudi created YARN-6841: -- Summary: TestOpportunisticContainerAllocatorAMService fails intermittently on trunk Key: YARN-6841 URL: https://issues.apache.org/jira/browse/YARN-6841 Project: Hadoop

[jira] [Commented] (YARN-6819) Application report fails if app rejected due to nodesize

2017-07-19 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092686#comment-16092686 ] Bibin A Chundatt commented on YARN-6819: Thank you [~sunilg] and [~rohithsharma] for review and

[jira] [Commented] (YARN-6840) Leverage RMStateStore to store scheduler configuration updates

2017-07-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092636#comment-16092636 ] Wangda Tan commented on YARN-6840: -- [~dan...@cloudera.com], thanks for your comments. To me, scheduler

[jira] [Commented] (YARN-6819) Application report fails if app rejected due to nodesize

2017-07-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092635#comment-16092635 ] Hudson commented on YARN-6819: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12028 (See