[jira] [Comment Edited] (YARN-6164) Expose maximum-am-resource-percent in YarnClient

2017-03-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898896#comment-15898896 ] Sunil G edited comment on YARN-6164 at 3/7/17 7:53 AM: --- Thanks [~leftnoteasy] for

[jira] [Commented] (YARN-6164) Expose maximum-am-resource-percent in YarnClient

2017-03-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898896#comment-15898896 ] Sunil G commented on YARN-6164: --- Thanks [~leftnoteasy] for sharing the thoughts. It makes sense by seeing

[jira] [Commented] (YARN-6209) AM should get notified when application moved to new queue

2017-03-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1589#comment-1589 ] Rohith Sharma K S commented on YARN-6209: - Going through whole discussion above, I would suggest to

[jira] [Updated] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huangkaixuan updated YARN-6289: --- Description: When running a simple wordcount experiment on YARN, I noticed that the task failed to

[jira] [Commented] (YARN-6148) NM node count reported to AM in Allocate Response should consider requested node label partitions.

2017-03-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898807#comment-15898807 ] Sunil G commented on YARN-6148: --- I generally went through whole approach suggested here, and I still feel

[jira] [Assigned] (YARN-6209) AM should get notified when application moved to new queue

2017-03-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S reassigned YARN-6209: --- Assignee: Rohith Sharma K S (was: Naganarasimha G R) > AM should get notified when

[jira] [Assigned] (YARN-6209) AM should get notified when application moved to new queue

2017-03-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S reassigned YARN-6209: --- Assignee: Naganarasimha G R (was: Rohith Sharma K S) > AM should get notified when

[jira] [Commented] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-03-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898706#comment-15898706 ] Akira Ajisaka commented on YARN-6208: - Thanks [~dan...@cloudera.com] for the comment. I just thought it

[jira] [Comment Edited] (YARN-2904) Use linux cgroups to enhance container tear down

2017-03-06 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898688#comment-15898688 ] Feng Yuan edited comment on YARN-2904 at 3/7/17 3:50 AM: - In my humble opinion,Task

[jira] [Comment Edited] (YARN-2904) Use linux cgroups to enhance container tear down

2017-03-06 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898688#comment-15898688 ] Feng Yuan edited comment on YARN-2904 at 3/7/17 3:49 AM: - In my humble opinion,Task

[jira] [Commented] (YARN-2904) Use linux cgroups to enhance container tear down

2017-03-06 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898688#comment-15898688 ] Feng Yuan commented on YARN-2904: - In my humble opinion,Task process leak but some unknowable

[jira] [Updated] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huangkaixuan updated YARN-6289: --- Attachment: Hadoop_Spark_Conf.zip > Fail to achieve data locality when runing MapReduce and Spark on

[jira] [Updated] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huangkaixuan updated YARN-6289: --- Issue Type: Bug (was: Improvement) > Fail to achieve data locality when runing MapReduce and Spark on

[jira] [Updated] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huangkaixuan updated YARN-6289: --- Priority: Major (was: Minor) > Fail to achieve data locality when runing MapReduce and Spark on HDFS

[jira] [Updated] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huangkaixuan updated YARN-6289: --- Attachment: YARN-DataLocality.docx > Fail to achieve data locality when runing MapReduce and Spark on

[jira] [Updated] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huangkaixuan updated YARN-6289: --- Attachment: (was: YARN-6289.01.docx) > Fail to achieve data locality when runing MapReduce and

[jira] [Updated] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huangkaixuan updated YARN-6289: --- Description: When I ran experiments with both Spark and MapReduce wordcount on YARN, I noticed that

[jira] [Comment Edited] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898619#comment-15898619 ] Huangkaixuan edited comment on YARN-6289 at 3/7/17 3:33 AM: The detailed

[jira] [Updated] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huangkaixuan updated YARN-6289: --- Summary: Fail to achieve data locality when runing MapReduce and Spark on HDFS (was: yarn got little

[jira] [Commented] (YARN-6293) Investigate Java 7 compatibility for new YARN UI

2017-03-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898643#comment-15898643 ] Sunil G commented on YARN-6293: --- cc/ [~Sreenath] > Investigate Java 7 compatibility for new YARN UI >

[jira] [Comment Edited] (YARN-6289) yarn got little data locality

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898619#comment-15898619 ] Huangkaixuan edited comment on YARN-6289 at 3/7/17 2:45 AM: The detail results

[jira] [Commented] (YARN-5703) ReservationAgents are not correctly configured

2017-03-06 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898630#comment-15898630 ] Sean Po commented on YARN-5703: --- I apologize for not responding, [~maniraj...@gmail.com] and

[jira] [Assigned] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

2017-03-06 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po reassigned YARN-5881: - Assignee: Wangda Tan (was: Sean Po) > Enable configuration of queue capacity in terms of absolute

[jira] [Commented] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

2017-03-06 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898625#comment-15898625 ] Sean Po commented on YARN-5881: --- Thanks Wangda, please take over the ticket. I have assigned it to you. >

[jira] [Commented] (YARN-6289) yarn got little data locality

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898619#comment-15898619 ] Huangkaixuan commented on YARN-6289: The detail results of the experiment are shown in the patch >

[jira] [Commented] (YARN-6234) Support multiple attempts on the node when AMRMProxy is enabled

2017-03-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898613#comment-15898613 ] Giovanni Matteo Fumarola commented on YARN-6234: The failed test is not related to the

[jira] [Commented] (YARN-6042) Dump scheduler and queue state information into FairScheduler DEBUG log

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898609#comment-15898609 ] Hadoop QA commented on YARN-6042: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5579) Resourcemanager should surface failed state store operation prominently

2017-03-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated YARN-5579: - Description: I found the following in Resourcemanager log when I tried to figure out why application got stuck in

[jira] [Commented] (YARN-6234) Support multiple attempts on the node when AMRMProxy is enabled

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898543#comment-15898543 ] Hadoop QA commented on YARN-6234: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6146) Add Builder methods for TimelineEntityFilters

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898467#comment-15898467 ] Hadoop QA commented on YARN-6146: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6234) Support multiple attempts on the node when AMRMProxy is enabled

2017-03-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6234: --- Attachment: YARN-6234-YARN-2915.v1.patch > Support multiple attempts on the

[jira] [Updated] (YARN-6146) Add Builder methods for TimelineEntityFilters

2017-03-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6146: - Attachment: YARN-6146.01.patch > Add Builder methods for TimelineEntityFilters >

[jira] [Updated] (YARN-6146) Add Builder methods for TimelineEntityFilters

2017-03-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6146: - Attachment: YARN-6146-YARN-5355.01.patch Uploading a patch for branch YARN-5355 > Add Builder methods for

[jira] [Commented] (YARN-6042) Dump scheduler and queue state information into FairScheduler DEBUG log

2017-03-06 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898389#comment-15898389 ] Yufei Gu commented on YARN-6042: Thanks for the review [~rchiang], uploaded patch v9 to get logger name

[jira] [Updated] (YARN-6042) Dump scheduler and queue state information into FairScheduler DEBUG log

2017-03-06 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6042: --- Attachment: YARN-6042.009.patch > Dump scheduler and queue state information into FairScheduler DEBUG log >

[jira] [Commented] (YARN-5948) Implement MutableConfigurationManager for handling storage into configuration store

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898375#comment-15898375 ] Hadoop QA commented on YARN-5948: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-03-06 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898372#comment-15898372 ] Daniel Templeton commented on YARN-6208: Thanks for the patch, [~ajisakaa]. I like the additional

[jira] [Created] (YARN-6294) ATS client should better handle Socket closed case

2017-03-06 Thread Junping Du (JIRA)
Junping Du created YARN-6294: Summary: ATS client should better handle Socket closed case Key: YARN-6294 URL: https://issues.apache.org/jira/browse/YARN-6294 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6285) Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications

2017-03-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898331#comment-15898331 ] Wangda Tan commented on YARN-6285: -- [~zhaoyunjiong], from your previous comment: bq. 1. Slowness in

[jira] [Assigned] (YARN-6287) RMCriticalThreadUncaughtExceptionHandler.rmContext should be final

2017-03-06 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-6287: -- Assignee: Corey Barker (was: Yufei Gu) >

[jira] [Resolved] (YARN-516) TestContainerLocalizer.testContainerLocalizerMain is failing

2017-03-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved YARN-516. -- Resolution: Later Resolving this old stale JIRA, unlikely we're going to do anything on HADOOP-9357. >

[jira] [Commented] (YARN-5665) Enhance documentation for yarn.resourcemanager.scheduler.class property

2017-03-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898272#comment-15898272 ] Hudson commented on YARN-5665: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11355 (See

[jira] [Commented] (YARN-5665) Enhance documentation for yarn.resourcemanager.scheduler.class property

2017-03-06 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898270#comment-15898270 ] Yufei Gu commented on YARN-5665: Thanks [~rchiang] for the review and commit. > Enhance documentation for

[jira] [Comment Edited] (YARN-5665) Enhance documentation for yarn.resourcemanager.scheduler.class property

2017-03-06 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898270#comment-15898270 ] Yufei Gu edited comment on YARN-5665 at 3/6/17 10:27 PM: - Thanks [~rchiang] for the

[jira] [Commented] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-03-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898262#comment-15898262 ] Wangda Tan commented on YARN-6050: -- [~rkanter], The reason of "nodeA:0" means "nodeA:*" which will be

[jira] [Commented] (YARN-5665) Enhance documentation for yarn.resourcemanager.scheduler.class property

2017-03-06 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898244#comment-15898244 ] Ray Chiang commented on YARN-5665: -- Sorry for the delay. +1. Committing soon. > Enhance documentation

[jira] [Commented] (YARN-5948) Implement MutableConfigurationManager for handling storage into configuration store

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898242#comment-15898242 ] Hadoop QA commented on YARN-5948: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-6292) YARN log aggregation doesn't support HDFS/ViewFs namespace other than what is specified in fs.defaultFS

2017-03-06 Thread Ang Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ang Zhang resolved YARN-6292. - Resolution: Duplicate Close as a duplicate of YARN-3269 > YARN log aggregation doesn't support

[jira] [Updated] (YARN-5665) Enhance documentation for yarn.resourcemanager.scheduler.class property

2017-03-06 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5665: - Summary: Enhance documentation for yarn.resourcemanager.scheduler.class property (was: Improve

[jira] [Updated] (YARN-5665) Improve documentation for yarn.resourcemanager.scheduler.class property

2017-03-06 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5665: - Summary: Improve documentation for yarn.resourcemanager.scheduler.class property (was: Documentation does

[jira] [Commented] (YARN-6292) YARN log aggregation doesn't support HDFS/ViewFs namespace other than what is specified in fs.defaultFS

2017-03-06 Thread Ang Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898225#comment-15898225 ] Ang Zhang commented on YARN-6292: - Yes [~jlowe], it is a duplicate of YARN-3269, thanks! > YARN log

[jira] [Commented] (YARN-6293) Investigate Java 7 compatibility for new YARN UI

2017-03-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898221#comment-15898221 ] Li Lu commented on YARN-6293: - Actually I just directly changed the ui module's pom.xml. I changed the parent

[jira] [Commented] (YARN-6164) Expose maximum-am-resource-percent in YarnClient

2017-03-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898192#comment-15898192 ] Wangda Tan commented on YARN-6164: -- Adding {{QueueConfigurations}} to QueueInfo is a good idea to me, but

[jira] [Updated] (YARN-5948) Implement MutableConfigurationManager for handling storage into configuration store

2017-03-06 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-5948: Attachment: YARN-5948-YARN-5734.005.patch > Implement MutableConfigurationManager for handling

[jira] [Commented] (YARN-5418) When partial log aggregation is enabled, display the list of aggregated files on the container log page

2017-03-06 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898190#comment-15898190 ] Xuan Gong commented on YARN-5418: - uploaded a patch for this. > When partial log aggregation is enabled,

[jira] [Created] (YARN-6293) Investigate Java 7 compatibility for new YARN UI

2017-03-06 Thread Li Lu (JIRA)
Li Lu created YARN-6293: --- Summary: Investigate Java 7 compatibility for new YARN UI Key: YARN-6293 URL: https://issues.apache.org/jira/browse/YARN-6293 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-5418) When partial log aggregation is enabled, display the list of aggregated files on the container log page

2017-03-06 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5418: Attachment: Screen Shot 2017-03-06 at 1.38.04 PM.png > When partial log aggregation is enabled, display the

[jira] [Updated] (YARN-5418) When partial log aggregation is enabled, display the list of aggregated files on the container log page

2017-03-06 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5418: Attachment: YARN-5418.1.patch > When partial log aggregation is enabled, display the list of aggregated

[jira] [Commented] (YARN-5948) Implement MutableConfigurationManager for handling storage into configuration store

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898145#comment-15898145 ] Hadoop QA commented on YARN-5948: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-5418) When partial log aggregation is enabled, display the list of aggregated files on the container log page

2017-03-06 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-5418: --- Assignee: Xuan Gong > When partial log aggregation is enabled, display the list of aggregated files

[jira] [Commented] (YARN-6292) YARN log aggregation doesn't support HDFS/ViewFs namespace other than what is specified in fs.defaultFS

2017-03-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898091#comment-15898091 ] Jason Lowe commented on YARN-6292: -- What version is involved here? Is this a duplicate of YARN-3269? >

[jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-03-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898083#comment-15898083 ] Jason Lowe commented on YARN-6195: -- Thanks for the patch, [~benson.qiu]! I'm confused about how labels

[jira] [Created] (YARN-6292) YARN log aggregation doesn't support HDFS/ViewFs namespace other than what is specified in fs.defaultFS

2017-03-06 Thread Ang Zhang (JIRA)
Ang Zhang created YARN-6292: --- Summary: YARN log aggregation doesn't support HDFS/ViewFs namespace other than what is specified in fs.defaultFS Key: YARN-6292 URL: https://issues.apache.org/jira/browse/YARN-6292

[jira] [Commented] (YARN-6285) Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications

2017-03-06 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897949#comment-15897949 ] yunjiong zhao commented on YARN-6285: - [~sunilg], Totally agree. This patch is for short time purpose

[jira] [Commented] (YARN-5948) Implement MutableConfigurationManager for handling storage into configuration store

2017-03-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897947#comment-15897947 ] Hadoop QA commented on YARN-5948: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5948) Implement MutableConfigurationManager for handling storage into configuration store

2017-03-06 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897906#comment-15897906 ] Jonathan Hung commented on YARN-5948: - 004 fixes checkstyle. > Implement MutableConfigurationManager

[jira] [Updated] (YARN-5948) Implement MutableConfigurationManager for handling storage into configuration store

2017-03-06 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-5948: Attachment: YARN-5948-YARN-5734.004.patch > Implement MutableConfigurationManager for handling

[jira] [Commented] (YARN-5179) Issue of CPU usage of containers

2017-03-06 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897728#comment-15897728 ] Manikandan R commented on YARN-5179: [~kasha]/[~konstantinos], any thoughts? > Issue of CPU usage of

[jira] [Commented] (YARN-6164) Expose maximum-am-resource-percent in YarnClient

2017-03-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897695#comment-15897695 ] Sunil G commented on YARN-6164: --- [~benson.qiu] I personally feel that having {{QueueConfigurations}} inside

[jira] [Commented] (YARN-6164) Expose maximum-am-resource-percent in YarnClient

2017-03-06 Thread Benson Qiu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897685#comment-15897685 ] Benson Qiu commented on YARN-6164: -- [~sunilg] [~bibinchundatt] I'm planning to set aside some time this

[jira] [Commented] (YARN-6207) Move application can fail when attempt add event is delayed

2017-03-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897673#comment-15897673 ] Sunil G commented on YARN-6207: --- +1 committing shortly. > Move application can fail when attempt add event

[jira] [Commented] (YARN-6237) Move UID constant into TimelineReaderUtils

2017-03-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897476#comment-15897476 ] Varun Saxena commented on YARN-6237: Thanks [~rohithsharma] ! Straightforward fix. Will commit it after

[jira] [Commented] (YARN-6256) Add FROM_ID info key for timeline entities in reader response.

2017-03-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897473#comment-15897473 ] Varun Saxena commented on YARN-6256: Thanks [~rohithsharma] for the latest patch. Changes LGTM. Will

[jira] [Assigned] (YARN-6237) Move UID constant into TimelineReaderUtils

2017-03-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-6237: -- Assignee: Rohith Sharma K S > Move UID constant into TimelineReaderUtils >

[jira] [Updated] (YARN-6291) [YARN-3368] Introduce query parameters (sort, filter, etc.) for tables to keep state on refresh/navigation

2017-03-06 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-6291: Attachment: YARN-6291.001.patch Patch #1 adds these query parameters to both "Applications" and

[jira] [Commented] (YARN-6148) NM node count reported to AM in Allocate Response should consider requested node label partitions.

2017-03-06 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897404#comment-15897404 ] Naganarasimha G R commented on YARN-6148: - bq. When default label for an application changes which

[jira] [Commented] (YARN-6276) Now container kill mechanism may lead process leak

2017-03-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897373#comment-15897373 ] Jason Lowe commented on YARN-6276: -- Processes escaping from the session is a known problem. If that's the

[jira] [Created] (YARN-6291) [YARN-3368] Introduce query parameters (sort, filter, etc.) for tables to keep state on refresh/navigation

2017-03-06 Thread JIRA
Gergely Novák created YARN-6291: --- Summary: [YARN-3368] Introduce query parameters (sort, filter, etc.) for tables to keep state on refresh/navigation Key: YARN-6291 URL:

[jira] [Updated] (YARN-6289) yarn got little data locality

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huangkaixuan updated YARN-6289: --- Description: When I ran experiments with both Spark and MapReduce wordcount with yarn on the

[jira] [Updated] (YARN-6182) [YARN-3368] Fix alignment issues and missing information in Queue pages

2017-03-06 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-6182: --- Description: This patch fixes following issues: In Queues page: # Queue Capacities: Absolute Max Capacity

[jira] [Updated] (YARN-6182) [YARN-3368] Fix alignment issues and missing information in Queue pages

2017-03-06 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-6182: --- Description: This patch fixes following issues: In Queues page: # Queue Capacities: Absolute Max Capacity

[jira] [Updated] (YARN-6289) yarn got little data locality

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huangkaixuan updated YARN-6289: --- Attachment: (was: YARN-6289.01.docx) > yarn got little data locality >

[jira] [Updated] (YARN-6289) yarn got little data locality

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huangkaixuan updated YARN-6289: --- Attachment: YARN-6289.01.docx > yarn got little data locality > - > >

[jira] [Updated] (YARN-6289) yarn got little data locality

2017-03-06 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huangkaixuan updated YARN-6289: --- Description: When I ran experiments with both Spark and MapReduce wordcount with yarn on the

[jira] [Commented] (YARN-6148) NM node count reported to AM in Allocate Response should consider requested node label partitions.

2017-03-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897155#comment-15897155 ] Varun Saxena commented on YARN-6148: Me and Naga just had an offline discussion with [~sunilg]. Will

[jira] [Commented] (YARN-6209) AM should get notified when application moved to new queue

2017-03-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897123#comment-15897123 ] Varun Saxena commented on YARN-6209: My thoughts. Probably you meant the same in comment above. I think

[jira] [Created] (YARN-6290) Fair scheduler page broken

2017-03-06 Thread JIRA
Léopold Boudard created YARN-6290: - Summary: Fair scheduler page broken Key: YARN-6290 URL: https://issues.apache.org/jira/browse/YARN-6290 Project: Hadoop YARN Issue Type: Bug Affects

[jira] [Commented] (YARN-6209) AM should get notified when application moved to new queue

2017-03-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897069#comment-15897069 ] Sunil G commented on YARN-6209: --- Ideally its better if we get an update from RM regarding the real AM' label.

[jira] [Comment Edited] (YARN-6209) AM should get notified when application moved to new queue

2017-03-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896994#comment-15896994 ] Varun Saxena edited comment on YARN-6209 at 3/6/17 10:06 AM: - Basically in

[jira] [Comment Edited] (YARN-6148) NM node count reported to AM in Allocate Response should consider requested node label partitions.

2017-03-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896978#comment-15896978 ] Varun Saxena edited comment on YARN-6148 at 3/6/17 10:00 AM: - Offline, we (me,

[jira] [Commented] (YARN-6209) AM should get notified when application moved to new queue

2017-03-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896994#comment-15896994 ] Varun Saxena commented on YARN-6209: Basically in SchedulerUtils while normalizing ask after receiving

[jira] [Commented] (YARN-6285) Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications

2017-03-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896984#comment-15896984 ] Sunil G commented on YARN-6285: --- Thanks [~zhaoyunjiong]. I understood the points made above. However I still

[jira] [Commented] (YARN-6148) NM node count reported to AM in Allocate Response should consider requested node label partitions.

2017-03-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896978#comment-15896978 ] Varun Saxena commented on YARN-6148: Offline. we (me, [~Naganarasimha] and [~bibinchundatt]) had

[jira] [Comment Edited] (YARN-6148) NM node count reported to AM in Allocate Response should consider requested node label partitions.

2017-03-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896978#comment-15896978 ] Varun Saxena edited comment on YARN-6148 at 3/6/17 9:39 AM: Offline, we (me,

[jira] [Comment Edited] (YARN-6209) AM should get notified when application moved to new queue

2017-03-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896973#comment-15896973 ] Sunil G edited comment on YARN-6209 at 3/6/17 9:37 AM: --- Sorry to ask this question. I

[jira] [Commented] (YARN-6209) AM should get notified when application moved to new queue

2017-03-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896973#comment-15896973 ] Sunil G commented on YARN-6209: --- Sorry to ask this question. bq.default label of the queue Why this is needed

[jira] [Commented] (YARN-6209) AM should get notified when application moved to new queue

2017-03-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896967#comment-15896967 ] Varun Saxena commented on YARN-6209: Probably you mean that we report default label of the queue to

[jira] [Comment Edited] (YARN-6209) AM should get notified when application moved to new queue

2017-03-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896947#comment-15896947 ] Varun Saxena edited comment on YARN-6209 at 3/6/17 9:20 AM: bq. Along with

[jira] [Commented] (YARN-6209) AM should get notified when application moved to new queue

2017-03-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896947#comment-15896947 ] Varun Saxena commented on YARN-6209: bq. Along with queue we have to send label too when default queue

[jira] [Assigned] (YARN-6209) AM should get notified when application moved to new queue

2017-03-06 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-6209: --- Assignee: Naganarasimha G R > AM should get notified when application moved to new

  1   2   >