[jira] [Commented] (YARN-3943) Use separate threshold configurations for disk-full detection and disk-not-full detection.

[ https://issues.apache.org/jira/browse/YARN-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909073#comment-14909073 ] Hadoop QA commented on YARN-3943: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-3943) Use separate threshold configurations for disk-full detection and disk-not-full detection.

[ https://issues.apache.org/jira/browse/YARN-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3943: Attachment: (was: YARN-3943.001.patch) > Use separate threshold configurations for disk-full detection

[jira] [Updated] (YARN-3943) Use separate threshold configurations for disk-full detection and disk-not-full detection.

[ https://issues.apache.org/jira/browse/YARN-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3943: Attachment: YARN-3943.001.patch > Use separate threshold configurations for disk-full detection and >

[jira] [Commented] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909070#comment-14909070 ] Hadoop QA commented on YARN-3964: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-4205) Add a service for monitoring application life time out

[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated YARN-4205: Description: This JIRA intend to provide a lifetime monitor service. The service will monitor the applications

[jira] [Commented] (YARN-162) nodemanager log aggregation has scaling issues with namenode

[ https://issues.apache.org/jira/browse/YARN-162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908237#comment-14908237 ] Kuhu Shukla commented on YARN-162: -- [~sseth] If you are not working on this, may I assign it to myself?

[jira] [Updated] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2729: Attachment: YARN-2729.20150925-1.patch Hi [~wangda] & [~rohithsharma], Please find the

[jira] [Commented] (YARN-3417) AM to be able to exit with a request saying "restart me with these (possibly updated) resource requirements"

[ https://issues.apache.org/jira/browse/YARN-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908122#comment-14908122 ] Kuhu Shukla commented on YARN-3417: --- [~varun_saxena] Are you working on this JIRA currently? If not may I

[jira] [Assigned] (YARN-4186) Make WebAppUtils a public API for yarn

[ https://issues.apache.org/jira/browse/YARN-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned YARN-4186: - Assignee: Kuhu Shukla > Make WebAppUtils a public API for yarn >

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908204#comment-14908204 ] nijel commented on YARN-4205: - Thanks [~leftnoteasy] for the comments Sorry for the small mistakes Updated the

[jira] [Updated] (YARN-4205) Add a service for monitoring application life time out

[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated YARN-4205: Attachment: YARN-4205_02.patch > Add a service for monitoring application life time out >

[jira] [Commented] (YARN-2024) IOException in AppLogAggregatorImpl does not give stacktrace and leaves aggregated TFile in a bad state.

[ https://issues.apache.org/jira/browse/YARN-2024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908224#comment-14908224 ] Kuhu Shukla commented on YARN-2024: --- [~xgong] Are you still working on this JIRA? Thanks! > IOException

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908250#comment-14908250 ] Sunil G commented on YARN-4140: --- Hi [~bibinchundatt] One more minor nit: bq.private boolean

[jira] [Commented] (YARN-4198) CapacityScheduler locking / synchronization improvements

[ https://issues.apache.org/jira/browse/YARN-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908136#comment-14908136 ] Kuhu Shukla commented on YARN-4198: --- [~curino] May I assign this JIRA to myself in case its not taken. >

[jira] [Assigned] (YARN-342) RM doesn't retry token renewals

[ https://issues.apache.org/jira/browse/YARN-342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned YARN-342: Assignee: Kuhu Shukla > RM doesn't retry token renewals > --- > >

[jira] [Commented] (YARN-4111) Killed application diagnostics message should be set rather having static mesage

[ https://issues.apache.org/jira/browse/YARN-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908201#comment-14908201 ] Sunil G commented on YARN-4111: --- Yes [~rohithsharma]. This will be better. But one thing to remember is,

[jira] [Assigned] (YARN-3638) Yarn Resource Manager Scheduler page - show percentage of total cluster that each queue is using

[ https://issues.apache.org/jira/browse/YARN-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned YARN-3638: - Assignee: Kuhu Shukla > Yarn Resource Manager Scheduler page - show percentage of total cluster

[jira] [Updated] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4140: --- Attachment: 0011-YARN-4140.patch Hi [~sunilg] Updating params as per comment > RM container

[jira] [Commented] (YARN-4198) CapacityScheduler locking / synchronization improvements

[ https://issues.apache.org/jira/browse/YARN-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908355#comment-14908355 ] Carlo Curino commented on YARN-4198: [~kshukla], I am happy to collaborate, but we have a patch in the

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908364#comment-14908364 ] Sangjin Lee commented on YARN-4075: --- Kicking off the build one more time. It might be due to the issue of

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908458#comment-14908458 ] Vrushali C commented on YARN-4075: -- Thanks @sjlee! The tests passed this time. Committing the patch in

[jira] [Updated] (YARN-4175) Example of use YARN-1197

[ https://issues.apache.org/jira/browse/YARN-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4175: - Assignee: MENG DING (was: Wangda Tan) > Example of use YARN-1197 > > >

[jira] [Commented] (YARN-4175) Example of use YARN-1197

[ https://issues.apache.org/jira/browse/YARN-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908676#comment-14908676 ] Wangda Tan commented on YARN-4175: -- Thanks for taking this [~mding], assigned to you! > Example of use

[jira] [Commented] (YARN-4175) Example of use YARN-1197

[ https://issues.apache.org/jira/browse/YARN-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908669#comment-14908669 ] MENG DING commented on YARN-4175: - Hi, [~leftnoteasy], if you are not working on this right now, I will be

[jira] [Commented] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908424#comment-14908424 ] Sunil G commented on YARN-3964: --- Hi [~dian.fu] Couple of points. 1. Is it better to check for

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908436#comment-14908436 ] MENG DING commented on YARN-1510: - I forgot to say that the failed tests are not related, as they all

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908456#comment-14908456 ] MENG DING commented on YARN-1510: - One thing I want to bring up for discussion is that this ticket adds two

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908503#comment-14908503 ] Li Lu commented on YARN-3942: - Ah I see. BTW, seems like the cache loading process in refreshCache is properly

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908548#comment-14908548 ] Vrushali C commented on YARN-4075: -- Committed patch v05, thanks [~varun_saxena] for the patch and

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908575#comment-14908575 ] Hadoop QA commented on YARN-4205: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-3942) Timeline store to read events from HDFS

[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3942: Attachment: YARN-3942-leveldb.002.patch Thanks [~gss2002]! I modified the patch with your changes. As a quick

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908403#comment-14908403 ] Naganarasimha G R commented on YARN-2729: - {{TestNodeStatusUpdaterForLabels}} is passing locally

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908423#comment-14908423 ] Greg Senia commented on YARN-3942: -- Noticed this in the timeline server logs with certain hive jobs..

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908361#comment-14908361 ] Hadoop QA commented on YARN-2729: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908435#comment-14908435 ] Li Lu commented on YARN-3942: - H... Seems quite likely, but let me double check it... > Timeline store to

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908471#comment-14908471 ] Li Lu commented on YARN-4075: - Thanks [~vrushalic]! I'll start to connect the web UI with this end point

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908440#comment-14908440 ] Hadoop QA commented on YARN-4075: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908482#comment-14908482 ] Greg Senia commented on YARN-3942: -- I see the issue.. Our security folks mandated a umask change and my

[jira] [Commented] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908489#comment-14908489 ] Naganarasimha G R commented on YARN-3964: - Hi [~sunilg], Good points sunil, But i feel we can have

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908790#comment-14908790 ] Greg Senia commented on YARN-3942: -- I was even able to create the problem with the REST/WS endpoint...

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908798#comment-14908798 ] Bibin A Chundatt commented on YARN-4140: Failures are not related to his patch > RM container

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908845#comment-14908845 ] Jonathan Eagles commented on YARN-3942: --- Also, I'm getting an error while starting up the

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908765#comment-14908765 ] Greg Senia commented on YARN-3942: -- Got beyond that and now getting this: 2015-09-25 17:43:32,249 - ERROR

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908855#comment-14908855 ] Li Lu commented on YARN-3942: - [~gss2002] the exception stack looks related to security settings? Not sure if

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908893#comment-14908893 ] Greg Senia commented on YARN-3942: -- [~gtCarrera9] that is all that is in the ATS log w/ debug enabled on

[jira] [Updated] (YARN-4092) RM HA UI redirection needs to be fixed when both RMs are in standby mode

[ https://issues.apache.org/jira/browse/YARN-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4092: -- Target Version/s: 2.8.0, 2.7.2, 2.6.2 (was: 2.8.0, 2.7.2) > RM HA UI redirection needs to be fixed when

[jira] [Updated] (YARN-4092) RM HA UI redirection needs to be fixed when both RMs are in standby mode

[ https://issues.apache.org/jira/browse/YARN-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4092: -- Fix Version/s: 2.6.2 > RM HA UI redirection needs to be fixed when both RMs are in standby mode >

[jira] [Commented] (YARN-4091) Improvement: Introduce more debug/diagnostics information to detail out scheduler activity

[ https://issues.apache.org/jira/browse/YARN-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908935#comment-14908935 ] Wangda Tan commented on YARN-4091: -- [~sunilg], sure :), cannot wait to see it! > Improvement: Introduce

[jira] [Commented] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908992#comment-14908992 ] Sunil G commented on YARN-3964: --- Hi [~Naganarasimha] Yes, We could not even create provider in case of point

[jira] [Updated] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated YARN-3964: -- Attachment: YARN-3964.009.patch > Support NodeLabelsProvider at Resource Manager side >

[jira] [Commented] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909028#comment-14909028 ] Dian Fu commented on YARN-3964: --- Hi [~Naganarasimha], [~sunilg], Thanks a lot for your review. Updated the

[jira] [Commented] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909029#comment-14909029 ] Naganarasimha G R commented on YARN-3964: - Hi [~sunilg], Point2 is debatable, my 2 cents here is,

[jira] [Updated] (YARN-3943) Use separate threshold configurations for disk-full detection and disk-not-full detection.

[ https://issues.apache.org/jira/browse/YARN-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3943: Attachment: YARN-3943.001.patch > Use separate threshold configurations for disk-full detection and >

[jira] [Commented] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909031#comment-14909031 ] Naganarasimha G R commented on YARN-3964: - Hi [~dian.fu], bq. Secondly, it's difficult to determine

[jira] [Commented] (YARN-3943) Use separate threshold configurations for disk-full detection and disk-not-full detection.

[ https://issues.apache.org/jira/browse/YARN-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909043#comment-14909043 ] zhihai xu commented on YARN-3943: - I attached a new patch YARN-3943.001.patch for review. The new patch

[jira] [Commented] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907806#comment-14907806 ] Dian Fu commented on YARN-3964: --- Hi [~Naganarasimha], Thanks a lot for your review. Have updated the patch

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907787#comment-14907787 ] Varun Saxena commented on YARN-4075: Test failures are weird. They seem to be triggered by

[jira] [Updated] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated YARN-3964: -- Attachment: YARN-3964.008.patch > Support NodeLabelsProvider at Resource Manager side >

[jira] [Commented] (YARN-3679) Add documentation for timeline server filter ordering

[ https://issues.apache.org/jira/browse/YARN-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907987#comment-14907987 ] Mit Desai commented on YARN-3679: - [~xgong], thanks for looking. YARN-3624 only changes the timeline

[jira] [Commented] (YARN-4141) Runtime Application Priority change should not throw exception for applications at finishing states

[ https://issues.apache.org/jira/browse/YARN-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907901#comment-14907901 ] Sunil G commented on YARN-4141: --- Test case failures are unrelated. > Runtime Application Priority change

[jira] [Commented] (YARN-2973) Capacity scheduler configuration ACLs not work.

[ https://issues.apache.org/jira/browse/YARN-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908046#comment-14908046 ] apachehadoop commented on YARN-2973: I also met the same problem, can you tell me how do you solve this

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908048#comment-14908048 ] Mit Desai commented on YARN-4183: - Here is the scenario. We want the Yarn application to not use the

[jira] [Updated] (YARN-2973) Capacity scheduler configuration ACLs not work.

[ https://issues.apache.org/jira/browse/YARN-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] apachehadoop updated YARN-2973: --- Environment: ubuntu 12.04, cloudera manager, cdh5.3.2 (was: ubuntu 12.04, cloudera manager, cdh5.2.1)

[jira] [Commented] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907892#comment-14907892 ] Hadoop QA commented on YARN-3964: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-4091) Improvement: Introduce more debug/diagnostics information to detail out scheduler activity

[ https://issues.apache.org/jira/browse/YARN-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908065#comment-14908065 ] Sunil G commented on YARN-4091: --- No problem. Thank you [~leftnoteasy] for sharing the thoughts. bq.I think we