[jira] [Updated] (YARN-2123) Progress bars in Web UI always at 100% due to non-US locale

2015-03-30 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-2123: Attachment: YARN-2123-002.patch Rebased. > Progress bars in Web UI always at 100% due to non-US loca

[jira] [Commented] (YARN-3416) deadlock in a job between map and reduce cores allocation

2015-03-30 Thread mai shurong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386301#comment-14386301 ] mai shurong commented on YARN-3416: --- The AM logs are repeately printed such as follows:

[jira] [Commented] (YARN-3416) deadlock in a job between map and reduce cores allocation

2015-03-30 Thread mai shurong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386300#comment-14386300 ] mai shurong commented on YARN-3416: --- The AM logs are repeately printed such as follows:

[jira] [Commented] (YARN-2123) Progress bars in Web UI always at 100% due to non-US locale

2015-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386401#comment-14386401 ] Hadoop QA commented on YARN-2123: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (YARN-3417) AM to be able to exit with a request saying "restart me with these (possibly updated) resource requirements)

2015-03-30 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-3417: Summary: AM to be able to exit with a request saying "restart me with these (possibly updated) resource requirements) Key: YARN-3417 URL: https://issues.apache.org/jira/browse/YAR

[jira] [Commented] (YARN-896) Roll up for long-lived services in YARN

2015-03-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386530#comment-14386530 ] Steve Loughran commented on YARN-896: - YARN-3417: AM to be able to exit with a request t

[jira] [Created] (YARN-3418) AM to be able to set/update web URL and IPC ports post-registration

2015-03-30 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-3418: Summary: AM to be able to set/update web URL and IPC ports post-registration Key: YARN-3418 URL: https://issues.apache.org/jira/browse/YARN-3418 Project: Hadoop YARN

[jira] [Commented] (YARN-896) Roll up for long-lived services in YARN

2015-03-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386537#comment-14386537 ] Steve Loughran commented on YARN-896: - Link to YARN-3418: AM to be able to update web an

[jira] [Updated] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-03-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3293: Attachment: Screen Shot 2015-03-30 at 4.30.14 PM.png Attached screenshot of additions to the Capacity

[jira] [Updated] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-03-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3293: Attachment: apache-yarn-3293.0.patch Uploaded initial patch > Track and display capacity scheduler h

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-03-30 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386576#comment-14386576 ] Varun Saxena commented on YARN-3047: [~sjlee0], the initial scope of this JIRA as you m

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-03-30 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386581#comment-14386581 ] Varun Saxena commented on YARN-3051: bq. Currently we're not including our first-class

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-03-30 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386584#comment-14386584 ] Varun Saxena commented on YARN-3051: bq. given a time window, query all entities in thi

[jira] [Assigned] (YARN-3418) AM to be able to set/update web URL and IPC ports post-registration

2015-03-30 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-3418: Assignee: Rohith > AM to be able to set/update web URL and IPC ports post-registration > ---

[jira] [Commented] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386633#comment-14386633 ] Hadoop QA commented on YARN-3293: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-03-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3293: Attachment: apache-yarn-3293.1.patch Updated patch to address findbugs warnings. > Track and display

[jira] [Updated] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3304: - Attachment: YARN-3304-v8.patch There are still two issues with v7 version: 1. cpuTimeMs in WindowsBasedProc

[jira] [Created] (YARN-3419) ConcurrentModificationException in FSLeafQueue

2015-03-30 Thread Dustin Cote (JIRA)
Dustin Cote created YARN-3419: - Summary: ConcurrentModificationException in FSLeafQueue Key: YARN-3419 URL: https://issues.apache.org/jira/browse/YARN-3419 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386773#comment-14386773 ] Hadoop QA commented on YARN-3293: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-3419) ConcurrentModificationException in FSLeafQueue

2015-03-30 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Cote updated YARN-3419: -- Attachment: YARN-3419-1.patch Attaching a patch moving to a thread safe ArrayList implementation > Conc

[jira] [Updated] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-03-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3293: Attachment: apache-yarn-3293.2.patch Uploaded patch to fix failing web service tests, > Track and di

[jira] [Commented] (YARN-3419) ConcurrentModificationException in FSLeafQueue

2015-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386790#comment-14386790 ] Hadoop QA commented on YARN-3419: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386823#comment-14386823 ] Hadoop QA commented on YARN-3304: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3419) ConcurrentModificationException in FSLeafQueue

2015-03-30 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386825#comment-14386825 ] Tsuyoshi Ozawa commented on YARN-3419: -- [~cotedm], Thank you for reporting. I think th

[jira] [Assigned] (YARN-3417) AM to be able to exit with a request saying "restart me with these (possibly updated) resource requirements)

2015-03-30 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3417: -- Assignee: Varun Saxena > AM to be able to exit with a request saying "restart me with these (pos

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386847#comment-14386847 ] Junping Du commented on YARN-3304: -- Hi [~adhoot], [~kasha] and [~vinodkv], I am sure v8 pa

[jira] [Commented] (YARN-3419) ConcurrentModificationException in FSLeafQueue

2015-03-30 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386850#comment-14386850 ] Dustin Cote commented on YARN-3419: --- [~ozawa] yep that will probably fix it, just on the

[jira] [Commented] (YARN-3169) drop the useless yarn overview document

2015-03-30 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386861#comment-14386861 ] Tsuyoshi Ozawa commented on YARN-3169: -- [~brahmareddy] the link to overview document a

[jira] [Commented] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386934#comment-14386934 ] Hadoop QA commented on YARN-3293: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2923) Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup

2015-03-30 Thread Jian Fang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386960#comment-14386960 ] Jian Fang commented on YARN-2923: - Thanks Naganarasimha for your quick update. I think y

[jira] [Commented] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-03-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386975#comment-14386975 ] Varun Vasudev commented on YARN-3293: - The test failures are unrelated. The findbugs wa

[jira] [Updated] (YARN-3417) AM to be able to exit with a request saying "restart me with these (possibly updated) resource requirements"

2015-03-30 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-3417: Summary: AM to be able to exit with a request saying "restart me with these (possibly updated) resource requi

[jira] [Commented] (YARN-3416) deadlock in a job between map and reduce cores allocation

2015-03-30 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386992#comment-14386992 ] Ray Chiang commented on YARN-3416: -- There probably is a bug here, but what value do you ha

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-03-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386996#comment-14386996 ] Steve Loughran commented on YARN-2423: -- Note that I've implemented the production-side

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386997#comment-14386997 ] Vinod Kumar Vavilapalli commented on YARN-3304: --- Tx for the update, [~djp]. L

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387021#comment-14387021 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-trunk-Commit #7461 (See [https:

[jira] [Created] (YARN-3420) Typos in SwiftNativeFileSystem and SwiftNativeFileSystemStore Javadoc

2015-03-30 Thread Chen He (JIRA)
Chen He created YARN-3420: - Summary: Typos in SwiftNativeFileSystem and SwiftNativeFileSystemStore Javadoc Key: YARN-3420 URL: https://issues.apache.org/jira/browse/YARN-3420 Project: Hadoop YARN I

[jira] [Commented] (YARN-2923) Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup

2015-03-30 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387023#comment-14387023 ] Naganarasimha G R commented on YARN-2923: - Thanks [~john.jian.fang] for your feedba

[jira] [Updated] (YARN-3420) Typos in SwiftNativeFileSystem and SwiftNativeFileSystemStore Javadoc

2015-03-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3420: --- Component/s: (was: documentation) > Typos in SwiftNativeFileSystem and SwiftNativeF

[jira] [Created] (YARN-3421) Typos in SwiftNativeFileSystem and SwiftNativeFileSystemStore Javadoc

2015-03-30 Thread Chen He (JIRA)
Chen He created YARN-3421: - Summary: Typos in SwiftNativeFileSystem and SwiftNativeFileSystemStore Javadoc Key: YARN-3421 URL: https://issues.apache.org/jira/browse/YARN-3421 Project: Hadoop YARN Is

[jira] [Updated] (YARN-3420) Typos in SwiftNativeFileSystem and SwiftNativeFileSystemStore Javadoc

2015-03-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3420: --- Component/s: documentation > Typos in SwiftNativeFileSystem and SwiftNativeFileSystemSt

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-03-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387062#comment-14387062 ] Sangjin Lee commented on YARN-3051: --- {quote} I agree we need to support all these queries

[jira] [Commented] (YARN-2923) Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup

2015-03-30 Thread Jian Fang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387065#comment-14387065 ] Jian Fang commented on YARN-2923: - That would require that our controller to monitor the li

[jira] [Updated] (YARN-3361) CapacityScheduler side changes to support non-exclusive node labels

2015-03-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3361: - Attachment: YARN-3361.1.patch Attached ver.1 patch for review. > CapacityScheduler side changes to support

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2015-03-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387091#comment-14387091 ] Arun Suresh commented on YARN-2962: --- [~varun_saxena], Thanks for the patch. It looks pret

[jira] [Created] (YARN-3422) relatedentities always return empty list when primary filter is set

2015-03-30 Thread Chang Li (JIRA)
Chang Li created YARN-3422: -- Summary: relatedentities always return empty list when primary filter is set Key: YARN-3422 URL: https://issues.apache.org/jira/browse/YARN-3422 Project: Hadoop YARN Is

[jira] [Updated] (YARN-3422) relatedentities always return empty list when primary filter is set

2015-03-30 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-3422: --- Attachment: YARN-3422.1.patch > relatedentities always return empty list when primary filter is set > -

[jira] [Updated] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

2015-03-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2003: -- Attachment: 0005-YARN-2003.patch Uploading a patch as per the comments. [~leftnoteasy] kindly check. > Support t

[jira] [Commented] (YARN-3422) relatedentities always return empty list when primary filter is set

2015-03-30 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387109#comment-14387109 ] Chang Li commented on YARN-3422: Hi [~zjshen], could you help me verify if this is a right

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-03-30 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387112#comment-14387112 ] Naganarasimha G R commented on YARN-3044: - Hi [~zjshen], [~djp] & [~sjlee0], I am

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-03-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387114#comment-14387114 ] Sunil G commented on YARN-3136: --- Hi [~jlowe] [~jianhe] {noformat} Bug type IS2_INCONSISTENT_S

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-03-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387136#comment-14387136 ] Sangjin Lee commented on YARN-3051: --- cc [~vrushalic] As for whether readers should speci

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-03-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387153#comment-14387153 ] Sangjin Lee commented on YARN-3047: --- I am fine with committing this patch with the unders

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-03-30 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387172#comment-14387172 ] Vrushali C commented on YARN-3051: -- That sounds correct, Sangjin. I will add that to the h

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-03-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387175#comment-14387175 ] Sangjin Lee commented on YARN-3044: --- bq. I am planning to go ahead with the approach spec

[jira] [Commented] (YARN-3422) relatedentities always return empty list when primary filter is set

2015-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387181#comment-14387181 ] Hadoop QA commented on YARN-3422: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2901) Add errors and warning stats to RM, NM web UI

2015-03-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387203#comment-14387203 ] Wangda Tan commented on YARN-2901: -- Hi Varun, Thanks for updating patch, I took a look aga

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387240#comment-14387240 ] Hudson commented on YARN-2495: -- FAILURE: Integrated in Hadoop-trunk-Commit #7467 (See [https:

[jira] [Commented] (YARN-3361) CapacityScheduler side changes to support non-exclusive node labels

2015-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387258#comment-14387258 ] Hadoop QA commented on YARN-3361: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-3361) CapacityScheduler side changes to support non-exclusive node labels

2015-03-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3361: - Attachment: YARN-3361.2.patch Attached ver.2 patch fixed findbugs warnings, failed tests are not related to

[jira] [Resolved] (YARN-3420) Typos in SwiftNativeFileSystem and SwiftNativeFileSystemStore Javadoc

2015-03-30 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He resolved YARN-3420. --- Resolution: Duplicate Release Note: Duplicated of HADOOP-11775 > Typos in SwiftNativeFileSystem and Swift

[jira] [Updated] (YARN-3420) Typos in SwiftNativeFileSystem and SwiftNativeFileSystemStore Javadoc

2015-03-30 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated YARN-3420: -- Assignee: (was: Chen He) > Typos in SwiftNativeFileSystem and SwiftNativeFileSystemStore Javadoc > -

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2015-03-30 Thread Jian Fang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387310#comment-14387310 ] Jian Fang commented on YARN-796: I took a look at ApplicationSubmissionContext.amContainerLa

[jira] [Commented] (YARN-3361) CapacityScheduler side changes to support non-exclusive node labels

2015-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387318#comment-14387318 ] Hadoop QA commented on YARN-3361: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387345#comment-14387345 ] Hitesh Shah commented on YARN-3304: --- Sigh. This broke compatibility again. Was there a re

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-03-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387351#comment-14387351 ] Zhijie Shen commented on YARN-3051: --- bq. Wanted to know, how will app context information

[jira] [Reopened] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah reopened YARN-3304: --- Also, FWIW, ResourceCalculatorProcessTree is a public API. Re-opening as this breaks Tez ( again ). > Res

[jira] [Commented] (YARN-3388) userlimit isn't playing well with DRF calculator

2015-03-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387413#comment-14387413 ] Wangda Tan commented on YARN-3388: -- Hi [~nroberts], Sorry for my late response and thanks

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-03-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387425#comment-14387425 ] Sandy Ryza commented on YARN-3415: -- This looks mostly reasonable. A few comments: * In FS

[jira] [Updated] (YARN-2890) MiniMRYarnCluster should turn on timeline service if configured to do so

2015-03-30 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-2890: Attachment: YARN-2890.3.patch Removed debug statements. > MiniMRYarnCluster should turn on timeline service

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-03-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387462#comment-14387462 ] Zhijie Shen commented on YARN-3391: --- bq. Then we can apply default values for all (name

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-03-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387463#comment-14387463 ] Sangjin Lee commented on YARN-3334: --- Sorry it took a while for me to go over the patch. I

[jira] [Commented] (YARN-2890) MiniMRYarnCluster should turn on timeline service if configured to do so

2015-03-30 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387464#comment-14387464 ] Mit Desai commented on YARN-2890: - [~hitesh], the test failures were due to HADOOP-11754 >

[jira] [Commented] (YARN-3361) CapacityScheduler side changes to support non-exclusive node labels

2015-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387469#comment-14387469 ] Hadoop QA commented on YARN-3361: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387478#comment-14387478 ] Vinod Kumar Vavilapalli commented on YARN-3304: --- To summarize what happened s

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-03-30 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387491#comment-14387491 ] Vrushali C commented on YARN-3391: -- bq. I propose: flow name: String: default(cluster_) A

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-03-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387498#comment-14387498 ] Li Lu commented on YARN-3334: - Hi [~sjlee0], I have some quick questions about getTimelineClien

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387509#comment-14387509 ] Junping Du commented on YARN-3304: -- Let's do here. I will upload a quick patch soon. > Re

[jira] [Commented] (YARN-2890) MiniMRYarnCluster should turn on timeline service if configured to do so

2015-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387513#comment-14387513 ] Hadoop QA commented on YARN-2890: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-03-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387515#comment-14387515 ] Zhijie Shen commented on YARN-3391: --- bq. do you know of any such config or context parame

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-03-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387523#comment-14387523 ] Zhijie Shen commented on YARN-3334: --- [~djp], [~sjlee0], [~gtCarrera9], per may previous c

[jira] [Comment Edited] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-03-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387523#comment-14387523 ] Zhijie Shen edited comment on YARN-3334 at 3/30/15 10:37 PM: - [

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387544#comment-14387544 ] Wangda Tan commented on YARN-3318: -- Hi Craig, Thanks for working on the patch, I just took

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-03-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387552#comment-14387552 ] Li Lu commented on YARN-3334: - OK, that solution LGTM. I'd like to double check if there are an

[jira] [Updated] (YARN-3388) Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit

2015-03-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3388: - Summary: Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing

[jira] [Commented] (YARN-3388) Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit

2015-03-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387556#comment-14387556 ] Wangda Tan commented on YARN-3388: -- Updated description. > Allocation in LeafQueue could

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-03-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387561#comment-14387561 ] Sangjin Lee commented on YARN-3334: --- I'm +1 with the simpler approach mentioned here. The

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-03-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387566#comment-14387566 ] Sangjin Lee commented on YARN-3334: --- Per Zhijie's suggestion, sounds like this code will

[jira] [Updated] (YARN-2243) Order of arguments for Preconditions.checkNotNull() is wrong in SchedulerApplicationAttempt ctor

2015-03-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2243: --- Fix Version/s: 2.7.0 > Order of arguments for Preconditions.checkNotNull() is wrong in > Sched

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387585#comment-14387585 ] Karthik Kambatla commented on YARN-3304: [~vinodkv], [~hitesh] - given we have made

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387645#comment-14387645 ] Hitesh Shah commented on YARN-3304: --- [~kasha] The reason I re-opened this was because no

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387656#comment-14387656 ] Hitesh Shah commented on YARN-3304: --- Forgot to add, we use this for resource monitoring f

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387713#comment-14387713 ] Hadoop QA commented on YARN-2729: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2923) Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup

2015-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387730#comment-14387730 ] Hadoop QA commented on YARN-2923: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-03-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3391: -- Attachment: YARN-3391.1.patch Create a patch to fix the flow context info. I've updated the distributed s

[jira] [Commented] (YARN-3378) a load test client that can replay a volume of history files

2015-03-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387762#comment-14387762 ] Sangjin Lee commented on YARN-3378: --- Looking into this bit more, I realize that convertin

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-03-30 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387763#comment-14387763 ] Rohit Agarwal commented on YARN-3415: - I don't understand the newly added tests: {code}

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387786#comment-14387786 ] Allen Wittenauer commented on YARN-3304: bq. To change tez, we will need to create

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387808#comment-14387808 ] Hitesh Shah commented on YARN-3304: --- [~aw] Thanks for putting it so bluntly. You may wish

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-30 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387810#comment-14387810 ] Hitesh Shah commented on YARN-3304: --- https://issues.apache.org/jira/browse/YARN-3297 is p

  1   2   >