[jira] [Updated] (YARN-3271) FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability

2015-04-29 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated YARN-3271: Attachment: YARN-3271.1.patch Attaching the patch kindly review FairScheduler: Move tests related to

[jira] [Commented] (YARN-3559) Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public

2015-04-29 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519137#comment-14519137 ] J.Andreina commented on YARN-3559: -- [~ste...@apache.org] ,I would like to work on this

[jira] [Updated] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-04-29 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peng Zhang updated YARN-3535: - Attachment: YARN-3535-002.patch # Remove call of recoverResourceRequestForContainer from preemption to

[jira] [Created] (YARN-3559) Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public

2015-04-29 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-3559: Summary: Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public Key: YARN-3559 URL: https://issues.apache.org/jira/browse/YARN-3559 Project: Hadoop

[jira] [Commented] (YARN-3485) FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies

2015-04-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519196#comment-14519196 ] Hudson commented on YARN-3485: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2110 (See

[jira] [Commented] (YARN-3485) FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies

2015-04-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519222#comment-14519222 ] Hudson commented on YARN-3485: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #169 (See

[jira] [Commented] (YARN-3485) FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies

2015-04-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519247#comment-14519247 ] Hudson commented on YARN-3485: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #178 (See

[jira] [Created] (YARN-3560) Not able to navigate to the cluster from tracking url (proxy) generated after submission of job

2015-04-29 Thread Anushri (JIRA)
Anushri created YARN-3560: - Summary: Not able to navigate to the cluster from tracking url (proxy) generated after submission of job Key: YARN-3560 URL: https://issues.apache.org/jira/browse/YARN-3560

[jira] [Commented] (YARN-3271) FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability

2015-04-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519326#comment-14519326 ] Hadoop QA commented on YARN-3271: - (!) The patch artifact directory on has been removed!

[jira] [Commented] (YARN-3485) FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies

2015-04-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519278#comment-14519278 ] Hudson commented on YARN-3485: -- FAILURE: Integrated in Hadoop-Yarn-trunk #912 (See

[jira] [Updated] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-29 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2893: Attachment: YARN-2893.004.patch AMLaucher: sporadic job failures due to EOFException in

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518761#comment-14518761 ] Sangjin Lee commented on YARN-3044: --- [~zjshen], sorry I missed your comment earlier...

[jira] [Commented] (YARN-2176) CapacityScheduler loops over all running applications rather than actively requesting apps

2015-04-29 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518781#comment-14518781 ] Xianyin Xin commented on YARN-2176: --- Sorry [~jlowe], i've made a mistake. What i thought

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-29 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518917#comment-14518917 ] zhihai xu commented on YARN-2893: - The TestAMRestart failure is not related to my change.

[jira] [Commented] (YARN-3552) RMServerUtils#DUMMY_APPLICATION_RESOURCE_USAGE_REPORT has negative numbers

2015-04-29 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519096#comment-14519096 ] Rohith commented on YARN-3552: -- I think for UI dispaly 'N/A' is resonable, and REST we should

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519027#comment-14519027 ] Steve Loughran commented on YARN-3539: -- bq. we need to update all the API classes to

[jira] [Created] (YARN-3558) Additional containers getting reserved from RM in case of Fair scheduler

2015-04-29 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-3558: -- Summary: Additional containers getting reserved from RM in case of Fair scheduler Key: YARN-3558 URL: https://issues.apache.org/jira/browse/YARN-3558 Project:

[jira] [Updated] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-29 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2893: Attachment: (was: YARN-2893.004.patch) AMLaucher: sporadic job failures due to EOFException in

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518760#comment-14518760 ] Sangjin Lee commented on YARN-3044: --- It looks like some of the issues reported by the

[jira] [Updated] (YARN-3484) Fix up yarn top shell code

2015-04-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3484: Attachment: YARN-3484.002.patch bq. variables that are local to a function should be declared local.

[jira] [Updated] (YARN-3554) Default value for maximum nodemanager connect wait time is too high

2015-04-29 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3554: Attachment: YARN-3554-20150429-2.patch Hi [~jlowe] Updating with 3 minutes as the timeout

[jira] [Commented] (YARN-3485) FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies

2015-04-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519568#comment-14519568 ] Hudson commented on YARN-3485: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2128 (See

[jira] [Commented] (YARN-3554) Default value for maximum nodemanager connect wait time is too high

2015-04-29 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519576#comment-14519576 ] Naganarasimha G R commented on YARN-3554: - Agree with you [~jlowe], but what do you

[jira] [Commented] (YARN-3554) Default value for maximum nodemanager connect wait time is too high

2015-04-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519603#comment-14519603 ] Jason Lowe commented on YARN-3554: -- I suggest we go with 3 minutes. The retry interval is

[jira] [Updated] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2015-04-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3362: - Attachment: capacity-scheduler.xml YARN-3362.20150428-3-modified.patch Add node label

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2015-04-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520074#comment-14520074 ] Wangda Tan commented on YARN-3362: -- bq. Well i understand that in the later patches we are

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520115#comment-14520115 ] Li Lu commented on YARN-3411: - Thanks [~stack] for the quick info! Yes let's go with HBase 1.

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520139#comment-14520139 ] Hadoop QA commented on YARN-2893: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3561) Non-AM Containers continue to run even after AM is stopped

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519848#comment-14519848 ] Vinod Kumar Vavilapalli commented on YARN-3561: --- Is this because the

[jira] [Updated] (YARN-3521) Support return structured NodeLabel objects in REST API when call getClusterNodeLabels

2015-04-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3521: -- Attachment: 0001-YARN-3521.patch Attaching an initial version. [~leftnoteasy] pls check the same as I have the

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-04-29 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519906#comment-14519906 ] Naganarasimha G R commented on YARN-3044: - Thanks for the review [~djp] [~sjlee0]

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2015-04-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519917#comment-14519917 ] Wangda Tan commented on YARN-3362: -- Hi Naga, Thanks for taking initiative for this, just

[jira] [Updated] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-29 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2893: Attachment: YARN-2893.004.patch AMLaucher: sporadic job failures due to EOFException in

[jira] [Commented] (YARN-2619) NodeManager: Add cgroups support for disk I/O isolation

2015-04-29 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519814#comment-14519814 ] Sidharta Seethana commented on YARN-2619: - [~vvasudev] , thanks for refactoring the

[jira] [Commented] (YARN-3554) Default value for maximum nodemanager connect wait time is too high

2015-04-29 Thread Hadoop QA (JIRA)
| | \\ \\ || Subsystem || Report/Notes || | Patch URL | http://issues.apache.org/jira/secure/attachment/12729227/YARN-3554-20150429-2.patch | | Optional Tests | javadoc javac unit findbugs checkstyle | | git revision | trunk / 8f82970 | | hadoop-yarn-api test log | https://builds.apache.org/job/PreCommit-YARN

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-29 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519858#comment-14519858 ] stack commented on YARN-3411: - bq. So there are some major changes between hbase 0.98 and hbase

[jira] [Commented] (YARN-3271) FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability

2015-04-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519861#comment-14519861 ] Karthik Kambatla commented on YARN-3271: Thanks for working on this, [~nijel].

[jira] [Updated] (YARN-3561) Non-AM Containers continue to run even after AM is stopped

2015-04-29 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-3561: Environment: debian 7 Non-AM Containers continue to run even after AM is stopped

[jira] [Updated] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-29 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2893: Attachment: (was: YARN-2893.004.patch) AMLaucher: sporadic job failures due to EOFException in

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2015-04-29 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519960#comment-14519960 ] Naganarasimha G R commented on YARN-3362: - Thanks [~wangda], for reviewing and

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519792#comment-14519792 ] Sangjin Lee commented on YARN-3044: --- Yes that's kind of what I'm wondering about. So

[jira] [Updated] (YARN-3561) Non-AM Containers continue to run even after AM is stopped

2015-04-29 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-3561: Fix Version/s: 2.6.1 Non-AM Containers continue to run even after AM is stopped

[jira] [Updated] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2015-04-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3362: - Attachment: Screen Shot 2015-04-29 at 11.42.17 AM.png Add node label usage in RM CapacityScheduler web UI

[jira] [Commented] (YARN-3544) AM logs link missing in the RM UI for a completed app

2015-04-29 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519964#comment-14519964 ] Xuan Gong commented on YARN-3544: - Original, we are calling getContainerReport to

[jira] [Commented] (YARN-3561) Non-AM Containers continue to run even after AM is stopped

2015-04-29 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519911#comment-14519911 ] Gour Saha commented on YARN-3561: - Slider stop command was called which initiates the

[jira] [Created] (YARN-3562) unit tests fail with the failure to bring up node manager

2015-04-29 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3562: - Summary: unit tests fail with the failure to bring up node manager Key: YARN-3562 URL: https://issues.apache.org/jira/browse/YARN-3562 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-3521) Support return structured NodeLabel objects in REST API when call getClusterNodeLabels

2015-04-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520226#comment-14520226 ] Wangda Tan commented on YARN-3521: -- Hi Sunil, Thanks for working on this, some comments:

[jira] [Updated] (YARN-3563) Completed app shows -1 running containers on RM web UI

2015-04-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3563: -- Attachment: Screen Shot 2015-04-29 at 2.11.19 PM.png Completed app shows -1 running containers on RM

[jira] [Updated] (YARN-3563) Completed app shows -1 running containers on RM web UI

2015-04-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3563: -- Component/s: webapp resourcemanager Completed app shows -1 running containers on RM

[jira] [Created] (YARN-3563) Completed app shows -1 running containers on RM web UI

2015-04-29 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-3563: - Summary: Completed app shows -1 running containers on RM web UI Key: YARN-3563 URL: https://issues.apache.org/jira/browse/YARN-3563 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-3551) Consolidate data model change according to the backend implementation

2015-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520295#comment-14520295 ] Sangjin Lee commented on YARN-3551: --- I'm fine with going with using GenericOptionMapper

[jira] [Resolved] (YARN-1876) Document the REST APIs of timeline and generic history services

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-1876. --- Resolution: Duplicate Duplicate is the right resolution. Document the REST

[jira] [Commented] (YARN-3533) Test: Fix launchAM in MockRM to wait for attempt to be scheduled

2015-04-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520293#comment-14520293 ] Jian He commented on YARN-3533: --- patch looks good to me, thanks [~adhoot] ! hopefully this

[jira] [Reopened] (YARN-1876) Document the REST APIs of timeline and generic history services

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reopened YARN-1876: --- Document the REST APIs of timeline and generic history services

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520312#comment-14520312 ] Vinod Kumar Vavilapalli commented on YARN-3539: --- bq. So I'm not sure if it's

[jira] [Created] (YARN-3564) TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly

2015-04-29 Thread Jian He (JIRA)
Jian He created YARN-3564: - Summary: TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly Key: YARN-3564 URL: https://issues.apache.org/jira/browse/YARN-3564 Project: Hadoop

[jira] [Commented] (YARN-2868) FairScheduler: Metric for latency to allocate first container for an application

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520196#comment-14520196 ] Vinod Kumar Vavilapalli commented on YARN-2868: --- Going through old tickets. I

[jira] [Updated] (YARN-1317) Make Queue, QueueACLs and QueueMetrics first class citizens in YARN

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1317: -- Target Version/s: 2.8.0 (was: ) I'd like to at the least get some of this done

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520214#comment-14520214 ] Sangjin Lee commented on YARN-3051: --- {quote} My major concern about this proposal is

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520319#comment-14520319 ] Vinod Kumar Vavilapalli commented on YARN-3539: --- In a way, I am saying that

[jira] [Commented] (YARN-3477) TimelineClientImpl swallows exceptions

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520328#comment-14520328 ] Vinod Kumar Vavilapalli commented on YARN-3477: --- This looks good to me.

[jira] [Commented] (YARN-3533) Test: Fix launchAM in MockRM to wait for attempt to be scheduled

2015-04-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520339#comment-14520339 ] Jian He commented on YARN-3533: --- bq. getApplicationAttempt seems confusing, I just opened

[jira] [Commented] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520252#comment-14520252 ] Thomas Graves commented on YARN-3517: - changes look good, +1. thanks [~vvasudev]

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520322#comment-14520322 ] Sangjin Lee commented on YARN-3044: --- {quote} Some might be but many(findbugs and

[jira] [Assigned] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned YARN-3517: - Assignee: Varun Vasudev (was: Thomas Graves) Seems like the JIRA

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520332#comment-14520332 ] Sangjin Lee commented on YARN-3045: --- Hi [~Naganarasimha], I do have one quick question on

[jira] [Commented] (YARN-3406) Display count of running containers in the RM's Web UI

2015-04-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520273#comment-14520273 ] Zhijie Shen commented on YARN-3406: --- The web UI seems to have bug: YARN-3563 Display

[jira] [Commented] (YARN-3546) AbstractYarnScheduler.getApplicationAttempt seems misleading, and there're some misuse of it

2015-04-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520292#comment-14520292 ] Jian He commented on YARN-3546: --- [~sandflee], inside the scheduler, every application only

[jira] [Commented] (YARN-3563) Completed app shows -1 running containers on RM web UI

2015-04-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520317#comment-14520317 ] Jason Lowe commented on YARN-3563: -- This sounds closely related to, if not a duplicate of,

[jira] [Commented] (YARN-3533) Test: Fix launchAM in MockRM to wait for attempt to be scheduled

2015-04-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520346#comment-14520346 ] Jian He commented on YARN-3533: --- committed to trunk and branch-2, thanks Anubhav ! Thanks

[jira] [Updated] (YARN-3564) TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly

2015-04-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3564: -- Description: the test fails intermittently in jenkins

[jira] [Updated] (YARN-3564) TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly

2015-04-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3564: -- Description: https://builds.apache.org/job/PreCommit-YARN-Build/7467/testReport/

[jira] [Commented] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520355#comment-14520355 ] Thomas Graves commented on YARN-3517: - thanks [~vinodkv] I missed that. RM web ui for

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520291#comment-14520291 ] Li Lu commented on YARN-3411: - Hi [~vrushalic] [~zjshen], just a quick thing to confirm that we

[jira] [Commented] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520308#comment-14520308 ] Hudson commented on YARN-3517: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7701 (See

[jira] [Commented] (YARN-3544) AM logs link missing in the RM UI for a completed app

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520378#comment-14520378 ] Hitesh Shah commented on YARN-3544: --- Doesnt the NM log link redirect the log server after

[jira] [Commented] (YARN-3564) TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly

2015-04-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520506#comment-14520506 ] Hadoop QA commented on YARN-3564: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3134: Attachment: YARN-3134-YARN-2928.001.patch [Storage implementation] Exploiting the option of using Phoenix to access

[jira] [Commented] (YARN-3534) Report node resource utilization

2015-04-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520574#comment-14520574 ] Karthik Kambatla commented on YARN-3534: I notice the patch tries to provide

[jira] [Commented] (YARN-3544) AM logs link missing in the RM UI for a completed app

2015-04-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520365#comment-14520365 ] Zhijie Shen commented on YARN-3544: --- Xuan, thanks for the patch. I've tried your patch

[jira] [Created] (YARN-3565) NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String

2015-04-29 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-3565: Summary: NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String Key: YARN-3565 URL: https://issues.apache.org/jira/browse/YARN-3565

[jira] [Updated] (YARN-3473) Fix RM Web UI configuration for some properties

2015-04-29 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3473: - Labels: BB2015-05-TBR (was: ) Fix RM Web UI configuration for some properties

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520473#comment-14520473 ] Zhijie Shen commented on YARN-3539: --- bq. That way, older installations and apps can

[jira] [Commented] (YARN-2868) FairScheduler: Metric for latency to allocate first container for an application

2015-04-29 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520480#comment-14520480 ] Ray Chiang commented on YARN-2868: -- I'll answer these in reverse order: 2) The first AM

[jira] [Commented] (YARN-3069) Document missing properties in yarn-default.xml

2015-04-29 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520497#comment-14520497 ] Ray Chiang commented on YARN-3069: -- Thanks Akira! I've made those changes. I definitely

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520520#comment-14520520 ] Hadoop QA commented on YARN-3134: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3134: Attachment: (was: YARN-3134-YARN-2928.runJenkins.001.patch) [Storage implementation] Exploiting the option of

[jira] [Updated] (YARN-3482) Report NM resource capacity in heartbeat

2015-04-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3482: --- Summary: Report NM resource capacity in heartbeat (was: Report NM available resources in

[jira] [Commented] (YARN-3564) TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly

2015-04-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520544#comment-14520544 ] Wangda Tan commented on YARN-3564: -- +1, will commit later.

[jira] [Commented] (YARN-3533) Test: Fix launchAM in MockRM to wait for attempt to be scheduled

2015-04-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520380#comment-14520380 ] Hudson commented on YARN-3533: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7702 (See

[jira] [Commented] (YARN-3544) AM logs link missing in the RM UI for a completed app

2015-04-29 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520379#comment-14520379 ] Hitesh Shah commented on YARN-3544: --- I meant redirect to the log server AM logs link

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520396#comment-14520396 ] Vinod Kumar Vavilapalli commented on YARN-3445: --- There is a too much of

[jira] [Updated] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3134: Attachment: YARN-3134-YARN-2928.runJenkins.001.patch In the latest patch I addressed all previous comments, and

[jira] [Commented] (YARN-3534) Report node resource utilization

2015-04-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520563#comment-14520563 ] Karthik Kambatla commented on YARN-3534: Skimmed through the latest patch.

[jira] [Commented] (YARN-3534) Report node resource utilization

2015-04-29 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520584#comment-14520584 ] Inigo Goiri commented on YARN-3534: --- The original reason for having ResourceUtilization

[jira] [Commented] (YARN-3544) AM logs link missing in the RM UI for a completed app

2015-04-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520586#comment-14520586 ] Zhijie Shen commented on YARN-3544: --- [~xgong], the patch doesn't apply for branch-2.7. It

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520599#comment-14520599 ] Hadoop QA commented on YARN-3134: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3564) TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly

2015-04-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3564: -- Attachment: YARN-3564.1.patch patch to fix the failure

[jira] [Resolved] (YARN-3392) Change NodeManager metrics to not populate resource usage metrics if they are unavailable

2015-04-29 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot resolved YARN-3392. - Resolution: Duplicate Change NodeManager metrics to not populate resource usage metrics if they

[jira] [Commented] (YARN-3544) AM logs link missing in the RM UI for a completed app

2015-04-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520425#comment-14520425 ] Zhijie Shen commented on YARN-3544: --- bq. Doesnt the NM log link redirect the log server

  1   2   >