[jira] [Updated] (YARN-3319) Implement a Fair SchedulerOrderingPolicy

2015-04-02 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.39.patch Implement a Fair SchedulerOrderingPolicy

[jira] [Updated] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-04-02 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3318: -- Attachment: YARN-3318.39.patch Create Initial OrderingPolicy Framework, integrate with

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-04-02 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392211#comment-14392211 ] Craig Welch commented on YARN-3318: --- [~leftnoteasy] SchedulerProcessEvents replaced

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-04-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392345#comment-14392345 ] Hadoop QA commented on YARN-3318: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-04-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3334: -- Attachment: YARN-3334.7.patch Last patch looks good to me, but I undo the some unnecessary change in

[jira] [Updated] (YARN-2942) Aggregated Log Files should be combined

2015-04-02 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-2942: Attachment: ConcatableAggregatedLogsProposal_v4.pdf I've just uploaded

[jira] [Commented] (YARN-3439) RM fails to renew token when Oozie launcher leaves before sub-job finishes

2015-04-02 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393433#comment-14393433 ] Rohini Palaniswamy commented on YARN-3439: -- bq. Essentially the idea is to

[jira] [Commented] (YARN-2901) Add errors and warning stats to RM, NM web UI

2015-04-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393494#comment-14393494 ] Wangda Tan commented on YARN-2901: -- +1 for the patch. Will commit it today if no opposite

[jira] [Commented] (YARN-3388) Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit

2015-04-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393493#comment-14393493 ] Hadoop QA commented on YARN-3388: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-04-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393545#comment-14393545 ] Wangda Tan commented on YARN-2729: -- Some comments: *1) Configuration:* Instead of

[jira] [Updated] (YARN-3439) RM fails to renew token when Oozie launcher leaves before sub-job finishes

2015-04-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-3439: - Attachment: YARN-3439.001.patch Daryn is out so posting a prototype patch he developed to get some early

[jira] [Updated] (YARN-3440) ResourceUsage should be copy-on-write

2015-04-02 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3440: Description: In {{org.apache.hadoop.yarn.server.resourcemanager.scheduler.ResourceUsage}}, even if it is

[jira] [Commented] (YARN-2890) MiniMRYarnCluster should turn on timeline service if configured to do so

2015-04-02 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393408#comment-14393408 ] Mit Desai commented on YARN-2890: - [~hitesh], did you had any comments on the patch?

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393412#comment-14393412 ] Hudson commented on YARN-3415: -- FAILURE: Integrated in Hadoop-trunk-Commit #7497 (See

[jira] [Updated] (YARN-3437) convert load test driver to timeline service v.2

2015-04-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3437: -- Attachment: YARN-3437.001.patch Patch v.1 posted. This is basically a modification of the YARN-2556

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393554#comment-14393554 ] Hadoop QA commented on YARN-3437: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3388) Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit

2015-04-02 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated YARN-3388: - Attachment: YARN-3388-v1.patch Hi [~leftnoteasy]. Uploaded a new version of patch that addresses

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-04-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393451#comment-14393451 ] Wangda Tan commented on YARN-2729: -- Apparently Jenkins ran wrong tests, rekicked Jenkins.

[jira] [Commented] (YARN-2942) Aggregated Log Files should be combined

2015-04-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393450#comment-14393450 ] Hadoop QA commented on YARN-2942: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2666) TestFairScheduler.testContinuousScheduling fails Intermittently

2015-04-02 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2666: Attachment: (was: YARN-2666.000.patch) TestFairScheduler.testContinuousScheduling fails Intermittently

[jira] [Commented] (YARN-3439) RM fails to renew token when Oozie launcher leaves before sub-job finishes

2015-04-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393410#comment-14393410 ] Hadoop QA commented on YARN-3439: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-04-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393556#comment-14393556 ] Hadoop QA commented on YARN-2729: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-04-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393388#comment-14393388 ] Vinod Kumar Vavilapalli commented on YARN-3318: --- bq. I think it should be

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393530#comment-14393530 ] Sangjin Lee commented on YARN-3437: --- Added a few folks for review. convert load test

[jira] [Updated] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue

2015-04-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-3415: - Summary: Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue (was: Non-AM

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-04-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393374#comment-14393374 ] Wangda Tan commented on YARN-3318: -- [~cwelch], I took a look at your latest patch as well

[jira] [Commented] (YARN-3365) Add support for using the 'tc' tool via container-executor

2015-04-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393496#comment-14393496 ] Hadoop QA commented on YARN-3365: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393264#comment-14393264 ] Zhijie Shen commented on YARN-3391: --- [~vrushalic], it sounds good to me to set aside the

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-04-02 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393351#comment-14393351 ] zhihai xu commented on YARN-3415: - [~sandyr], thanks for the review, The latest patch

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-04-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393347#comment-14393347 ] Vinod Kumar Vavilapalli commented on YARN-3318: --- bq. I think it is useful to

[jira] [Created] (YARN-3442) Consider abstracting out user, app limits etc into some sort of a LimitPolicy

2015-04-02 Thread Vinod Kumar Vavilapalli (JIRA)
Vinod Kumar Vavilapalli created YARN-3442: - Summary: Consider abstracting out user, app limits etc into some sort of a LimitPolicy Key: YARN-3442 URL: https://issues.apache.org/jira/browse/YARN-3442

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-04-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393440#comment-14393440 ] Vinod Kumar Vavilapalli commented on YARN-3318: --- Filed YARN-3441 and

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-04-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393441#comment-14393441 ] Junping Du commented on YARN-3334: -- Thanks [~zjshen] for review and comments! bq. but I

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue

2015-04-02 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393476#comment-14393476 ] zhihai xu commented on YARN-3415: - Thanks [~ragarwal] for valuable feedback and filing this

[jira] [Updated] (YARN-2666) TestFairScheduler.testContinuousScheduling fails Intermittently

2015-04-02 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2666: Attachment: YARN-2666.000.patch TestFairScheduler.testContinuousScheduling fails Intermittently

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393563#comment-14393563 ] Wangda Tan commented on YARN-3410: -- Thanks for your comment, [~rohithsharma]. But what's

[jira] [Commented] (YARN-2942) Aggregated Log Files should be combined

2015-04-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393700#comment-14393700 ] Karthik Kambatla commented on YARN-2942: (Canceled the patch to stop Jenkins from

[jira] [Updated] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-02 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-3366: Attachment: YARN-3366.001.patch Attaching a patch with an implementation of traffic

[jira] [Commented] (YARN-3435) AM container to be allocated Appattempt AM container shown as null

2015-04-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393975#comment-14393975 ] Hadoop QA commented on YARN-3435: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-04-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393631#comment-14393631 ] Zhijie Shen commented on YARN-3334: --- If so, I suggest combining the two massages

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393711#comment-14393711 ] Wangda Tan commented on YARN-3434: -- [~tgraves], I feel like this issue and several related

[jira] [Resolved] (YARN-685) Capacity Scheduler is not distributing the reducers tasks across the cluster

2015-04-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-685. - Resolution: Invalid According to test result from [~raviprak], CS fairly distributes reducers to NMs in

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393750#comment-14393750 ] Sangjin Lee commented on YARN-3051: --- bq. To plot graphs based on timeseries data, we may

[jira] [Commented] (YARN-3365) Add support for using the 'tc' tool via container-executor

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393773#comment-14393773 ] Hudson commented on YARN-3365: -- FAILURE: Integrated in Hadoop-trunk-Commit #7500 (See

[jira] [Commented] (YARN-3444) Fixed typo (capability)

2015-04-02 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393861#comment-14393861 ] Gabor Liptak commented on YARN-3444: Pull request at

[jira] [Commented] (YARN-3390) RMTimelineCollector should have the context info of each app

2015-04-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393615#comment-14393615 ] Sangjin Lee commented on YARN-3390: --- I think we need to either pass in the context per

[jira] [Updated] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-02 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3134: Attachment: YARN-3134DataSchema.pdf After some community discussion we're finalizing the Phoenix data schema design

[jira] [Commented] (YARN-2666) TestFairScheduler.testContinuousScheduling fails Intermittently

2015-04-02 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393743#comment-14393743 ] zhihai xu commented on YARN-2666: - Hi [~ozawa], I rebased the patch YARN-2666.000.patch

[jira] [Updated] (YARN-2901) Add errors and warning metrics page to RM, NM web UI

2015-04-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2901: - Summary: Add errors and warning metrics page to RM, NM web UI (was: Add errors and warning stats to RM,

[jira] [Commented] (YARN-2901) Add errors and warning metrics page to RM, NM web UI

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393810#comment-14393810 ] Hudson commented on YARN-2901: -- FAILURE: Integrated in Hadoop-trunk-Commit #7501 (See

[jira] [Updated] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-02 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-3443: Attachment: YARN-3443.001.patch Attaching patch that 1) separates out CGroup implementation

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393645#comment-14393645 ] Sangjin Lee commented on YARN-3391: --- I am fine with tabling this discussion and

[jira] [Commented] (YARN-3365) Add support for using the 'tc' tool via container-executor

2015-04-02 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393789#comment-14393789 ] Sidharta Seethana commented on YARN-3365: - Actually, never mind - it seems like the

[jira] [Commented] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394003#comment-14394003 ] Hadoop QA commented on YARN-3443: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2666) TestFairScheduler.testContinuousScheduling fails Intermittently

2015-04-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393725#comment-14393725 ] Hadoop QA commented on YARN-2666: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-04-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393723#comment-14393723 ] Sangjin Lee commented on YARN-3334: --- I took a quick look at the latest patch, and it

[jira] [Created] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-02 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3443: --- Summary: Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM Key: YARN-3443 URL:

[jira] [Created] (YARN-3444) Fixed typo (capability)

2015-04-02 Thread Gabor Liptak (JIRA)
Gabor Liptak created YARN-3444: -- Summary: Fixed typo (capability) Key: YARN-3444 URL: https://issues.apache.org/jira/browse/YARN-3444 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-2666) TestFairScheduler.testContinuousScheduling fails Intermittently

2015-04-02 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393976#comment-14393976 ] Tsuyoshi Ozawa commented on YARN-2666: -- OK, I'll check it.

[jira] [Updated] (YARN-3365) Add support for using the 'tc' tool via container-executor

2015-04-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3365: -- Fix Version/s: 2.8.0 Add support for using the 'tc' tool via container-executor

[jira] [Commented] (YARN-3365) Add support for using the 'tc' tool via container-executor

2015-04-02 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393775#comment-14393775 ] Sidharta Seethana commented on YARN-3365: - Thanks, Vinod! we'll need a small patch

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-02 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393971#comment-14393971 ] Sidharta Seethana commented on YARN-3366: - Since this patch requires uncommitted

[jira] [Commented] (YARN-3390) RMTimelineCollector should have the context info of each app

2015-04-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393643#comment-14393643 ] Zhijie Shen commented on YARN-3390: --- bq. I would favor the latter approach +1

[jira] [Commented] (YARN-2942) Aggregated Log Files should be combined

2015-04-02 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393717#comment-14393717 ] Robert Kanter commented on YARN-2942: - Yes, it does a blocking wait. I think this will

[jira] [Updated] (YARN-2942) Aggregated Log Files should be combined

2015-04-02 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-2942: Attachment: ConcatableAggregatedLogsProposal_v5.pdf I've uploaded a v5 doc which address those

[jira] [Commented] (YARN-3436) Doc WebServicesIntro.html Example Rest API url wrong

2015-04-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393935#comment-14393935 ] Hadoop QA commented on YARN-3436: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2424) LCE should support non-cgroups, non-secure mode

2015-04-02 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393938#comment-14393938 ] Sidharta Seethana commented on YARN-2424: - It looks different versions of the patch

[jira] [Commented] (YARN-3390) RMTimelineCollector should have the context info of each app

2015-04-02 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394059#comment-14394059 ] Naganarasimha G R commented on YARN-3390: - Thanks for the feedback [~zjshen]

[jira] [Updated] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-04-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3334: - Attachment: YARN-3334-v8.patch Upload v8 patch to address minor comments for log in TimelineClientImpl.

[jira] [Created] (YARN-3445) NM notify RM on running Apps in NM-RM heartbeat

2015-04-02 Thread Junping Du (JIRA)
Junping Du created YARN-3445: Summary: NM notify RM on running Apps in NM-RM heartbeat Key: YARN-3445 URL: https://issues.apache.org/jira/browse/YARN-3445 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-04-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394052#comment-14394052 ] Junping Du commented on YARN-3334: -- Thanks [~zjshen] and [~sjlee0] for comments! bq. If

[jira] [Updated] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-04-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3334: - Attachment: YARN-3334-v6.patch Incorporate [~zjshen]'s comments in v6 patch. Rebase it to latest YARN-2928

[jira] [Commented] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-04-02 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393194#comment-14393194 ] Craig Welch commented on YARN-3293: --- Hey [~vvasudev], it seems that the patch doesn't

[jira] [Commented] (YARN-3425) NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392872#comment-14392872 ] Hudson commented on YARN-3425: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #151 (See

[jira] [Created] (YARN-3435) AM container to be allocated Appattempt AM container shown as null

2015-04-02 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-3435: -- Summary: AM container to be allocated Appattempt AM container shown as null Key: YARN-3435 URL: https://issues.apache.org/jira/browse/YARN-3435 Project: Hadoop

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392866#comment-14392866 ] Hudson commented on YARN-3430: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #151 (See

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392789#comment-14392789 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #142 (See

[jira] [Commented] (YARN-3425) NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392791#comment-14392791 ] Hudson commented on YARN-3425: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #142 (See

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392784#comment-14392784 ] Hudson commented on YARN-3430: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #142 (See

[jira] [Commented] (YARN-3433) Jersey tests failing with Port in Use -again

2015-04-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392497#comment-14392497 ] Steve Loughran commented on YARN-3433: -- {code}

[jira] [Commented] (YARN-3425) NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392543#comment-14392543 ] Hudson commented on YARN-3425: -- FAILURE: Integrated in Hadoop-Yarn-trunk #885 (See

[jira] [Created] (YARN-3433) Jersey tests failing with Port in Use -again

2015-04-02 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-3433: Summary: Jersey tests failing with Port in Use -again Key: YARN-3433 URL: https://issues.apache.org/jira/browse/YARN-3433 Project: Hadoop YARN Issue Type:

[jira] [Assigned] (YARN-3433) Jersey tests failing with Port in Use -again

2015-04-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned YARN-3433: -- Assignee: Brahma Reddy Battula Jersey tests failing with Port in Use -again

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392656#comment-14392656 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2083 (See

[jira] [Commented] (YARN-3425) NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392658#comment-14392658 ] Hudson commented on YARN-3425: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2083 (See

[jira] [Created] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-02 Thread Thomas Graves (JIRA)
Thomas Graves created YARN-3434: --- Summary: Interaction between reservations and userlimit can result in significant ULF violation Key: YARN-3434 URL: https://issues.apache.org/jira/browse/YARN-3434

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-02 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392751#comment-14392751 ] Thomas Graves commented on YARN-3434: - The issue here is that in if we allow the user

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392541#comment-14392541 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-Yarn-trunk #885 (See

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392536#comment-14392536 ] Hudson commented on YARN-3430: -- FAILURE: Integrated in Hadoop-Yarn-trunk #885 (See

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392595#comment-14392595 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #151 (See

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392590#comment-14392590 ] Hudson commented on YARN-3430: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #151 (See

[jira] [Commented] (YARN-3425) NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392597#comment-14392597 ] Hudson commented on YARN-3425: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #151 (See

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392651#comment-14392651 ] Hudson commented on YARN-3430: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2083 (See

[jira] [Commented] (YARN-3432) Cluster metrics have wrong Total Memory when there is reserved memory on CS

2015-04-02 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392687#comment-14392687 ] Thomas Graves commented on YARN-3432: - that will fix it for the capacity scheduler, we

[jira] [Updated] (YARN-3435) AM container to be allocated Appattempt AM container shown as null

2015-04-02 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3435: --- Attachment: Screenshot.png Attaching Screen shot for bug AM container to be allocated

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-04-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393015#comment-14393015 ] Zhijie Shen commented on YARN-3334: --- Junping, did you have the chance to look at the 3

[jira] [Created] (YARN-3436) Doc WebServicesIntro.html Example Rest API url wrong

2015-04-02 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-3436: -- Summary: Doc WebServicesIntro.html Example Rest API url wrong Key: YARN-3436 URL: https://issues.apache.org/jira/browse/YARN-3436 Project: Hadoop YARN

[jira] [Created] (YARN-3437) convert load test driver to timeline service v.2

2015-04-02 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3437: - Summary: convert load test driver to timeline service v.2 Key: YARN-3437 URL: https://issues.apache.org/jira/browse/YARN-3437 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-3435) AM container to be allocated Appattempt AM container shown as null

2015-04-02 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3435: --- Attachment: YARN-3435.001.patch AM container to be allocated Appattempt AM container shown as

[jira] [Created] (YARN-3438) add a mode to replay MR job history files to the timeline service

2015-04-02 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3438: - Summary: add a mode to replay MR job history files to the timeline service Key: YARN-3438 URL: https://issues.apache.org/jira/browse/YARN-3438 Project: Hadoop YARN

  1   2   >