[jira] [Updated] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-11 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5739: Attachment: YARN-5739-YARN-5355.002.patch 002 patch to address most of the comments. We can wait till YARN-5585 is

[jira] [Commented] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2016-11-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15649247#comment-15649247 ] Li Lu commented on YARN-5585: - Finished my round of review. Other than my previous, just one nit: In

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15649236#comment-15649236 ] Li Lu commented on YARN-5739: - Thanks [~vrushalic]! I'll add a KeyOnlyFilter in the filter list. Got confused

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645776#comment-15645776 ] Li Lu commented on YARN-3053: - Thanks [~varun_saxena] for the write up! After checking the doc I have a quick

[jira] [Commented] (YARN-3359) Recover collector list in RM failed over

2016-11-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15640583#comment-15640583 ] Li Lu commented on YARN-3359: - BTW, TestWorkPreservingRMRestart appears to be flaky. I cannot reproduce this

[jira] [Updated] (YARN-3359) Recover collector list in RM failed over

2016-11-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3359: Attachment: YARN-3359-YARN-5355.004.patch Fix the UT failure. > Recover collector list in RM failed over >

[jira] [Updated] (YARN-3359) Recover collector list in RM failed over

2016-11-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3359: Attachment: YARN-3359-YARN-5355.003.patch My bad... New patch. > Recover collector list in RM failed over >

[jira] [Updated] (YARN-3359) Recover collector list in RM failed over

2016-11-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3359: Attachment: (was: YARN-3359-YARN-5355.003.patch) > Recover collector list in RM failed over >

[jira] [Updated] (YARN-3359) Recover collector list in RM failed over

2016-11-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3359: Attachment: YARN-3359-YARN-5355.003.patch Upload 003 patch to address review comments. > Recover collector list in

[jira] [Commented] (YARN-3359) Recover collector list in RM failed over

2016-11-04 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15637799#comment-15637799 ] Li Lu commented on YARN-3359: - bq. Also, we are sending all collectors known to this NM and not only the NMs'

[jira] [Commented] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2016-11-04 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15637196#comment-15637196 ] Li Lu commented on YARN-5585: - Let's make {{GenericEntityReader #calculateTheClosestNextRowKeyForPrefix}} a

[jira] [Commented] (YARN-3359) Recover collector list in RM failed over

2016-11-03 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633666#comment-15633666 ] Li Lu commented on YARN-3359: - I cannot reproduce those two test failures and they appears to be unrelated.

[jira] [Updated] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-02 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5739: Attachment: YARN-5739-YARN-5355.001.patch First draft to perform a list operation to entities belong to the same

[jira] [Updated] (YARN-5780) [YARN-5079] Allowing YARN native services to post data to timeline service V.2

2016-11-02 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5780: Summary: [YARN-5079] Allowing YARN native services to post data to timeline service V.2 (was: [YARN native service]

[jira] [Commented] (YARN-5713) Update jackson from 1.9.13 to 2.x in hadoop-yarn

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613718#comment-15613718 ] Li Lu commented on YARN-5713: - Bumping up the version of jackson appears to have some impact to timeline

[jira] [Commented] (YARN-3538) TimelineServer doesn't catch/translate all exceptions raised

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613505#comment-15613505 ] Li Lu commented on YARN-3538: - It's a little bit surprising that this patch still applies after 18 months...

[jira] [Updated] (YARN-3884) RMContainerImpl transition from RESERVED to KILL apphistory status not updated

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3884: Component/s: (was: timelineserver) > RMContainerImpl transition from RESERVED to KILL apphistory status not

[jira] [Commented] (YARN-4668) Reuse objectMapper instance in Yarn

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613376#comment-15613376 ] Li Lu commented on YARN-4668: - Will commit the patch shortly. > Reuse objectMapper instance in Yarn >

[jira] [Updated] (YARN-3359) Recover collector list in RM failed over

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3359: Attachment: YARN-3359-YARN-5355.002.patch New patch to address checkstyle warnings and UT failures. > Recover

[jira] [Commented] (YARN-4668) Reuse objectMapper instance in Yarn

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613039#comment-15613039 ] Li Lu commented on YARN-4668: - Looks clean. Will wait for a few hours and then commit it. > Reuse

[jira] [Commented] (YARN-3359) Recover collector list in RM failed over

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613036#comment-15613036 ] Li Lu commented on YARN-3359: - Thanks [~vrushalic]! I'll clean those checkstyle warnings. The failure in

[jira] [Commented] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613026#comment-15613026 ] Li Lu commented on YARN-5265: - +1 to target to trunk. Let's check if this patch can be applied to trunk

[jira] [Updated] (YARN-4668) Reuse objectMapper instance in Yarn

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4668: Attachment: YARN-4668.002_1.patch I quickly updated [~linyiqun]'s original patch to make it apply to trunk. Kicking

[jira] [Commented] (YARN-4668) Reuse objectMapper instance in Yarn

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612920#comment-15612920 ] Li Lu commented on YARN-4668: - Patch LGTM, but it no longer applies to the current trunk. I'll try to tweak it

[jira] [Updated] (YARN-5647) [Security] Collector and reader side changes for loading auth filters and principals

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5647: Labels: oct16-hard (was: oct16-medium) > [Security] Collector and reader side changes for loading auth filters and

[jira] [Updated] (YARN-4495) add a way to tell AM container increase/decrease request is invalid

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4495: Labels: oct16-hard (was: ) > add a way to tell AM container increase/decrease request is invalid >

[jira] [Updated] (YARN-4495) add a way to tell AM container increase/decrease request is invalid

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4495: Component/s: client api > add a way to tell AM container increase/decrease request is invalid >

[jira] [Updated] (YARN-4528) decreaseContainer Message maybe lost if NM restart

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4528: Labels: oct16-medium (was: ) > decreaseContainer Message maybe lost if NM restart >

[jira] [Updated] (YARN-4528) decreaseContainer Message maybe lost if NM restart

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4528: Component/s: nodemanager > decreaseContainer Message maybe lost if NM restart >

[jira] [Updated] (YARN-4260) Check NodeManager's validity based on hostname(IP) and port

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4260: Labels: oct-16-easy oct16-easy (was: oct16-easy) > Check NodeManager's validity based on hostname(IP) and port >

[jira] [Updated] (YARN-4260) Check NodeManager's validity based on hostname(IP) and port

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4260: Labels: oct16-easy (was: oct-16-easy oct16-easy) > Check NodeManager's validity based on hostname(IP) and port >

[jira] [Updated] (YARN-4260) Check NodeManager's validity based on hostname(IP) and port

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4260: Labels: oct16-easy (was: ) > Check NodeManager's validity based on hostname(IP) and port >

[jira] [Updated] (YARN-4236) Metric for aggregated resources allocation per queue

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4236: Labels: oct16-medium (was: ) > Metric for aggregated resources allocation per queue >

[jira] [Updated] (YARN-4236) Metric for aggregated resources allocation per queue

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4236: Component/s: scheduler metrics > Metric for aggregated resources allocation per queue >

[jira] [Updated] (YARN-4216) Container logs not shown for newly assigned containers after NM recovery

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4216: Labels: oct16-medium (was: ) > Container logs not shown for newly assigned containers after NM recovery >

[jira] [Updated] (YARN-4214) AppAttemptInfo should have ApplicationAttemptId

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4214: Component/s: restapi resourcemanager > AppAttemptInfo should have ApplicationAttemptId >

[jira] [Updated] (YARN-4214) AppAttemptInfo should have ApplicationAttemptId

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4214: Labels: oct16-easy (was: ) > AppAttemptInfo should have ApplicationAttemptId >

[jira] [Updated] (YARN-4214) AppAttemptInfo should have ApplicationAttemptId

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4214: Labels: (was: resourcemanager restapi) > AppAttemptInfo should have ApplicationAttemptId >

[jira] [Updated] (YARN-4214) AppAttemptInfo should have ApplicationAttemptId

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4214: Labels: resourcemanager restapi (was: ) > AppAttemptInfo should have ApplicationAttemptId >

[jira] [Updated] (YARN-4213) Add REST API to RM to retrieve containers info from an application attempt

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4213: Component/s: restapi resourcemanager > Add REST API to RM to retrieve containers info from an

[jira] [Updated] (YARN-4213) Add REST API to RM to retrieve containers info from an application attempt

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4213: Labels: oct16-easy (was: ) > Add REST API to RM to retrieve containers info from an application attempt >

[jira] [Updated] (YARN-4198) CapacityScheduler locking / synchronization improvements

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4198: Labels: oct16-hard (was: ) > CapacityScheduler locking / synchronization improvements >

[jira] [Updated] (YARN-4198) CapacityScheduler locking / synchronization improvements

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4198: Component/s: capacity scheduler > CapacityScheduler locking / synchronization improvements >

[jira] [Updated] (YARN-4194) Extend Reservation Definition Langauge (RDL) extensions to support node labels

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4194: Component/s: scheduler > Extend Reservation Definition Langauge (RDL) extensions to support node labels >

[jira] [Updated] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4195: Component/s: scheduler > Support of node-labels in the ReservationSystem "Plan" >

[jira] [Updated] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4195: Labels: oct16-hard (was: ) > Support of node-labels in the ReservationSystem "Plan" >

[jira] [Updated] (YARN-4194) Extend Reservation Definition Langauge (RDL) extensions to support node labels

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4194: Labels: oct16-medium (was: ) > Extend Reservation Definition Langauge (RDL) extensions to support node labels >

[jira] [Updated] (YARN-4186) Make WebAppUtils a public API for yarn

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4186: Component/s: webapp api > Make WebAppUtils a public API for yarn >

[jira] [Updated] (YARN-4186) Make WebAppUtils a public API for yarn

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4186: Labels: oct16-easy (was: ) > Make WebAppUtils a public API for yarn > -- > >

[jira] [Updated] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4161: Labels: oct16-medium (was: ) > Capacity Scheduler : Assign single or multiple containers per heart beat > driven

[jira] [Updated] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2016-10-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4161: Component/s: (was: capacityscheduler) capacity scheduler > Capacity Scheduler : Assign single

[jira] [Updated] (YARN-5780) [YARN native service] Allowing YARN native services to post data to timeline service V.2

2016-10-25 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5780: Attachment: YARN-5780.poc.patch POC patch to launch timeline client and post timeline data. This patch applies to

[jira] [Updated] (YARN-5780) [YARN native service] Allowing YARN native services to post data to timeline service V.2

2016-10-25 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5780: Assignee: (was: Li Lu) > [YARN native service] Allowing YARN native services to post data to timeline > service

[jira] [Created] (YARN-5780) [YARN native service] Allowing YARN native services to post data to timeline service V.2

2016-10-25 Thread Li Lu (JIRA)
Li Lu created YARN-5780: --- Summary: [YARN native service] Allowing YARN native services to post data to timeline service V.2 Key: YARN-5780 URL: https://issues.apache.org/jira/browse/YARN-5780 Project: Hadoop

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-10-25 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606313#comment-15606313 ] Li Lu commented on YARN-5739: - Thanks [~vrushalic]! Yes. One concern we had was the scan may need to go

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-10-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592927#comment-15592927 ] Li Lu commented on YARN-5739: - We may not want to introduce another table for storing entity types for each

[jira] [Commented] (YARN-5715) introduce entity prefix for return and sort order

2016-10-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587089#comment-15587089 ] Li Lu commented on YARN-5715: - I prefer the approach to provide an utility method to invert longs, and leave

[jira] [Updated] (YARN-5747) Application timeline metric aggregation in timeline v2 will lost last round aggregation when an application finishes

2016-10-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5747: Attachment: YARN-5747-trunk.001.patch Upload a patch to quickly fix the issue. > Application timeline metric

[jira] [Updated] (YARN-5747) Application timeline metric aggregation in timeline v2 will lost last round aggregation when an application finishes

2016-10-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5747: Target Version/s: 3.0.0-alpha2 > Application timeline metric aggregation in timeline v2 will lost last round >

[jira] [Updated] (YARN-3359) Recover collector list in RM failed over

2016-10-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3359: Attachment: (was: YARN-3359-YARN-5355.001.patch) > Recover collector list in RM failed over >

[jira] [Updated] (YARN-3359) Recover collector list in RM failed over

2016-10-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3359: Attachment: YARN-3359-YARN-5355.001.patch > Recover collector list in RM failed over >

[jira] [Updated] (YARN-3359) Recover collector list in RM failed over

2016-10-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3359: Attachment: YARN-3359-YARN-5355.001.patch Rebased the patch to the latest YARN-5355 branch and addressed Rohith's

[jira] [Updated] (YARN-3359) Recover collector list in RM failed over

2016-10-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3359: Target Version/s: YARN-5355 (was: YARN-2928) > Recover collector list in RM failed over >

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2016-10-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586135#comment-15586135 ] Li Lu commented on YARN-3816: - +1. And we can separate the work of taking average from YARN-4821 if that can

[jira] [Resolved] (YARN-4220) [Storage implementation] Support getEntities with only Application id but no userId

2016-10-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu resolved YARN-4220. - Resolution: Won't Fix Finished UI POC and we no longer require these APIs. Close as won't fix for now. >

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2016-10-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584034#comment-15584034 ] Li Lu commented on YARN-3816: - Created YARN-5747 for a fix on the aggregation problem. This fix should be

[jira] [Created] (YARN-5747) Application timeline metric aggregation in timeline v2 will lost last round aggregation when an application finishes

2016-10-17 Thread Li Lu (JIRA)
Li Lu created YARN-5747: --- Summary: Application timeline metric aggregation in timeline v2 will lost last round aggregation when an application finishes Key: YARN-5747 URL: https://issues.apache.org/jira/browse/YARN-5747

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2016-10-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584027#comment-15584027 ] Li Lu commented on YARN-3816: - bq. Currently they emit them every 3 seconds, but I think we should do a time

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2016-10-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583958#comment-15583958 ] Li Lu commented on YARN-3816: - Hi [~varun_saxena], please see my comments inline... bq. We do not aggregate the

[jira] [Commented] (YARN-4220) [Storage implementation] Support getEntities with only Application id but no userId

2016-10-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583852#comment-15583852 ] Li Lu commented on YARN-4220: - After we finished UI integration and streamlined most UI use cases in

[jira] [Resolved] (YARN-3914) Entity created time should be part of the row key of entity table

2016-10-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu resolved YARN-3914. - Resolution: Won't Fix Close this issue as discussed before. The community reached an agreement to not to move

[jira] [Commented] (YARN-5638) Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery

2016-10-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576780#comment-15576780 ] Li Lu commented on YARN-5638: - Thanks [~sjlee0]! Let me rebase my patch for YARN-3359 and update there. >

[jira] [Created] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-10-14 Thread Li Lu (JIRA)
Li Lu created YARN-5739: --- Summary: Provide timeline reader API to list available timeline entity types for one application Key: YARN-5739 URL: https://issues.apache.org/jira/browse/YARN-5739 Project: Hadoop

[jira] [Commented] (YARN-5638) Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery

2016-10-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576570#comment-15576570 ] Li Lu commented on YARN-5638: - [~sjlee0] Let's target this to 5355 branch only? I don't think there is an

[jira] [Updated] (YARN-5638) Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery

2016-10-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5638: Attachment: YARN-5638-YARN-5355.v5.patch V5 patch to address two issues discovered with real cluster testing: 1.

[jira] [Commented] (YARN-5699) Retrospect yarn entity fields which are publishing in events info fields.

2016-10-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570387#comment-15570387 ] Li Lu commented on YARN-5699: - OK, I don't have a strong preference on that. Once the data is available on

[jira] [Commented] (YARN-5699) Retrospect yarn entity fields which are publishing in events info fields.

2016-10-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570267#comment-15570267 ] Li Lu commented on YARN-5699: - Thanks [~sjlee0]. This said I'm generally fine with Rohith's planning. End time

[jira] [Commented] (YARN-5699) Retrospect yarn entity fields which are publishing in events info fields.

2016-10-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569980#comment-15569980 ] Li Lu commented on YARN-5699: - bq. Are you proposing elevating all event info items to the entity info unless

[jira] [Commented] (YARN-5699) Retrospect yarn entity fields which are publishing in events info fields.

2016-10-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569771#comment-15569771 ] Li Lu commented on YARN-5699: - Actually let's take one step backward... What is the key benefit for keeping

[jira] [Commented] (YARN-5561) [Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via REST

2016-10-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569539#comment-15569539 ] Li Lu commented on YARN-5561: - I'm generally OK with option 1, as it's quite consistent with my original

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-10-11 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566718#comment-15566718 ] Li Lu commented on YARN-4061: - Thanks [~jrottinghuis]! So our current plan is to extend the buffered mutator

[jira] [Updated] (YARN-5638) Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery

2016-10-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5638: Attachment: YARN-5638-YARN-5355.v4.patch Thanks for the review of [~sjlee0]! Upload a new patch to address your

[jira] [Commented] (YARN-5638) Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery

2016-10-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563806#comment-15563806 ] Li Lu commented on YARN-5638: - Thanks for the review [~sjlee0]! bq. I see that the RM timestamp is currently

[jira] [Commented] (YARN-5699) Retrospect yarn entity fields which are publishing in events info fields.

2016-10-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563620#comment-15563620 ] Li Lu commented on YARN-5699: - Thanks for the work [~rohithsharma]! Generally fine but a few concerns: 1. I

[jira] [Commented] (YARN-5561) [Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via REST

2016-10-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563483#comment-15563483 ] Li Lu commented on YARN-5561: - I don't have a strong preference on those query parameters either, but I think

[jira] [Commented] (YARN-5561) [Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via REST

2016-10-04 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546350#comment-15546350 ] Li Lu commented on YARN-5561: - Seems like we're reaching much agreement on the general proposal of this JIRA.

[jira] [Commented] (YARN-5699) Retrospect container entity fields which are publishing in events info fields.

2016-10-04 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546344#comment-15546344 ] Li Lu commented on YARN-5699: - I think the major concern is that when putting useful fields into event info

[jira] [Updated] (YARN-5681) Change collector discovery to support collectors mapped to clients but not applications

2016-09-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5681: Attachment: YARN-5681-YARN-3359.001.patch Upload a patch to extend collector representations in RMs and NMs. After

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

2016-09-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534307#comment-15534307 ] Li Lu commented on YARN-4205: - I committed the addendum patch to branch-2. Thanks [~cnauroth] for the review.

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

2016-09-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534288#comment-15534288 ] Li Lu commented on YARN-4205: - OK, I'll commit it shortly then. > Add a service for monitoring application

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

2016-09-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534247#comment-15534247 ] Li Lu commented on YARN-4205: - [~cnauroth] shall we put this patch to branch-2 only, or to trunk as well? >

[jira] [Updated] (YARN-4205) Add a service for monitoring application life time out

2016-09-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4205: Attachment: YARN-4205-addendum.001.patch Upload an addendum patch to expand the (non-synchronized) putIfAbsent

[jira] [Created] (YARN-5681) Change collector discovery to support collectors mapped to clients but not applications

2016-09-27 Thread Li Lu (JIRA)
Li Lu created YARN-5681: --- Summary: Change collector discovery to support collectors mapped to clients but not applications Key: YARN-5681 URL: https://issues.apache.org/jira/browse/YARN-5681 Project: Hadoop

[jira] [Commented] (YARN-3981) support timeline clients not associated with an application

2016-09-26 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524485#comment-15524485 ] Li Lu commented on YARN-3981: - Continuing this thread. We may want to limit the active connections to the

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-26 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523904#comment-15523904 ] Li Lu commented on YARN-5585: - Hi [~rohithsharma], some of my understandings bq. IIUC from user perspective,

[jira] [Updated] (YARN-5638) Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery

2016-09-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5638: Attachment: YARN-5638-trunk.v3.patch Upload a new patch to address checkstyle issues. I did not fix the two warnings

[jira] [Updated] (YARN-5638) Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery

2016-09-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5638: Attachment: YARN-5638-trunk.v2.patch Sorry wrong patch... let me try a new one... > Introduce a collector

[jira] [Updated] (YARN-5638) Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery

2016-09-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5638: Attachment: (was: YARN-5638-trunk.v2.patch) > Introduce a collector timestamp to uniquely identify collectors

[jira] [Updated] (YARN-5638) Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery

2016-09-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5638: Attachment: YARN-5638-trunk.v2.patch Thanks for the review [~rohithsharma]! I addressed most of you comments except

[jira] [Updated] (YARN-3359) Recover collector list in RM failed over

2016-09-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3359: Attachment: YARN-3359-YARN-5638.patch Posting a patch based on the solution of YARN-5638. With all app level

<    1   2   3   4   5   6   7   8   9   10   >