[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625502#comment-14625502 ] Sangjin Lee commented on YARN-3908: --- bq. 1. In fact, I'm wondering if we should but info

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14633937#comment-14633937 ] Sangjin Lee commented on YARN-3908: --- bq. 1. The events have been written into metrics

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14633936#comment-14633936 ] Sangjin Lee commented on YARN-3908: --- The JIRA site seems offline right now. bq. 1. The

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-07-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634128#comment-14634128 ] Sangjin Lee commented on YARN-3814: --- bq. 1. Cluster ID is mandatory in YARN-3049 whereas

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634383#comment-14634383 ] Sangjin Lee commented on YARN-3908: --- I'd like to propose closing this issue with the

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634293#comment-14634293 ] Sangjin Lee commented on YARN-3908: --- Currently we're not calling

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634326#comment-14634326 ] Sangjin Lee commented on YARN-3049: --- I do see that you're adding a call to

[jira] [Commented] (YARN-4074) [timeline reader] implement support for querying for flows and flow runs

2015-08-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14710133#comment-14710133 ] Sangjin Lee commented on YARN-4074: --- Actually the backend will need to differentiate the

[jira] [Commented] (YARN-4058) Miscellaneous issues in NodeManager project

2015-08-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14710288#comment-14710288 ] Sangjin Lee commented on YARN-4058: --- The unit test result seems fine to me:

[jira] [Commented] (YARN-4284) condition for AM blacklisting is too narrow

2015-10-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971356#comment-14971356 ] Sangjin Lee commented on YARN-4284: --- [~jlowe], could you kindly let me know what you think? Thanks! >

[jira] [Commented] (YARN-4221) Store user in app to flow table

2015-10-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971403#comment-14971403 ] Sangjin Lee commented on YARN-4221: --- I've reviewed the patch, and it LGTM. I'll let others comment on

[jira] [Commented] (YARN-4129) Refactor the SystemMetricPublisher in RM to better support newer events

2015-10-22 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969532#comment-14969532 ] Sangjin Lee commented on YARN-4129: --- Rekicked the jenkins build. > Refactor the SystemMetricPublisher in

[jira] [Commented] (YARN-4284) condition for AM blacklisting is too narrow

2015-10-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967377#comment-14967377 ] Sangjin Lee commented on YARN-4284: --- [~steve_l] [~sunilg], if you have one or two nodes and the AM

[jira] [Commented] (YARN-4129) Refactor the SystemMetricPublisher in RM to better support newer events

2015-10-22 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969858#comment-14969858 ] Sangjin Lee commented on YARN-4129: --- Thanks for updating the patch [~Naganarasimha]. I'm +1 on the latest

[jira] [Commented] (YARN-4284) condition for AM blacklisting is too narrow

2015-10-26 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974979#comment-14974979 ] Sangjin Lee commented on YARN-4284: --- Thanks [~jlowe]! > condition for AM blacklisting is too narrow >

[jira] [Commented] (YARN-4284) condition for AM blacklisting is too narrow

2015-10-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972392#comment-14972392 ] Sangjin Lee commented on YARN-4284: --- The checkstyle issue is not new (and not something I can fix in

[jira] [Updated] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-10-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2859: -- Target Version/s: 2.8.0, 2.7.2 (was: 2.8.0, 2.7.2, 2.6.2) Fix Version/s: (was: 2.6.2) This

[jira] [Commented] (YARN-4284) condition for AM blacklisting is too narrow

2015-10-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971759#comment-14971759 ] Sangjin Lee commented on YARN-4284: --- Thanks. I agree that PREEMPTED is unequivocally not a node issue.

[jira] [Commented] (YARN-4284) condition for AM blacklisting is too narrow

2015-10-26 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974559#comment-14974559 ] Sangjin Lee commented on YARN-4284: --- Could you take a quick look at the updated patch, and let me know

[jira] [Updated] (YARN-4284) condition for AM blacklisting is too narrow

2015-10-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4284: -- Attachment: YARN-4284.002.patch v.2 patch posted. Added PREEMPTED as a condition for not blacklisting

[jira] [Commented] (YARN-4284) condition for AM blacklisting is too narrow

2015-10-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967523#comment-14967523 ] Sangjin Lee commented on YARN-4284: --- I think the current patch would be sufficient, yes. I'd also like to

[jira] [Commented] (YARN-4284) condition for AM blacklisting is too narrow

2015-10-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968325#comment-14968325 ] Sangjin Lee commented on YARN-4284: --- It happens more often than not. If the node is having issues and the

[jira] [Commented] (YARN-4179) [reader implementation] support flow activity queries based on time

2015-10-22 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969456#comment-14969456 ] Sangjin Lee commented on YARN-4179: --- Thanks for updating the patch [~varun_saxena]. I'm +1 on the latest

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999660#comment-14999660 ] Sangjin Lee commented on YARN-4053: --- To make progress with this ticket, if you're in line with what

[jira] [Commented] (YARN-2556) Tool to measure the performance of the timeline server

2015-11-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997275#comment-14997275 ] Sangjin Lee commented on YARN-2556: --- +1 with the proposal to add documentation. The command line help is

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997267#comment-14997267 ] Sangjin Lee commented on YARN-4183: --- Sorry I missed this one as well. Maybe this is a FAQ somewhere, but

[jira] [Created] (YARN-4350) TestDistributedShell fails

2015-11-11 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-4350: - Summary: TestDistributedShell fails Key: YARN-4350 URL: https://issues.apache.org/jira/browse/YARN-4350 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-11-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3862: -- Attachment: YARN-3862-feature-YARN-2928.wip.03.patch Testing the new feature branch name

[jira] [Updated] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3816: -- Labels: yarn-2928-1st-milestone (was: ) > [Aggregation] App-level aggregation and accumulation for YARN

[jira] [Updated] (YARN-3863) Enhance filters in TimelineReader

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3863: -- Labels: yarn-2928-1st-milestone (was: ) > Enhance filters in TimelineReader >

[jira] [Updated] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3862: -- Labels: yarn-2928-1st-milestone (was: ) > Decide which contents to retrieve and send back in response

[jira] [Updated] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4053: -- Labels: yarn-2928-1st-milestone (was: ) > Change the way metric values are stored in HBase Storage >

[jira] [Updated] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3995: -- Labels: yarn-2928-1st-milestone (was: ) > Some of the NM events are not getting published due race

[jira] [Updated] (YARN-4238) createdTime and modifiedTime is not reported while publishing entities to ATSv2

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4238: -- Labels: yarn-2928-1st-milestone (was: ) > createdTime and modifiedTime is not reported while publishing

[jira] [Updated] (YARN-4239) Flow page for Web UI

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4239: -- Labels: yarn-2928-1st-milestone (was: ) > Flow page for Web UI > > >

[jira] [Updated] (YARN-3907) create the flow-version table

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3907: -- Labels: yarn-2928-1st-milestone (was: ) > create the flow-version table > -

[jira] [Updated] (YARN-3367) Replace starting a separate thread for post entity with event loop in TimelineClient

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3367: -- Labels: yarn-2928-1st-milestone (was: ) > Replace starting a separate thread for post entity with event

[jira] [Updated] (YARN-3959) Store application related configurations in Timeline Service v2

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3959: -- Labels: yarn-2928-1st-milestone (was: ) > Store application related configurations in Timeline Service

[jira] [Updated] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4062: -- Labels: yarn-2928-1st-milestone (was: ) > Add the flush and compaction functionality via coprocessors

[jira] [Updated] (YARN-4097) Create POC timeline web UI with new YARN web UI framework

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4097: -- Labels: yarn-2928-1st-milestone (was: ) > Create POC timeline web UI with new YARN web UI framework >

[jira] [Updated] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4200: -- Labels: yarn-2928-1st-milestone (was: ) > Refactor reader classes in storage to nest under hbase

[jira] [Created] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

2015-11-13 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-4356: - Summary: ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off Key: YARN-4356 URL: https://issues.apache.org/jira/browse/YARN-4356

[jira] [Updated] (YARN-3150) [Documentation] Documenting the timeline service v2

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3150: -- Labels: yarn-2928-1st-milestone (was: ) > [Documentation] Documenting the timeline service v2 >

[jira] [Updated] (YARN-3461) Consolidate flow name/version/run defaults

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3461: -- Labels: yarn-2928-1st-milestone (was: ) > Consolidate flow name/version/run defaults >

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004661#comment-15004661 ] Sangjin Lee commented on YARN-4356: --- This is the rough note I jotted down while going over the changes

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004954#comment-15004954 ] Sangjin Lee commented on YARN-4183: --- This is also somewhat relevant to YARN-4356.

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004969#comment-15004969 ] Sangjin Lee commented on YARN-4350: --- As I mentioned in YARN-2859, I'm not sure if that is the reason for

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004967#comment-15004967 ] Sangjin Lee commented on YARN-2859: --- Thanks for looking [~Naganarasimha]. But I'm not sure if that is the

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15005152#comment-15005152 ] Sangjin Lee commented on YARN-4350: --- The entire test times out in about 15 minutes. {noformat}

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15005120#comment-15005120 ] Sangjin Lee commented on YARN-4350: --- It times out (after 15 minutes) consistently for me even after

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15005021#comment-15005021 ] Sangjin Lee commented on YARN-4183: --- {quote} +1. I don't see a fundamental challenge to support "1",

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004972#comment-15004972 ] Sangjin Lee commented on YARN-4350: --- What I suspect is that maybe in our code (YARN-2928 branch) we may

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15005045#comment-15005045 ] Sangjin Lee commented on YARN-2859: --- Could you also check if this resolves the timeout issue in

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15005052#comment-15005052 ] Sangjin Lee commented on YARN-4183: --- This is still very much an open-ended discussion. I recognize that

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007077#comment-15007077 ] Sangjin Lee commented on YARN-4350: --- Thanks [~Naganarasimha] for the quick patch. I applied the patch on

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007082#comment-15007082 ] Sangjin Lee commented on YARN-2859: --- Just to be sure, those 3 issues you mentioned impact only the

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007242#comment-15007242 ] Sangjin Lee commented on YARN-4183: --- I agree we probably shouldn't put too many points of discussion here

[jira] [Updated] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI "list" command

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1480: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2) > RM web services getApps() accepts many more filters than

[jira] [Updated] (YARN-3478) FairScheduler page not performed because different enum of YarnApplicationState and RMAppState

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3478: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-3575) Job using 2.5 jars fails on a 2.6 cluster whose RM has been restarted

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3575: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. > Job

[jira] [Updated] (YARN-4060) Revisit default retry config for connection with RM

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4060: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-1681) When "banned.users" is not set in LCE's container-executor.cfg, submit job with user in DEFAULT_BANNED_USERS will receive unclear error message

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1681: -- Target Version/s: (was: 2.7.2, 2.6.2) > When "banned.users" is not set in LCE's

[jira] [Updated] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI "list" command

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1480: -- Target Version/s: 2.7.2 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. > RM web

[jira] [Updated] (YARN-2038) Revisit how AMs learn of containers from previous attempts

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2038: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-1856) cgroups based memory monitoring for containers

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1856: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-4312) TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time out

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4312: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2) > TestSubmitApplicationWithRMHA fails on branch-2.7 and

[jira] [Updated] (YARN-2506) TimelineClient should NOT be in yarn-common project

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2506: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-4312) TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time out

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4312: -- Target Version/s: 2.7.2 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-2746) YARNDelegationTokenID misses serializing version from the common abstract ID

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2746: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-2657) MiniYARNCluster to (optionally) add MicroZookeeper service

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2657: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-2457) FairScheduler: Handle preemption to help starved parent queues

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2457: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-2055) Preemption: Jobs are failing due to AMs are getting launched and killed multiple times

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2055: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-1848) Persist ClusterMetrics across RM HA transitions

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1848: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-2037) Add restart support for Unmanaged AMs

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2037: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. > Add

[jira] [Updated] (YARN-2599) Standby RM should also expose some jmx and metrics

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2599: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-1767) Windows: Allow a way for users to augment classpath of YARN daemons

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1767: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Updated] (YARN-2014) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2014: -- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2, 2.6.2) Targeting 2.6.3 now that 2.6.2 has shipped. >

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-11-03 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987636#comment-14987636 ] Sangjin Lee commented on YARN-3862: --- [~aw], sorry to bother you here, but our latest jenkins run is an

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-11-03 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987902#comment-14987902 ] Sangjin Lee commented on YARN-3862: --- Thanks. We'll discuss when we should address the next rebase. Thanks

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-11-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14994758#comment-14994758 ] Sangjin Lee commented on YARN-3862: --- [~jrottinghuis] and I went over the patch in some more detail, and

[jira] [Updated] (YARN-4312) TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time out

2015-11-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4312: -- Fix Version/s: 2.6.3 Cherry-picked the fix to branch-2.6. Thanks [~varun_saxena]! >

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-11-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986444#comment-14986444 ] Sangjin Lee commented on YARN-3862: --- I just kicked off a jenkins run on the latest patch. Sorry

[jira] [Updated] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2859: -- Fix Version/s: 2.6.3 > ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster >

[jira] [Updated] (YARN-4320) TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4320: -- Fix Version/s: 2.6.3 > TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to >

[jira] [Commented] (YARN-4320) TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14993332#comment-14993332 ] Sangjin Lee commented on YARN-4320: --- Committed it to branch-2.6 too. > TestJobHistoryEventHandler fails

[jira] [Updated] (YARN-4326) Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4326: -- Fix Version/s: 2.7.3 2.6.3 Pulled the fix to branch-2.7 and branch-2.6. > Fix

[jira] [Commented] (YARN-4179) [reader implementation] support flow activity queries based on time

2015-10-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961238#comment-14961238 ] Sangjin Lee commented on YARN-4179: --- bq. Now the question comes should we then have a daterange like

[jira] [Commented] (YARN-4129) Refactor the SystemMetricPublisher in RM to better support newer events

2015-10-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963494#comment-14963494 ] Sangjin Lee commented on YARN-4129: --- I just kicked off a rebuild. It is likely that a concurrent build

[jira] [Commented] (YARN-3367) Replace starting a separate thread for post entity with event loop in TimelineClient

2015-10-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947620#comment-14947620 ] Sangjin Lee commented on YARN-3367: --- {quote} You mean that flush need not be coupled with the sync call ?

[jira] [Commented] (YARN-1681) When "banned.users" is not set in LCE's container-executor.cfg, submit job with user in DEFAULT_BANNED_USERS will receive unclear error message

2015-10-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959907#comment-14959907 ] Sangjin Lee commented on YARN-1681: --- Any progress on this? FYI, we will cut the first RC for 2.6.2 next

[jira] [Commented] (YARN-2506) TimelineClient should NOT be in yarn-common project

2015-10-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959908#comment-14959908 ] Sangjin Lee commented on YARN-2506: --- Any progress on this? FYI, we will cut the first RC for 2.6.2 next

[jira] [Commented] (YARN-3798) ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED

2015-10-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959904#comment-14959904 ] Sangjin Lee commented on YARN-3798: --- Any progress on this? FYI, we will cut the first RC for 2.6.2 next

[jira] [Commented] (YARN-4179) [reader implementation] support flow activity queries based on time

2015-10-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959590#comment-14959590 ] Sangjin Lee commented on YARN-4179: --- BTW, another thing: we should verify the start date is earlier than

[jira] [Commented] (YARN-4179) [reader implementation] support flow activity queries based on time

2015-10-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959587#comment-14959587 ] Sangjin Lee commented on YARN-4179: --- Yes, I know that java's SimpleDateFormat is not thread safe. There

[jira] [Commented] (YARN-2556) Tool to measure the performance of the timeline server

2015-10-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959622#comment-14959622 ] Sangjin Lee commented on YARN-2556: --- The latest patch is almost ready. I only have one small comment.

[jira] [Commented] (YARN-4179) [reader implementation] support flow activity queries based on time

2015-10-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959260#comment-14959260 ] Sangjin Lee commented on YARN-4179: --- >From the user's point of view, I think it makes the most sense to

[jira] [Commented] (YARN-4221) Store user in app to flow table

2015-10-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964114#comment-14964114 ] Sangjin Lee commented on YARN-4221: --- Hi [~varun_saxena], it appears the patch is no longer valid after

[jira] [Commented] (YARN-4129) Refactor the SystemMetricPublisher in RM to better support newer events

2015-10-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964142#comment-14964142 ] Sangjin Lee commented on YARN-4129: --- bq. I was of diff understanding on this and also i had seen other

[jira] [Commented] (YARN-4129) Refactor the SystemMetricPublisher in RM to better support newer events

2015-10-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965516#comment-14965516 ] Sangjin Lee commented on YARN-4129: --- Thanks [~Naganarasimha] for the updated patch. Some comments:

[jira] [Commented] (YARN-3798) ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED

2015-10-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965349#comment-14965349 ] Sangjin Lee commented on YARN-3798: --- [~ozawa], can it be verified and merged today? I am targeting

<    3   4   5   6   7   8   9   10   11   12   >