[jira] [Updated] (YARN-3914) Entity created time should be part of the row key of entity table

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3914: --- Parent Issue: YARN-5355 (was: YARN-2928) > Entity created time should be part of the row key o

[jira] [Updated] (YARN-4097) Create POC timeline web UI with new YARN web UI framework

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4097: --- Parent Issue: YARN-5355 (was: YARN-2928) > Create POC timeline web UI with new YARN web UI fra

[jira] [Updated] (YARN-4116) refactor ColumnHelper read* methods

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4116: --- Parent Issue: YARN-5355 (was: YARN-2928) > refactor ColumnHelper read* methods > -

[jira] [Updated] (YARN-4220) [Storage implementation] Support getEntities with only Application id but no flow and flow run ID

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4220: --- Parent Issue: YARN-5355 (was: YARN-2928) > [Storage implementation] Support getEntities with o

[jira] [Updated] (YARN-4173) Ensure the final values for metrics/events are emitted/stored at APP completion time

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4173: --- Parent Issue: YARN-5355 (was: YARN-2928) > Ensure the final values for metrics/events are emit

[jira] [Updated] (YARN-4261) fix the order of timelinereader in yarn/yarn.cmd

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4261: --- Parent Issue: YARN-5355 (was: YARN-2928) > fix the order of timelinereader in yarn/yarn.cmd >

[jira] [Updated] (YARN-4239) Flow page for Web UI

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4239: --- Parent Issue: YARN-5355 (was: YARN-2928) > Flow page for Web UI > > >

[jira] [Updated] (YARN-4489) Limit flow runs returned while querying flows

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4489: --- Parent Issue: YARN-5355 (was: YARN-2928) > Limit flow runs returned while querying flows > ---

[jira] [Updated] (YARN-4455) Support fetching metrics by time range

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4455: --- Parent Issue: YARN-5355 (was: YARN-2928) > Support fetching metrics by time range > --

[jira] [Updated] (YARN-4343) Need to support Application History Server on ATSV2

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4343: --- Parent Issue: YARN-5355 (was: YARN-2928) > Need to support Application History Server on ATSV2

[jira] [Updated] (YARN-4368) Support Multiple versions of the timeline service at the same time

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4368: --- Parent Issue: YARN-5355 (was: YARN-2928) > Support Multiple versions of the timeline service a

[jira] [Commented] (YARN-4489) Limit flow runs returned while querying flows

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371295#comment-15371295 ] Joep Rottinghuis commented on YARN-4489: Don't we already have this in alpha-1? >

[jira] [Updated] (YARN-4561) Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4561: --- Parent Issue: YARN-5355 (was: YARN-2928) > Compaction coprocessor enhancements: On/Off, whitel

[jira] [Updated] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4675: --- Parent Issue: YARN-5355 (was: YARN-2928) > Reorganize TimeClientImpl into TimeClientV1Impl and

[jira] [Updated] (YARN-4504) Retrospect on defaults for created time while querying

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4504: --- Parent Issue: YARN-5355 (was: YARN-2928) > Retrospect on defaults for created time while query

[jira] [Updated] (YARN-4736) Issues with HBaseTimelineWriterImpl in single node hadoop & hbase cluster

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4736: --- Parent Issue: YARN-5355 (was: YARN-2928) > Issues with HBaseTimelineWriterImpl in single node

[jira] [Updated] (YARN-4821) Have a separate NM timeline publishing-interval

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4821: --- Parent Issue: YARN-5355 (was: YARN-2928) > Have a separate NM timeline publishing-interval > -

[jira] [Updated] (YARN-4786) Enhance hbase coprocessor aggregation operations:GLOBAL_MIN, LATEST_MIN etc and FINAL attributes

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4786: --- Parent Issue: YARN-5355 (was: YARN-2928) > Enhance hbase coprocessor aggregation operations:GL

[jira] [Updated] (YARN-5011) Support metric filters for flow runs

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5011: --- Parent Issue: YARN-5355 (was: YARN-2928) > Support metric filters for flow runs >

[jira] [Updated] (YARN-4985) Refactor the coprocessor code & other definition classes into independent packages

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4985: --- Parent Issue: YARN-5355 (was: YARN-2928) > Refactor the coprocessor code & other definition cl

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371287#comment-15371287 ] Joep Rottinghuis commented on YARN-4455: Note quite clear what is mean by this jira

[jira] [Updated] (YARN-5071) address HBase compatibility issues with trunk

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5071: --- Parent Issue: YARN-5355 (was: YARN-2928) > address HBase compatibility issues with trunk > ---

[jira] [Updated] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5229: --- Parent Issue: YARN-5355 (was: YARN-2928) > Refactor #isApplicationEntity and #getApplicationEv

[jira] [Updated] (YARN-5156) YARN_CONTAINER_FINISHED of YARN_CONTAINERs will always have running state

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5156: --- Parent Issue: YARN-5355 (was: YARN-2928) > YARN_CONTAINER_FINISHED of YARN_CONTAINERs will alw

[jira] [Updated] (YARN-5260) Review / Recommendations for hbase writer code

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5260: --- Parent Issue: YARN-5355 (was: YARN-2928) > Review / Recommendations for hbase writer code > --

[jira] [Updated] (YARN-5094) some YARN container events have timestamp of -1 in REST output

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5094: --- Parent Issue: YARN-5355 (was: YARN-2928) > some YARN container events have timestamp of -1 in

[jira] [Updated] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5265: --- Parent Issue: YARN-5355 (was: YARN-2928) > Make HBase configuration for the timeline service c

[jira] [Updated] (YARN-4765) Split TestHBaseTimelineStorage into multiple test classes

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-4765: --- Parent Issue: YARN-5355 (was: YARN-2928) > Split TestHBaseTimelineStorage into multiple test c

[jira] [Updated] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5265: --- Attachment: YARN-5265-YARN-5355.06.patch Path on new branch YARN-5355 with findbugs and checkst

[jira] [Commented] (YARN-5354) TestDistributedShell.checkTimelineV2() may fail for concurrent tests

2016-07-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372027#comment-15372027 ] Joep Rottinghuis commented on YARN-5354: This should work, but why not use {code}

[jira] [Commented] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-07-12 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373261#comment-15373261 ] Joep Rottinghuis commented on YARN-5265: Unit tests are failing. Very plausible tha

[jira] [Commented] (YARN-5359) FileSystemTimelineReader/Writer uses unix-specific default

2016-07-12 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15374097#comment-15374097 ] Joep Rottinghuis commented on YARN-5359: Patch looks good. There may be one additio

[jira] [Commented] (YARN-5364) timelineservice modules have indirect dependencies on mapreduce artifacts

2016-07-12 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15374098#comment-15374098 ] Joep Rottinghuis commented on YARN-5364: LGTM. > timelineservice modules have indi

[jira] [Created] (YARN-5378) Accomodate app-id->cluster mapping

2016-07-14 Thread Joep Rottinghuis (JIRA)
Joep Rottinghuis created YARN-5378: -- Summary: Accomodate app-id->cluster mapping Key: YARN-5378 URL: https://issues.apache.org/jira/browse/YARN-5378 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5378) Accomodate app-id->cluster mapping

2016-07-14 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376499#comment-15376499 ] Joep Rottinghuis commented on YARN-5378: Our current AppToFlow table has the cluste

[jira] [Commented] (YARN-5378) Accomodate app-id->cluster mapping

2016-07-14 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376503#comment-15376503 ] Joep Rottinghuis commented on YARN-5378: The rest API would be modified to make the

[jira] [Commented] (YARN-5378) Accomodate app-id->cluster mapping

2016-07-14 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378224#comment-15378224 ] Joep Rottinghuis commented on YARN-5378: Yeah, either flowName!cluster1@dc2:foo@dai

[jira] [Commented] (YARN-5304) Ship single node HBase config option with single startup command

2016-07-22 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390217#comment-15390217 ] Joep Rottinghuis commented on YARN-5304: The goal is the simplest possible setup, b

[jira] [Commented] (YARN-4765) Split TestHBaseTimelineStorage into multiple test classes

2016-08-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15417918#comment-15417918 ] Joep Rottinghuis commented on YARN-4765: Looks good to me. One thing I'm wondering

[jira] [Updated] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-11-03 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5265: --- Attachment: YARN-5265-YARN-5355.11.patch Thanks [~sjlee0] for the suggestions. Uploading YARN-5

[jira] [Commented] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-11-03 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15633271#comment-15633271 ] Joep Rottinghuis commented on YARN-5265: I'm still looking at local test failures t

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-11-03 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634966#comment-15634966 ] Joep Rottinghuis commented on YARN-4061: Opened HBASE-17018 and attached a pdf of m

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674398#comment-15674398 ] Joep Rottinghuis commented on YARN-3053: Two questions: - are there race conditions

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674433#comment-15674433 ] Joep Rottinghuis commented on YARN-3053: Once we trust that the connection to the c

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674445#comment-15674445 ] Joep Rottinghuis commented on YARN-3053: For delegation tokens there is a mechanism

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-12-13 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15746555#comment-15746555 ] Joep Rottinghuis commented on YARN-4061: Attached an updated design for a SpoolingB

[jira] [Commented] (YARN-5976) Update hbase version to 1.2

2016-12-14 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15749242#comment-15749242 ] Joep Rottinghuis commented on YARN-5976: I'm +1 on that approach. Certainly the mos

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-12-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755117#comment-15755117 ] Joep Rottinghuis commented on YARN-4061: For the next version of the patch I'll mod

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-12-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756464#comment-15756464 ] Joep Rottinghuis commented on YARN-4061: [~gtCarrera9] I've filed a separate jira H

[jira] [Updated] (YARN-5304) Ship single node HBase config option with single startup command

2016-12-19 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5304: --- Assignee: (was: Joep Rottinghuis) > Ship single node HBase config option with single startu

[jira] [Updated] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-08-13 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5265: --- Attachment: YARN-5265-YARN-5355.07.patch Attaching new (rebased) patch. Expect to still have un

[jira] [Updated] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-08-13 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5265: --- Attachment: YARN-5265-YARN-5355.08.patch The 07 patch is lacking the new unit test. Uploading p

[jira] [Updated] (YARN-5304) Ship single node HBase config option with single startup command

2016-08-15 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5304: --- Attachment: (was: YARN-5265-YARN-5355.09.patch) > Ship single node HBase config option with

[jira] [Updated] (YARN-5304) Ship single node HBase config option with single startup command

2016-08-15 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5304: --- Attachment: YARN-5265-YARN-5355.09.patch Think I found the cause of the unit test failures. In

[jira] [Updated] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-08-15 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5265: --- Attachment: YARN-5265-YARN-5355.09.patch Think I found the cause of the unit test failures. In

[jira] [Issue Comment Deleted] (YARN-5304) Ship single node HBase config option with single startup command

2016-08-15 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5304: --- Comment: was deleted (was: Think I found the cause of the unit test failures. In one case I cre

[jira] [Commented] (YARN-5626) Support long running apps handling multiple flows

2016-09-25 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15520939#comment-15520939 ] Joep Rottinghuis commented on YARN-5626: As per our discussion on the status call l

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-25 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15520952#comment-15520952 ] Joep Rottinghuis commented on YARN-5585: [~sjlee0] wouldn't the column value filter

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-25 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15520959#comment-15520959 ] Joep Rottinghuis commented on YARN-5585: Will have to look into the solution a bit

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-25 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15521715#comment-15521715 ] Joep Rottinghuis commented on YARN-5585: Good point, something we need to check. We

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15529989#comment-15529989 ] Joep Rottinghuis commented on YARN-4061: I'm going to write up some requirements fo

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530324#comment-15530324 ] Joep Rottinghuis commented on YARN-4061: HBASE-12728 introduced the BufferedMutator

[jira] [Commented] (YARN-4561) Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530564#comment-15530564 ] Joep Rottinghuis commented on YARN-4561: For late arriving data that was spooled us

[jira] [Commented] (YARN-4561) Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530597#comment-15530597 ] Joep Rottinghuis commented on YARN-4561: All data that comes in late would be marke

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-09-29 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15532914#comment-15532914 ] Joep Rottinghuis commented on YARN-4061: Potential additional challenge, to seriali

[jira] [Assigned] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-10-06 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis reassigned YARN-4061: -- Assignee: Joep Rottinghuis (was: Li Lu) > [Fault tolerance] Fault tolerant writer for t

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-10-20 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15592611#comment-15592611 ] Joep Rottinghuis commented on YARN-4061: You do bring up an interesting question [~

[jira] [Commented] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2016-10-20 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15592635#comment-15592635 ] Joep Rottinghuis commented on YARN-5742: We should really carefully consider whethe

[jira] [Commented] (YARN-5760) [ATSv2] Create HBase connection only if an app collector is publishing from NM

2016-10-20 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15592721#comment-15592721 ] Joep Rottinghuis commented on YARN-5760: If we lazily initialize the connection the

[jira] [Comment Edited] (YARN-5760) [ATSv2] Create HBase connection only if an app collector is publishing from NM

2016-10-20 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15592721#comment-15592721 ] Joep Rottinghuis edited comment on YARN-5760 at 10/20/16 7:20 PM: ---

[jira] [Updated] (YARN-5378) Accomodate app-id->cluster mapping

2016-10-27 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5378: --- Labels: Oct (was: ) > Accomodate app-id->cluster mapping > --

[jira] [Updated] (YARN-5378) Accomodate app-id->cluster mapping

2016-10-27 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5378: --- Labels: (was: Oct) > Accomodate app-id->cluster mapping > --

[jira] [Updated] (YARN-5378) Accomodate app-id->cluster mapping

2016-10-27 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5378: --- Labels: oct16-medium (was: ) > Accomodate app-id->cluster mapping > --

[jira] [Updated] (YARN-5378) Accomodate app-id->cluster mapping

2016-10-27 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5378: --- Labels: (was: oct16-medium) > Accomodate app-id->cluster mapping > --

[jira] [Commented] (YARN-4765) Split TestHBaseTimelineStorage into multiple test classes

2016-10-27 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15612989#comment-15612989 ] Joep Rottinghuis commented on YARN-4765: Patch still applies cleanly. We have lots

[jira] [Commented] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-10-27 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15613413#comment-15613413 ] Joep Rottinghuis commented on YARN-5265: Patch no longer applies cleanly due to YAR

[jira] [Updated] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-10-27 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5265: --- Attachment: YARN-5265-YARN-5355.10.patch > Make HBase configuration for the timeline service co

[jira] [Commented] (YARN-5265) Make HBase configuration for the timeline service configurable

2016-10-27 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15613764#comment-15613764 ] Joep Rottinghuis commented on YARN-5265: Uploaded a new rebased patch: YARN-5265-

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630275#comment-14630275 ] Joep Rottinghuis commented on YARN-3908: bq. In fact, I'm wondering if we should bu

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630289#comment-14630289 ] Joep Rottinghuis commented on YARN-3908: Patch looks good with one comment. I compl

[jira] [Commented] (YARN-445) Ability to signal containers

2015-07-21 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636221#comment-14636221 ] Joep Rottinghuis commented on YARN-445: --- Can we rekindle this discussion? We've had fo

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-07-21 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636244#comment-14636244 ] Joep Rottinghuis commented on YARN-3176: For the record, we're running with this pa

[jira] [Commented] (YARN-451) Add more metrics to RM page

2015-07-21 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636358#comment-14636358 ] Joep Rottinghuis commented on YARN-451: --- Just for the record, at Twitter we've been ru

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-22 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636399#comment-14636399 ] Joep Rottinghuis commented on YARN-3908: What does this mean for the HBaseTimelineW

[jira] [Commented] (YARN-3949) ensure timely flush of timeline writes

2015-07-24 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14640059#comment-14640059 ] Joep Rottinghuis commented on YARN-3949: I think a simple write and separate flush

[jira] [Commented] (YARN-3949) ensure timely flush of timeline writes

2015-07-24 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14640959#comment-14640959 ] Joep Rottinghuis commented on YARN-3949: bq. On top of the current patch, how about

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-24 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641114#comment-14641114 ] Joep Rottinghuis commented on YARN-3908: It would be good to get the patch for YARN

[jira] [Commented] (YARN-3949) ensure timely flush of timeline writes

2015-07-24 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641380#comment-14641380 ] Joep Rottinghuis commented on YARN-3949: LGTM. Joep > ensure timely flush of t

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-05 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14658671#comment-14658671 ] Joep Rottinghuis commented on YARN-3045: Yeah, the discussion thread here seems to

[jira] [Commented] (YARN-3863) Enhance filters in TimelineReader

2015-08-13 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696163#comment-14696163 ] Joep Rottinghuis commented on YARN-3863: [~varun_saxena] in YARN-3862 you refer to

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-08-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699795#comment-14699795 ] Joep Rottinghuis commented on YARN-3901: Starting to go through. Just as a note (no

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-08-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699804#comment-14699804 ] Joep Rottinghuis commented on YARN-3901: Presumably the storeWithTag method is just

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-08-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699937#comment-14699937 ] Joep Rottinghuis commented on YARN-3901: It seems that in general in order to get i

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-08-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700255#comment-14700255 ] Joep Rottinghuis commented on YARN-3901: After discussing with [~vrushalic] we conc

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-08-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700264#comment-14700264 ] Joep Rottinghuis commented on YARN-3901: peekNext also has to deal with limit corre

[jira] [Commented] (YARN-4063) Populate the flow activity table

2015-08-21 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707256#comment-14707256 ] Joep Rottinghuis commented on YARN-4063: Min max should work well. Wondering how we

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-08-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720667#comment-14720667 ] Joep Rottinghuis commented on YARN-3862: If we need to retrieve exactly known colum

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-08-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720837#comment-14720837 ] Joep Rottinghuis commented on YARN-3901: Reviewed / discussed 1.patch with [~vrusha

[jira] [Commented] (YARN-4102) Add an "incremental" mode for timeline schema creator

2015-09-02 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14727775#comment-14727775 ] Joep Rottinghuis commented on YARN-4102: Looks good to me. One caveat is in the nam

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-09-02 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14727816#comment-14727816 ] Joep Rottinghuis commented on YARN-4053: Part of the issue is that there are many m

<    1   2   3   4   5   >