[jira] [Commented] (YARN-3150) [Documentation] Documenting the timeline service v2

2016-04-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257361#comment-15257361 ] Sangjin Lee commented on YARN-3150: --- Thanks [~gtCarrera9] for your review. I hope the lat

[jira] [Commented] (YARN-3150) [Documentation] Documenting the timeline service v2

2016-04-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257377#comment-15257377 ] Sangjin Lee commented on YARN-3150: --- Sounds good. I'll do that when I have updated the pa

[jira] [Commented] (YARN-4958) The file localization process should allow for wildcards to reduce the application footprint in the state store

2016-04-26 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258346#comment-15258346 ] Sangjin Lee commented on YARN-4958: --- {quote} Depends of the definition of correctly. I d

[jira] [Commented] (YARN-4958) The file localization process should allow for wildcards to reduce the application footprint in the state store

2016-04-26 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258473#comment-15258473 ] Sangjin Lee commented on YARN-4958: --- Just to be sure, {{foo.xml}} does appear explicitly

[jira] [Commented] (YARN-4447) Provide a mechanism to represent complex filters and parse them at the REST layer

2016-04-27 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261276#comment-15261276 ] Sangjin Lee commented on YARN-4447: --- I just restarted the jenkins build, but it seems tha

[jira] [Commented] (YARN-2928) YARN Timeline Service: Next generation

2016-04-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262963#comment-15262963 ] Sangjin Lee commented on YARN-2928: --- For those who are following this ticket, we are near

[jira] [Commented] (YARN-3959) Store application related configurations in Timeline Service v2

2016-04-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263174#comment-15263174 ] Sangjin Lee commented on YARN-3959: --- {quote} Are we posting configurations for all YARN a

[jira] [Commented] (YARN-3959) Store application related configurations in Timeline Service v2

2016-04-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263234#comment-15263234 ] Sangjin Lee commented on YARN-3959: --- [~varun_saxena], one interesting thing about the con

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-04-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263335#comment-15263335 ] Sangjin Lee commented on YARN-4577: --- Would you be able to come up with a unit test still?

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-04-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263359#comment-15263359 ] Sangjin Lee commented on YARN-4734: --- >From the YARN-2928 (timeline service v.2) perspecti

[jira] [Commented] (YARN-3959) Store application related configurations in Timeline Service v2

2016-04-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263361#comment-15263361 ] Sangjin Lee commented on YARN-3959: --- [~Naganarasimha], [~varun_saxena], your thoughts? >

[jira] [Commented] (YARN-4986) Add a check in the coprocessor for table to operated on

2016-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264291#comment-15264291 ] Sangjin Lee commented on YARN-4986: --- Thanks [~vrushalic] for finding and fixing these iss

[jira] [Updated] (YARN-3150) [Documentation] Documenting the timeline service v2

2016-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3150: -- Attachment: (was: TimelineServiceV2.html) > [Documentation] Documenting the timeline service v2 > ---

[jira] [Updated] (YARN-3150) [Documentation] Documenting the timeline service v2

2016-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3150: -- Attachment: TimelineServiceV2.pdf > [Documentation] Documenting the timeline service v2 > ---

[jira] [Updated] (YARN-3150) [Documentation] Documenting the timeline service v2

2016-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3150: -- Attachment: YARN-3150-YARN-2928.04.patch Posted patch v.4. This completes the last remaining details for

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264399#comment-15264399 ] Sangjin Lee commented on YARN-4577: --- If you push more into {{AuxiliaryServiceWithCustomCl

[jira] [Updated] (YARN-4239) Flow page for Web UI

2016-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4239: -- Labels: (was: yarn-2928-1st-milestone) > Flow page for Web UI > > >

[jira] [Updated] (YARN-4173) Ensure the final values for metrics/events are emitted/stored at APP completion time

2016-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4173: -- Labels: (was: yarn-2928-1st-milestone) > Ensure the final values for metrics/events are emitted/stored

[jira] [Updated] (YARN-4097) Create POC timeline web UI with new YARN web UI framework

2016-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4097: -- Labels: (was: yarn-2928-1st-milestone) > Create POC timeline web UI with new YARN web UI framework > --

[jira] [Updated] (YARN-4986) Add a check in the coprocessor for table to operated on

2016-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4986: -- Labels: yarn-2928-1st-milestone (was: ) > Add a check in the coprocessor for table to operated on >

[jira] [Updated] (YARN-5014) Ensure non-metric values are returned as is for flow run table from the coprocessor

2016-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5014: -- Labels: yarn-2928-1st-milestone (was: ) > Ensure non-metric values are returned as is for flow run table

[jira] [Commented] (YARN-4986) Add a check in the coprocessor for table to operated on

2016-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264978#comment-15264978 ] Sangjin Lee commented on YARN-4986: --- The latest patch LGTM. Thanks for adding the unit te

[jira] [Resolved] (YARN-5014) Ensure non-metric values are returned as is for flow run table from the coprocessor

2016-04-29 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee resolved YARN-5014. --- Resolution: Fixed Fix Version/s: YARN-2928 This is fixed by YARN-4986. > Ensure non-metric valu

[jira] [Commented] (YARN-4447) Provide a mechanism to represent complex filters and parse them at the REST layer

2016-04-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265379#comment-15265379 ] Sangjin Lee commented on YARN-4447: --- Thanks [~varun_saxena]! This is a very comprehensive

[jira] [Commented] (YARN-4447) Provide a mechanism to represent complex filters and parse them at the REST layer

2016-04-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265389#comment-15265389 ] Sangjin Lee commented on YARN-4447: --- bq. Can we not use expr.toLowerCase().indexOf("or ")

[jira] [Commented] (YARN-4447) Provide a mechanism to represent complex filters and parse them at the REST layer

2016-04-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265413#comment-15265413 ] Sangjin Lee commented on YARN-4447: --- Some more feedback... (TimelineParserForCompareExpr

[jira] [Commented] (YARN-4447) Provide a mechanism to represent complex filters and parse them at the REST layer

2016-04-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265424#comment-15265424 ] Sangjin Lee commented on YARN-4447: --- {quote} Spaces in the expression will have to be enc

[jira] [Commented] (YARN-4447) Provide a mechanism to represent complex filters and parse them at the REST layer

2016-04-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265428#comment-15265428 ] Sangjin Lee commented on YARN-4447: --- bq. IMO, we cannot lowercase the whole expression as

[jira] [Commented] (YARN-4447) Provide a mechanism to represent complex filters and parse them at the REST layer

2016-05-01 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15266150#comment-15266150 ] Sangjin Lee commented on YARN-4447: --- Thanks for updating the patch [~varun_saxena]. I thi

[jira] [Commented] (YARN-4447) Provide a mechanism to represent complex filters and parse them at the REST layer

2016-05-01 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15266152#comment-15266152 ] Sangjin Lee commented on YARN-4447: --- One other thing: it seems {{TimelineParserForEqualit

[jira] [Commented] (YARN-4447) Provide a mechanism to represent complex filters and parse them at the REST layer

2016-05-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267322#comment-15267322 ] Sangjin Lee commented on YARN-4447: --- +1 on the latest patch. I'll give a little bit of ti

[jira] [Commented] (YARN-4821) Have a separate NM timeline publishing-interval

2016-05-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267794#comment-15267794 ] Sangjin Lee commented on YARN-4821: --- Thanks [~Naganarasimha] for the patch! I took a look

[jira] [Updated] (YARN-4821) Have a separate NM timeline publishing-interval

2016-05-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4821: -- Labels: (was: yarn-2928-1st-milestone) > Have a separate NM timeline publishing-interval >

[jira] [Updated] (YARN-5011) Support metric filters for flow runs

2016-05-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5011: -- Labels: (was: yarn-2928-1st-milestone) > Support metric filters for flow runs > ---

[jira] [Created] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5045: - Summary: hbase unit tests fail due to dependency issues Key: YARN-5045 URL: https://issues.apache.org/jira/browse/YARN-5045 Project: Hadoop YARN Issue Type: Sub-ta

[jira] [Commented] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273218#comment-15273218 ] Sangjin Lee commented on YARN-5045: --- This is basically a *diamond dependency problem*. Ti

[jira] [Commented] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273383#comment-15273383 ] Sangjin Lee commented on YARN-5045: --- One point about not including non-test source in the

[jira] [Updated] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5045: -- Attachment: YARN-5045-YARN-2928.poc.patch Posted the POC patch. With this, I have a clean build in terms

[jira] [Updated] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5045: -- Attachment: YARN-5045-YARN-2928.01.patch Posted patch v.1. This should be ready for review. > hbase unit

[jira] [Commented] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274235#comment-15274235 ] Sangjin Lee commented on YARN-5045: --- Thanks for the comments [~varun_saxena]. I did notic

[jira] [Updated] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5045: -- Attachment: YARN-5045-YARN-2928.02.patch Posted patch v.2. Added hadoop-auth as another artifact to enfo

[jira] [Updated] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5045: -- Attachment: YARN-5045-YARN-2928.03.patch Posted patch v.3. Thanks for the suggestion [~gtCarrera9]. I di

[jira] [Commented] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15275003#comment-15275003 ] Sangjin Lee commented on YARN-5045: --- Rekicked jenkins. Timelineservice and timelineservic

[jira] [Commented] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276610#comment-15276610 ] Sangjin Lee commented on YARN-5045: --- Yes, I believe CHANGES.txt has been removed altogeth

[jira] [Created] (YARN-5070) upgrade HBase version for first merge

2016-05-10 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5070: - Summary: upgrade HBase version for first merge Key: YARN-5070 URL: https://issues.apache.org/jira/browse/YARN-5070 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5071: - Summary: address HBase compatibility issues with trunk Key: YARN-5071 URL: https://issues.apache.org/jira/browse/YARN-5071 Project: Hadoop YARN Issue Type: Sub-tas

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278587#comment-15278587 ] Sangjin Lee commented on YARN-5071: --- We have 2 areas of concern: # running our timeline s

[jira] [Commented] (YARN-5070) upgrade HBase version for first merge

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278596#comment-15278596 ] Sangjin Lee commented on YARN-5070: --- Yes, I thought about phoenix. Do you have some thoug

[jira] [Commented] (YARN-5070) upgrade HBase version for first merge

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278632#comment-15278632 ] Sangjin Lee commented on YARN-5070: --- HBase 1.2.1 is a potential candidate. > upgrade HBa

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278640#comment-15278640 ] Sangjin Lee commented on YARN-5071: --- Regarding #2, I don't think java 8 would be an issue

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278763#comment-15278763 ] Sangjin Lee commented on YARN-5071: --- The main issue we saw was that in the trunk all metr

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278772#comment-15278772 ] Sangjin Lee commented on YARN-5071: --- There may be more incompatible changes coming along

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278773#comment-15278773 ] Sangjin Lee commented on YARN-5071: --- No. Let me open one. > address HBase compatibility

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278780#comment-15278780 ] Sangjin Lee commented on YARN-5071: --- Filed HBASE-15812. > address HBase compatibility is

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279123#comment-15279123 ] Sangjin Lee commented on YARN-4577: --- It appears the latest patch is missing {{AuxiliaryS

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279138#comment-15279138 ] Sangjin Lee commented on YARN-4577: --- One minor nit on {{AuxiliaryServiceWithCustomClassLo

[jira] [Commented] (YARN-5070) upgrade HBase version for first merge

2016-05-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280916#comment-15280916 ] Sangjin Lee commented on YARN-5070: --- Thanks [~enis] for the info. We're keenly interested

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281003#comment-15281003 ] Sangjin Lee commented on YARN-4577: --- I think it's quite close. The hadoop-common test fai

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-12 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281757#comment-15281757 ] Sangjin Lee commented on YARN-4577: --- +1. Committing shortly. I'm going to commit to trunk

[jira] [Commented] (YARN-5026) Container fail to launch for mapred application

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15285068#comment-15285068 ] Sangjin Lee commented on YARN-5026: --- [~bibinchundatt], would you like to update the patch

[jira] [Created] (YARN-5093) created time shows 0 in most REST output

2016-05-16 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5093: - Summary: created time shows 0 in most REST output Key: YARN-5093 URL: https://issues.apache.org/jira/browse/YARN-5093 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-5094) some YARN container events have timestamp of -1 in REST output

2016-05-16 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5094: - Summary: some YARN container events have timestamp of -1 in REST output Key: YARN-5094 URL: https://issues.apache.org/jira/browse/YARN-5094 Project: Hadoop YARN I

[jira] [Created] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-16 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5095: - Summary: flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled Key: YARN-5095 URL: https://issues.apache.org/jira/browse/YARN-5095

[jira] [Created] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-16 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5096: - Summary: timelinereader has a lot of logging that's not useful Key: YARN-5096 URL: https://issues.apache.org/jira/browse/YARN-5096 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15285660#comment-15285660 ] Sangjin Lee commented on YARN-5095: --- I'm not sure if this is related but I also see this

[jira] [Created] (YARN-5097) NPE in Separator.joinEncoded()

2016-05-16 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5097: - Summary: NPE in Separator.joinEncoded() Key: YARN-5097 URL: https://issues.apache.org/jira/browse/YARN-5097 Project: Hadoop YARN Issue Type: Sub-task Com

[jira] [Commented] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15285670#comment-15285670 ] Sangjin Lee commented on YARN-5095: --- Indeed this looks like a separate issue. > flow act

[jira] [Updated] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5096: -- Labels: yarn-2928-1st-milestone (was: ) > timelinereader has a lot of logging that's not useful > --

[jira] [Issue Comment Deleted] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5095: -- Comment: was deleted (was: I'm not sure if this is related but I also see this log in the RM log: {noform

[jira] [Issue Comment Deleted] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5095: -- Comment: was deleted (was: Indeed this looks like a separate issue.) > flow activities and flow runs are

[jira] [Updated] (YARN-5052) Update timeline service v2 documentation to capture information about filters

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5052: -- Labels: yarn-2928-1st-milestone (was: ) > Update timeline service v2 documentation to capture informatio

[jira] [Commented] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15285742#comment-15285742 ] Sangjin Lee commented on YARN-5095: --- [~gtCarrera9], is YARN-5018 related to this JIRA or

[jira] [Updated] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5050: -- Labels: yarn-2928-1st-milestone (was: ) > Code cleanup for TestDistributedShell > --

[jira] [Updated] (YARN-5071) address HBase compatibility issues with trunk

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5071: -- Labels: yarn-2928-1st-milestone (was: ) > address HBase compatibility issues with trunk > --

[jira] [Updated] (YARN-5070) upgrade HBase version for first merge

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5070: -- Labels: yarn-2928-1st-milestone (was: ) > upgrade HBase version for first merge > --

[jira] [Created] (YARN-5102) timeline service build fails with java 8

2016-05-17 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5102: - Summary: timeline service build fails with java 8 Key: YARN-5102 URL: https://issues.apache.org/jira/browse/YARN-5102 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-5102) timeline service build fails with java 8

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5102: -- Attachment: YARN-5102-YARN-2928.01.patch Posted the patch. I don't know why we didn't see it earlier. >

[jira] [Commented] (YARN-5102) timeline service build fails with java 8

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15287327#comment-15287327 ] Sangjin Lee commented on YARN-5102: --- Can I get a +1 on this? > timeline service build fa

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15287548#comment-15287548 ] Sangjin Lee commented on YARN-5018: --- Should this also be marked as the merge blocker? An

[jira] [Created] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-17 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5105: - Summary: entire time series is returned for YARN container system metrics (CPU and memory) Key: YARN-5105 URL: https://issues.apache.org/jira/browse/YARN-5105 Project: Hado

[jira] [Updated] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5018: -- Labels: yarn-2928-1st-milestone (was: ) > Online aggregation logic should not run immediately after coll

[jira] [Updated] (YARN-5093) created time shows 0 in most REST output

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5093: -- Description: When querying the REST API, I find that the created time value is returned as "0" for most

[jira] [Commented] (YARN-5093) created time shows 0 in most REST output

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15287864#comment-15287864 ] Sangjin Lee commented on YARN-5093: --- Yes, I think you're right. I initially thought this

[jira] [Assigned] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee reassigned YARN-5096: - Assignee: Sangjin Lee > timelinereader has a lot of logging that's not useful > --

[jira] [Commented] (YARN-5093) created time shows 0 in most REST output

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15287986#comment-15287986 ] Sangjin Lee commented on YARN-5093: --- The fix could be not writing the created column (and

[jira] [Created] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-17 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5109: - Summary: timestamps are stored unencoded causing parse errors Key: YARN-5109 URL: https://issues.apache.org/jira/browse/YARN-5109 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15288444#comment-15288444 ] Sangjin Lee commented on YARN-5109: --- For example, code that creates the column name for e

[jira] [Updated] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5096: -- Description: After running about a dozen or so requests, the timelinereader log is filled with the follo

[jira] [Updated] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5096: -- Attachment: YARN-5096-YARN-2928.01.patch Posted the patch. Could you please take a quick look and commit

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289207#comment-15289207 ] Sangjin Lee commented on YARN-5109: --- Thanks for looking into this [~varun_saxena]. It mig

[jira] [Commented] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289236#comment-15289236 ] Sangjin Lee commented on YARN-5105: --- I was thinking more along the line of emitting only

[jira] [Created] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-18 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5111: - Summary: YARN container system metrics are not aggregated to application Key: YARN-5111 URL: https://issues.apache.org/jira/browse/YARN-5111 Project: Hadoop YARN

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289571#comment-15289571 ] Sangjin Lee commented on YARN-5109: --- These are the all the cases of "naked" joins: {nofor

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289895#comment-15289895 ] Sangjin Lee commented on YARN-5109: --- I spoke with [~jrottinghuis] offline about this. Ini

[jira] [Commented] (YARN-5093) created time shows 0 in most REST output

2016-05-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289917#comment-15289917 ] Sangjin Lee commented on YARN-5093: --- It is getting written. It's that subsequent writes f

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290166#comment-15290166 ] Sangjin Lee commented on YARN-5109: --- Here is a proposal. Instead of blindly splitting alo

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290570#comment-15290570 ] Sangjin Lee commented on YARN-5050: --- I'm curious, don't we want to enable SYSTEM_METRICS_

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15291498#comment-15291498 ] Sangjin Lee commented on YARN-5109: --- Good point about the column qualifiers not needing t

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292229#comment-15292229 ] Sangjin Lee commented on YARN-5109: --- Joep, Vrushali, and I discussed some more offline, a

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292270#comment-15292270 ] Sangjin Lee commented on YARN-5109: --- Another related issue I see is currently the event i

<    1   2   3   4   5   6   7   8   9   10   >