[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1 in REST output

2016-05-26 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303431#comment-15303431 ] Sangjin Lee commented on YARN-5094: --- Filed YARN-5169. We discussed this offline, and I believe this is

[jira] [Created] (YARN-5169) most of YARN events have timestamp of -1

2016-05-26 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5169: - Summary: most of YARN events have timestamp of -1 Key: YARN-5169 URL: https://issues.apache.org/jira/browse/YARN-5169 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-26 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303236#comment-15303236 ] Sangjin Lee commented on YARN-5109: --- I am also +1 on the latest patch. I'll wait until the EOD for last

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-26 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302528#comment-15302528 ] Sangjin Lee commented on YARN-5109: --- Also, one of the unit tests is failing. Haven't checked again if the

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-26 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302510#comment-15302510 ] Sangjin Lee commented on YARN-5109: --- Thanks for updating the patch [~varun_saxena]! I'll go over it one

[jira] [Commented] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301264#comment-15301264 ] Sangjin Lee commented on YARN-5111: --- Is it possible that the {{realtimeAggregatorOp}} bit was not

[jira] [Commented] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301156#comment-15301156 ] Sangjin Lee commented on YARN-5095: --- The unit test failures are unrelated (one JIRA here: YARN-5091).

[jira] [Commented] (YARN-5097) NPE in Separator.joinEncoded()

2016-05-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301031#comment-15301031 ] Sangjin Lee commented on YARN-5097: --- +1. Committing it shortly. > NPE in Separator.joinEncoded() >

[jira] [Commented] (YARN-1151) Ability to configure auxiliary services from HDFS-based JAR files

2016-05-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300289#comment-15300289 ] Sangjin Lee commented on YARN-1151: --- I don't think a separate configuration is necessary to handle

[jira] [Commented] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299452#comment-15299452 ] Sangjin Lee commented on YARN-5105: --- Thanks for the update Varun! I am going over the patch, and am

[jira] [Commented] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299260#comment-15299260 ] Sangjin Lee commented on YARN-5095: --- [~varun_saxena], I have one question on line 886 of

[jira] [Commented] (YARN-5139) [Umbrella] Move YARN scheduler towards global scheduler

2016-05-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299051#comment-15299051 ] Sangjin Lee commented on YARN-5139: --- Yes, we would love to see this for more reasons than one! >

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298630#comment-15298630 ] Sangjin Lee commented on YARN-5018: --- The latest patch looks good to me. I'll commit it shortly. > Online

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298621#comment-15298621 ] Sangjin Lee commented on YARN-5018: --- Understood. For this specific JIRA, it is safe to say the unit test

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298599#comment-15298599 ] Sangjin Lee commented on YARN-5018: --- I don't think we applied any trunk fixes by hand after the last

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298575#comment-15298575 ] Sangjin Lee commented on YARN-5018: --- What are the fixes? > Online aggregation logic should not run

[jira] [Commented] (YARN-5093) created time shows 0 in most REST output

2016-05-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298527#comment-15298527 ] Sangjin Lee commented on YARN-5093: --- +1. Committing it shortly. > created time shows 0 in most REST

[jira] [Commented] (YARN-5093) created time shows 0 in most REST output

2016-05-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298445#comment-15298445 ] Sangjin Lee commented on YARN-5093: --- Hmm, OK. I thought there would be no ambiguity, but I suppose I was

[jira] [Commented] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298441#comment-15298441 ] Sangjin Lee commented on YARN-5111: --- Just to note, you will not be able to see the *container* system

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298433#comment-15298433 ] Sangjin Lee commented on YARN-5109: --- Thanks for updating the patch [~varun_saxena]! I think it's almost

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298368#comment-15298368 ] Sangjin Lee commented on YARN-5018: --- Somehow the jenkins build didn't kick in. Started a build manually.

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297514#comment-15297514 ] Sangjin Lee commented on YARN-5018: --- Looks good. I'll commit it when jenkins returns clean. > Online

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297501#comment-15297501 ] Sangjin Lee commented on YARN-5071: --- I tried rebasing our branch with the current trunk, and I was able

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297451#comment-15297451 ] Sangjin Lee commented on YARN-5018: --- I think it is fine to have this flag in the generic

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297442#comment-15297442 ] Sangjin Lee commented on YARN-5018: --- The point is taken. Can we do this at least then? We can implement

[jira] [Comment Edited] (YARN-5097) NPE in Separator.joinEncoded()

2016-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297326#comment-15297326 ] Sangjin Lee edited comment on YARN-5097 at 5/23/16 11:26 PM: - Thanks

[jira] [Commented] (YARN-5097) NPE in Separator.joinEncoded()

2016-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297326#comment-15297326 ] Sangjin Lee commented on YARN-5097: --- Thanks [~vrushalic]. I understand Joep also was suggesting a logging

[jira] [Commented] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297316#comment-15297316 ] Sangjin Lee commented on YARN-5105: --- {quote} One more thing we need to think about is behavior of fields

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1 in REST output

2016-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297290#comment-15297290 ] Sangjin Lee commented on YARN-5094: --- Yes, I'm also slightly leaning towards populating the timestamp

[jira] [Commented] (YARN-5097) NPE in Separator.joinEncoded()

2016-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297277#comment-15297277 ] Sangjin Lee commented on YARN-5097: --- Thanks [~vrushalic] for your patch! To clarify, fixing YARN-5018

[jira] [Commented] (YARN-5093) created time shows 0 in most REST output

2016-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297274#comment-15297274 ] Sangjin Lee commented on YARN-5093: --- Thanks [~varun_saxena]! I suspect most of the unit test changes are

[jira] [Commented] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297234#comment-15297234 ] Sangjin Lee commented on YARN-5095: --- Thanks for the patch [~varun_saxena]! Would it be easier to add an

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297139#comment-15297139 ] Sangjin Lee commented on YARN-5018: --- [~gtCarrera9], thanks for the patch! I think defining a state after

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297099#comment-15297099 ] Sangjin Lee commented on YARN-5109: --- Thanks [~varun_saxena] for the patch! I think it's almost there. I

[jira] [Commented] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15294577#comment-15294577 ] Sangjin Lee commented on YARN-5095: --- The main reason I went with the start time as opposed to the submit

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15294559#comment-15294559 ] Sangjin Lee commented on YARN-5109: --- Hmm, could you point to the specific method where the proposed

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15294555#comment-15294555 ] Sangjin Lee commented on YARN-5109: --- [~jrottinghuis], [~vrushalic], and I dug a little bit, and it

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15293713#comment-15293713 ] Sangjin Lee commented on YARN-5109: --- The {{ApplicationTable}} and {{EntityTable}} javadoc also reflect

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15293705#comment-15293705 ] Sangjin Lee commented on YARN-5109: --- Hmm, I don't remember there was a reason the application row key had

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15293651#comment-15293651 ] Sangjin Lee commented on YARN-5018: --- [~gtCarrera9], how about adding a check in

[jira] [Commented] (YARN-5097) NPE in Separator.joinEncoded()

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292498#comment-15292498 ] Sangjin Lee commented on YARN-5097: --- I suspect this is indeed related with YARN-5018. The entire context

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292446#comment-15292446 ] Sangjin Lee commented on YARN-5018: --- I don't think it is a band-aid. I think it is more than acceptable

[jira] [Commented] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292442#comment-15292442 ] Sangjin Lee commented on YARN-5111: --- I saw this with a sleep job that ran for 5 minutes. I also checked

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292411#comment-15292411 ] Sangjin Lee commented on YARN-5050: --- +1. I'll commit it shortly. > Code cleanup for TestDistributedShell

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292379#comment-15292379 ] Sangjin Lee commented on YARN-5050: --- Thanks for the explanation. I'll wait for the jenkins run. > Code

[jira] [Commented] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292278#comment-15292278 ] Sangjin Lee commented on YARN-5096: --- Committed it: {noformat} commit

[jira] [Commented] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292275#comment-15292275 ] Sangjin Lee commented on YARN-5096: --- Ah I missed that one. Thanks for letting me know. I'll make that

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292270#comment-15292270 ] Sangjin Lee commented on YARN-5109: --- Another related issue I see is currently the event id and the info

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292229#comment-15292229 ] Sangjin Lee commented on YARN-5109: --- Joep, Vrushali, and I discussed some more offline, and we realized

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291498#comment-15291498 ] Sangjin Lee commented on YARN-5109: --- Good point about the column qualifiers not needing the correct

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15290570#comment-15290570 ] Sangjin Lee commented on YARN-5050: --- I'm curious, don't we want to enable

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15290166#comment-15290166 ] Sangjin Lee commented on YARN-5109: --- Here is a proposal. Instead of blindly splitting along the separator

[jira] [Commented] (YARN-5093) created time shows 0 in most REST output

2016-05-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289917#comment-15289917 ] Sangjin Lee commented on YARN-5093: --- It is getting written. It's that subsequent writes for that entity

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289895#comment-15289895 ] Sangjin Lee commented on YARN-5109: --- I spoke with [~jrottinghuis] offline about this. Initially we were

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289571#comment-15289571 ] Sangjin Lee commented on YARN-5109: --- These are the all the cases of "naked" joins:

[jira] [Created] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-18 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5111: - Summary: YARN container system metrics are not aggregated to application Key: YARN-5111 URL: https://issues.apache.org/jira/browse/YARN-5111 Project: Hadoop YARN

[jira] [Commented] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289236#comment-15289236 ] Sangjin Lee commented on YARN-5105: --- I was thinking more along the line of emitting only the latest value

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289207#comment-15289207 ] Sangjin Lee commented on YARN-5109: --- Thanks for looking into this [~varun_saxena]. It might be good to

[jira] [Updated] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5096: -- Attachment: YARN-5096-YARN-2928.01.patch Posted the patch. Could you please take a quick look and commit

[jira] [Updated] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5096: -- Description: After running about a dozen or so requests, the timelinereader log is filled with the

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288444#comment-15288444 ] Sangjin Lee commented on YARN-5109: --- For example, code that creates the column name for events: {code}

[jira] [Created] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-17 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5109: - Summary: timestamps are stored unencoded causing parse errors Key: YARN-5109 URL: https://issues.apache.org/jira/browse/YARN-5109 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5093) created time shows 0 in most REST output

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287986#comment-15287986 ] Sangjin Lee commented on YARN-5093: --- The fix could be not writing the created column (and any other

[jira] [Assigned] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee reassigned YARN-5096: - Assignee: Sangjin Lee > timelinereader has a lot of logging that's not useful >

[jira] [Commented] (YARN-5093) created time shows 0 in most REST output

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287864#comment-15287864 ] Sangjin Lee commented on YARN-5093: --- Yes, I think you're right. I initially thought this might be a UI

[jira] [Updated] (YARN-5093) created time shows 0 in most REST output

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5093: -- Description: When querying the REST API, I find that the created time value is returned as "0" for most

[jira] [Updated] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5018: -- Labels: yarn-2928-1st-milestone (was: ) > Online aggregation logic should not run immediately after

[jira] [Created] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-17 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5105: - Summary: entire time series is returned for YARN container system metrics (CPU and memory) Key: YARN-5105 URL: https://issues.apache.org/jira/browse/YARN-5105 Project:

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287548#comment-15287548 ] Sangjin Lee commented on YARN-5018: --- Should this also be marked as the merge blocker? And I see that the

[jira] [Commented] (YARN-5102) timeline service build fails with java 8

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287327#comment-15287327 ] Sangjin Lee commented on YARN-5102: --- Can I get a +1 on this? > timeline service build fails with java 8

[jira] [Updated] (YARN-5102) timeline service build fails with java 8

2016-05-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5102: -- Attachment: YARN-5102-YARN-2928.01.patch Posted the patch. I don't know why we didn't see it earlier. >

[jira] [Created] (YARN-5102) timeline service build fails with java 8

2016-05-17 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5102: - Summary: timeline service build fails with java 8 Key: YARN-5102 URL: https://issues.apache.org/jira/browse/YARN-5102 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-5070) upgrade HBase version for first merge

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5070: -- Labels: yarn-2928-1st-milestone (was: ) > upgrade HBase version for first merge >

[jira] [Updated] (YARN-5071) address HBase compatibility issues with trunk

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5071: -- Labels: yarn-2928-1st-milestone (was: ) > address HBase compatibility issues with trunk >

[jira] [Updated] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5050: -- Labels: yarn-2928-1st-milestone (was: ) > Code cleanup for TestDistributedShell >

[jira] [Commented] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15285742#comment-15285742 ] Sangjin Lee commented on YARN-5095: --- [~gtCarrera9], is YARN-5018 related to this JIRA or YARN-5097? >

[jira] [Updated] (YARN-5052) Update timeline service v2 documentation to capture information about filters

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5052: -- Labels: yarn-2928-1st-milestone (was: ) > Update timeline service v2 documentation to capture

[jira] [Issue Comment Deleted] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5095: -- Comment: was deleted (was: Indeed this looks like a separate issue.) > flow activities and flow runs

[jira] [Issue Comment Deleted] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5095: -- Comment: was deleted (was: I'm not sure if this is related but I also see this log in the RM log:

[jira] [Updated] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5096: -- Labels: yarn-2928-1st-milestone (was: ) > timelinereader has a lot of logging that's not useful >

[jira] [Commented] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15285670#comment-15285670 ] Sangjin Lee commented on YARN-5095: --- Indeed this looks like a separate issue. > flow activities and flow

[jira] [Created] (YARN-5097) NPE in Separator.joinEncoded()

2016-05-16 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5097: - Summary: NPE in Separator.joinEncoded() Key: YARN-5097 URL: https://issues.apache.org/jira/browse/YARN-5097 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15285660#comment-15285660 ] Sangjin Lee commented on YARN-5095: --- I'm not sure if this is related but I also see this log in the RM

[jira] [Created] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-16 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5096: - Summary: timelinereader has a lot of logging that's not useful Key: YARN-5096 URL: https://issues.apache.org/jira/browse/YARN-5096 Project: Hadoop YARN Issue

[jira] [Created] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-16 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5095: - Summary: flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled Key: YARN-5095 URL: https://issues.apache.org/jira/browse/YARN-5095

[jira] [Created] (YARN-5094) some YARN container events have timestamp of -1 in REST output

2016-05-16 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5094: - Summary: some YARN container events have timestamp of -1 in REST output Key: YARN-5094 URL: https://issues.apache.org/jira/browse/YARN-5094 Project: Hadoop YARN

[jira] [Created] (YARN-5093) created time shows 0 in most REST output

2016-05-16 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5093: - Summary: created time shows 0 in most REST output Key: YARN-5093 URL: https://issues.apache.org/jira/browse/YARN-5093 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5026) Container fail to launch for mapred application

2016-05-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15285068#comment-15285068 ] Sangjin Lee commented on YARN-5026: --- [~bibinchundatt], would you like to update the patch to implement

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-12 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281757#comment-15281757 ] Sangjin Lee commented on YARN-4577: --- +1. Committing shortly. I'm going to commit to trunk and branch-2

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281003#comment-15281003 ] Sangjin Lee commented on YARN-4577: --- I think it's quite close. The hadoop-common test failure is

[jira] [Commented] (YARN-5070) upgrade HBase version for first merge

2016-05-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15280916#comment-15280916 ] Sangjin Lee commented on YARN-5070: --- Thanks [~enis] for the info. We're keenly interested in getting

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279138#comment-15279138 ] Sangjin Lee commented on YARN-4577: --- One minor nit on {{AuxiliaryServiceWithCustomClassLoader.java}}: -

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279123#comment-15279123 ] Sangjin Lee commented on YARN-4577: --- It appears the latest patch is missing

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278780#comment-15278780 ] Sangjin Lee commented on YARN-5071: --- Filed HBASE-15812. > address HBase compatibility issues with trunk

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278773#comment-15278773 ] Sangjin Lee commented on YARN-5071: --- No. Let me open one. > address HBase compatibility issues with

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278772#comment-15278772 ] Sangjin Lee commented on YARN-5071: --- There may be more incompatible changes coming along in the trunk in

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278763#comment-15278763 ] Sangjin Lee commented on YARN-5071: --- The main issue we saw was that in the trunk all metrics v.1 classes

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278640#comment-15278640 ] Sangjin Lee commented on YARN-5071: --- Regarding #2, I don't think java 8 would be an issue, but things

[jira] [Commented] (YARN-5070) upgrade HBase version for first merge

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278632#comment-15278632 ] Sangjin Lee commented on YARN-5070: --- HBase 1.2.1 is a potential candidate. > upgrade HBase version for

[jira] [Commented] (YARN-5070) upgrade HBase version for first merge

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278596#comment-15278596 ] Sangjin Lee commented on YARN-5070: --- Yes, I thought about phoenix. Do you have some thoughts on the

<    1   2   3   4   5   6   7   8   9   10   >