[jira] [Commented] (YARN-7075) [YARN-3368] Improvement of Web UI

2017-08-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147892#comment-16147892 ] Li Lu commented on YARN-7075: - Maybe it worth the effort to make the donuts slightly thicker? If there are a

[jira] [Commented] (YARN-7109) Extend aggregation operation for new ATS design

2017-08-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144140#comment-16144140 ] Li Lu commented on YARN-7109: - BTW [~Zian Chen] you may want to find out some documentations here:

[jira] [Commented] (YARN-7109) Extend aggregation operation for new ATS design

2017-08-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144138#comment-16144138 ] Li Lu commented on YARN-7109: - Thanks for the proposal [~Zian Chen]! I've already added you to the contributor

[jira] [Assigned] (YARN-7109) Extend aggregation operation for new ATS design

2017-08-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-7109: --- Assignee: Zian Chen > Extend aggregation operation for new ATS design >

[jira] [Updated] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-25 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-6999: Fix Version/s: 2.9 > Add log about how to solve Error: Could not find or load main class >

[jira] [Updated] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-25 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-6999: Labels: newbie (was: beginner) > Add log about how to solve Error: Could not find or load main class >

[jira] [Commented] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141133#comment-16141133 ] Li Lu commented on YARN-6999: - Patch LGTM. The patch is trivial for unit tests. Findbugs warning appears to be

[jira] [Commented] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140353#comment-16140353 ] Li Lu commented on YARN-6999: - This looks much better, thanks for the work [~littlestone00]! Could you please

[jira] [Commented] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131720#comment-16131720 ] Li Lu commented on YARN-6999: - I kicked Jenkins for a precommit build. Not sure why this was missed. > Add

[jira] [Commented] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131718#comment-16131718 ] Li Lu commented on YARN-6999: - Thanks for the work [~littlestone00], this appears to be a real usability issue

[jira] [Assigned] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-6999: --- Assignee: Linlin Zhou > Add log about how to solve Error: Could not find or load main class >

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2017-06-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033890#comment-16033890 ] Li Lu commented on YARN-5094: - Sorry about the delay. Please feel free to take it. Let's not touch

[jira] [Created] (YARN-6323) Rolling upgrade/config change is broken on timeline v2.

2017-03-10 Thread Li Lu (JIRA)
Li Lu created YARN-6323: --- Summary: Rolling upgrade/config change is broken on timeline v2. Key: YARN-6323 URL: https://issues.apache.org/jira/browse/YARN-6323 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-6316) Provide help information and documentation for TimelineSchemaCreator

2017-03-09 Thread Li Lu (JIRA)
Li Lu created YARN-6316: --- Summary: Provide help information and documentation for TimelineSchemaCreator Key: YARN-6316 URL: https://issues.apache.org/jira/browse/YARN-6316 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-6294) ATS client should better handle Socket closed case

2017-03-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-6294: Attachment: YARN-6294-trunk.001.patch YARN-6294-branch-2.001.patch Since trunk and branch-2 diverge

[jira] [Commented] (YARN-6293) Investigate Java 7 compatibility for new YARN UI

2017-03-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898221#comment-15898221 ] Li Lu commented on YARN-6293: - Actually I just directly changed the ui module's pom.xml. I changed the parent

[jira] [Created] (YARN-6293) Investigate Java 7 compatibility for new YARN UI

2017-03-06 Thread Li Lu (JIRA)
Li Lu created YARN-6293: --- Summary: Investigate Java 7 compatibility for new YARN UI Key: YARN-6293 URL: https://issues.apache.org/jira/browse/YARN-6293 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-6030) Eliminate timelineServiceV2 boolean flag in TimelineClientImpl

2017-02-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883782#comment-15883782 ] Li Lu commented on YARN-6030: - I think so. Please feel free to check and close. Thanks! > Eliminate

[jira] [Updated] (YARN-6228) EntityGroupFSTimelineStore should allow configurable cache stores.

2017-02-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-6228: Attachment: YARN-6228-trunk.002.patch I cannot reproduce the failures locally. Try again... >

[jira] [Updated] (YARN-6228) EntityGroupFSTimelineStore should allow configurable cache stores.

2017-02-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-6228: Attachment: YARN-6228-trunk.001.patch Patch to make cache stores configurable. > EntityGroupFSTimelineStore should

[jira] [Created] (YARN-6228) EntityGroupFSTimelineStore should allow configurable cache stores.

2017-02-23 Thread Li Lu (JIRA)
Li Lu created YARN-6228: --- Summary: EntityGroupFSTimelineStore should allow configurable cache stores. Key: YARN-6228 URL: https://issues.apache.org/jira/browse/YARN-6228 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6069) CORS support in timeline v2

2017-02-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876765#comment-15876765 ] Li Lu commented on YARN-6069: - Sorry to chime in this late, but one general question about CORS itself. I'm

[jira] [Commented] (YARN-6177) Yarn client should exit with an informative error message if an incompatible Jersey library is used at client

2017-02-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15870725#comment-15870725 ] Li Lu commented on YARN-6177: - Committing... > Yarn client should exit with an informative error message if

[jira] [Commented] (YARN-6177) Yarn client should exit with an informative error message if an incompatible Jersey library is used at client

2017-02-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15870541#comment-15870541 ] Li Lu commented on YARN-6177: - LGTM. Will commit in a few hours if nobody objects. > Yarn client should exit

[jira] [Commented] (YARN-6177) Yarn client should exit with an informative error message if an incompatible Jersey library is used at client

2017-02-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869304#comment-15869304 ] Li Lu commented on YARN-6177: - bq. Set yarn.timeline-service.client.best-effort to true with this patch, so

[jira] [Commented] (YARN-6177) Yarn client should exit with an informative error message if an incompatible Jersey library is used at client

2017-02-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868817#comment-15868817 ] Li Lu commented on YARN-6177: - OK I see. Is it possible to disable timeline service for those affected

[jira] [Updated] (YARN-5718) TimelineClient (and other places in YARN) shouldn't over-write HDFS client retry settings which could cause unexpected behavior

2017-02-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5718: Hadoop Flags: Incompatible change > TimelineClient (and other places in YARN) shouldn't over-write HDFS client >

[jira] [Commented] (YARN-6027) Support fromid(offset) filter for /flows API

2017-02-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868746#comment-15868746 ] Li Lu commented on YARN-6027: - Thanks [~rohithsharma]! Generally fine but one nit is that we're exposing a lot

[jira] [Commented] (YARN-6177) Yarn client should exit with an informative error message if an incompatible Jersey library is used at client

2017-02-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868682#comment-15868682 ] Li Lu commented on YARN-6177: - Thanks [~cheersyang]. My concern is with these lines: {code} 379 } catch

[jira] [Commented] (YARN-4675) Reorganize TimelineClient and TimelineClientImpl into separate classes for ATSv1.x and ATSv2

2017-02-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868593#comment-15868593 ] Li Lu commented on YARN-4675: - V10 patch looks good to me. > Reorganize TimelineClient and TimelineClientImpl

[jira] [Commented] (YARN-6177) Yarn client should exit with an informative error message if an incompatible Jersey library is used at client

2017-02-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868451#comment-15868451 ] Li Lu commented on YARN-6177: - Thanks for the hard work [~cheersyang]! Keep using

[jira] [Commented] (YARN-6177) Yarn client should exit with an informative error message if an incompatible Jersey library is used at client

2017-02-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865034#comment-15865034 ] Li Lu commented on YARN-6177: - [~cheersyang] Looks fine to me. Thanks! > Yarn client should exit with an

[jira] [Commented] (YARN-6177) Yarn client should exit with an informative error message if an incompatible Jersey library is used at client

2017-02-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865015#comment-15865015 ] Li Lu commented on YARN-6177: - bq. Use timeline best effort flag seems a better option for me than disabling

[jira] [Commented] (YARN-6177) Yarn client should exit with an informative error message if an incompatible Jersey library is used at client

2017-02-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864950#comment-15864950 ] Li Lu commented on YARN-6177: - One quick inquiry: are we catching every throwable and swallow them if

[jira] [Commented] (YARN-5271) ATS client doesn't work with Jersey 2 on the classpath

2017-02-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861715#comment-15861715 ] Li Lu commented on YARN-5271: - Thanks [~jojochuang]! Let's not revert the change directly since the code base

[jira] [Commented] (YARN-6027) Improve /flows API for more flexible filters fromid, collapse, userid

2017-02-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858664#comment-15858664 ] Li Lu commented on YARN-6027: - Thanks for the patch [~rohithsharma]! One big picture question: I'm still not

[jira] [Commented] (YARN-6137) Yarn client implicitly invoke ATS client which accesses HDFS

2017-02-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858544#comment-15858544 ] Li Lu commented on YARN-6137: - Thanks [~jlowe] for the review and commit! > Yarn client implicitly invoke ATS

[jira] [Updated] (YARN-6137) Yarn client implicitly invoke ATS client which accesses HDFS

2017-02-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-6137: Attachment: YARN-6137-trunk.002.patch Thanks [~jlowe] for the review! A new patch to address all review comments.

[jira] [Commented] (YARN-5271) ATS client doesn't work with Jersey 2 on the classpath

2017-02-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856995#comment-15856995 ] Li Lu commented on YARN-5271: - Thanks [~cheersyang]. bq. The fix here was trying to alleviate this pain, it

[jira] [Commented] (YARN-5271) ATS client doesn't work with Jersey 2 on the classpath

2017-02-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15854576#comment-15854576 ] Li Lu commented on YARN-5271: - Thanks for the work [~cheersyang]! This looks like a pretty unfortunate case

[jira] [Updated] (YARN-6137) Yarn client implicitly invoke ATS client which accesses HDFS

2017-02-03 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-6137: Attachment: YARN-6137-trunk.001.patch First patch to fix this issue. Note that we always start a timeline client

[jira] [Reopened] (YARN-5271) ATS client doesn't work with Jersey 2 on the classpath

2017-02-02 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reopened YARN-5271: - > ATS client doesn't work with Jersey 2 on the classpath > -- > >

[jira] [Commented] (YARN-5271) ATS client doesn't work with Jersey 2 on the classpath

2017-02-02 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15850784#comment-15850784 ] Li Lu commented on YARN-5271: - Quick note: are we catching an error here and disables timeline service based

[jira] [Commented] (YARN-6137) Yarn client implicitly invoke ATS client which accesses HDFS

2017-02-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15849020#comment-15849020 ] Li Lu commented on YARN-6137: - This appears to be an ATS v1.5 only issue, but a bigger question is, why do we

[jira] [Assigned] (YARN-6137) Yarn client implicitly invoke ATS client which accesses HDFS

2017-02-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-6137: --- Assignee: Li Lu > Yarn client implicitly invoke ATS client which accesses HDFS >

[jira] [Updated] (YARN-2355) MAX_APP_ATTEMPTS_ENV may no longer be a useful env var for a container

2017-01-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2355: Hadoop Flags: Incompatible change > MAX_APP_ATTEMPTS_ENV may no longer be a useful env var for a container >

[jira] [Commented] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2017-01-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830892#comment-15830892 ] Li Lu commented on YARN-4675: - Thanks [~Naganarasimha]! I took a look at the 003 patch. Not sure why but I

[jira] [Commented] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-01-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815912#comment-15815912 ] Li Lu commented on YARN-6054: - Thanks [~raviprak]. The committed patch LGTM. Once the old file is backed up we

[jira] [Commented] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-01-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815599#comment-15815599 ] Li Lu commented on YARN-6054: - Oops sorry [~Naganarasimha] I was trying to take a closer look at the updated

[jira] [Commented] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-01-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803022#comment-15803022 ] Li Lu commented on YARN-6054: - Thanks [~raviprak], fail the second attempt sounds like a right choice. I'm not

[jira] [Commented] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-01-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802926#comment-15802926 ] Li Lu commented on YARN-6054: - Thanks [~raviprak] for the patch! One quick concern is what will happen if the

[jira] [Commented] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved

2016-12-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782102#comment-15782102 ] Li Lu commented on YARN-6029: - Thanks [~wangda]! bq. But it could cause inconsistency read data, for example,

[jira] [Commented] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved

2016-12-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782007#comment-15782007 ] Li Lu commented on YARN-6029: - I'm not a scheduler expert, but "not affecting any data structure" sounds like

[jira] [Created] (YARN-6030) Eliminate timelineServiceV2 boolean flag in TimelineClientImpl

2016-12-27 Thread Li Lu (JIRA)
Li Lu created YARN-6030: --- Summary: Eliminate timelineServiceV2 boolean flag in TimelineClientImpl Key: YARN-6030 URL: https://issues.apache.org/jira/browse/YARN-6030 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2016-12-22 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771143#comment-15771143 ] Li Lu commented on YARN-5585: - I don't have a strong opinion on fromIdPrefix and fromId. Both ways make sense

[jira] [Commented] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2016-12-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765533#comment-15765533 ] Li Lu commented on YARN-5585: - Some of my comments: TimelineUIDConverter - consistency with comments: let's

[jira] [Commented] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2016-12-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765001#comment-15765001 ] Li Lu commented on YARN-5585: - I'm fine with only supporting inputs with idPrefix for fromId. Once users can

[jira] [Commented] (YARN-5585) [Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

2016-12-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762691#comment-15762691 ] Li Lu commented on YARN-5585: - Thanks [~rohithsharma] for the update! With regards to the APIs, I think we can

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-12-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762438#comment-15762438 ] Li Lu commented on YARN-4061: - Thanks [~jrottinghuis]! bq. For our usecase, that makes the puts idempotent.

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-12-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752682#comment-15752682 ] Li Lu commented on YARN-4061: - I went through the new design doc in HBASE-17018 and I think it's mostly good.

[jira] [Commented] (YARN-5976) Update hbase version to 1.2

2016-12-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749184#comment-15749184 ] Li Lu commented on YARN-5976: - Let's remove the Phoenix dependency and revert affected patches. We can work on

[jira] [Commented] (YARN-5647) [Security] Collector and reader side changes for loading auth filters and principals

2016-12-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746392#comment-15746392 ] Li Lu commented on YARN-5647: - Sorry for the late reply folks, as I kept being stuck with some other issues

[jira] [Commented] (YARN-5974) Remove direct reference to TimelineClientImpl

2016-12-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15733773#comment-15733773 ] Li Lu commented on YARN-5974: - The timed out UT looks weird since I could not find anything useful in the test

[jira] [Updated] (YARN-5974) Remove direct reference to TimelineClientImpl

2016-12-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5974: Attachment: YARN-5974-YARN-5355.001.patch Took a look at all direct references to TimelineClientImpl in our code

[jira] [Commented] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-12-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15730203#comment-15730203 ] Li Lu commented on YARN-4675: - For TimelineClientImpl, I'm totally fine to separate v1 and v2. I'm not

[jira] [Commented] (YARN-5974) Remove direct reference to TimelineClientImpl

2016-12-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15730205#comment-15730205 ] Li Lu commented on YARN-5974: - Time is up... So I'll take this work... > Remove direct reference to

[jira] [Assigned] (YARN-5974) Remove direct reference to TimelineClientImpl

2016-12-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-5974: --- Assignee: Li Lu > Remove direct reference to TimelineClientImpl >

[jira] [Commented] (YARN-5647) [Security] Collector and reader side changes for loading auth filters and principals

2016-12-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727044#comment-15727044 ] Li Lu commented on YARN-5647: - Thanks [~varun_saxena]! Can we split the kerberos related work from the rest

[jira] [Commented] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-12-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726783#comment-15726783 ] Li Lu commented on YARN-4675: - Created YARN-5974 for removing unnecessary references to TimelineClientImpl. >

[jira] [Created] (YARN-5974) Remove direct reference to TimelineClientImpl

2016-12-06 Thread Li Lu (JIRA)
Li Lu created YARN-5974: --- Summary: Remove direct reference to TimelineClientImpl Key: YARN-5974 URL: https://issues.apache.org/jira/browse/YARN-5974 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-12-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726776#comment-15726776 ] Li Lu commented on YARN-4675: - I'm fine with separating the v1 and v2 interfaces. Right now mixing v1 and v2

[jira] [Commented] (YARN-5756) Add state-machine implementation for queues

2016-12-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723639#comment-15723639 ] Li Lu commented on YARN-5756: - Thanks [~xgong]. Looks fine but I'm not extremely familiar with

[jira] [Updated] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-12-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5739: Attachment: YARN-5739-YARN-5355.007.patch Thanks [~varun_saxena] for the comments. Addressed all of them. >

[jira] [Commented] (YARN-5756) Add state-machine implementation for queues

2016-12-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713505#comment-15713505 ] Li Lu commented on YARN-5756: - Thanks [~xgong] for the patch! Generally fine, some comments: QueueState.java

[jira] [Updated] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-12-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5739: Attachment: YARN-5739-YARN-5355.006.patch New 006 patch to make Jenkins happy. > Provide timeline reader API to

[jira] [Updated] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-12-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5739: Attachment: (was: YARN-5739-YARN-5355.006.patch) > Provide timeline reader API to list available timeline entity

[jira] [Commented] (YARN-5756) Add state-machine implementation for queues

2016-12-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713290#comment-15713290 ] Li Lu commented on YARN-5756: - Seems like the second submission has been ignored by Jenkins. Kick it for one

[jira] [Updated] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-12-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5739: Attachment: YARN-5739-YARN-5355.006.patch New patch to address review comments. > Provide timeline reader API to

[jira] [Commented] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-12-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712881#comment-15712881 ] Li Lu commented on YARN-4675: - Yes I agree we need to decide on this issue soon. +1 for reorganizing

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710412#comment-15710412 ] Li Lu commented on YARN-5739: - Also, the two augmentParams in GenericEntityReader and in

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710400#comment-15710400 ] Li Lu commented on YARN-5739: - But I'd certainly appreciate if there are better names! > Provide timeline

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710357#comment-15710357 ] Li Lu commented on YARN-5739: - bq. I hate to nitpick on the name, but AbstractTimelineStorageReader sounds a

[jira] [Commented] (YARN-5933) ATS stale entries in active directory causes ApplicationNotFoundException in RM

2016-11-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710108#comment-15710108 ] Li Lu commented on YARN-5933: - bq. AppLogs#parseSummaryLogs() can skip subsequent getAppState for Unknown apps

[jira] [Commented] (YARN-5756) Add state-machine implementation for queues

2016-11-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710022#comment-15710022 ] Li Lu commented on YARN-5756: - Hi [~xgong], I tried to apply the patch locally but there were several issues

[jira] [Commented] (YARN-5761) Separate QueueManager from Scheduler

2016-11-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709840#comment-15709840 ] Li Lu commented on YARN-5761: - Will commit this patch shortly. > Separate QueueManager from Scheduler >

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709830#comment-15709830 ] Li Lu commented on YARN-5739: - Any more comments folks? Thanks! > Provide timeline reader API to list

[jira] [Commented] (YARN-5933) ATS stale entries in active directory causes ApplicationNotFoundException in RM

2016-11-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707125#comment-15707125 ] Li Lu commented on YARN-5933: - Thanks [~Prabhu Joseph] for the clarification. Now I got the point for the

[jira] [Commented] (YARN-5761) Separate QueueManager from Scheduler

2016-11-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706732#comment-15706732 ] Li Lu commented on YARN-5761: - +1 LGTM. Will wait for ~24 hrs before committing this. > Separate QueueManager

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706169#comment-15706169 ] Li Lu commented on YARN-5739: - Kick Jenkins again for the new patch. > Provide timeline reader API to list

[jira] [Updated] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5739: Attachment: YARN-5739-YARN-5355.005.patch Refactored EntityTypeReader and TimelineEntityReader. EntityTypeReader has

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703452#comment-15703452 ] Li Lu commented on YARN-5739: - Sure. Let me try with some refactoring... > Provide timeline reader API to list

[jira] [Commented] (YARN-5933) ATS stale entries in active directory causes ApplicationNotFoundException in RM

2016-11-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703312#comment-15703312 ] Li Lu commented on YARN-5933: - After putting some thoughts on this issue I have some hesitation to directly

[jira] [Commented] (YARN-5933) ATS stale entries in active directory causes ApplicationNotFoundException in RM

2016-11-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703184#comment-15703184 ] Li Lu commented on YARN-5933: - bq. ATS will keep on requesting and which floods RM. [~Prabhu Joseph] by saying

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-22 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688032#comment-15688032 ] Li Lu commented on YARN-5739: - Sure. Let's wait for more comments on this. > Provide timeline reader API to

[jira] [Updated] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-22 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5739: Attachment: YARN-5739-YARN-5355.004.patch Address comments above. bq. Moreover, REST endpoint suggestion was both

[jira] [Updated] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5739: Attachment: YARN-5739-YARN-5355.003.patch Version 003 patch that addresses more review comments. Specifically: 1.

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668416#comment-15668416 ] Li Lu commented on YARN-3053: - bq. Can we capture that aspect as a future work as part of implementing the

[jira] [Commented] (YARN-5814) Add druid as storage backend in YARN Timeline Service

2016-11-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665393#comment-15665393 ] Li Lu commented on YARN-5814: - Thanks [~BINGXUE QIU] for the doc! I have some quick questions: 1. According to

[jira] [Commented] (YARN-5814) Add druid as storage backend in YARN Timeline Service

2016-11-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665337#comment-15665337 ] Li Lu commented on YARN-5814: - Linking this issue the the umbrella JIRA of timeline v.2. > Add druid as

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665273#comment-15665273 ] Li Lu commented on YARN-3053: - Thanks [~varun_saxena]! bq. When collector manager receives the request to

  1   2   3   4   5   6   7   8   9   10   >