[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061186#comment-15061186 ] Li Lu commented on YARN-4224: - Discussed about the PUT use case with Wangda. Right now we're no

[jira] [Commented] (YARN-4445) Unify the term flowId and flowName in timeline v2 codebase

[ https://issues.apache.org/jira/browse/YARN-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059453#comment-15059453 ] Li Lu commented on YARN-4445: - I lean toward "flowName" since this is not indicating it is suff

[jira] [Commented] (YARN-4445) Unify the term flowId and flowName in timeline v2 codebase

[ https://issues.apache.org/jira/browse/YARN-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059297#comment-15059297 ] Li Lu commented on YARN-4445: - Thanks for the contribution [~zhanzhang]! The patch LGTM. +1 pen

[jira] [Commented] (YARN-4460) [Bug fix] RM fails to start when SMP is enabled

[ https://issues.apache.org/jira/browse/YARN-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059255#comment-15059255 ] Li Lu commented on YARN-4460: - The failing tests are irrelevant. > [Bug fix] RM fails to star

[jira] [Commented] (YARN-4444) TimelineClientImpl#doPosting should not fail on AbstractMethodError

[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059204#comment-15059204 ] Li Lu commented on YARN-: - Thanks [~leftnoteasy]! I'm also thinking about the solution for

[jira] [Updated] (YARN-4444) TimelineClientImpl#doPosting should not fail on AbstractMethodError

[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-: Attachment: YARN--trunk.001.patch In this patch I catch the AbstractMethodError thrown by the doPostingObject me

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059082#comment-15059082 ] Li Lu commented on YARN-4224: - Thanks [~varun_saxena]! The plan on the query parameters looks f

[jira] [Updated] (YARN-4445) Unify the term flowId and flowName in timeline v2 codebase

[ https://issues.apache.org/jira/browse/YARN-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4445: Assignee: Zhan Zhang (was: Li Lu) > Unify the term flowId and flowName in timeline v2 codebase > ---

[jira] [Updated] (YARN-4445) Unify the term flowId and flowName in timeline v2 codebase

[ https://issues.apache.org/jira/browse/YARN-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4445: Labels: refactor (was: ) > Unify the term flowId and flowName in timeline v2 codebase >

[jira] [Commented] (YARN-4460) [Bug fix] RM fails to start when SMP is enabled

[ https://issues.apache.org/jira/browse/YARN-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059010#comment-15059010 ] Li Lu commented on YARN-4460: - Could not reproduce the UT failures locally. All failures appear

[jira] [Updated] (YARN-4460) [Bug fix] RM fails to start when SMP is enabled

[ https://issues.apache.org/jira/browse/YARN-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4460: Attachment: YARN-4460-feature-YARN-2928.001.patch Upload a patch to quickly fix this issue. I moved event handler reg

[jira] [Created] (YARN-4460) [Bug fix] RM fails to start when SMP is enabled

Li Lu created YARN-4460: --- Summary: [Bug fix] RM fails to start when SMP is enabled Key: YARN-4460 URL: https://issues.apache.org/jira/browse/YARN-4460 Project: Hadoop YARN Issue Type: Sub-task Affe

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056817#comment-15056817 ] Li Lu commented on YARN-3816: - Thanks for the explanations [~djp]! With regard to my question:

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056626#comment-15056626 ] Li Lu commented on YARN-4224: - bq. Anyways from the GET side which is our immediate use case, i

[jira] [Commented] (YARN-4450) TestTimelineAuthenticationFilter and TestYarnConfigurationFields fail

[ https://issues.apache.org/jira/browse/YARN-4450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056450#comment-15056450 ] Li Lu commented on YARN-4450: - Patch LGTM. +1. Will commit shortly. > TestTimelineAuthenticat

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15055229#comment-15055229 ] Li Lu commented on YARN-4224: - [~vrushalic] I think the proposal is pretty close to the hRaven

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053898#comment-15053898 ] Li Lu commented on YARN-4224: - Opened YARN-4445 to trace the renaming issue for flowId. > Cha

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053896#comment-15053896 ] Li Lu commented on YARN-4224: - Oh and I forgot to mention one point. For each of the proposed e

[jira] [Created] (YARN-4445) Unify the term flowId and flowName in timeline v2 codebase

Li Lu created YARN-4445: --- Summary: Unify the term flowId and flowName in timeline v2 codebase Key: YARN-4445 URL: https://issues.apache.org/jira/browse/YARN-4445 Project: Hadoop YARN Issue Type: Sub-ta

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053868#comment-15053868 ] Li Lu commented on YARN-4224: - I've got some offline discussions with [~leftnoteasy] and [~vino

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053663#comment-15053663 ] Li Lu commented on YARN-4224: - [~varun_saxena] I'm not 100% sure we've reached an agreement her

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053435#comment-15053435 ] Li Lu commented on YARN-3816: - One precaution: seems like some changes in this JIRA is conflict

[jira] [Created] (YARN-4444) TimelineClientImpl#doPosting should not fail on AbstractMethodError

Li Lu created YARN-: --- Summary: TimelineClientImpl#doPosting should not fail on AbstractMethodError Key: YARN- URL: https://issues.apache.org/jira/browse/YARN- Project: Hadoop YARN Issue Ty

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053117#comment-15053117 ] Li Lu commented on YARN-4356: - Sure. If there's no objections, I'll commit this patch later thi

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052038#comment-15052038 ] Li Lu commented on YARN-4224: - And, BTW, under the current resource model of ATS v2, maybe a fu

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052035#comment-15052035 ] Li Lu commented on YARN-4224: - Reformat: OK I've got a few references for the discussion. I lo

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052030#comment-15052030 ] Li Lu commented on YARN-4224: - OK I've got a few references for the discussion. I looked at the

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051966#comment-15051966 ] Li Lu commented on YARN-4356: - I can see in the v.6 patch both concerns are addressed. Any othe

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051956#comment-15051956 ] Li Lu commented on YARN-4224: - I scanned through the patch. The patch itself looks fine, but I

[jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4219: Attachment: YARN-4219-YARN-4265.003.patch Fixed the synchronization issue on service stop. > New levelDB cache stor

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265.YARN-4234.002.patch Update a new patch to fix some log issues and implement the getTimeline API

[jira] [Updated] (YARN-3817) [Aggregation] Flow and User level aggregation on Application States table

[ https://issues.apache.org/jira/browse/YARN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3817: Attachment: YARN-3817-poc-v1-rebase.patch Rebase the POC patch to the feature-YARN-2928 branch. The new patch is base

[jira] [Commented] (YARN-3623) We should have a config to indicate the Timeline Service version

[ https://issues.apache.org/jira/browse/YARN-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051426#comment-15051426 ] Li Lu commented on YARN-3623: - Agree. +1 for the change. > We should have a config to indicat

[jira] [Commented] (YARN-3623) We should have a config to indicate the Timeline Service version

[ https://issues.apache.org/jira/browse/YARN-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051377#comment-15051377 ] Li Lu commented on YARN-3623: - I'd like to make sure I understand this change correctly. Specif

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049536#comment-15049536 ] Li Lu commented on YARN-3816: - Thanks for the update [~djp]! I went through an earlier version

[jira] [Commented] (YARN-3623) We should have a config to indicate the Timeline Service version

[ https://issues.apache.org/jira/browse/YARN-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049449#comment-15049449 ] Li Lu commented on YARN-3623: - The new description LGTM. [~sjlee0] any suggestions? Thanks! >

[jira] [Commented] (YARN-3623) We should have a config to indicate the Timeline Service version

[ https://issues.apache.org/jira/browse/YARN-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049169#comment-15049169 ] Li Lu commented on YARN-3623: - Hi folks, seems like we're reaching agreement on the config itse

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048106#comment-15048106 ] Li Lu commented on YARN-4356: - Latest patch LGTM. +1 pending Jenkins. I'll wait for one more da

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048057#comment-15048057 ] Li Lu commented on YARN-4356: - Thanks [~sjlee0]! bq. The v.1 behavior should be essentially the

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047987#comment-15047987 ] Li Lu commented on YARN-4234: - Patch generally LGTM. The only issue is that if NameNode is unav

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047912#comment-15047912 ] Li Lu commented on YARN-4356: - Hi [~sjlee0], thanks for the work! Mostly LGTM, just a few thing

[jira] [Commented] (YARN-3623) We should have a config to indicate the Timeline Service version

[ https://issues.apache.org/jira/browse/YARN-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047758#comment-15047758 ] Li Lu commented on YARN-3623: - bq. it may be sufficient to note it here and carry on that discu

[jira] [Commented] (YARN-3623) We should have a config to indicate the Timeline Service version

[ https://issues.apache.org/jira/browse/YARN-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047675#comment-15047675 ] Li Lu commented on YARN-3623: - Thanks for the review [~djp]! The ATS v1.5 introduces some new A

[jira] [Commented] (YARN-3368) Improve YARN web UI

[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041879#comment-15041879 ] Li Lu commented on YARN-3368: - +1 for a new branch. We can merge with the progress in this bran

[jira] [Commented] (YARN-3623) We should have a config to indicate the Timeline Service version

[ https://issues.apache.org/jira/browse/YARN-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036654#comment-15036654 ] Li Lu commented on YARN-3623: - Hi [~Naganarasimha] sorry for the late reply (just came back fro

[jira] [Commented] (YARN-3623) We should have a config to indicate the Timeline Service version

[ https://issues.apache.org/jira/browse/YARN-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15015061#comment-15015061 ] Li Lu commented on YARN-3623: - Patch LGTM. The findbugs warnings appears to be irrelevant to th

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15011604#comment-15011604 ] Li Lu commented on YARN-4356: - bq. I haven't looked at YARN-4234 in detail yet. Are you referri

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009932#comment-15009932 ] Li Lu commented on YARN-4356: - Thanks for the long list [~sjlee0] and [~jrottinghuis]! I'm grad

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009877#comment-15009877 ] Li Lu commented on YARN-4234: - Hi [~xgong], the current fix will force to close the current FD

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007493#comment-15007493 ] Li Lu commented on YARN-4234: - One more problem: Looking into the writer, I can see the writer

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007208#comment-15007208 ] Li Lu commented on YARN-4234: - Hi [~xgong], not sure if you've noticed [~sjlee0]'s comments in

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005084#comment-15005084 ] Li Lu commented on YARN-4183: - Sure. We can distribute the work and check them out. I can help

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005047#comment-15005047 ] Li Lu commented on YARN-4183: - bq. Also, if 1.5 is meant to include 1, then we can limit suppor

[jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4219: Attachment: YARN-4219-YARN-4265.002.patch > New levelDB cache storage for timeline v1.5 > ---

[jira] [Commented] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004988#comment-15004988 ] Li Lu commented on YARN-4219: - I noticed one problem for the current ATS v1.5's caching policy

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004962#comment-15004962 ] Li Lu commented on YARN-4183: - bq. With v.2 and especially early on with v.2, it would be rathe

[jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4219: Attachment: YARN-4219-YARN-4265.001.patch I rebased my YARN-4219 patch on top of YARN-4265 since the caching storage

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003290#comment-15003290 ] Li Lu commented on YARN-4234: - Hi [~xgong], thanks for the update! General design LGTM, a few q

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265.YARN-4234.001.patch I refactored my code and added some unit tests. The current patch only depe

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001476#comment-15001476 ] Li Lu commented on YARN-4234: - Hi [~Naganarasimha], I'm not extremely familiar with the delegat

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001380#comment-15001380 ] Li Lu commented on YARN-4234: - I think here are some miscommunications, please feel free to cor

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001325#comment-15001325 ] Li Lu commented on YARN-4234: - Thanks [~Naganarasimha], this is a good suggestion. Maybe we can

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001224#comment-15001224 ] Li Lu commented on YARN-4234: - Well let me clarify one thing: ATS v1.5 supports all ATS v1 feat

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001202#comment-15001202 ] Li Lu commented on YARN-4234: - [~Naganarasimha] Sure, we can certainly add those extra sanity c

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001155#comment-15001155 ] Li Lu commented on YARN-4265: - Thanks [~jlowe]! Yes the current POC version is heavily based on

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001108#comment-15001108 ] Li Lu commented on YARN-4234: - Hi [~Naganarasimha], IIUC the TIMELINE_SERVICE_VERSION config is

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15000857#comment-15000857 ] Li Lu commented on YARN-4183: - Discussed with [~xgong] offline, and seems like YARN-4234 is blo

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999817#comment-14999817 ] Li Lu commented on YARN-4183: - bq. Already Subtask YARN-3623 is raised for this, hope i can wor

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999697#comment-14999697 ] Li Lu commented on YARN-4183: - Thanks [~vinodkv]! I agree we should find some better ways to or

[jira] [Commented] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994141#comment-14994141 ] Li Lu commented on YARN-4219: - Yes, this is a caching storage for ATS v1.5 design. We can prior

[jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4219: Attachment: YARN-4219-trunk.003.patch Attaching 003 patch to fix javac warnings and javadoc errors. > New levelDB c

[jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4219: Attachment: YARN-4219-trunk.002.patch New patch addressing Jenkins -1s. > New levelDB cache storage for timeline v1

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981540#comment-14981540 ] Li Lu commented on YARN-4265: - This patch relies on YARN-3942.002 and YARN-4234.3 patches. >

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981505#comment-14981505 ] Li Lu commented on YARN-4265: - Another key addition in this patch, compare to YARN-3942, is a "

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265-trunk.poc_001.patch This is a proof-of-concept patch for the proposed improvement. This patch i

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981381#comment-14981381 ] Li Lu commented on YARN-4265: - We need to use the finalized APIs in YARN-4234 to build the read

[jira] [Commented] (YARN-4313) Race condition in MiniMRYarnCluster when getting history server address

[ https://issues.apache.org/jira/browse/YARN-4313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980875#comment-14980875 ] Li Lu commented on YARN-4313: - Latest change LGTM. Could any committers please review this chan

[jira] [Commented] (YARN-4313) Race condition in MiniMRYarnCluster when getting history server address

[ https://issues.apache.org/jira/browse/YARN-4313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980727#comment-14980727 ] Li Lu commented on YARN-4313: - Well wait, quick question---why do we need to initialize a custo

[jira] [Commented] (YARN-4313) Race condition in MiniMRYarnCluster when getting history server address

[ https://issues.apache.org/jira/browse/YARN-4313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980720#comment-14980720 ] Li Lu commented on YARN-4313: - Oh I overlooked that. Yes in this case we can use an atomic bool

[jira] [Commented] (YARN-4313) Race condition in MiniMRYarnCluster when getting history server address

[ https://issues.apache.org/jira/browse/YARN-4313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14979640#comment-14979640 ] Li Lu commented on YARN-4313: - Thanks [~jianhe] for the work. I have one quick w.r.t the atomic

[jira] [Commented] (YARN-4237) Support additional queries for ATSv2 Web UI

[ https://issues.apache.org/jira/browse/YARN-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959295#comment-14959295 ] Li Lu commented on YARN-4237: - I've committed this patch to YARN-2928 branch. Thanks [~varun_sa

[jira] [Commented] (YARN-4237) Support additional queries for ATSv2 Web UI

[ https://issues.apache.org/jira/browse/YARN-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959286#comment-14959286 ] Li Lu commented on YARN-4237: - Since there's no objection, I'll commit this patch shortly. >

[jira] [Commented] (YARN-4237) Support additional queries for ATSv2 Web UI

[ https://issues.apache.org/jira/browse/YARN-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958117#comment-14958117 ] Li Lu commented on YARN-4237: - Sorry for the delay folks. Patch LGTM. I tried it locally and it

[jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4219: Attachment: YARN-4219-trunk.001.patch Let me quickly flip the patch to address some findbugs warnings. > New levelD

[jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4219: Attachment: (was: YARN-4219-trunk.001.patch) > New levelDB cache storage for timeline v1.5 >

[jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4219: Attachment: YARN-4219-trunk.001.patch Upload a patch to add the leveldb cache storage. To organize this storage, I r

[jira] [Created] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

Li Lu created YARN-4265: --- Summary: Provide new timeline plugin storage to support fine-grained entity caching Key: YARN-4265 URL: https://issues.apache.org/jira/browse/YARN-4265 Project: Hadoop YARN I

[jira] [Updated] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4200: Attachment: YARN-4200-YARN-2928.001.patch Since YARN-4075 is in and we're relatively stable on the reader implementat

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944067#comment-14944067 ] Li Lu commented on YARN-4061: - Thanks for the review [~sjlee0]! bq. Since the actual storage

[jira] [Commented] (YARN-4220) [Storage implementation] Support getEntities with only Application id but no flow and flow run ID

[ https://issues.apache.org/jira/browse/YARN-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943785#comment-14943785 ] Li Lu commented on YARN-4220: - Sure. We can fix it here. Right now I'm passing flow and flowrun

[jira] [Commented] (YARN-4220) [Storage implementation] Support getEntities with only Application id but no flow and flow run ID

[ https://issues.apache.org/jira/browse/YARN-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943741#comment-14943741 ] Li Lu commented on YARN-4220: - Oh Thanks [~varun_saxena]. Having looked at the code I can see w

[jira] [Commented] (YARN-4220) [Storage implementation] Support getEntities with only Application id but no flow and flow run ID

[ https://issues.apache.org/jira/browse/YARN-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943721#comment-14943721 ] Li Lu commented on YARN-4220: - Well this may be the thing I'm missing now: I made a call {{htt

[jira] [Commented] (YARN-3864) Implement support for querying single app and all apps for a flow run

[ https://issues.apache.org/jira/browse/YARN-3864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941727#comment-14941727 ] Li Lu commented on YARN-3864: - OK, I can update my local version accordingly. > Implement sup

[jira] [Commented] (YARN-4220) [Storage implementation] Support getEntities with only Application id but no flow and flow run ID

[ https://issues.apache.org/jira/browse/YARN-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940556#comment-14940556 ] Li Lu commented on YARN-4220: - Well, seems like flow and flowrun ids can be easily cached on th

[jira] [Updated] (YARN-4220) [Storage implementation] Support getEntities with only Application id but no flow and flow run ID

[ https://issues.apache.org/jira/browse/YARN-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4220: Priority: Minor (was: Major) > [Storage implementation] Support getEntities with only Application id but no > flow

[jira] [Created] (YARN-4220) [Storage implementation] Support getEntities with only Application id but no flow and flow run ID

Li Lu created YARN-4220: --- Summary: [Storage implementation] Support getEntities with only Application id but no flow and flow run ID Key: YARN-4220 URL: https://issues.apache.org/jira/browse/YARN-4220 Project:

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940406#comment-14940406 ] Li Lu commented on YARN-3942: - YARN-4219 opened to track the new leveldb cache storage separate

[jira] [Created] (YARN-4219) New levelDB cache storage for timeline v1.5

Li Lu created YARN-4219: --- Summary: New levelDB cache storage for timeline v1.5 Key: YARN-4219 URL: https://issues.apache.org/jira/browse/YARN-4219 Project: Hadoop YARN Issue Type: Bug Repor

[jira] [Commented] (YARN-3864) Implement support for querying single app and all apps for a flow run

[ https://issues.apache.org/jira/browse/YARN-3864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940344#comment-14940344 ] Li Lu commented on YARN-3864: - bq. I guess we can get flow runs from /flows endpoint and then f

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940314#comment-14940314 ] Li Lu commented on YARN-3942: - Thanks for the info [~jlowe]! Sure I can open a new JIRA for the

<    2   3   4   5   6   7   8   9   10   11   >