[jira] [Commented] (YARN-4705) ATS 1.5 parse pipeline to consider handling open() events recoverably

[ https://issues.apache.org/jira/browse/YARN-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158146#comment-15158146 ] Li Lu commented on YARN-4705: - Seems we need to somewhat handle this? This will happen when a scan happens

[jira] [Commented] (YARN-4716) TimelineClient to implement Flushable; propagate to writer

[ https://issues.apache.org/jira/browse/YARN-4716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157837#comment-15157837 ] Li Lu commented on YARN-4716: - bq. for the FS it propagates the flush down to the stream writing events to the

[jira] [Commented] (YARN-4716) TimelineClient to implement Flushable; propagate to writer

[ https://issues.apache.org/jira/browse/YARN-4716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157760#comment-15157760 ] Li Lu commented on YARN-4716: - +1, this is necessary to publish important lifecycle events for YARN

[jira] [Commented] (YARN-4700) ATS storage has one extra record each time the RM got restarted

[ https://issues.apache.org/jira/browse/YARN-4700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156208#comment-15156208 ] Li Lu commented on YARN-4700: - [~Naganarasimha] sure, please go ahead and take it. Thanks! > ATS storage has

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155207#comment-15155207 ] Li Lu commented on YARN-4545: - bq. Regarding where the checks go, the key thing is "not in YarnConfiguration".

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153542#comment-15153542 ] Li Lu commented on YARN-4545: - Thanks [~ste...@apache.org]! bq. the new

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152923#comment-15152923 ] Li Lu commented on YARN-4696: - Thanks [~ste...@apache.org]! The latest patch LGTM. Could some committers have

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151422#comment-15151422 ] Li Lu commented on YARN-4696: - Thanks [~ste...@apache.org]! This new override based solution works better

[jira] [Created] (YARN-4700) ATS storage has one extra record each time the RM got restarted

Li Lu created YARN-4700: --- Summary: ATS storage has one extra record each time the RM got restarted Key: YARN-4700 URL: https://issues.apache.org/jira/browse/YARN-4700 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149562#comment-15149562 ] Li Lu commented on YARN-4696: - Thanks for the work [~ste...@apache.org]! My main question is that what is the

[jira] [Commented] (YARN-4695) EntityGroupFSTimelineStore to not log errors during shutdown

[ https://issues.apache.org/jira/browse/YARN-4695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149041#comment-15149041 ] Li Lu commented on YARN-4695: - Sure. I'll take a look. Thanks for the work! > EntityGroupFSTimelineStore to

[jira] [Assigned] (YARN-4695) EntityGroupFSTimelineStore to not log errors during shutdown

[ https://issues.apache.org/jira/browse/YARN-4695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-4695: --- Assignee: Li Lu > EntityGroupFSTimelineStore to not log errors during shutdown >

[jira] [Created] (YARN-4688) Allow YARN system metrics publisher to use ATS v1.5 APIs

Li Lu created YARN-4688: --- Summary: Allow YARN system metrics publisher to use ATS v1.5 APIs Key: YARN-4688 URL: https://issues.apache.org/jira/browse/YARN-4688 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4545: Attachment: YARN-4545-trunk.005.patch Thanks [~djp]! Got your point. Upload a new patch to change the signature

[jira] [Commented] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123041#comment-15123041 ] Li Lu commented on YARN-4219: - Thanks [~rohithsharma]! Let me know if there's any problem. > New levelDB

[jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4219: Attachment: YARN-4219-trunk.addendum1.patch Upload an addendum patch to fix the javadoc issue with Java 8. > New

[jira] [Commented] (YARN-4656) Javadoc compilation fails in trunk

[ https://issues.apache.org/jira/browse/YARN-4656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123036#comment-15123036 ] Li Lu commented on YARN-4656: - Addendum patch has already been posted in YARN-4219. > Javadoc compilation

[jira] [Commented] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123026#comment-15123026 ] Li Lu commented on YARN-4219: - OK, let me quickly post a fix. > New levelDB cache storage for timeline v1.5 >

[jira] [Commented] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123059#comment-15123059 ] Li Lu commented on YARN-4219: - Thanks [~rohithsharma]! > New levelDB cache storage for timeline v1.5 >

[jira] [Updated] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4545: Attachment: YARN-4545-trunk.004.patch Thanks [~djp] for the review! I've addressed all problems in the latest patch.

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122570#comment-15122570 ] Li Lu commented on YARN-4545: - I cannot reproduce the UT failures on my local machine. Meanwhile, I'm not sure

[jira] [Commented] (YARN-4224) Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120232#comment-15120232 ] Li Lu commented on YARN-4224: - +1. I'll commit shortly. > Support fetching entities by UID and change the

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118338#comment-15118338 ] Li Lu commented on YARN-4545: - Folks I suspect there're some regression with the latest change. I'll debug it

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118526#comment-15118526 ] Li Lu commented on YARN-4545: - BTW folks please feel free to review the 003 patch. Thanks! > Allow YARN

[jira] [Updated] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4545: Attachment: YARN-4545-trunk.003.patch Addressed the UT failures. > Allow YARN distributed shell to use ATS v1.5

[jira] [Commented] (YARN-4224) Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115807#comment-15115807 ] Li Lu commented on YARN-4224: - Thanks Varun! bq. How does TimelineReaderWebServicesUtils sound ? LGTM. I

[jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4219: Attachment: YARN-4219-trunk.006.patch Thanks Junping for the review! The method you pointed out is to compact a

[jira] [Updated] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4545: Attachment: (was: YARN-4545-trunk.002.patch) > Allow YARN distributed shell to use ATS v1.5 APIs >

[jira] [Commented] (YARN-4224) Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111491#comment-15111491 ] Li Lu commented on YARN-4224: - Thanks [~varun_saxena]. The latest patch generally LGTM. Some minor comments:

[jira] [Updated] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4545: Attachment: YARN-4545-trunk.002.patch Let me quickly flip the 002 patch to include the missing ASF license. >

[jira] [Updated] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4545: Attachment: YARN-4545-trunk.001.patch Update the patch and rebase it to the latest trunk. > Allow YARN distributed

[jira] [Updated] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4545: Attachment: YARN-4545-trunk.002.patch Address findbugs warnings. > Allow YARN distributed shell to use ATS v1.5

[jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4219: Attachment: YARN-4219-trunk.004.patch Rebase the patch to latest trunk. > New levelDB cache storage for timeline

[jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5

[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4219: Attachment: YARN-4219-trunk.005.patch Thanks [~xgong] for the comment! Upload a new patch to address the findbugs

[jira] [Created] (YARN-4604) TimelineDataManager should return gracefully when one entity's id or type is empty

Li Lu created YARN-4604: --- Summary: TimelineDataManager should return gracefully when one entity's id or type is empty Key: YARN-4604 URL: https://issues.apache.org/jira/browse/YARN-4604 Project: Hadoop YARN

[jira] [Commented] (YARN-4596) SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities

[ https://issues.apache.org/jira/browse/YARN-4596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106240#comment-15106240 ] Li Lu commented on YARN-4596: - I've created YARN-4604 and MAPREDUCE-6610 to trace the two problems raised in

[jira] [Resolved] (YARN-4604) TimelineDataManager should return gracefully when one entity's id or type is empty

[ https://issues.apache.org/jira/browse/YARN-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu resolved YARN-4604. - Resolution: Won't Fix > TimelineDataManager should return gracefully when one entity's id or type is > empty >

[jira] [Commented] (YARN-4604) TimelineDataManager should return gracefully when one entity's id or type is empty

[ https://issues.apache.org/jira/browse/YARN-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106342#comment-15106342 ] Li Lu commented on YARN-4604: - Yes you're right. I missed the preprocess part. Close this as won't fix. >

[jira] [Commented] (YARN-4596) SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities

[ https://issues.apache.org/jira/browse/YARN-4596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105838#comment-15105838 ] Li Lu commented on YARN-4596: - Ah I've got your point. Yes we can definitely improve the logic here. Please

[jira] [Updated] (YARN-4596) SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities

[ https://issues.apache.org/jira/browse/YARN-4596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4596: Attachment: YARN-4596-trunk.001.patch A quick patch to log error messages in a TimelineResponse for SMP. >

[jira] [Commented] (YARN-4596) SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities

[ https://issues.apache.org/jira/browse/YARN-4596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102299#comment-15102299 ] Li Lu commented on YARN-4596: - Hi [~Naganarasimha] actually I was referring to the logic we have in the SMP

[jira] [Updated] (YARN-4596) SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities

[ https://issues.apache.org/jira/browse/YARN-4596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4596: Attachment: YARN-4596-trunk.002.patch Just found distributed shell has the same problem. Update the patch to address

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102704#comment-15102704 ] Li Lu commented on YARN-4577: - Thanks [~xgong] for the work! The overall logic of reusing

[jira] [Commented] (YARN-4596) SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities

[ https://issues.apache.org/jira/browse/YARN-4596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102924#comment-15102924 ] Li Lu commented on YARN-4596: - [~Naganarasimha] Yes we can handle this in a separate JIRA (please feel free to

[jira] [Commented] (YARN-4596) SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities

[ https://issues.apache.org/jira/browse/YARN-4596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102927#comment-15102927 ] Li Lu commented on YARN-4596: - BTW, the second point also appears to be orthogonal to the current problem. We

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102712#comment-15102712 ] Li Lu commented on YARN-4577: - BTW I tried this patch locally but it does not apply on the latest trunk. I hit

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265-trunk.008.patch New patch to address the checkstyle hidden field warning. I also tested

[jira] [Created] (YARN-4596) SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities

Li Lu created YARN-4596: --- Summary: SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities Key: YARN-4596 URL: https://issues.apache.org/jira/browse/YARN-4596 Project: Hadoop

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098966#comment-15098966 ] Li Lu commented on YARN-4265: - The maven dependency check uses a separate maven repository

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265-trunk.006.patch Thanks [~djp] for the review! I addressed all of you concerns in the latest

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097488#comment-15097488 ] Li Lu commented on YARN-4265: - Also, the failing unit tests are not related to the changes in this JIRA. >

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265-trunk.007.patch New patch adds the missing package-info.java that the check-style script is

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265-trunk.005.patch Thanks [~djp] and [~liuml07] for the help! Since we need to handle files with

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265-trunk.004.patch Thanks [~djp] for the review! I updated my patch according to your comments.

[jira] [Commented] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088396#comment-15088396 ] Li Lu commented on YARN-4200: - If there are no further comments I'll commit this patch tomorrow morning.

[jira] [Commented] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088358#comment-15088358 ] Li Lu commented on YARN-4200: - Any other concerns on this patch? All check style issues appear to be

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085873#comment-15085873 ] Li Lu commented on YARN-4265: - Sure. Linking this the YARN-4545 which works on the distributed shell

[jira] [Commented] (YARN-4238) createdTime and modifiedTime is not reported while publishing entities to ATSv2

[ https://issues.apache.org/jira/browse/YARN-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086484#comment-15086484 ] Li Lu commented on YARN-4238: - That's an important concern. I know [~hitesh] knows a lot of details there, but

[jira] [Commented] (YARN-4238) createdTime and modifiedTime is not reported while publishing entities to ATSv2

[ https://issues.apache.org/jira/browse/YARN-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086498#comment-15086498 ] Li Lu commented on YARN-4238: - Seems like to only thing related is the Tez UI. [~Sreenath] any comments from

[jira] [Updated] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4545: Attachment: YARN-4545-YARN-4265.001.patch Adding timeline v1.5 support to Distributed shell. Right now all container

[jira] [Commented] (YARN-4224) Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083473#comment-15083473 ] Li Lu commented on YARN-4224: - Thanks Varun. bq. /flows endpoint is for querying active flows with default

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083480#comment-15083480 ] Li Lu commented on YARN-4265: - bq. Can we provide a default one (could be simple) for built-in YARN

[jira] [Created] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

Li Lu created YARN-4545: --- Summary: Allow YARN distributed shell to use ATS v1.5 APIs Key: YARN-4545 URL: https://issues.apache.org/jira/browse/YARN-4545 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083959#comment-15083959 ] Li Lu commented on YARN-4356: - Ah OK. But we do need to update the actual code when we introduce a new version

[jira] [Commented] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083933#comment-15083933 ] Li Lu commented on YARN-4200: - Sure. Will do that soon. Thanks! > Refactor reader classes in storage to nest

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083938#comment-15083938 ] Li Lu commented on YARN-4356: - One quick query w.r.t changes in this JIRA: I just noticed that in

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265-trunk.003.patch Refresh the patch once more to: # Add documentations about cache item and its

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084419#comment-15084419 ] Li Lu commented on YARN-4356: - Oh I missed this part... Thanks for the reminder! > ensure the timeline

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084002#comment-15084002 ] Li Lu commented on YARN-4356: - I'm fine to live with it for now. However, if anyone happen to have time I can

[jira] [Updated] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4200: Attachment: YARN-4200-feature-YARN-2928.003.patch Add package-info.java. > Refactor reader classes in storage to

[jira] [Updated] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4200: Attachment: YARN-4200-feature-YARN-2928.002.patch Quickly refresh the patch to the latest feature branch. Please

[jira] [Commented] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084097#comment-15084097 ] Li Lu commented on YARN-4200: - Oh I believe right now we're not marking all ATS v2 related APIs to be public,

[jira] [Commented] (YARN-3352) [Event producers] Change distributed shell to use TIMELINE_SERVICE_VERSION

[ https://issues.apache.org/jira/browse/YARN-3352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084523#comment-15084523 ] Li Lu commented on YARN-3352: - Just remembered this issue when I'm working on YARN-4545. Right now after the

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265-trunk.002.patch Thanks [~djp] for the review! In the 002 patch I addressed most of the

[jira] [Commented] (YARN-4224) Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082152#comment-15082152 ] Li Lu commented on YARN-4224: - Thanks [~varun_saxena]. I briefly looked at the endpoints, generally looked

[jira] [Commented] (YARN-4224) Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082301#comment-15082301 ] Li Lu commented on YARN-4224: - Ah one more question: in the original design, /flows will return a list of

[jira] [Commented] (YARN-4516) [YARN-3368] Use em-table to better render tables

[ https://issues.apache.org/jira/browse/YARN-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075509#comment-15075509 ] Li Lu commented on YARN-4516: - [~Sreenath] Never mind, I figured out how to feed models to an em-table by

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074561#comment-15074561 ] Li Lu commented on YARN-4265: - Sorry by saying YARN-4234 I'm actually meaning YARN-3942. > Provide new

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074560#comment-15074560 ] Li Lu commented on YARN-4265: - BTW, I've got some offline discussion with [~jlowe]. In general, we agreed to

[jira] [Commented] (YARN-4516) [YARN-3368] Use em-table to better render tables

[ https://issues.apache.org/jira/browse/YARN-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074530#comment-15074530 ] Li Lu commented on YARN-4516: - OK I've updated my local em-table. [~Sreenath] one more (probably silly)

[jira] [Commented] (YARN-4516) [YARN-3368] Use em-table to better render tables

[ https://issues.apache.org/jira/browse/YARN-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074360#comment-15074360 ] Li Lu commented on YARN-4516: - Thanks [~Sreenath]! Shall I redo npm install to get this feature? >

[jira] [Commented] (YARN-4516) [YARN-3368] Use em-table to better render tables

[ https://issues.apache.org/jira/browse/YARN-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073305#comment-15073305 ] Li Lu commented on YARN-4516: - Thanks [~leftnoteasy] and [~Sreenath]! Now I've set up em-table for ats v2 web

[jira] [Commented] (YARN-4516) [YARN-3368] Use em-table to better render tables

[ https://issues.apache.org/jira/browse/YARN-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072334#comment-15072334 ] Li Lu commented on YARN-4516: - Hi [~leftnoteasy], [~Sreenath], if currently there is nobody working on this

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072061#comment-15072061 ] Li Lu commented on YARN-4224: - I think it's still depending on if we would like to model entity type as one

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072068#comment-15072068 ] Li Lu commented on YARN-4224: - Yes let's move forward with this for now. We can still make some quick cosmetic

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070229#comment-15070229 ] Li Lu commented on YARN-4224: - Actually I think the /ws/v2/timeline/apps/{app UID}/entities?entityType=...

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070243#comment-15070243 ] Li Lu commented on YARN-4224: - Yes, I think this is fine for entities. The root cause of this is that entities

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265-trunk.001.patch Thanks [~djp]! I just rebased my patch to the latest trunk. > Provide new

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: (was: YARN-4265-trunk.poc_001.patch) > Provide new timeline plugin storage to support fine-grained

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070246#comment-15070246 ] Li Lu commented on YARN-4224: - After all these discussion, I think it will be helpful to come up with a write

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070306#comment-15070306 ] Li Lu commented on YARN-4224: - Thanks [~leftnoteasy]! I agree that we should separate the semantics and

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070295#comment-15070295 ] Li Lu commented on YARN-4224: - Well, return first 100 entities is just one example (we can even say return one

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15068950#comment-15068950 ] Li Lu commented on YARN-4224: - Thanks Varun. Some of my comments: bq. You mean just have one endpoint and based

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066917#comment-15066917 ] Li Lu commented on YARN-4224: - bq. We will pass optional parameters as part of query param. Correct ? I think

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067263#comment-15067263 ] Li Lu commented on YARN-4224: - Thanks for the work [~varun_saxena]! A few quick concerns: 1. I understand we

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067327#comment-15067327 ] Li Lu commented on YARN-4234: - Thanks for the work [~xgong] and [~djp]! Once this patch is committed, would

[jira] [Commented] (YARN-4445) Unify the term flowId and flowName in timeline v2 codebase

[ https://issues.apache.org/jira/browse/YARN-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061212#comment-15061212 ] Li Lu commented on YARN-4445: - All failing system tests passed on my local machine. +1. Since it has been

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061186#comment-15061186 ] Li Lu commented on YARN-4224: - Discussed about the PUT use case with Wangda. Right now we're not planning any

[jira] [Updated] (YARN-4460) [Bug fix] RM fails to start when SMP is enabled

[ https://issues.apache.org/jira/browse/YARN-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4460: Attachment: YARN-4460-feature-YARN-2928.001.patch Upload a patch to quickly fix this issue. I moved event handler

[jira] [Created] (YARN-4460) [Bug fix] RM fails to start when SMP is enabled

Li Lu created YARN-4460: --- Summary: [Bug fix] RM fails to start when SMP is enabled Key: YARN-4460 URL: https://issues.apache.org/jira/browse/YARN-4460 Project: Hadoop YARN Issue Type: Sub-task

<    1   2   3   4   5   6   7   8   9   10   >