[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15592927#comment-15592927 ]
Li Lu commented on YARN-5739: ----------------------------- We may not want to introduce another table for storing entity types for each application since this bothers the write path a lot. Considering this is a relatively rare use case in a cluster, we would rather put most of the burden on the reader side. I got some offline discussion with Enis from HBase community, and it seems like we can provide a custom filter on the storage layer to "jump" on a scan. In this way, we can quickly jump over all entities within one application, just grabbing out different entity types. In this JIRA we also need to add endpoints serving this data. > Provide timeline reader API to list available timeline entity types for one > application > --------------------------------------------------------------------------------------- > > Key: YARN-5739 > URL: https://issues.apache.org/jira/browse/YARN-5739 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelinereader > Reporter: Li Lu > Assignee: Li Lu > > Right now we only show a part of available timeline entity data in the new > YARN UI. However, some data (especially library specific data) are not > possible to be queried out by the web UI. It will be appealing for the UI to > provide an "entity browser" for each YARN application. Actually, simply > dumping out available timeline entities (with proper pagination, of course) > would be pretty helpful for UI users. > On timeline side, we're not far away from this goal. Right now I believe the > only thing missing is to list all available entity types within one > application. The challenge here is that we're not storing this data for each > application, but given this kind of call is relatively rare (compare to > writes and updates) we can perform some scanning during the read time. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org