[
https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15454227#comment-15454227
]
Rohith Sharma K S commented on YARN-5585:
-----------------------------------------
bq. Can we translate the fromId request into some HBase filters so that we can
process this request on the storage layer?
Ultimately this will be better way to do rather than at TimelineReader API
level. But I am not sure that does HBase filters can support to scan the rows
which are less than or greater than id's. I will have look at this with high
priority. This make more sense to me.
bq. but note that this requires some in-memory operation to actually sort all
entities, but not only read part of them out from the storage?
This is current behavior. Already entities are sorted using
TimelineClient#compareTo in {{TimelineEntityReader#readEntities}}. Another
loop on sorted entities required to achieve this.
bq. he problem with this kind of an approach is that new apps keep on getting
added so result may not be latest.
It is fine to me. I agree with Lilu.
> [Atsv2] Add a new filter fromId in REST endpoints
> -------------------------------------------------
>
> Key: YARN-5585
> URL: https://issues.apache.org/jira/browse/YARN-5585
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelinereader
> Reporter: Rohith Sharma K S
> Assignee: Rohith Sharma K S
>
> TimelineReader REST API's provides lot of filters to retrieve the
> applications. Along with those, it would be good to add new filter i.e fromId
> so that entities can be retrieved after the fromId.
> Example : If applications are stored database, app-1 app-2 ... app-10.
> *getApps?limit=5* gives app-1 to app-10. But to retrieve next 5 apps, it is
> difficult.
> So proposal is to have fromId in the filter like
> *getApps?limit=5&&fromId=app-5* which gives list of apps from app-6 to
> app-10.
> This is very useful for pagination in web UI.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
