[
https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15453070#comment-15453070
]
Li Lu commented on YARN-5585:
-----------------------------
Can we translate the fromId request into some HBase filters so that we can
process this request on the storage layer? I agree with [~varun_saxena] that
supporting fromId for containers may be different. Containers are not top-level
concept for timeline service, so unless there is a strong enough reason, I'd
incline to not to introduce a separate for containers.
bq. But once rows are retrieved from HBase, it is sorted as
TimelineEntity#compareTo provided.
We can certainly do this, but note that this requires some in-memory operation
to actually sort all entities, but not only read part of them out from the
storage?
bq. However, the problem with this kind of an approach is that new apps keep on
getting added so result may not be latest.
I'm fine if the results are not the "latest". Once the system behaves in a
linearizable fashion (results are consistent according to time) we're fine.
> [Atsv2] Add a new filter fromId in REST endpoints
> -------------------------------------------------
>
> Key: YARN-5585
> URL: https://issues.apache.org/jira/browse/YARN-5585
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelinereader
> Reporter: Rohith Sharma K S
> Assignee: Rohith Sharma K S
>
> TimelineReader REST API's provides lot of filters to retrieve the
> applications. Along with those, it would be good to add new filter i.e fromId
> so that entities can be retrieved after the fromId.
> Example : If applications are stored database, app-1 app-2 ... app-10.
> *getApps?limit=5* gives app-1 to app-10. But to retrieve next 5 apps, it is
> difficult.
> So proposal is to have fromId in the filter like
> *getApps?limit=5&&fromId=app-5* which gives list of apps from app-6 to
> app-10.
> This is very useful for pagination in web UI.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
