[
https://issues.apache.org/jira/browse/YUNIKORN-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17631178#comment-17631178
]
Yongjun Zhang edited comment on YUNIKORN-1385 at 11/9/22 5:32 PM:
------------------------------------------------------------------
Thanks a lot for your quick response [~zhuqi] [~wilfreds] !
[~zhuqi], yes, your interpretation is right. except for that we want track
vcore seconds too.
[~wilfreds],
{quote}
YuniKorn will not even know if the pod really uses all memory. YuniKorn
contrary to YARN will never run on each node in the cluster. The info you thus
can get is of limited value and only gives an indication.
{quote}
That seems a challenge. Wonder if k8s itself tracks this situation? If not,
does it mean k8s was not designed with tracking real resource usage in mind?
{quote}
A push service might be possible as long as it is out of band of the scheduling
cycle.
{quote}
That's what the "Post processing" section in my writing indicates.
Thanks.
was (Author: yzhangal):
Thanks a lot for your quick response [~zhuqi] [~wilfreds] !
[~zhuqi], yes, your interpretation is right. except for that we want track
vcore seconds too.
[~Shotdet],
{quote}
YuniKorn will not even know if the pod really uses all memory. YuniKorn
contrary to YARN will never run on each node in the cluster. The info you thus
can get is of limited value and only gives an indication.
{quote}
That seems a challenge. Wonder if k8s itself tracks this situation? If not,
does it mean k8s was not designed with tracking real resource usage in mind?
{quote}
A push service might be possible as long as it is out of band of the scheduling
cycle.
{quote}
That's what the "Post processing" section in my writing indicates.
Thanks.
> To provide visibility to application's aggregated resource consumption
> ----------------------------------------------------------------------
>
> Key: YUNIKORN-1385
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1385
> Project: Apache YuniKorn
> Issue Type: New Feature
> Components: core - common, core - scheduler, shim - kubernetes
> Reporter: Yongjun Zhang
> Assignee: Yongjun Zhang
> Priority: Major
> Attachments: image-2022-11-09-11-06-20-479.png,
> yunikornResourceUsageVisibility.pdf
>
>
> Currently the "Used Resource" for a given application reported at Yunikorn
> GUI is actually the snapshot of the resources currently allocated to the
> application. We need to provide visibility to how much resources an
> application has used so far, and it would be important to report how much
> total resources is used by the application.
> The unit of resources used can be memoryseconds/vcoreseconds like how Hadoop
> Yarn does in its app summary report. However, there is more complexity with
> K8s which supports different instance types (Hadoop Yarn does support
> multiple instance types but its app summary report ignored instance types).
> It would be nice to report how much resource is used for each instance types
> used by an application.
> This is a top level Jira for this new feature. Subtask jira will be created
> when we work on it.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
