zuston commented on issue #333: URL: https://github.com/apache/incubator-uniffle/issues/333#issuecomment-1328435807
> Given this is a starter issue, do you mind sharing some key code pointers to help understand the workflow of the shuffle server that collects then observes the app bytes? > > I assume it cannot be limited to only TOP 10 since the metrics will change and there always a need to sort? Sorry, I must correct the above conversation that `The aggregated data of single app used bytes has been collected in current codebase` is wrong. We have to collect all the app's write bytes in `ShuffleTaskManager.shuffleTaskInfos`. When method of `updateCachedBlockIds` is triggered, the size of written bytes should be updated in App's `ShuffleTaskInfo`. After that, we could expose these top10 metrics by sorting these shuffleTaskInfos through extra api uri, like xxxx:19999/metrics/app. Do you think so? Maybe my idea is not right, feel free to discuss more ~ @amaliujia If you are interested in this issue, I will assign this to you. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@uniffle.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
