[
https://issues.apache.org/jira/browse/HIVE-28789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
László Bodor updated HIVE-28789:
--------------------------------
Description: The proposal here is to implement a way in HS2 to get metrics
from Tez sessions. The actual implementation should be abstracted on the
TezSession/TezSessionState level. In Tez, there is a notion of unmanaged
sessions (TEZ-3991), which implies that Tez sessions (AMs) would expose metrics
about themselves, however, moving the metrics from the dagClient would be
beneficial for this purpose, as theoretically, metrics can exist outside of a
running DAG's scope too. An initial implementation in Hive might want to
contain the getMetrics abstraction and a default implementation for getting
those from the most recent DagStatus (got from a dagClient), and later, a
metric endpoint can be created for Tez AMs.
> Session-level metrics from Tez sessions
> ---------------------------------------
>
> Key: HIVE-28789
> URL: https://issues.apache.org/jira/browse/HIVE-28789
> Project: Hive
> Issue Type: Improvement
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
>
> The proposal here is to implement a way in HS2 to get metrics from Tez
> sessions. The actual implementation should be abstracted on the
> TezSession/TezSessionState level. In Tez, there is a notion of unmanaged
> sessions (TEZ-3991), which implies that Tez sessions (AMs) would expose
> metrics about themselves, however, moving the metrics from the dagClient
> would be beneficial for this purpose, as theoretically, metrics can exist
> outside of a running DAG's scope too. An initial implementation in Hive might
> want to contain the getMetrics abstraction and a default implementation for
> getting those from the most recent DagStatus (got from a dagClient), and
> later, a metric endpoint can be created for Tez AMs.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
