[
https://issues.apache.org/jira/browse/HADOOP-19311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manish Bhatt updated HADOOP-19311:
----------------------------------
Description:
Current Flow: We have implemented metrics collection in ABFS flow. We have
created a custom AbfsBackoffMetrics and AbfsReadFooterMetrics class which
stores all the metrics on the file system level. Our objective is to move away
from the custom class implementation and use IOStatisticsStore to store the
metrics which is present in hadoop-common.
Changes Made: This PR contains the changes related to storing metrics related
to above mentioned classes in IOStatisticStore which is present in
hadoop-common. AbstractAbfsStatisticsSource abstract class is created which is
implementing IOStatisticsSource interface. This will store IOStatistics of the
child metrics class.
Both AbfsBackoffMetrics and AbfsReadFooterMetrics is inheriting
AbstractAbfsStatisticsSource and store the respective metrics in
IOStatisticsStore.
> ABFS: Implement Backoff and Read Footer metrics using IOStatistics
> ------------------------------------------------------------------
>
> Key: HADOOP-19311
> URL: https://issues.apache.org/jira/browse/HADOOP-19311
> Project: Hadoop Common
> Issue Type: Task
> Components: fs/azure
> Affects Versions: 3.5.0, 3.4.1
> Reporter: Manish Bhatt
> Assignee: Manish Bhatt
> Priority: Major
>
> Current Flow: We have implemented metrics collection in ABFS flow. We have
> created a custom AbfsBackoffMetrics and AbfsReadFooterMetrics class which
> stores all the metrics on the file system level. Our objective is to move
> away from the custom class implementation and use IOStatisticsStore to store
> the metrics which is present in hadoop-common.
> Changes Made: This PR contains the changes related to storing metrics related
> to above mentioned classes in IOStatisticStore which is present in
> hadoop-common. AbstractAbfsStatisticsSource abstract class is created which
> is implementing IOStatisticsSource interface. This will store IOStatistics of
> the child metrics class.
> Both AbfsBackoffMetrics and AbfsReadFooterMetrics is inheriting
> AbstractAbfsStatisticsSource and store the respective metrics in
> IOStatisticsStore.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
