[
https://issues.apache.org/jira/browse/HDDS-1089?focusedWorklogId=200615&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-200615
]
ASF GitHub Bot logged work on HDDS-1089:
----------------------------------------
Author: ASF GitHub Bot
Created on: 19/Feb/19 14:20
Start Date: 19/Feb/19 14:20
Worklog Time Spent: 10m
Work Description: elek commented on pull request #501: HDDS-1089. Disable
OzoneFSStorageStatistics for hadoop versions older than 2.8
URL: https://github.com/apache/hadoop/pull/501
HDDS-1033 introduced OzoneFSStorageStatistics for OzoneFileSystem. It uses
the StorageStatistics which is introduced in HADOOP-13065 (available from the
hadoop2.8/3.0).
Using older hadoop (for example hadoop-2.7 which is included in the spark
distributions) is not possible any more even with using the isolated class
loader (introduced in HDDS-922).
Fortunately it can be fixed:
# We can support null in storageStatistics field with checking everywhere
before call it.
# We can create a new constructor of OzoneClientAdapterImpl without using
OzoneFSStorageStatistics): If OzoneFSStorageStatistics is not in the
method/constructor signature we don't need to load it.
# We can check the availability of HADOOP-13065 and if the classes are not
in the classpath we can skip the initialization of the OzoneFSStorageStatistics
See: https://issues.apache.org/jira/browse/HDDS-1089
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 200615)
Time Spent: 10m
Remaining Estimate: 0h
> Disable OzoneFSStorageStatistics for hadoop versions older than 2.8
> -------------------------------------------------------------------
>
> Key: HDDS-1089
> URL: https://issues.apache.org/jira/browse/HDDS-1089
> Project: Hadoop Distributed Data Store
> Issue Type: Improvement
> Components: Ozone Filesystem
> Reporter: Elek, Marton
> Assignee: Elek, Marton
> Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> HDDS-1033 introduced OzoneFSStorageStatistics for OzoneFileSystem. It uses
> the StorageStatistics which is introduced in HADOOP-13065 (available from the
> hadoop2.8/3.0).
> Using older hadoop (for example hadoop-2.7 which is included in the spark
> distributions) is not possible any more even with using the isolated class
> loader (introduced in HDDS-922).
> Fortunately it can be fixed:
> # We can support null in storageStatistics field with checking everywhere
> before call it.
> # We can create a new constructor of OzoneClientAdapterImpl without using
> OzoneFSStorageStatistics): If OzoneFSStorageStatistics is not in the
> method/constructor signature we don't need to load it.
> # We can check the availability of HADOOP-13065 and if the classes are not
> in the classpath we can skip the initialization of the
> OzoneFSStorageStatistics
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
