[jira] [Updated] (HDFS-10930) Refactor Datanode IO operations into a single class

2016-10-04 Thread Xiaoyu Yao (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xiaoyu Yao updated HDFS-10930:
--
Attachment: HDFS-10930.01.patch

Attach a initial patch that refactors IO related operations into 
DatanodeIO.java class. I will open follow up JIRAs on instrumentation, per 
volume IO related metrics collection, etc based on that.

> Refactor Datanode IO operations into a single class
> ---
>
> Key: HDFS-10930
> URL: https://issues.apache.org/jira/browse/HDFS-10930
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: datanode
>Reporter: Xiaoyu Yao
>Assignee: Xiaoyu Yao
> Attachments: HDFS-10930.01.patch
>
>
> Datanode IO (Disk/Network) related operations and instrumentations are 
> currently spilled in many classes such as DataNode.java, BlockReceiver.java, 
> BlockSender.java, FsDatasetImpl.java, FsVolumeImpl.java, 
> DirectoryScanner.java, BlockScanner.java, FsDatasetAsyncDiskService.java, 
> LocalReplica.java, LocalReplicaPipeline.java, Storage.java, etc. 
> This ticket is opened to consolidate IO related operations for easy 
> instrumentation, metrics collection, logging and trouble shooting. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

[jira] [Updated] (HDFS-10930) Refactor Datanode IO operations into a single class

2016-10-03 Thread Xiaoyu Yao (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xiaoyu Yao updated HDFS-10930:
--
Description: 
Datanode IO (Disk/Network) related operations and instrumentations are 
currently spilled in many classes such as DataNode.java, BlockReceiver.java, 
BlockSender.java, FsDatasetImpl.java, FsVolumeImpl.java, DirectoryScanner.java, 
BlockScanner.java, FsDatasetAsyncDiskService.java, LocalReplica.java, 
LocalReplicaPipeline.java, Storage.java, etc. 

This ticket is opened to consolidate IO related operations for easy 
instrumentation, metrics collection, logging and trouble shooting. 


  was:
Datanode IO (Disk/Network) related operations and instrumentations are 
currently spilled in many classes such as DataNode.java, BlockReceiver.java, 
BlockSender.java, FsDatasetImpl.java, FsVolumeImpl.java, DirectoryScanner.java, 
BlockScanner.java, FsDatasetAsyncDiskService.java, LocalReplica.java, 
LocalReplicaPipeline.java, Storage.java, etc. This ticket is opened to 
consolidate them into a single class. 



> Refactor Datanode IO operations into a single class
> ---
>
> Key: HDFS-10930
> URL: https://issues.apache.org/jira/browse/HDFS-10930
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: datanode
>Reporter: Xiaoyu Yao
>Assignee: Xiaoyu Yao
>
> Datanode IO (Disk/Network) related operations and instrumentations are 
> currently spilled in many classes such as DataNode.java, BlockReceiver.java, 
> BlockSender.java, FsDatasetImpl.java, FsVolumeImpl.java, 
> DirectoryScanner.java, BlockScanner.java, FsDatasetAsyncDiskService.java, 
> LocalReplica.java, LocalReplicaPipeline.java, Storage.java, etc. 
> This ticket is opened to consolidate IO related operations for easy 
> instrumentation, metrics collection, logging and trouble shooting. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org