[jira] [Commented] (HDFS-9382) Track the acks for the packets which are sent from ErasureCodingWorker as part of reconstruction work

2015-11-16 Thread Zhe Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007553#comment-15007553
 ] 

Zhe Zhang commented on HDFS-9382:
-

Great idea Uma. With this proposed work, we should probably revisit whether we 
should unify block reader and writer for client and DN. I believe [~libo-intel] 
has explored the idea to some extent.

> Track the acks for the packets which are sent from ErasureCodingWorker as 
> part of reconstruction work
> -
>
> Key: HDFS-9382
> URL: https://issues.apache.org/jira/browse/HDFS-9382
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: datanode
>Affects Versions: 3.0.0
>Reporter: Uma Maheswara Rao G
>Assignee: Uma Maheswara Rao G
>
> Currently we are not tracking the acks for the packets which are sent from DN 
> ECWorker as part of reconstruction work. This jira is proposing to tracks the 
> acks as reconstruction work is really expensive, so we should know if any 
> packets failed to write at target DN 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HDFS-9382) Track the acks for the packets which are sent from ErasureCodingWorker as part of reconstruction work

2015-11-16 Thread Li Bo (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008062#comment-15008062
 ] 

Li Bo commented on HDFS-9382:
-

Unifying the readers and writers is very complicated due to the different 
details, so I have postponed the work. Maybe we can consider the optimization 
after most of the functionalities of EC are satisfied. 

> Track the acks for the packets which are sent from ErasureCodingWorker as 
> part of reconstruction work
> -
>
> Key: HDFS-9382
> URL: https://issues.apache.org/jira/browse/HDFS-9382
> Project: Hadoop HDFS
>  Issue Type: Sub-task
>  Components: datanode
>Affects Versions: 3.0.0
>Reporter: Uma Maheswara Rao G
>Assignee: Uma Maheswara Rao G
>
> Currently we are not tracking the acks for the packets which are sent from DN 
> ECWorker as part of reconstruction work. This jira is proposing to tracks the 
> acks as reconstruction work is really expensive, so we should know if any 
> packets failed to write at target DN 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)