[
https://issues.apache.org/jira/browse/HDFS-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759261#action_12759261
]
Hairong Kuang commented on HDFS-642:
------------------------------------
Yes, I agree. This was discussed at the design time. If a block contains a lot
of packets, this impact should be minimal. The advantage of this design is that
it makes lease/pipeline recovery much cleaner.
> Support pipeline close and close recovery
> -----------------------------------------
>
> Key: HDFS-642
> URL: https://issues.apache.org/jira/browse/HDFS-642
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: Append Branch
>
>
> This jira intends to implement the third stage of block construction: close.
> The main ideas are:
> 1. A client notifies the datanodes in the pipeline to finalize a replica and
> then shuts down the pipeline by sending a special end-of-block message.
> 2. The end-of-block message does not get sent until the client finishes
> sending all packets belong to the block and have received all their acks.
> 3. If close fails, the client recovers the failures by setting up a new
> pipeline with the remaining datanodes and a newer generation stamp.
> 4. I plan to use an empty packet as the end-of-block message.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
