[
https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137912#comment-16137912
]
Weiwei Yang edited comment on HDFS-12282 at 8/23/17 5:24 AM:
-------------------------------------------------------------
Ah [~anu], I think you are right, this worker thread processes HB and handles
the states of nodes, if this gets slow down, there will be some lag on nodes
status update.
bq. Why do we need this in the path of anything heart beat related?
In earlier discussions, we agreed to use HB to send block deletion TXs. Do you
want to re-discuss that? Maybe move this part away from HB processing and
create a new RPC call for that? I am totally fine with that too, I think what
you mentioned to keep HB light weight and non-disk-I/O involved makes sense to
me. Existing implementation logic please refer to [^Block delete via HB between
SCM and DN.png]
Thanks
was (Author: cheersyang):
Ah [~anu], I think you are right, this worker thread processes HB and handles
the states of nodes, if this gets slow down, there will be some lag on nodes
status update.
bq. Why do we need this in the path of anything heart beat related?
In earlier discussions, we agreed to use HB to send block deletion TXs. Do you
want to re-discuss that? Maybe move this part away from HB processing and
create a new RPC call for that? I am totally fine with that too, I think what
you mentioned to keep HB light weight and non-disk-I/O involved makes sense to
me.
Thanks
> Ozone: DeleteKey-4: Block delete via HB between SCM and DN
> ----------------------------------------------------------
>
> Key: HDFS-12282
> URL: https://issues.apache.org/jira/browse/HDFS-12282
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: datanode, ozone, scm
> Reporter: Weiwei Yang
> Assignee: Weiwei Yang
> Attachments: Block delete via HB between SCM and DN.png,
> HDFS-12282-HDFS-7240.001.patch, HDFS-12282-HDFS-7240.002.patch,
> HDFS-12282-HDFS-7240.003.patch, HDFS-12282.WIP.patch
>
>
> This is the task 3 in the design doc, implements the SCM to datanode
> interactions. Including
> # SCM sends block deletion message via HB to datanode
> # datanode changes block state to deleting when processes the HB response
> # datanode sends deletion ACKs back to SCM
> # SCM handles ACKs and removes blocks in DB
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]