[
https://issues.apache.org/jira/browse/HDFS-16569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17534276#comment-17534276
]
Xiaoqiao He commented on HDFS-16569:
------------------------------------
{quote}Regarding Tectonic, seperating deamon threads from NN and isolating DN
from NN are most attracting features. Maybe we can design and implement those
features on hadoop-4 ?{quote}
Hmmm, It is very similar to Ozone, and will be a big architecture refactor.
Maybe we could start with only one nit feature (of course it need to discuss
and reach agreement first.), such as report location from client only as above
mentioned.
> Consider attaching block location info from client when closing a completed
> file
> --------------------------------------------------------------------------------
>
> Key: HDFS-16569
> URL: https://issues.apache.org/jira/browse/HDFS-16569
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Yuanbo Liu
> Priority: Major
>
> when a file is finished, client will not close it until DNs send
> RECEIVED_BLOCK by ibr or client is timeout. we can always see such kind of
> log in namenode
> {code:java}
> is COMMITTED but not COMPLETE(numNodes= 0 < minimum = 1) in file{code}
> Since client already has the last block locations, it's not necessary to rely
> on the ibr from DN when closing file.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
