Yang Yun created HDFS-15022:
-------------------------------
Summary: Add new RPC to transfer data block with external shell
script across Datanode
Key: HDFS-15022
URL: https://issues.apache.org/jira/browse/HDFS-15022
Project: Hadoop HDFS
Issue Type: Improvement
Components: datanode
Reporter: Yang Yun
Assignee: Yang Yun
Replicating data block is expensive when some Datanodes are down, especially
for slow storage. Add a new RPC to replicate block with external shell script
across datanode. User can choose more effective way to copy block files.
In our setup, Archive volume are configured to remote reliable storage. we just
add a new link file in new datanode to the remote file when do replication.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]