Hari Sekhon created HDFS-8297:
---------------------------------
Summary: Ability to online trigger data dir rescan for blocks
Key: HDFS-8297
URL: https://issues.apache.org/jira/browse/HDFS-8297
Project: Hadoop HDFS
Issue Type: New Feature
Components: datanode
Affects Versions: 2.6.0
Environment: HDP 2.2
Reporter: Hari Sekhon
Feature request to add functionality to online trigger data dir rescan for
available blocks without having to restart datanode.
Motivation is if using HDFS storage tiering with an archive tier to a separate
hyperscale storage device over the network (Hedvig in this case) which may go
away and then return due to say a network interruption or other temporary
error, this leaves HDFS fsck declaring missing blocks, that are clearly visible
on the mount point for the node's archive directory. An online trigger for data
dir rescsan for available blocks would avoid having to do a rolling restart of
all datanodes across a cluster. I did try sending a kill -HUP to the datanode
process (both SecureDataNodeStarter parent and child) while tailing the log
hoping this might do it, but nothing happened in the log.
Hari Sekhon
http://www.linkedin.com/in/harisekhon
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
