[
https://issues.apache.org/jira/browse/HDFS-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Watzke updated HDFS-9783:
-------------------------------
Description:
We're running CDH 5.4.4 (with Hadoop 2.6.0). Recently we've added 800T of
ARCHIVE storage, marked some data (16T * 2 repl. factor) as "COLD" and ran the
hdfs mover to enforce the storage policy.
After a few minutes, the mover hangs because one or more datanodes hang as
well. Please check out the deadlock revealed by jstack .
was:
We're running CDH 5.4.4 (with Hadoop 2.6.0). Recently we've added 800T of
ARCHIVE storage, marked some data (16T * 2 repl. factor) as "COLD" and ran the
hdfs mover to enforce the storage policy.
After a few minutes, the mover hangs and a few datanodes hang as well.
> DataNode deadlocks after running hdfs mover
> -------------------------------------------
>
> Key: HDFS-9783
> URL: https://issues.apache.org/jira/browse/HDFS-9783
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode
> Affects Versions: 2.6.0
> Reporter: David Watzke
> Attachments: datanode.stack.txt
>
>
> We're running CDH 5.4.4 (with Hadoop 2.6.0). Recently we've added 800T of
> ARCHIVE storage, marked some data (16T * 2 repl. factor) as "COLD" and ran
> the hdfs mover to enforce the storage policy.
> After a few minutes, the mover hangs because one or more datanodes hang as
> well. Please check out the deadlock revealed by jstack .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
