[ https://issues.apache.org/jira/browse/HDFS-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinayakumar B resolved HDFS-9783. --------------------------------- Resolution: Duplicate Resolving as duplicate. Feel free to re-open if fix in HDFS-9661 doesnt work for you. > DataNode deadlocks after running hdfs mover > ------------------------------------------- > > Key: HDFS-9783 > URL: https://issues.apache.org/jira/browse/HDFS-9783 > Project: Hadoop HDFS > Issue Type: Bug > Components: datanode > Affects Versions: 2.6.0 > Reporter: David Watzke > Attachments: datanode.stack.txt > > > We're running CDH 5.4.4 (with Hadoop 2.6.0). Recently we've added 800T of > ARCHIVE storage, marked some data (16T * 2 repl. factor) as "COLD" and ran > the hdfs mover to enforce the storage policy. > After a few minutes, the mover hangs because one or more datanodes hang as > well. Please check out the deadlock revealed by jstack. Also, here's what > appeared in DN log: > 2016-02-09 15:58:15,676 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: > Not able to copy block 1157230686 to /5.45.60.142:40144 because threads quota > is exceeded. -- This message was sent by Atlassian JIRA (v6.3.4#6332)