[
https://issues.apache.org/jira/browse/HDFS-17349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17821278#comment-17821278
]
Srinivasu Majeti commented on HDFS-17349:
-----------------------------------------
Hi [~weichiu] / [~sodonnell], Could you please review this as we see more than
a couple of instances where this evictWriters does not work effectively or does
not report any error/warning message as to why it has not shown any impact.
Thank you!
> evictWriters command does not seem to work effectively
> ------------------------------------------------------
>
> Key: HDFS-17349
> URL: https://issues.apache.org/jira/browse/HDFS-17349
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Srinivasu Majeti
> Priority: Major
>
> Post running {{evictWriters}} on Datanodes while decommissioning going on,
> noticed the below messages being logged. That means {{evictWriters is
> successfully issued to Datanode and it tried interrupting all xceivers.}}
> {code:java}
> 2023-11-29 16:37:18,599 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
> Evicting all writers.
> 2023-11-29 16:37:18,600 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
> Stopped the writer:
> NioInetPeer(Socket[addr=/10.4.33.104,port=42982,localport=9866])
> 2023-11-29 16:37:18,600 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
> Stopped the writer:
> NioInetPeer(Socket[addr=/10.4.35.105,port=43300,localport=9866])
> 2023-11-29 16:37:18,600 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
> Stopped the writer:
> NioInetPeer(Socket[addr=/10.4.33.60,port=59978,localport=9866]){code}
> Even after we see "Stopped the writer: NioInetPeer(Socket[addr=/10.4.35.105",
> we still see open files not released from 10.4.35.105, and decommission did
> not progress.
> {code:java}
> $ hdfs dfsadmin -listOpenFiles -blockingDecommission -path=/
> Client Host Client Name Open File Path
> 10.4.35.105 DFSClient_NONMAPREDUCE_-211169064_96
> /warehouse/tablespace/managed/hive/sys.db/query_data/date=2023-11-28/hive_3162c2fd-cdd0-47f4-979c-d1c3263bfc86_1
> 10.4.35.149 DFSClient_NONMAPREDUCE_1084942995_59
> /warehouse/tablespace/managed/hive/sys.db/query_data/date=2023-11-28/hive_2360faef-7894-41d9-a13c-57d70593583e_1{code}
> We may need to either report if evictWriters successfully executed or failed
> by checking for the actual status of xceivers.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
