Wei-Chiu Chuang created HDFS-13613:
--------------------------------------
Summary: RegionServer log is flooded with "Execution rejected,
Executing in current thread"
Key: HDFS-13613
URL: https://issues.apache.org/jira/browse/HDFS-13613
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 2.4.0
Environment: CDH 5.13, HBase RegionServer, Kerberized, hedged read
Reporter: Wei-Chiu Chuang
In the log of a HBase RegionServer with hedged read, we saw the following
message flooding the log file.
{noformat}
2018-05-19 17:22:55,691 INFO org.apache.hadoop.hdfs.DFSClient: Execution
rejected, Executing in current thread
2018-05-19 17:22:55,692 INFO org.apache.hadoop.hdfs.DFSClient: Execution
rejected, Executing in current thread
2018-05-19 17:22:55,695 INFO org.apache.hadoop.hdfs.DFSClient: Execution
rejected, Executing in current thread
2018-05-19 17:22:55,696 INFO org.apache.hadoop.hdfs.DFSClient: Execution
rejected, Executing in current thread
2018-05-19 17:22:55,696 INFO org.apache.hadoop.hdfs.DFSClient: Execution
rejected, Executing in current thread
....
{noformat}
Sometimes the RS spits tens of thousands of lines of this message in a minute.
We should do something to stop this message flooding the log file. Also, we
should make this message more actionable. Discussed with [~huaxiang], this
message can appear if there are stale DataNodes.
I believe this issue existed since HDFS-5776.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
