Lee young gon created MAPREDUCE-7291:
----------------------------------------
Summary: Attempt(map or reduce) remains NEW(state). And job is
stuck in certain conditions.
Key: MAPREDUCE-7291
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7291
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 3.1.2
Environment: !image-2020-08-10-15-13-03-930.png!
Reporter: Lee young gon
Attachments: image-2020-08-10-15-13-03-930.png
Attempt(map or reduce) remains NEW(state). And job is stuck in certain
conditions.
The following are the situations:
# total task(map/reduce) count is same as the running limit of
task(mapreduce.job.running.map.limit/mapreduce.job.running.reduce.limit).
# And start job. -> And total tasks(map/reduce) are running. -> And failed
attempt for some reasons.
# Request allocation of new containers because the attempt failed.
# Quickly receive allocation of new containers.
# However, new container is released because failed attempts have not been
cleared up.(allocated == total == running limit)
# Subsequently, the failed attempts is terminated, but it is waiting forever.
# Job is stuck.
We switched MR frameworks(2.7.1) and checked that it worked well.
Perhaps it is related to -MAPREDUCE-6697-
Can you help me?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
