[
https://issues.apache.org/jira/browse/MAPREDUCE-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lee young gon updated MAPREDUCE-7291:
-------------------------------------
Description:
Attempt(map or reduce) remains NEW(state). And job is stuck in certain
conditions.
The following are the situations:
# total task(map/reduce) count is same as the running limit of
task(mapreduce.job.running.map.limit/mapreduce.job.running.reduce.limit).
# And start job. -> And total tasks(map/reduce) are running. -> And failed
attempt for some reasons.
# Request allocation of new containers because the attempt failed.
# Quickly receive allocation of new containers.
# However, new container is released because failed attempts have not been
cleared up.(allocated == total == running limit)
# Subsequently, the failed attempts is terminated, but it is waiting forever.
# Job is stuck.
!image-2020-08-10-15-13-03-930.png|width=915,height=154!
We switched MR frameworks(2.7.1) and checked that it worked well.
Perhaps it is related to -MAPREDUCE-6697-
Can you help me?
was:
Attempt(map or reduce) remains NEW(state). And job is stuck in certain
conditions.
The following are the situations:
# total task(map/reduce) count is same as the running limit of
task(mapreduce.job.running.map.limit/mapreduce.job.running.reduce.limit).
# And start job. -> And total tasks(map/reduce) are running. -> And failed
attempt for some reasons.
# Request allocation of new containers because the attempt failed.
# Quickly receive allocation of new containers.
# However, new container is released because failed attempts have not been
cleared up.(allocated == total == running limit)
# Subsequently, the failed attempts is terminated, but it is waiting forever.
# Job is stuck.
!image-2020-08-10-15-13-03-930.png|width=1128,height=190!
We switched MR frameworks(2.7.1) and checked that it worked well.
Perhaps it is related to -MAPREDUCE-6697-
Can you help me?
> Attempt(map or reduce) remains NEW(state). And job is stuck in certain
> conditions.
> ----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-7291
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7291
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 3.1.2
> Reporter: Lee young gon
> Priority: Major
> Attachments: image-2020-08-10-15-13-03-930.png
>
>
> Attempt(map or reduce) remains NEW(state). And job is stuck in certain
> conditions.
> The following are the situations:
> # total task(map/reduce) count is same as the running limit of
> task(mapreduce.job.running.map.limit/mapreduce.job.running.reduce.limit).
> # And start job. -> And total tasks(map/reduce) are running. -> And failed
> attempt for some reasons.
> # Request allocation of new containers because the attempt failed.
> # Quickly receive allocation of new containers.
> # However, new container is released because failed attempts have not been
> cleared up.(allocated == total == running limit)
> # Subsequently, the failed attempts is terminated, but it is waiting forever.
> # Job is stuck.
> !image-2020-08-10-15-13-03-930.png|width=915,height=154!
> We switched MR frameworks(2.7.1) and checked that it worked well.
> Perhaps it is related to -MAPREDUCE-6697-
> Can you help me?
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
