[
https://issues.apache.org/jira/browse/YARN-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Lowe updated YARN-8695:
-----------------------------
Priority: Minor (was: Major)
Downgrading the priority since this has no impact on functionality.
Does "container id container_1534394833079_0012_01_000006" appear earlier in
the AM log? This may simply be a case where the AM has already decided to
forget about a container it used earlier to run a task, and complains when the
RM informs the AM of the completion of that container. If that is indeed what
is happening then this bug should be moved to the MAPREDUCE project, as it
would be a bug in the MapReduce AM code rather than YARN.
> ERROR: Container complete event for unknown container id
> --------------------------------------------------------
>
> Key: YARN-8695
> URL: https://issues.apache.org/jira/browse/YARN-8695
> Project: Hadoop YARN
> Issue Type: Bug
> Components: RM
> Reporter: sivasankar
> Priority: Minor
>
> Have deployed a cluster with *3 data nodes*. YARN/MapReduce2/HDFS version is
> *2.7.3* on HDP. While running teragen and Gobblin the following Yarn errors
> get reported in the logs. Errors get reported only when the map tasks defined
> for the job less than or equals to the number of data nodes in the cluster.
> For *Teragen* -Dmapreduce.job.maps=4
> For *Gobblin* mr.job.max.mappers=4
> There are no errors if the map tasks(splits) are <= number of data nodes.
> 2018-08-16 06:54:05,681 ERROR [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: *Container
> complete event for unknown container id
> container_1534394833079_0012_01_000006*
> 2018-08-16 05:00:50,138 ERROR [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Container
> complete event for unknown container id
> container_1534394833079_0001_01_000055 2018-08-16 05:00:50,138 INFO
> [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received
> completed container container_1534394833079_0001_01_000054 2018-08-16
> 05:00:50,138 ERROR [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Container
> complete event for unknown container id
> container_1534394833079_0001_01_000054 2018-08-16 05:00:50,138 INFO
> [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received
> completed container container_1534394833079_0001_01_000053 2018-08-16
> 05:00:50,138 ERROR [RMCommunicator Allocator]
> org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Container
> complete event for unknown container id container_1534394833079_0001_01_000053
> *Note*: There is no functionality issue.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
