[
https://issues.apache.org/jira/browse/YARN-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13795597#comment-13795597
]
Hitesh Shah commented on YARN-1289:
-----------------------------------
I believe this jira should be considered invalid. YARN does not and should not
have any implicit dependencies on mapreduce. *If* anyone wants to runs
MapReduce jobs on a YARN cluster, configuration of the mapreduce shuffle
service is mandatory - however this does not hold true for cases where someone
is using YARN to run non-MR applications.
If someone wanted to change the implementation of the shuffle service to a
potentially better/faster implementation, defining a default would create a
problem. Also, in terms of future-proofing, what is the expectation if MR in
later versions switches to use a different service? Is that expectation that
default services will keep on changing over time based on MR implementation
changes?
> Configuration "yarn.nodemanager.aux-services" should have default value for
> mapreduce_shuffle.
> ----------------------------------------------------------------------------------------------
>
> Key: YARN-1289
> URL: https://issues.apache.org/jira/browse/YARN-1289
> Project: Hadoop YARN
> Issue Type: Bug
> Components: nodemanager
> Reporter: wenwupeng
> Assignee: Junping Du
> Attachments: YARN-1289.patch
>
>
> Failed to run benchmark when not configure yarn.nodemanager.aux-services
> value in yarn-site.xml', it is better to configure default value.
> 13/10/09 22:19:23 INFO mapreduce.Job: Task Id :
> attempt_1381371516570_0001_m_000000_1, Status : FAILED
> Container launch failed for container_1381371516570_0001_01_000005 :
> org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The
> auxService:mapreduce_shuffle does not exist
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at
> org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:152)
> at
> org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)
> at
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:155)
> at
> org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:369)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
--
This message was sent by Atlassian JIRA
(v6.1#6144)
