Akshay Agarwal created YARN-8663:
------------------------------------
Summary: Opportunistic Container property
"mapreduce.job.num-opportunistic-maps-percent" is throwing wrong exception at
wrong sequence
Key: YARN-8663
URL: https://issues.apache.org/jira/browse/YARN-8663
Project: Hadoop YARN
Issue Type: Bug
Components: yarn
Affects Versions: 3.1.1
Environment: Secure Installation with Kerberos ON.
Reporter: Akshay Agarwal
Pre-requisites:
{code:java}
1. Install HA cluster.
2.Set yarn.nodemanager.opportunistic-containers-max-queue-length=(positive
integer value)[NodeManager->yarnsite.xml]
3. Set yarn.resourcemanager.opportunistic-container-allocation.enabled=
true[ResourceManager->yarnsite.xml]
{code}
Steps to reproduce:
{code:java}
1.Keep All NodeManagers Up
2. Submit a job with -Dmapreduce.job.num-opportunistic-maps-percent="abh" or
"2.5"
{code}
Expected Result:
{code:java}
Should through an Exception stating "NumberFormatException" before writing the
input for mappers.
{code}
Log Details:
{code:java}
2018-08-14 18:15:54,049 INFO mapreduce.Job: map 0% reduce 0%
2018-08-14 18:15:54,069 INFO mapreduce.Job: Job job_1534236847054_0005 failed
with state FAILED due to: Application application_1534236847054_0005 failed 2
times due to AM Container for appattempt_1534236847054_0005_000002 exited with
exitCode: 1
Failing this attempt.Diagnostics: [2018-08-14 18:15:53.110]Exception from
container-launch.
Container id: container_e31_1534236847054_0005_02_000001
Exit code: 1
[2018-08-14 18:15:53.113]Container exited with a non-zero exit code 1. Error
file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option UseSplitVerifier;
support was removed in 8.0
Aug 14, 2018 6:15:51 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver
as a provider class
Aug 14, 2018 6:15:51 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a
provider class
Aug 14, 2018 6:15:51 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a
root resource class
Aug 14, 2018 6:15:51 PM
com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM'
Aug 14, 2018 6:15:51 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to
GuiceManagedComponentProvider with the scope "Singleton"
Aug 14, 2018 6:15:52 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to
GuiceManagedComponentProvider with the scope "Singleton"
Aug 14, 2018 6:15:52 PM
com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory
getComponentProvider
INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to
GuiceManagedComponentProvider with the scope "PerRequest"
log4j:WARN No appenders could be found for logger
(org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more
info.
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
