Hi guys,
I'm facing some issues starting SLS (Scheduler Load Simulator) on both
hadoop 2.6.0 and 2.5.0.
Starting the simulation I get:
Exception in thread "main" java.lang.RuntimeException:
java.lang.NullPointerException
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
at
org.apache.hadoop.yarn.sls.SLSRunner.startAMFromSLSTraces(SLSRunner.java:313)
at org.apache.hadoop.yarn.sls.SLSRunner.startAM(SLSRunner.java:248)
at org.apache.hadoop.yarn.sls.SLSRunner.start(SLSRunner.java:145)
at org.apache.hadoop.yarn.sls.SLSRunner.main(SLSRunner.java:528)
Caused by: java.lang.NullPointerException
at
java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:123)
... 4 more
I tried exporting any possible env variable:
export JAVA_HOME=/usr/lib/jvm/java-8-oracle/
export HADOOP_HOME=/opt/yarn/hadoop-2.6.0
export HADOOP_MAPRED_HOME=$HADOOP_HOME
export HADOOP_COMMON_HOME=$HADOOP_HOME
export HADOOP_HDFS_HOME=$HADOOP_HOME
export HADOOP_YARN_HOME=$HADOOP_HOME
export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
export PATH=$PATH:$HADOOP_HOME/bin
export
HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:${HADOOP_HOME}/share/hadoop/tools/lib/*
The exception is raised after a while, I think right after the nodes are
added to the simulation. Complete log in the attachment.
The command used is ./slsrun.sh
--input-sls=/home/user/automaticInput.json --output-dir=/home/user/auto
--print-simulation
Thanks in advance
Fabio
15/01/10 02:50:42 INFO conf.Configuration: found resource core-site.xml at
file:/opt/yarn/hadoop-2.6.0/etc/hadoop/core-site.xml
Java HotSpot(TM) Server VM warning: You have loaded library
/opt/yarn/hadoop-2.6.0/lib/native/libhadoop.so.1.0.0 which might have disabled
stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>',
or link it with '-z noexecstack'.
15/01/10 02:50:42 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/01/10 02:50:42 INFO security.Groups: clearing userToGroupsMap cache
15/01/10 02:50:43 INFO conf.Configuration: found resource yarn-site.xml at
file:/opt/yarn/hadoop-2.6.0/etc/hadoop/yarn-site.xml
15/01/10 02:50:48 INFO event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher
15/01/10 02:50:48 INFO security.NMTokenSecretManagerInRM:
NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms
15/01/10 02:50:48 INFO security.RMContainerTokenSecretManager:
ContainerTokenKeyRollingInterval: 86400000ms and
ContainerTokenKeyActivationDelay: 900000ms
15/01/10 02:50:48 INFO security.AMRMTokenSecretManager:
AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000
ms
15/01/10 02:50:49 INFO event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType
for class
org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler
15/01/10 02:50:49 INFO event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for
class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager
15/01/10 02:50:49 INFO resourcemanager.ResourceManager: Using Scheduler:
org.apache.hadoop.yarn.sls.scheduler.ResourceSchedulerWrapper
15/01/10 02:50:49 INFO mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
15/01/10 02:50:49 INFO mortbay.log: jetty-6.1.26
15/01/10 02:50:49 INFO mortbay.log: Started [email protected]:10001
15/01/10 02:50:49 INFO event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType
for class
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
15/01/10 02:50:49 INFO event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
15/01/10 02:50:49 INFO event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType
for class
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
15/01/10 02:50:49 INFO event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
15/01/10 02:50:49 INFO impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
15/01/10 02:50:49 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10
second(s).
15/01/10 02:50:49 INFO impl.MetricsSystemImpl: ResourceManager metrics system
started
15/01/10 02:50:49 INFO event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class
org.apache.hadoop.yarn.server.resourcemanager.RMAppManager
15/01/10 02:50:49 INFO event.AsyncDispatcher: Registering class
org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType
for class
org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
15/01/10 02:50:49 INFO resourcemanager.RMNMInfo: Registered RMNMInfo MBean
15/01/10 02:50:49 INFO metrics.SystemMetricsPublisher: YARN system metrics
publishing service is not enabled
15/01/10 02:50:49 INFO util.HostsFileReader: Refreshing hosts (include/exclude)
list
15/01/10 02:50:49 INFO conf.Configuration: found resource
capacity-scheduler.xml at
file:/opt/yarn/hadoop-2.6.0/etc/hadoop/capacity-scheduler.xml
15/01/10 02:50:49 INFO capacity.ParentQueue: root, capacity=1.0,
asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING,
acls=ADMINISTER_QUEUE:*SUBMIT_APPLICATIONS:*, labels=*,
, reservationsContinueLooking=true
15/01/10 02:50:49 INFO capacity.ParentQueue: Initialized parent-queue root
name=root, fullname=root
15/01/10 02:50:49 INFO capacity.LeafQueue: Initializing default
capacity = 1.0 [= (float) configuredCapacity / 100 ]
asboluteCapacity = 1.0 [= parentAbsoluteCapacity * capacity ]
maxCapacity = 1.0 [= configuredMaxCapacity ]
absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined,
(parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ]
userLimit = 100 [= configuredUserLimit ]
userLimitFactor = 1.0 [= configuredUserLimitFactor ]
maxApplications = 10000 [= configuredMaximumSystemApplicationsPerQueue or
(int)(configuredMaximumSystemApplications * absoluteCapacity)]
maxApplicationsPerUser = 10000 [= (int)(maxApplications * (userLimit / 100.0f)
* userLimitFactor) ]
maxActiveApplications = 1 [= max((int)ceil((clusterResourceMemory /
minimumAllocation) * maxAMResourcePerQueuePercent * absoluteMaxCapacity),1) ]
maxActiveAppsUsingAbsCap = 1 [= max((int)ceil((clusterResourceMemory /
minimumAllocation) *maxAMResourcePercent * absoluteCapacity),1) ]
maxActiveApplicationsPerUser = 1 [= max((int)(maxActiveApplications *
(userLimit / 100.0f) * userLimitFactor),1) ]
usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory *
absoluteCapacity)]
absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory]
maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ]
minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory -
minimumAllocationMemory) / maximumAllocationMemory ]
numContainers = 0 [= currentNumContainers ]
state = RUNNING [= configuredState ]
acls = ADMINISTER_QUEUE:*SUBMIT_APPLICATIONS:* [= configuredAcls ]
nodeLocalityDelay = 40
labels=*,
nodeLocalityDelay = 40
reservationsContinueLooking = true
15/01/10 02:50:49 INFO capacity.CapacityScheduler: Initialized queue: default:
capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>,
usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0
15/01/10 02:50:49 INFO capacity.CapacityScheduler: Initialized queue: root:
numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0,
vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
15/01/10 02:50:49 INFO capacity.CapacityScheduler: Initialized root queue root:
numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0,
vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
15/01/10 02:50:49 INFO capacity.CapacityScheduler: Initialized queue mappings,
override: false
15/01/10 02:50:49 INFO capacity.CapacityScheduler: Initialized
CapacityScheduler with calculator=class
org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator,
minimumAllocation=<<memory:1024, vCores:1>>, maximumAllocation=<<memory:8192,
vCores:32>>, asynchronousScheduling=false, asyncScheduleInterval=5ms
15/01/10 02:50:49 INFO resourcemanager.ResourceManager: Transitioning to active
state
15/01/10 02:50:49 INFO security.RMContainerTokenSecretManager: Rolling
master-key for container-tokens
15/01/10 02:50:49 INFO security.NMTokenSecretManagerInRM: Rolling master-key
for nm-tokens
15/01/10 02:50:49 INFO delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
15/01/10 02:50:49 INFO security.RMDelegationTokenSecretManager: storing master
key with keyID 1
15/01/10 02:50:49 INFO delegation.AbstractDelegationTokenSecretManager:
Starting expired delegation token remover thread, tokenRemoverScanInterval=60
min(s)
15/01/10 02:50:49 INFO delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
15/01/10 02:50:49 INFO security.RMDelegationTokenSecretManager: storing master
key with keyID 2
15/01/10 02:50:55 INFO ipc.CallQueueManager: Using callQueue class
java.util.concurrent.LinkedBlockingQueue
15/01/10 02:50:55 INFO ipc.Server: Starting Socket Reader #1 for port 8031
15/01/10 02:50:55 INFO pb.RpcServerFactoryPBImpl: Adding protocol
org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server
15/01/10 02:50:55 INFO ipc.Server: IPC Server listener on 8031: starting
15/01/10 02:50:55 INFO ipc.Server: IPC Server Responder: starting
15/01/10 02:51:00 INFO ipc.CallQueueManager: Using callQueue class
java.util.concurrent.LinkedBlockingQueue
15/01/10 02:51:00 INFO ipc.Server: Starting Socket Reader #1 for port 8030
15/01/10 02:51:00 INFO pb.RpcServerFactoryPBImpl: Adding protocol
org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server
15/01/10 02:51:00 INFO ipc.Server: IPC Server Responder: starting
15/01/10 02:51:00 INFO ipc.Server: IPC Server listener on 8030: starting
15/01/10 02:51:05 INFO ipc.CallQueueManager: Using callQueue class
java.util.concurrent.LinkedBlockingQueue
15/01/10 02:51:05 INFO ipc.Server: Starting Socket Reader #1 for port 8032
15/01/10 02:51:05 INFO pb.RpcServerFactoryPBImpl: Adding protocol
org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server
15/01/10 02:51:05 INFO ipc.Server: IPC Server Responder: starting
15/01/10 02:51:05 INFO ipc.Server: IPC Server listener on 8032: starting
15/01/10 02:51:05 INFO resourcemanager.ResourceManager: Transitioned to active
state
15/01/10 02:51:05 INFO http.HttpRequestLog: Http request log for
http.requests.resourcemanager is not defined
15/01/10 02:51:05 INFO http.HttpServer2: Added global filter 'safety'
(class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
15/01/10 02:51:05 INFO http.HttpServer2: Added filter RMAuthenticationFilter
(class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to
context cluster
15/01/10 02:51:05 INFO http.HttpServer2: Added filter RMAuthenticationFilter
(class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to
context logs
15/01/10 02:51:05 INFO http.HttpServer2: Added filter RMAuthenticationFilter
(class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to
context static
15/01/10 02:51:05 INFO http.HttpServer2: Added filter static_user_filter
(class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to
context cluster
15/01/10 02:51:05 INFO http.HttpServer2: Added filter static_user_filter
(class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to
context logs
15/01/10 02:51:05 INFO http.HttpServer2: Added filter static_user_filter
(class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to
context static
15/01/10 02:51:05 INFO http.HttpServer2: adding path spec: /cluster/*
15/01/10 02:51:05 INFO http.HttpServer2: adding path spec: /ws/*
15/01/10 02:51:05 INFO http.HttpServer2: Jetty bound to port 8088
15/01/10 02:51:05 INFO mortbay.log: jetty-6.1.26
15/01/10 02:51:05 INFO mortbay.log: Extract
jar:file:/opt/yarn/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-common-2.6.0.jar!/webapps/cluster
to /tmp/Jetty_0_0_0_0_8088_cluster____u0rgz3/webapp
15/01/10 02:51:06 INFO delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
15/01/10 02:51:06 INFO delegation.AbstractDelegationTokenSecretManager:
Starting expired delegation token remover thread, tokenRemoverScanInterval=60
min(s)
15/01/10 02:51:06 INFO delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
15/01/10 02:51:06 INFO delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
15/01/10 02:51:06 INFO delegation.AbstractDelegationTokenSecretManager:
Starting expired delegation token remover thread, tokenRemoverScanInterval=60
min(s)
15/01/10 02:51:06 INFO delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
15/01/10 02:51:06 INFO delegation.AbstractDelegationTokenSecretManager:
Starting expired delegation token remover thread, tokenRemoverScanInterval=60
min(s)
15/01/10 02:51:06 INFO delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
15/01/10 02:51:06 INFO delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
15/01/10 02:51:06 INFO mortbay.log: Started
[email protected]:8088
15/01/10 02:51:06 INFO webapp.WebApps: Web app /cluster started at 8088
15/01/10 02:51:07 INFO webapp.WebApps: Registered webapp guice modules
15/01/10 02:51:12 INFO ipc.CallQueueManager: Using callQueue class
java.util.concurrent.LinkedBlockingQueue
15/01/10 02:51:12 INFO ipc.Server: Starting Socket Reader #1 for port 8033
15/01/10 02:51:12 INFO pb.RpcServerFactoryPBImpl: Adding protocol
org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to
the server
15/01/10 02:51:12 INFO ipc.Server: IPC Server Responder: starting
15/01/10 02:51:12 INFO ipc.Server: IPC Server listener on 8033: starting
15/01/10 02:51:12 INFO util.RackResolver: Resolved node1 to /default-rack
15/01/10 02:51:12 INFO rmnode.RMNodeImpl: node1:0 Node Transitioned from NEW to
RUNNING
15/01/10 02:51:12 INFO resourcemanager.ResourceTrackerService: NodeManager from
node node1(cmPort: 0 httpPort: 80) registered with capability: <memory:10240,
vCores:10>, assigned nodeId node1:0
15/01/10 02:51:12 INFO capacity.CapacityScheduler: Added node node1:0
clusterResource: <memory:10240, vCores:10>
Exception in thread "main" java.lang.RuntimeException:
java.lang.NullPointerException
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
at
org.apache.hadoop.yarn.sls.SLSRunner.startAMFromSLSTraces(SLSRunner.java:313)
at org.apache.hadoop.yarn.sls.SLSRunner.startAM(SLSRunner.java:248)
at org.apache.hadoop.yarn.sls.SLSRunner.start(SLSRunner.java:145)
at org.apache.hadoop.yarn.sls.SLSRunner.main(SLSRunner.java:528)
Caused by: java.lang.NullPointerException
at
java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:123)
... 4 more
