Hi,
I want to enable adaptivescheduler in hadoop 0.20.203.0. I have a jar file from
this scheduler.(I am sure that this jar file works properly.).I put jar file in
HADOOP_HOME/lib and I set HADOOP_CLASSPATH in hadop-env.sh.and I set the
required property of scheduler in mapred-site.xml. when I run my cluster, all
of jobtracker,datanode,.... start. But when I go to UI of
scheduler(http://localhost:50030/scheduler), I face with error 404. what should
I do?please help me ....
my jobtracker log is:
2013-07-25 07:34:14,229 INFO org.apache.hadoop.mapred.JobTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting JobTracker
STARTUP_MSG: host = master/192.168.0.112
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.203.0
STARTUP_MSG: build =
http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203
-r 1099333; compiled by 'oom' on Wed May 4 07:57:50 PDT 2011
************************************************************/
2013-07-25 07:34:14,317 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
loaded properties from hadoop-metrics2.properties
2013-07-25 07:34:14,326 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2013-07-25 07:34:14,328 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl:
Scheduled snapshot period at 10 second(s).
2013-07-25 07:34:14,328 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl:
JobTracker metrics system started
2013-07-25 07:34:14,545 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
registered.
2013-07-25 07:34:14,548WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl:
Source name ugi already exists!
2013-07-25 07:34:14,550 INFO
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
2013-07-25 07:34:14,551 INFO org.apache.hadoop.mapred.JobTracker: Scheduler
configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT,
limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
2013-07-25 07:34:14,552 INFO org.apache.hadoop.util.HostsFileReader: Refreshing
hosts (include/exclude) list
2013-07-25 07:34:14,557 INFO
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Starting expired delegation token remover thread, tokenRemoverScanInterval=60
min(s)
2013-07-25 07:34:14,558 INFO
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
2013-07-25 07:34:14,629 INFO org.apache.hadoop.mapred.JobTracker: Starting
jobtracker with owner as maedeh
2013-07-25 07:34:14,654 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
RpcDetailedActivityForPort9001 registered.
2013-07-25 07:34:14,654 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
RpcActivityForPort9001 registered.
2013-07-25 07:34:14,657 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
2013-07-25 07:34:20,142 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2013-07-25 07:34:20,370 INFO org.apache.hadoop.http.HttpServer: Added global
filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-07-25 07:34:20,533 INFO org.apache.hadoop.http.HttpServer: Port returned
by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the
listener on 50030
2013-07-25 07:34:20,535 INFO org.apache.hadoop.http.HttpServer:
listener.getLocalPort() returned 50030
webServer.getConnectors()[0].getLocalPort() returned 50030
2013-07-25 07:34:20,535 INFO org.apache.hadoop.http.HttpServer: Jetty bound to
port 50030
2013-07-25 07:34:20,535 INFO org.mortbay.log: jetty-6.1.x
2013-07-25 07:34:21,435 INFO org.mortbay.log: Started
SelectChannelConnector@0.0.0.0:50030
2013-07-25 07:34:21,443 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source jvm
registered.
2013-07-25 07:34:21,443 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
JobTrackerMetrics registered.
2013-07-25 07:34:21,444 INFO org.apache.hadoop.mapred.JobTracker: JobTracker up
at: 9001
2013-07-25 07:34:21,444 INFO org.apache.hadoop.mapred.JobTracker: JobTracker
webserver: 50030
2013-07-25 07:34:25,330 INFO org.apache.hadoop.mapred.JobTracker: Cleaning up
the system directory
2013-07-25 07:34:25,987 INFO org.apache.hadoop.mapred.JobHistory: Creating DONE
folder at file:/home/maedeh/hadoop-0.20.203.0/logs/history/done
2013-07-25 07:34:25,999 INFO org.apache.hadoop.mapred.JobTracker: History
server being initialized in embedded mode
2013-07-25 07:34:26,001 INFO org.apache.hadoop.mapred.JobHistoryServer: Started
job history server at: localhost:50030
2013-07-25 07:34:26,001 INFO org.apache.hadoop.mapred.JobTracker: Job History
Server web address: localhost:50030
2013-07-25 07:34:26,004 INFO org.apache.hadoop.mapred.CompletedJobStatusStore:
Completed job store is inactive
2013-07-25 07:34:27,798 INFO org.apache.hadoop.mapred.AdaptiveScheduler:
Successfully configured AdaptiveScheduler
2013-07-25 07:34:27,798 INFO org.apache.hadoop.mapred.JobTracker: Refreshing
hosts information
2013-07-25 07:34:27,807 INFO org.apache.hadoop.util.HostsFileReader: Setting
the includes file to
2013-07-25 07:34:27,807 INFO org.apache.hadoop.util.HostsFileReader: Setting
the excludes file to
2013-07-25 07:34:27,807 INFO org.apache.hadoop.util.HostsFileReader: Refreshing
hosts (include/exclude) list
2013-07-25 07:34:27,807 INFO org.apache.hadoop.mapred.JobTracker:
Decommissioning 0 nodes
2013-07-25 07:34:27,809 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2013-07-25 07:34:27,810 INFO org.apache.hadoop.ipc.Server: IPC Server listener
on 9001: starting
2013-07-25 07:34:27,810 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0
on 9001: starting
2013-07-25 07:34:27,811 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1
on 9001: starting
2013-07-25 07:34:27,811 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2
on 9001: starting
2013-07-25 07:34:27,811 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3
on 9001: starting
2013-07-25 07:34:27,811 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4
on 9001: starting
2013-07-25 07:34:27,812 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5
on 9001: starting
2013-07-25 07:34:27,813 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6
on 9001: starting
2013-07-25 07:34:27,813 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7
on 9001: starting
2013-07-25 07:34:27,813 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8
on 9001: starting
2013-07-25 07:34:27,813 INFO org.apache.hadoop.mapred.JobTracker: Starting
RUNNING
2013-07-25 07:34:27,814 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9
on 9001: starting
2013-07-25 07:34:36,628 INFO org.apache.hadoop.net.NetworkTopology: Adding a
new node: /default-rack/slave1
2013-07-25 07:34:36,629 INFO org.apache.hadoop.mapred.JobTracker: Adding
tracker tracker_slave1:localhost/127.0.0.1:34317 to host slave1
2013-07-25 07:34:40,978 INFO org.apache.hadoop.net.NetworkTopology: Adding a
new node: /default-rack/slave2
2013-07-25 07:34:40,978 INFO org.apache.hadoop.mapred.JobTracker: Adding
tracker tracker_slave2:localhost/127.0.0.1:41451 to host slave2
