Hi, All, I'm using hadoop-2.5.0-cdh5.2.0 on mesos 0.21.0, the following are from master log of mesos: I0114 14:47:04.855033 17756 master.cpp:1768] Deactivating framework 20150114-144506-3205108908-5050-17750-0000 (Hadoop: (RPC port: 9001, WebUI port: 50030)) at [email protected]:35511 I0114 14:47:04.857833 17755 hierarchical_allocator_process.hpp:405] Deactivated framework 20150114-144506-3205108908-5050-17750-0000 I0114 14:47:04.858381 17755 hierarchical_allocator_process.hpp:563] Recovered cpus(*):2; mem(*):2808; disk(*):45148; ports(*):[31000-32000] (total allocatable: cpus(*):2; mem(*):2808; disk(*):45148; ports(*):[31000-32000]) on slave 20150108-152507-3205108908-5050-27619-S0 from framework 20150114-144506-3205108908-5050-17750-0000 I0114 14:47:11.107666 17753 http.cpp:478] HTTP request for '/master/state.json' I0114 14:47:21.117486 17757 http.cpp:478] HTTP request for '/master/state.json' I0114 14:47:31.129355 17759 http.cpp:478] HTTP request for '/master/state.json'
Cheers, Dan 2015-01-14 14:32 GMT-06:00 Vinod Kone <[email protected]>: > What do the master logs say? > > On Wed, Jan 14, 2015 at 12:21 PM, Dan Dong <[email protected]> wrote: > >> Hi, >> When I run hadoop jobs on Mesos(0.21.0), the jobs are stuck for ever: >> 15/01/14 13:59:30 INFO mapred.FileInputFormat: Total input paths to >> process : 8 >> 15/01/14 13:59:30 INFO mapred.JobClient: Running job: >> job_201501141358_0001 >> 15/01/14 13:59:31 INFO mapred.JobClient: map 0% reduce 0% >> >> From jobtracker log I see: >> 2015-01-14 13:59:35,542 INFO org.apache.hadoop.mapred.ResourcePolicy: >> Launching task Task_Tracker_0 on http://centos-2.local:31911 with >> mapSlots=1 reduceSlots=0 >> 2015-01-14 14:04:35,552 WARN org.apache.hadoop.mapred.MesosScheduler: >> Tracker http://centos-2.local:31911 failed to launch within 300 seconds, >> killing it >> >> I started manually namenode and jobtracker on master node and datanode >> on slave, but I could not see tasktracker started by mesos on slave. Note >> that if I ran hadoop directly without Mesos( of course the conf files are >> different and tasktracker will be started manually on slave), everything >> works fine. Any hints? >> >> Cheers, >> Dan >> > >
