Hi,
I am trying to run hadoop over mesos. And I am using the code in the trunk.
But I ran into some problems here. My hadoop version is cdh3u3.
*1. when a job is pending because of no enough resources, I use ctrl-c to
stop the job client. But I can see the pending mapper and pending reducer
are still in the job tracker. Then I try to use "hadoop job -kill jobid" to
kill this job, but nothing happens in jobtracker, mapper and reducer are
still pending. The log in jobtracker is as follow.*
13/04/11 17:21:07 INFO mapred.MesosScheduler: JobTracker Status
Pending Map Tasks: 1
Pending Reduce Tasks: 1
Idle Map Slots: 0
Idle Reduce Slots: 0
Inactive Map Slots: 0 (launched but no hearbeat yet)
Inactive Reduce Slots: 0 (launched but no hearbeat yet)
Needed Map Slots: 1
Needed Reduce Slots: 1
13/04/11 17:21:07 INFO mapred.MesosScheduler: Declining offer with
insufficient resources for a TaskTracker:
cpus: offered 4.0 needed 1.800000011920929
mem : offered 2731.0 needed 6432.0
disk: offered 70651.0 needed 4096.0
ports: at least 2 (sufficient)
[name: "cpus"
type: SCALAR
scalar {
value: 4.0
}
, name: "mem"
type: SCALAR
scalar {
value: 2731.0
}
, name: "ports"
type: RANGES
ranges {
range {
begin: 31000
end: 32000
}
}
, name: "disk"
type: SCALAR
scalar {
value: 70651.0
}
]
13/04/11 17:21:07 INFO mapred.MesosScheduler: Unable to fully satisfy
needed map/reduce slots: 1 map slots 1 reduce slots remaining
*2. when we submit the job to the jobtracker, I can not find any running
job on jobtracker web interface(http://localhost:50030/jobtracker.jsp). But
when the job is finished, I can see the job info in retired job in
jobtracker.*
Any ideas about this ? Thanks a lot.
Guodong
