Below is the output form hadoop fsck / : Status: HEALTHY Total size: 0 B Total blocks: 0 Total dirs: 6 Total files: 0 Over-replicated blocks: 0 Under-replicated blocks: 0 Target replication factor: 2 Real replication factor: 0.0
The filesystem under path '/' is HEALTHY. ************************ I am also wondering that, according to Google's paper about MapReduce, if there's any node failure or not responding for a given amount of time, the master will reassign the job to the other nodes. Is it true in Hadoop's implementation? Since I didn't see any job reassignment when a job has been pending too long. Thanks, Ming 2007/10/1, Ted Dunning <[EMAIL PROTECTED]>: > > What does [hadoop fsck /] show? > > > On 10/1/07 5:36 AM, "Ming Yang" <[EMAIL PROTECTED]> wrote: > > > Hi, > > > > I am using hadoop 0.14.1 on Ubuntu 7.04 (kernel version 2.6.20) > > The Java version is 1.5.0.12. There are no failed tasks and no > > lost task trackers.. What I observed is the machine only finished > > part of the reduce tasks and became idle. Could the issue come > > from my HDFS since the status showed the transfer rate is so low? > > > > Thanks, > > > > Ming > > > > > > 2007/9/30, Arun C Murthy <[EMAIL PROTECTED]>: > >> Ming Yang, > >> > >> On Sun, Sep 30, 2007 at 01:13:07PM -0400, Ming Yang wrote: > >>> Hi, > >>> > >>> I set up a 2-node Hadoop cluster, whose nodes are all in > >>> the same network and ran the 'grep' example. The map tasks > >>> were distributed among the two machines and ran without any > >>> problem. However, the reduce task, which is running at the slave > >>> node, doesn't seem to finish and stops at 11%. I checked the > >>> reduce task tracker and it shows the following message: > >>> > >>> reduce > copy (5 of 15 at 0.00 MB/s) > > >>> > >>> Can anyone let me know where the problem comes from? > >>> and how to fix it? I really appreciate it! > >>> > >> > >> Could you provide details on the hadoop version, platform etc.? Were there > >> any failed tasks, lost task-trackers? > >> > >> Arun > >> > >>> Thank you, > >>> > >>> Ming Yang > >> > >
