Hi
There were no errors in the logs untill I started a job, for example
distcopy
Then I got next stack
2008-11-19 08:55:15,407 INFO org.apache.hadoop.fs.FSNamesystem: Number of
transactions: 6 Total time for transactions(ms): 1 Number of syncs: 3
SyncTimes(ms): 25018
2008-11-19 08:55:46,642 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 50001, call
addBlock(/mnt/hadoop/mapred/system/distcp_c46kkq/_distcp_src_files,
DFSClient_1391490560) from 10.254.82.67:43861: error: java.io.IOException:
File /mnt/hadoop/mapred/system/distcp_c46kkq/_distcp_src_files could only be
replicated to 0 nodes, instead of 1
java.io.IOException: File
/mnt/hadoop/mapred/system/distcp_c46kkq/_distcp_src_files could only be
replicated to 0 nodes, instead of 1
at
org.apache.hadoop.dfs.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1120)
at org.apache.hadoop.dfs.NameNode.addBlock(NameNode.java:330)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
2008-11-19 08:55:47,051 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3
But there is nothing surprising. As there are no live datanodes of course FS
is not working.
It's amazing but after that I re-create EC2 server again cluster started
working and nodes get added just after startup. Don't know what was the
problem.
But still the question why datanodes didn't work until I had restarted them.
Alexander
2008/11/20 David Wei <[EMAIL PROTECTED]>
> Hi, Alexander,
>
> Maybe you can paste the logs of this 2 datanodes here then we can help to
> identify the problems.
>
> David
>
> Alexander Aristov 写道:
>
>> Hi all
>>
>> I run hadoop cluster on Amazon EC2 servers. I start clusterof 2 data nodes
>> and then open job tracker to read status. It shows me that 2 data nodes as
>> expected. It's ok.
>>
>> Then I open FS monitoring page (host:50070). And it shows me that the
>> cluster has 0 live nodes and 0 dead nodes. So it says there are no
>> datanodes
>> at all and hence hadoop file system is not working.
>>
>> But if I reboot the two datanodes then they get added as a new datanodes
>> (3
>> and 4) on the job tracker page and they become alive on the other page.
>> HDFS
>> becomes working.
>>
>> What can be a problem that hadoop doesn't add datanodes on startup but
>> adds
>> them after rebooting.
>>
>> --
>> Best Regards
>> Alexander Aristov
>> .
>>
>>
>>
>
>
>
--
Best Regards
Alexander Aristov