see this error ava.io.IOException: Incompatible clusterIDs in /home/yarn/hadoop-2.2.0/hdfs/dn: namenode clusterID = CID-c91ccd10-8ea0-4fb3-9037-d5f57694674e; datanode clusterID = CID-89e2e0b8-2d61-4d6a-9424-ab46e4f83cab
Did you format your namenode ? after formatting the namenode did you delete the contents for datanode directory? On Wed, Jul 2, 2014 at 2:24 PM, EdwardKing <[email protected]> wrote: > I find logs,but I don't know how to do it. Thanks > > 2014-07-02 01:07:38,473 FATAL > org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for > block pool Block pool BP-279671289-127.0.0.1-1404285849267 (storage id > DS-601761441-127.0.0.1-50010-1404205370190) service to localhost/ > 127.0.0.1:9000 > java.io.IOException: Incompatible clusterIDs in > /home/yarn/hadoop-2.2.0/hdfs/dn: namenode clusterID = > CID-c91ccd10-8ea0-4fb3-9037-d5f57694674e; datanode clusterID = > CID-89e2e0b8-2d61-4d6a-9424-ab46e4f83cab > at > org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:391) > at > org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:191) > at > org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:219) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:837) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:808) > at > org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:280) > at > org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:222) > at > org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:664) > at java.lang.Thread.run(Thread.java:745) > 2014-07-02 01:07:38,489 WARN > org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service > for: Block pool BP-279671289-127.0.0.1-1404285849267 (storage id > DS-601761441-127.0.0.1-50010-1404205370190) service to localhost/ > 127.0.0.1:9000 > 2014-07-02 01:07:38,601 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: Removed Block pool > BP-279671289-127.0.0.1-1404285849267 (storage id > DS-601761441-127.0.0.1-50010-1404205370190) > 2014-07-02 01:07:40,602 WARN > org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode > 2014-07-02 01:07:40,606 INFO org.apache.hadoop.util.ExitUtil: Exiting with > status 0 > 2014-07-02 01:07:40,610 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG: > /************************************************************ > SHUTDOWN_MSG: Shutting down DataNode at localhost.localdomain/127.0.0.1 > ************************************************************/ > 2014-07-02 01:08:34,956 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG: > /************************************************************ > > > > ----- Original Message ----- > *From:* Nitin Pawar <[email protected]> > *To:* [email protected] > *Sent:* Wednesday, July 02, 2014 4:49 PM > *Subject:* Re: why hadoop-daemon.sh stop itself > > pull out the logs from datanode log file > > it will tell why it stopped > > > On Wed, Jul 2, 2014 at 2:05 PM, EdwardKing <[email protected]> wrote: > >> I use hadoop2.2.0 , I start hadoop-daemon service,like follows: >> >> [hdfs@localhost logs]$ hadoop-daemon.sh start namenode >> [hdfs@localhost logs]$ hadoop-daemon.sh start secondarynamenode >> [hdfs@localhost logs]$ hadoop-daemon.sh start datanode >> [hdfs@localhost logs]$ jps >> 4135 NameNode >> 4270 SecondaryNameNode >> 4331 DataNode >> 4364 Jps >> >> After a while,when I use jps command,I find datanode is disappeared.Why? >> [hdfs@localhost logs]$ jps >> 4135 NameNode >> 4270 SecondaryNameNode >> 4364 Jps >> >> >> >> --------------------------------------------------------------------------------------------------- >> Confidentiality Notice: The information contained in this e-mail and any >> accompanying attachment(s) >> is intended only for the use of the intended recipient and may be >> confidential and/or privileged of >> Neusoft Corporation, its subsidiaries and/or its affiliates. If any >> reader of this communication is >> not the intended recipient, unauthorized use, forwarding, printing, >> storing, disclosure or copying >> is strictly prohibited, and may be unlawful.If you have received this >> communication in error,please >> immediately notify the sender by return e-mail, and delete the original >> message and all copies from >> your system. Thank you. >> >> --------------------------------------------------------------------------------------------------- >> > > > > -- > Nitin Pawar > > > --------------------------------------------------------------------------------------------------- > Confidentiality Notice: The information contained in this e-mail and any > accompanying attachment(s) > is intended only for the use of the intended recipient and may be > confidential and/or privileged of > Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader > of this communication is > not the intended recipient, unauthorized use, forwarding, printing, > storing, disclosure or copying > is strictly prohibited, and may be unlawful.If you have received this > communication in error,please > immediately notify the sender by return e-mail, and delete the original > message and all copies from > your system. Thank you. > > --------------------------------------------------------------------------------------------------- > -- Nitin Pawar
