HUYLEBROECK Jeremy RD-ILAB-SSF wrote: > On my dev machine, I have dfs.replication set to 1 in > conf/hadoop-site.xml. > > But I get those warning messages in hadoop.log > > Fs.FSNamesystem - Replication requested of 2 is larger than cluster > size(1). Using cluster size. > Zero targets found, forbidden1.size=1 forbidden2.size()=0 > > I don't know where the 2 is coming from as hadoop-default.xml set it to > 3 and the hadoop code uses also 3 by default. > Also, the hadoop-site.xml is read properly (fs config is properly used > for instance) > > Can I completely ignore those warnings or it means that there is > something bad going on? > > I use hadoop-0.4 with nutch-0.8 > >
This could indicate a corrupted file (missing blocks). Please run 'hadoop fsck /' and check the output. -- Best regards, Andrzej Bialecki <>< ___. ___ ___ ___ _ _ __________________________________ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com ------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
