I'm copying data into the ndfs right now, I've had the server crash (bad mem timings oops) it was running 2 datanodes and the namenode. It recovered from a flat out crash perfectly (blue-screen kernel error system beeping windows 2003 64 sucks), I started the datanodes first then the namenode and it replicated data and continued writing of the file. perfect. but here is something people are going to run into big-time on one of my machines, I'm running nutch on it from a network share, the network share went down and here is what happens. the network stops sending data. it waits saying could not complete file, retrying, now it has all its data it had to send and recieve while it didnt trying to catch up, the bad news is had I not re-connected to the server's share drive the system would of hung waiting untill I did without copying the rest of the 300gbytes of data I'm copying into it @ 5-22mbytes a sec I'll let you know in the morning if it completes, if it is able to recover fully from this data is transfering but it still says could not complete file, retrying every 1/2-1/3 second. good news data rates are up to 10mbytes on some machines minimum 4mbytes
Just in case someone has a single machine connected to a nas or iscsi or nfs or even crappy samba and experiences a network outage. -Jay ------------------------------------------------------- SF.Net email is Sponsored by the Better Software Conference & EXPO September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf _______________________________________________ Nutch-developers mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-developers
