Bryan Duxbury wrote:
Ok, so, what might I do next to try and diagnose this? Does it sound like it might be an HDFS/mapreduce bug, or should I pore over my own code first?
>
Also, did any of the other exceptions look interesting?
The exceptions closest to the failure time would be most important.. which are those? You can start from there.
At a given time, check /proc/pid/fs (on linux) to verify you actually have only one block open. Most likely that is not the case. Then you can try to figure out how many blocks are open (from Datanode log),.. then what files they belong to etc.
hope this helps. Raghu.
