Anyone have any pointers debugging why an odd HDFS close is failing?
Here is the exception I'm getting.
2007-08-22 21:45:21,459 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 9000, call
complete(/bfd/hadoop-stack-data/tmp/hbase/compaction.tmp/hregion_hbaserepository,,8918388410463499185/repo/mapfiles/-1/data,
DFSClient_1857293290) from 208.76.44.139:52301: error:
java.io.IOException: Unknown file:
/bfd/hadoop-stack-data/tmp/hbase/compaction.tmp/hregion_hbaserepository,,8918388410463499185/repo/mapfiles/-1/data
java.io.IOException: Unknown file:
/bfd/hadoop-stack-data/tmp/hbase/compaction.tmp/hregion_hbaserepository,,8918388410463499185/repo/mapfiles/-1/data
at org.apache.hadoop.dfs.FSDirectory.addBlocks(FSDirectory.java:561)
at
org.apache.hadoop.dfs.FSNamesystem.completeFileInternal(FSNamesystem.java:1002)
at
org.apache.hadoop.dfs.FSNamesystem.completeFile(FSNamesystem.java:952)
at org.apache.hadoop.dfs.NameNode.complete(NameNode.java:348) at
sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:566)
...
Its an open, write a few records and then a close. Usually it works.
My hadoop is TRUNK, perhaps a couple of hours old (r567876). Nothing in
dmesg. On this machine I only have 1024 file descriptors but I'd expect
to see complaint about file handles if this were the issue.
Thanks,
St.Ack