hdfs fuse mount and namenode out of memory conditions.

2008-11-17 Thread Jason Venner
We recently setup a fuse mount using the 18.2 fuse code, against our 18.1 hdfs, which has been running stably for some time. We have about 20 datanodes and 50TB or so in our hdfs. The namenode is running an i686 kernel and has been running with -Xmx1500m. We have 1,492,093 files in our hdfs

Re: hdfs fuse mount and namenode out of memory conditions.

2008-11-17 Thread Pete Wyckoff
Hi Jason, There's nothing that fuse does that should cause this I don't think. If this is a cat operation, fuse will do this in chunks of 32 K which you can change by mounting with -ordbuffer_size=#bytes. Do you have the stack trace or the NN log while this app is running? Were you doing the