Just a heads up on this, we've run into problems when trying to use fuse to mount dfs running on port :8020. However, it works fine when we ran it on :9000.
-paul On Thu, Apr 22, 2010 at 7:59 PM, Brian Bockelman <[email protected]>wrote: > Hey Christian, > > I've run into this before. > > Make sure that the hostname/port you give to fuse is EXACTLY the same as > listed in hadoop-site.xml. > > If these aren't the same text string (including the ":8020"), then you get > those sort of issues. > > Brian > > On Apr 22, 2010, at 5:00 AM, Christian Baun wrote: > > > Dear All, > > > > I want to test HDFS inside Amazon EC2. > > > > Two Ubuntu instances are running inside EC2. > > One server is namenode and jobtracker. The other server is the datanode. > > Cloudera (hadoop-0.20) is installed and running. > > > > Now, I want to mount HDFS. > > I tried to install contrib/fuse-dfs as described here: > > http://wiki.apache.org/hadoop/MountableHDFS > > > > The compilation worked via: > > > > # ant compile-c++-libhdfs -Dlibhdfs=1 > > # ant package -Djava5.home=/usr/lib/jvm/java-1.5.0-sun-1.5.0.06/ > -Dforrest.home=/home/ubuntu/apache-forrest-0.8/ > > # ant compile-contrib -Dlibhdfs=1 -Dfusedfs=1 > > > > But now, when I try to mount the filesystem: > > > > # ./fuse_dfs_wrapper.sh dfs:// > ec2-75-101-210-65.compute-1.amazonaws.com:8020 /mnt/hdfs/ -d > > port=8020,server=ec2-75-101-210-65.compute-1.amazonaws.com > > fuse-dfs didn't recognize /mnt/hdfs/,-2 > > fuse-dfs ignoring option -d > > FUSE library version: 2.8.1 > > nullpath_ok: 0 > > unique: 1, opcode: INIT (26), nodeid: 0, insize: 56 > > INIT: 7.13 > > flags=0x0000007b > > max_readahead=0x00020000 > > INIT: 7.12 > > flags=0x00000011 > > max_readahead=0x00020000 > > max_write=0x00020000 > > unique: 1, success, outsize: 40 > > > > > > # ./fuse_dfs_wrapper.sh dfs:// > ec2-75-101-210-65.compute-1.amazonaws.com:8020 /mnt/hdfs/ > > port=8020,server=ec2-75-101-210-65.compute-1.amazonaws.com > > fuse-dfs didn't recognize /mnt/hdfs/,-2 > > > > # ls /mnt/hdfs/ > > ls: reading directory /mnt/hdfs/: Input/output error > > # ls /mnt/hdfs/ > > ls: cannot access /mnt/hdfs/o¢ : No such file or directory > > o??? > > # ls /mnt/hdfs/ > > ls: reading directory /mnt/hdfs/: Input/output error > > # ls /mnt/hdfs/ > > ls: cannot access /mnt/hdfs/`á›Óÿ : No such file or directory > > `????? > > # ls /mnt/hdfs/ > > ls: reading directory /mnt/hdfs/: Input/output error > > ... > > > > > > What can I do at this point? > > > > Thanks in advance > > Christian > >
