Here are some notes I took when installing fuse here on our system. This was
for a hadoop 19.1 installation.
Installing Fuse/Hadoop:
2. mkdir /hdfs/client01
4. Install Sun JDK 1.6 (must be Sun)
a. RPM: jdk-6u14-ea-linux-amd64.rpm
b. This DID NOT WORK:
java version "1.6.0"
OpenJDK Runtime Environment (build 1.6.0-b09)
OpenJDK 64-Bit Server VM (build 1.6.0-b09, mixed mode)
c. Must be this:
java version "1.6.0_14-ea"
Java(TM) SE Runtime Environment (build 1.6.0_14-ea-b04)
Java HotSpot(TM) 64-Bit Server VM (build 14.0-b13, mixed mode)
5. wget
http://newman.ultralight.org/repos/hadoop/4/x86_64/hadoop-0.19.1-7.el4.x86_64.rpm
6. wget
http://newman.ultralight.org/repos/hadoop/4/x86_64/fuse-libs-2.7.4-8_10.el4.x86_64.rpm
7. wget
http://dag.wieers.com/rpm/packages/fuse/fuse-2.7.3-1.el5.rf.x86_64.rpm
OR
wget
http://newman.ultralight.org/repos/hadoop/4/x86_64/fuse-2.7.4-8_10.el4.x86_64.rpm
8. wget
http://newman.ultralight.org/repos/hadoop/4/x86_64/hadoop-fuse-0.19.1-7.el4.x86_64.rpm
9. rpm –ivh hadoop-0.19.1-7.el4.x86_64.rpm
10. rpm –ivh fuse-2.7.3-1.el5.rf.x86_64.rpm
11. rpm –ivh hadoop-fuse-0.19.1-7.el4.x86_64.rpm
12. rpm –ivh fuse-libs-2.7.4-8_10.el4.x86_64.rpm
13. yum install hadoop
14. yum install hadoop-fuse fuse-libs
15. In /etc/fstab:
a. hdfs# /hdfs/client01 fuse
server=<server_hostname>,port=9000,rdbuffer=1048576,allow_other,big_writes 0
0
16. Then execute command:
a. mount /hdfs/client01
b. ls /hdfs/client01
17. References:
a. https://twiki.grid.iu.edu/bin/view/Storage/HadoopInstallation
b. http://wiki.apache.org/hadoop/MountableHDFS
18. Error:
a. After performing a “yum upgrade” on the entire system it broke the
fuse installation:
i. [r...@host1 ~]#
modprobe fuse
FATAL: Module fuse not found.
ii. [r...@host1 ~]# mount
/hdfs/client01
port=11091,server=#A#####
fuse-dfs didn't recognize /hdfs/client01,-2
fuse-dfs ignoring option allow_other
fuse: device not found, try 'modprobe fuse' first
b. Solution: Reinstall newer RPM’s:
i.
fuse-2.7.4-8_10.el5.x86_64.rpm
ii.
fuse-kmdl-2.6.18-128.1.10.el5-2.7.4-8_10.el5.x86_64.rpm
iii.
fuse-libs-2.7.4-8_10.el5.x86_64.rpm
iv.
hadoop-0.19.1-7.el5.x86_64.rpm
v.
hadoop-fuse-0.19.1-8.el5.x86_64.rpm
2009/12/13 lwm <[email protected]>
> Hi all
> I have installed hadoop with version 0.18.2, and I want to use fuse in
> hadoop. Following the src/contrib/fuse-dfs/README, I executed "ant
> compile-contrib -Dlibhdfs=1 -Dfusedfs=1 ", an error occured. I can't fix it.
> Can anyone help me? Or is there a good install guide for me?
> thanks.
> When I executed "ant compile-contrib -Dcompile.c++=1 -Dfusedfs=1
> -Dlibhdfs.noperms=1", it was builded successfully.
>
> compile:
> [echo] contrib: fuse-dfs
> [exec] automake: Makefile.am: required file `./NEWS' not found
> [exec] automake: Makefile.am: required file `./AUTHORS' not found
> [exec] automake: Makefile.am: required file `./ChangeLog' not found
> [exec] src/Makefile.am:19: invalid unused variable name: `AM_LDFLAGS'
> [exec] configure: error: cannot run /bin/bash ./config.sub
> BUILD FAILED
> /home/wm/work/hadoop/build.xml:410: The following error occurred while
> executing this line:
> /home/wm/work/hadoop/src/contrib/build.xml:30: The following error occurred
> while executing this line:
> /home/wm/work/hadoop/src/contrib/fuse-dfs/build.xml:54: exec returned: 1
>
>
>
--
