I have been using this extensively, I think the version prior to the addition of the directory write operations. I see high reliability when the fuse_dfs is run ON the master name node, I see low reliability when run on other machines.

I was running hadoop streaming job, that for each record copied out a 100k-1M file into tmp, via fuse_dfs and ran an operation on it.

It appeared that the JVM's were crashing - I wonder if there wasn't a large enough ram size but the error logs are getting lost unless I run the fuse debug from the command line.

Pete Wyckoff (JIRA) wrote:
     [ 
https://issues.apache.org/jira/browse/HADOOP-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pete Wyckoff updated HADOOP-4:
------------------------------

    Attachment: fuse-dfs.tar.gz

Here's a version with configure to make things easier.

Just run bootstrap.sh after setting the right hdfs, fuse and jdk paths.

I still haven't added a version # (next on my list) or better docs (next next 
on my list).

--- pete


tool to mount dfs on linux
--------------------------

                Key: HADOOP-4
                URL: https://issues.apache.org/jira/browse/HADOOP-4
            Project: Hadoop Core
         Issue Type: Improvement
         Components: fs
   Affects Versions: 0.5.0
        Environment: linux only
           Reporter: John Xing
           Assignee: Doug Cutting
        Attachments: fuse-dfs.tar.gz, fuse-dfs.tar.gz, 
fuse-hadoop-0.1.0_fuse-j.2.2.3_hadoop.0.5.0.tar.gz, 
fuse-hadoop-0.1.0_fuse-j.2.4_hadoop.0.5.0.tar.gz, fuse-hadoop-0.1.1.tar.gz, 
fuse-j-hadoopfs-03.tar.gz, fuse_dfs.c, fuse_dfs.c, Makefile


tool to mount dfs on linux

--
Jason Venner
Attributor - Publish with Confidence <http://www.attributor.com/>
Attributor is hiring Hadoop Wranglers, contact if interested

Reply via email to