I have been using this extensively, I think the version prior to the
addition of the directory write operations.
I see high reliability when the fuse_dfs is run ON the master name node,
I see low reliability when run on other machines.
I was running hadoop streaming job, that for each record copied out a
100k-1M file into tmp, via fuse_dfs and ran an operation on it.
It appeared that the JVM's were crashing - I wonder if there wasn't a
large enough ram size but the error logs are getting lost unless I run
the fuse debug from the command line.
Pete Wyckoff (JIRA) wrote:
[
https://issues.apache.org/jira/browse/HADOOP-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pete Wyckoff updated HADOOP-4:
------------------------------
Attachment: fuse-dfs.tar.gz
Here's a version with configure to make things easier.
Just run bootstrap.sh after setting the right hdfs, fuse and jdk paths.
I still haven't added a version # (next on my list) or better docs (next next
on my list).
--- pete
tool to mount dfs on linux
--------------------------
Key: HADOOP-4
URL: https://issues.apache.org/jira/browse/HADOOP-4
Project: Hadoop Core
Issue Type: Improvement
Components: fs
Affects Versions: 0.5.0
Environment: linux only
Reporter: John Xing
Assignee: Doug Cutting
Attachments: fuse-dfs.tar.gz, fuse-dfs.tar.gz,
fuse-hadoop-0.1.0_fuse-j.2.2.3_hadoop.0.5.0.tar.gz,
fuse-hadoop-0.1.0_fuse-j.2.4_hadoop.0.5.0.tar.gz, fuse-hadoop-0.1.1.tar.gz,
fuse-j-hadoopfs-03.tar.gz, fuse_dfs.c, fuse_dfs.c, Makefile
tool to mount dfs on linux
--
Jason Venner
Attributor - Publish with Confidence <http://www.attributor.com/>
Attributor is hiring Hadoop Wranglers, contact if interested