[Gluster-users] MapReduce on glusterfs in Hadoop

2013-02-22 Thread Nikhil Agarwal
Hi All, Thanks a lot for taking out your time to answer my question. I am trying to implement a file system in hadoop under irg.apache.hadoop.fs package something similar to KFS, glusterfs, etc. I wanted to know is that in README.txt of glusterfs it is mentioned : # ./bin/start-mapred.sh

[Gluster-users] help posix_fallocate too slow on glusterfs client

2013-02-22 Thread 符永涛
Dear gluster experts, Recently I have encountered a problem about posix_fallocate performance on glusterfs client. I use posix_fallocate to allocate a file with specified size on glusterfs client. For example if I create a file with size of 1907658896, it will take about 20 seconds on glusterfs

[Gluster-users] Sync status of underlying bricks for replicated volume

2013-02-22 Thread Sejal1 S
Hi Gluster Experts, I am trying in integrate glusterfs as a replication file system in my product. As a background, I will be creating a distributed replicated (glusterfs) volume on two bricks present on two different server. Can you please guide me to find out the sync status of all bricks

Re: [Gluster-users] I/O error repaired only by owner or root access

2013-02-22 Thread Rajesh Amaravathi
Hi Dan, Could you please provide the following info (1) the exact permissions of the file you are accessing and its parent directory, (2) the user from which 'ls -l' is issued, and (3) the owner of the file, and the parent directory. You could open a bug for it if it is seen several times.

[Gluster-users] Is having millions of directories unusual?

2013-02-22 Thread Dan Bretherton
Dear All- I have just discovered that the volume I've been having the most trouble with contains over 3.3 million directories. Most of these are output from a storm tracking model that produces output in a large number of directories, each containing a handful of small files. Is this number

Re: [Gluster-users] MapReduce on glusterfs in Hadoop

2013-02-22 Thread Jay Vyas
Hi nithin: The fuse mount is what allows the filesystem to access distributed files in gluster: that is, GlusterFS has its own fuse mount ... And GlusterFileSystem wraps that in hadoop FileSystem semantics. Meanwhile, The mapreduce jobs are invoked using on custom core-site and mapred-site

Re: [Gluster-users] Bug in log rotation for 3.3.1

2013-02-22 Thread Joe Julian
Yes, I am aware. Louis' packaging is part of the official debian development and bugs against it are tracked at launchpad. Toby Corkindale toby.corkind...@strategicdata.com.au wrote: On 22/02/13 11:18, Joe Julian wrote: On 02/20/2013 05:05 PM, Toby Corkindale wrote:

[Gluster-users] Peer Probe

2013-02-22 Thread Tony Saenz
Hey, I was wondering if I could get a bit of help.. I installed a new Infiniband card into my servers but I'm unable to get it to come up as a peer. Is there something I'm missing? [root@fpsgluster testvault]# gluster peer probe fpsgluster2ib Probe on host fpsgluster2ib port 0 already in peer