problems when hadoop runs upon ceph

2012-03-24 Thread lixiaobing10
Hi ceph-devel, I installed ceph-0.44, which can be mounted by ceph-fuse correctly. Besides, hadoop-0.20.205.0 patched with hadoop-0.20.205.0-cephfs1.patch can run correctly too, but with hdfs as the underlying fs. (refered to http://ceph.newdream.net/wiki/Hadoop_FileSystem) However, when I

How to read CRUSH source code efficiently?

2012-03-24 Thread 胡瀚森
After reading the thesis about CRUSH, I proceed to read the related source code in order to understand it more deeply and thoroughly. But it's seems not to be efficient to read the source code files in src/crush one by one. I'd like to know where should I start? I think the pseudo code Algorithm

Re: problems when hadoop runs upon ceph

2012-03-24 Thread Noah Watkins
On Mar 24, 2012, at 12:18 AM, lixiaobin...@otcaix.iscas.ac.cn wrote: 12/03/24 14:45:47 INFO ceph.CephFileSystem: initialize:Ceph initialization arguments: CephFSInterface -k /data/keyring.mds.0 -n client.admin --auth-supported=cephx -m 192.168.122.201:6789

Re: Mysteriously poor write performance

2012-03-24 Thread Andrey Korolyov
http://xdel.ru/downloads/ceph-logs-dbg/ On Fri, Mar 23, 2012 at 9:53 PM, Samuel Just sam.j...@dreamhost.com wrote: (CCing the list) Actually, can you could re-do the rados bench run with 'debug journal = 20' along with the other debugging?  That should give us better information. -Sam On