On Mon, 21 Jul 2008, Padraig O'Sullivan wrote: > You were right about the osds having trouble initializing. The output > I'm getting from the cmonctl commands looks like what you expected: > > # ./cmonctl mds stat > mon0 <- 'mds stat' > mon0 -> 'e2: 1 nodes: 1 up:creating' (0) > # ./cmonctl pg stat > mon0 <- 'pg stat' > mon0 -> 'v5: 1152 pgs: 1152 creating; 0 KB used, 0 KB / 0 KB free' (0) > # > > So there is definitely something up with btrfs here (I guess btrfs is > far from stable so I can't complain) since I have had no issues when > setting up a cluster with block devices. I have debugging enabled on > the osd daemons and have been having a look through their log files. I > have 2 storage nodes and in the log file for the first one (after some > initialization messages), I keep seeing the following lines repeated > over and over: > [...] > I'm not really sure what these messages mean in the log files as I'm > not that familiar with Ceph internally yet. Do you have any pointers > or ideas (based on this limited information) on what's going on here? > Or if you have any suggestions on other log files to look at?
Since things behave with ebofs, a wild guess would be that you're not running cosd as root, and cosd isn't gracefully failing? And/or the transaction ioctls are failing gracefully. It's probably not btrfs's fault, either way. Can you email me the full osd output? > I've read through the USENIX paper describing the architecture and I'm > starting to go through the source code to gain a better understanding > of how everything works which I hope will also help me in > understanding what the messages in the log files mean (or at least > where they are coming from). I'm taking a grad course in HPC in the > Fall which involves a significant project and I was hoping to do a > project with Ceph as I find it pretty interesting and I'd like to be > able to contribute to an open source project. I know this is quite > off-topic now but are the projects suggested for Google's summer of > code still available for someone to work on? Absolutely. Let me know which if any of those idea sound interesting. sage ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Ceph-devel mailing list Ceph-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ceph-devel
