Re: [ceph-users] Ceph on ArmHF Ubuntu 14.4LTS?

2014-12-22 Thread Christopher Kunz
Am 22.12.14 um 16:10 schrieb Gregory Farnum: > On Sun, Dec 21, 2014 at 11:54 PM, Christopher Kunz > wrote: >> Hi all, >> >> I'm trying to get a working PoC installation of Ceph done on an armhf >> platform. I'm failing to find working Ceph packages (so does >> ceph-deploy, too) for Ubuntu Trusty L

Re: [ceph-users] Weird scrub problem

2014-12-22 Thread Samuel Just
Oh, that's a bit less interesting. The bug might be still around though. -Sam On Mon, Dec 22, 2014 at 2:50 PM, Andrey Korolyov wrote: > On Tue, Dec 23, 2014 at 1:12 AM, Samuel Just wrote: >> You'll have to reproduce with logs on all three nodes. I suggest you >> open a high priority bug and at

[ceph-users] Any Good Ceph Web Interfaces?

2014-12-22 Thread Tony
Please don't mention calamari :-) The best web interface for ceph that actually works with RHEL6.6 Preferable something in repo and controls and monitors all other ceph osd, mon, etc. Take everything and live for the moment. ___ ceph-users mailing lis

Re: [ceph-users] 1256 OSD/21 server ceph cluster performance issues.

2014-12-22 Thread Sean Sullivan
Awesome! I have yet to hear of any zfs in ceph chat nor have I seen it on the mailing lists that I have caught. I would assume it would function pretty well considering how long it has been in use along some production systems I have seen. I have little to no experience with it personally though.

Re: [ceph-users] OSD & JOURNAL not associated - ceph-disk list ?

2014-12-22 Thread Loic Dachary
Hi Florent, On 22/12/2014 19:49, Florent MONTHEL wrote: > Hi Loic, Hi Robert, > > Thanks. I’m integrating CEPH OSD with OpenSVC services > (http://www.opensvc.com) so I have to generate UUID myself in order to map > services > It’s the reason for that I’m generating sgdisk commands with my own

Re: [ceph-users] 1256 OSD/21 server ceph cluster performance issues.

2014-12-22 Thread Craig Lewis
On Mon, Dec 22, 2014 at 2:57 PM, Sean Sullivan wrote: > Thanks Craig! > > I think that this may very well be my issue with osds dropping out but I > am still not certain as I had the cluster up for a small period while > running rados bench for a few days without any status changes. > Mine were

Re: [ceph-users] Weird scrub problem

2014-12-22 Thread Andrey Korolyov
On Tue, Dec 23, 2014 at 1:12 AM, Samuel Just wrote: > You'll have to reproduce with logs on all three nodes. I suggest you > open a high priority bug and attach the logs. > > debug osd = 20 > debug filestore = 20 > debug ms = 1 > > I'll be out for the holidays, but I should be able to look at it

Re: [ceph-users] 1256 OSD/21 server ceph cluster performance issues.

2014-12-22 Thread Sean Sullivan
Hello Christian, Sorry for the long wait. Actually I have done a rados bench earlier on in the cluster without any failure but it did take a while. That and there is actually a lot of data being downloaded to the cluster now. Here are the rados results for 100 seconds:: http://pastebin.com/q5E6Jjk

Re: [ceph-users] Weird scrub problem

2014-12-22 Thread Samuel Just
You'll have to reproduce with logs on all three nodes. I suggest you open a high priority bug and attach the logs. debug osd = 20 debug filestore = 20 debug ms = 1 I'll be out for the holidays, but I should be able to look at it when I get back. -Sam On Mon, Dec 22, 2014 at 12:52 PM, Andrey Kor

Re: [ceph-users] ceph-deploy & state of documentation [was: OSD & JOURNAL not associated - ceph-disk list ?]

2014-12-22 Thread Mark Kirkwood
On 22/12/14 07:37, Nico Schottelius wrote: Hello list, I am a bit wondering about "ceph-deploy" and the development of ceph: I see that many people in the community are pushing towards the use of ceph-deploy, likely to ease use of ceph. However, I have run multiple times into issues using ceph-

Re: [ceph-users] Weird scrub problem

2014-12-22 Thread Andrey Korolyov
On Mon, Dec 22, 2014 at 11:50 PM, Samuel Just wrote: > So > 4.458_head/DIR_8/DIR_5/DIR_4/DIR_F/rbd\\udata.cbba8a759d2.0a5b__head_6F0DF458__4 > is present on osd 3, osd 34, and osd 10? > -Sam > Yes, exactly, and have same checksum. ___ ceph-

Re: [ceph-users] Weird scrub problem

2014-12-22 Thread Samuel Just
So 4.458_head/DIR_8/DIR_5/DIR_4/DIR_F/rbd\\udata.cbba8a759d2.0a5b__head_6F0DF458__4 is present on osd 3, osd 34, and osd 10? -Sam On Mon, Dec 22, 2014 at 8:36 AM, Andrey Korolyov wrote: > Hello, > > I am currently facing some strange problem, most probably a bug (osd.3 > is a primary

Re: [ceph-users] ceph-deploy & state of documentation [was: OSD & JOURNAL not associated - ceph-disk list ?]

2014-12-22 Thread Nico Schottelius
Yes - we are mostly using cdist [0] and also plan to support ceph mid term. The website is by the way running on a VM managed with Opennebula and stored on the ceph cluster - so in case it is not reachable, you can guess why ;-) [0] http://www.nico.schottelius.org/software/cdist/ Craig Lewis [Mo

Re: [ceph-users] ceph-deploy & state of documentation [was: OSD & JOURNAL not associated - ceph-disk list ?]

2014-12-22 Thread Craig Lewis
I get the impression that more people on the ML are using a config management system. ceph-deploy questions seem to come from new users following the quick start guide. I know both Puppet and Chef are fairly well represented here. I've seen a few posts about Salt and Ansible, but not much. Cala

Re: [ceph-users] Slow requests: waiting_for_osdmap

2014-12-22 Thread Wido den Hollander
On 12/22/2014 07:42 PM, Gregory Farnum wrote: > On Mon, Dec 22, 2014 at 10:30 AM, Wido den Hollander wrote: > >> For example, two ops: >> >> #1: >> >> { "description": "osd_sub_op(client.2433432.0:61603164 20.424 >> 19038c24\/rbd_data.d7c912ae8944a.08b6\/head\/\/20 [] v >> 63283'83010

Re: [ceph-users] Slow requests: waiting_for_osdmap

2014-12-22 Thread Gregory Farnum
On Mon, Dec 22, 2014 at 10:30 AM, Wido den Hollander wrote: > For example, two ops: > > #1: > > { "description": "osd_sub_op(client.2433432.0:61603164 20.424 > 19038c24\/rbd_data.d7c912ae8944a.08b6\/head\/\/20 [] v > 63283'8301089 snapset=0=[]:[] snapc=0=[])", > "received_at

Re: [ceph-users] OSD & JOURNAL not associated - ceph-disk list ?

2014-12-22 Thread Florent MONTHEL
Hi Loic, Hi Robert, Thanks. I’m integrating CEPH OSD with OpenSVC services (http://www.opensvc.com ) so I have to generate UUID myself in order to map services It’s the reason for that I’m generating sgdisk commands with my own UUID After activating OSD, I don’t have ma

Re: [ceph-users] Slow requests: waiting_for_osdmap

2014-12-22 Thread Wido den Hollander
On 12/22/2014 07:04 PM, Gregory Farnum wrote: > On Mon, Dec 22, 2014 at 8:20 AM, Wido den Hollander wrote: >> Hi, >> >> While investigating slow requests on a Firefly (0.80.7) I looked at the >> historic ops from the admin socket. >> >> On a OSD which just spitted out some slow requests I noticed:

Re: [ceph-users] Slow requests: waiting_for_osdmap

2014-12-22 Thread Gregory Farnum
On Mon, Dec 22, 2014 at 8:20 AM, Wido den Hollander wrote: > Hi, > > While investigating slow requests on a Firefly (0.80.7) I looked at the > historic ops from the admin socket. > > On a OSD which just spitted out some slow requests I noticed: > > "received_at": "2014-12-22 17:08:41.496

Re: [ceph-users] OSD & JOURNAL not associated - ceph-disk list ?

2014-12-22 Thread Robert LeBlanc
Florent, I had similar issues, even when using ceph-disk. I've fixed it by making sure the part-UUID of the journal partition is the only thing in the file /var/lib/ceph/osd/{cluster}-{OSD#}/journal_uuid and made sure that the /var/lib/ceph/osd/{cluster}-{OSD#}/journal was a symlink to the correct

Re: [ceph-users] ARM v8

2014-12-22 Thread Ken Dreyer
On 12/22/2014 09:28 AM, Loic Dachary wrote: > You will need to compile them from source. Depending on the distribution you > may also want to compile google perftools and tcmalloc: I'm not > sure why exactly but that has been repored to help. I strongly > advise that you run > make check ( or run-m

[ceph-users] Weird scrub problem

2014-12-22 Thread Andrey Korolyov
Hello, I am currently facing some strange problem, most probably a bug (osd.3 is a primary holder): ceph pg scrub 4.458 2014-12-22 19:19:00.238077 osd.3 [ERR] 4.458 osd.34 missing 6f0df458/rbd_data.cbba8a759d2.0a5b/head//4 2014-12-22 19:19:00.238079 osd.3 [ERR] 4.458 osd.10 missing 6

Re: [ceph-users] ARM v8

2014-12-22 Thread Loic Dachary
Hi, You will need to compile them from source. Depending on the distribution you may also want to compile google perftools and tcmalloc: I'm not sure why exactly but that has been repored to help. I strongly advise that you run make check ( or run-make-check.sh if you compile master ) to exerci

[ceph-users] Slow requests: waiting_for_osdmap

2014-12-22 Thread Wido den Hollander
Hi, While investigating slow requests on a Firefly (0.80.7) I looked at the historic ops from the admin socket. On a OSD which just spitted out some slow requests I noticed: "received_at": "2014-12-22 17:08:41.496391", "age": "9.948475", "duration": "5.915489"

Re: [ceph-users] Ceph rbd mapped but files all have 0 byte size

2014-12-22 Thread Yuan Cheng
Dear Ilya, Thank you very much for your reply. Here are more problems to the problem. On Thu, Dec 18, 2014 at 12:09 AM, Ilya Dryomov wrote: > On Tue, Dec 16, 2014 at 6:19 AM, Cyan Cheng wrote: > > Dear All, > > > > We have set up ceph and used it for about one year already. > > > > Here is a s

[ceph-users] ARM v8

2014-12-22 Thread Garg, Pankaj
Hi, Where can I find ARMv8 binaries for Ceph Firefly for either RHEL or Ubuntu? Or do we just have to compile from source files to produce an installable package. Thanks Pankaj ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/

Re: [ceph-users] Ceph on ArmHF Ubuntu 14.4LTS?

2014-12-22 Thread Gregory Farnum
On Sun, Dec 21, 2014 at 11:54 PM, Christopher Kunz wrote: > Hi all, > > I'm trying to get a working PoC installation of Ceph done on an armhf > platform. I'm failing to find working Ceph packages (so does > ceph-deploy, too) for Ubuntu Trusty LTS. The ceph.com repos don't have > anything besides c

Re: [ceph-users] Running ceph in Deis/Docker

2014-12-22 Thread Gregory Farnum
On Sun, Dec 21, 2014 at 8:20 PM, Jimmy Chu wrote: > Hi, > > This is a followup question to my previous question. When the last monitor > in a ceph monitor set is down, what is the proper way to boot up the ceph > monitor set again? > > On one hand, we could try not to make this happen, but on the