[ceph-users] Hostname not found error

2014-02-04 Thread Sahana
Hi I am trying to form ceph cluster using ceph-deploy. I generated ssh-keygen, copied key to all ceph nodes, then added user and hostname in ~/.ssh/config file : cat /home/ems/.ssh/config Host host1 Hostname aa.bbb.cc.d #ip User user For sample I ran purge command, I get this error: ceph-de

Re: [ceph-users] RGW Replication

2014-02-04 Thread Josh Durgin
On 02/04/2014 07:44 PM, Craig Lewis wrote: On 2/4/14 17:06 , Craig Lewis wrote: On 2/4/14 14:43 , Yehuda Sadeh wrote: Does it ever catching up? You mentioned before that most of the writes went to the same two buckets, so that's probably one of them. Note that writes to the same bucket are b

Re: [ceph-users] RGW Replication

2014-02-04 Thread Craig Lewis
On 2/4/14 17:06 , Craig Lewis wrote: On 2/4/14 14:43 , Yehuda Sadeh wrote: Does it ever catching up? You mentioned before that most of the writes went to the same two buckets, so that's probably one of them. Note that writes to the same bucket are being handled in-order by the agent. Yehuda

Re: [ceph-users] RGW Replication

2014-02-04 Thread Yehuda Sadeh
On Tue, Feb 4, 2014 at 5:06 PM, Craig Lewis wrote: > > > On 2/4/14 14:43 , Yehuda Sadeh wrote: > > Now that objects are missing in the slave, how do I fix it? radosgw-agent > --sync-scope=full ? > > That would do it, yes. > > > I'm hesitant to do this, at least until I understand what's going on

Re: [ceph-users] RGW Replication

2014-02-04 Thread Yehuda Sadeh
On Tue, Feb 4, 2014 at 2:21 PM, Craig Lewis wrote: > > Craig Lewis > Senior Systems Engineer > Office +1.714.602.1309 > Email cle...@centraldesktop.com > > Central Desktop. Work together in ways you never thought possible. > Connect with us Website | Twitter | Facebook | LinkedIn | Blog

Re: [ceph-users] RGW Replication

2014-02-04 Thread Craig Lewis
*Craig Lewis* Senior Systems Engineer Office +1.714.602.1309 Email cle...@centraldesktop.com *Central Desktop. Work together in ways you never thought possible.* Connect with us Website | Twitter

Re: [ceph-users] ceph interactive mode tab completion

2014-02-04 Thread Ahmed Kamal
That would indeed be awesome! On Tue, Feb 4, 2014 at 12:28 AM, Ben Sherman wrote: > Hello all, > > I noticed ceph has an interactive mode. > > I did quick search and I don't see that tab completion is in there, > but there are some mentions of readline in the source, so I'm > wondering if it is

[ceph-users] Ceph MON can no longer join quorum

2014-02-04 Thread Greg Poirier
I have a MON that at some point lost connectivity to the rest of the cluster and now cannot rejoin. Each time I restart it, it looks like it's attempting to create a new MON and join the cluster, but the rest of the cluster rejects it, because the new one isn't in the monmap. I don't know why it

Re: [ceph-users] Low RBD Performance

2014-02-04 Thread Gruher, Joseph R
>> Ultimately this seems to be an FIO issue. If I use "--iodepth X" or "-- >iodepth=X" on the FIO command line I always get queue depth 1. After >switching to specifying "iodepth=X" in the body of the FIO workload file I do >get the desired queue depth and I can immediately see performance is muc

Re: [ceph-users] Performance issues running vmfs on top of Ceph

2014-02-04 Thread Maciej Bonin
Hello Brad, We are using iscsi via tgt with ESXi: > And yes it we are using iscsi via tgtd from the ceph-extras repo I believe > (in response to a message I just noticed come in while I was typing) Regards, Maciej Bonin Systems Engineer | M247 Limited M247.com  Connected with our Customers Conta

Re: [ceph-users] RGW Replication

2014-02-04 Thread Yehuda Sadeh
On Tue, Feb 4, 2014 at 10:07 AM, Craig Lewis wrote: > > > > On 2/3/14 14:34 , Craig Lewis wrote: > > > On 2/3/14 10:51 , Gregory Farnum wrote: > > On Mon, Feb 3, 2014 at 10:43 AM, Craig Lewis > wrote: > > I've been noticing somethings strange with my RGW federation. I added some > statistics to

Re: [ceph-users] Performance issues running vmfs on top of Ceph

2014-02-04 Thread McNamara, Bradley
Just for clarity since I didn't see it explained, but how are you accessing Ceph using ESXI? Is it via iscsi or NFS? Thanks. Brad McNamara -Original Message- From: ceph-users-boun...@lists.ceph.com [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Maciej Bonin Sent: Tuesday, Feb

Re: [ceph-users] Low RBD Performance

2014-02-04 Thread Mark Nelson
On 02/04/2014 01:08 PM, Gruher, Joseph R wrote: -Original Message- From: Gregory Farnum [mailto:g...@inktank.com] Sent: Tuesday, February 04, 2014 9:46 AM To: Gruher, Joseph R Cc: Mark Nelson; ceph-users@lists.ceph.com; Ilya Dryomov Subject: Re: [ceph-users] Low RBD Performance On Tue

Re: [ceph-users] Low RBD Performance

2014-02-04 Thread Gruher, Joseph R
>-Original Message- >From: Gregory Farnum [mailto:g...@inktank.com] >Sent: Tuesday, February 04, 2014 9:46 AM >To: Gruher, Joseph R >Cc: Mark Nelson; ceph-users@lists.ceph.com; Ilya Dryomov >Subject: Re: [ceph-users] Low RBD Performance > >On Tue, Feb 4, 2014 at 9:29 AM, Gruher, Joseph R

Re: [ceph-users] Performance issues running vmfs on top of Ceph

2014-02-04 Thread Maciej Bonin
Hello again, Having said that we seem to have improved the performance by following http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1033665 after we figured out there might be a mismatch between reported and actually supported capabilities. Thank yo

Re: [ceph-users] Performance issues running vmfs on top of Ceph

2014-02-04 Thread Maciej Bonin
Hello Mark, Thanks for getting back to me. We do have a couple of vms running that were migrated off xen that are fine, performance in rados bench is what one would expect (maxing the 4xgigabit bond). The only other time I've noticed similar issues is when running mkfs.ext[3-4] on new images, w

Re: [ceph-users] Performance issues running vmfs on top of Ceph

2014-02-04 Thread Neil Levine
Also, how are you accessing Ceph - is it using the TGT iSCSI package? On Tue, Feb 4, 2014 at 10:10 AM, Mark Nelson wrote: > On 02/04/2014 11:55 AM, Maciej Bonin wrote: > >> Hello guys, >> >> We're testing running an esxi hv on top of a ceph backend and we're >> getting abysmal performance when u

Re: [ceph-users] Performance issues running vmfs on top of Ceph

2014-02-04 Thread Mark Nelson
On 02/04/2014 11:55 AM, Maciej Bonin wrote: Hello guys, We're testing running an esxi hv on top of a ceph backend and we're getting abysmal performance when using vmfs, has anyone else tried this successful, any advice ? Would be really thankful for any hints. Hi! I don't have a ton of expe

[ceph-users] Performance issues running vmfs on top of Ceph

2014-02-04 Thread Maciej Bonin
Hello guys, We're testing running an esxi hv on top of a ceph backend and we're getting abysmal performance when using vmfs, has anyone else tried this successful, any advice ? Would be really thankful for any hints. Regards, Maciej Bonin Systems Engineer | M247 Limited M247.com  Connected with

Re: [ceph-users] Low RBD Performance

2014-02-04 Thread Gregory Farnum
On Tue, Feb 4, 2014 at 9:29 AM, Gruher, Joseph R wrote: > > >>-Original Message- >>From: ceph-users-boun...@lists.ceph.com [mailto:ceph-users- >>boun...@lists.ceph.com] On Behalf Of Mark Nelson >>Sent: Monday, February 03, 2014 6:48 PM >>To: ceph-users@lists.ceph.com >>Subject: Re: [ceph-u

Re: [ceph-users] Low RBD Performance

2014-02-04 Thread Gruher, Joseph R
>-Original Message- >From: ceph-users-boun...@lists.ceph.com [mailto:ceph-users- >boun...@lists.ceph.com] On Behalf Of Mark Nelson >Sent: Monday, February 03, 2014 6:48 PM >To: ceph-users@lists.ceph.com >Subject: Re: [ceph-users] Low RBD Performance > >On 02/03/2014 07:29 PM, Gruher, Jose

Re: [ceph-users] poor data distribution

2014-02-04 Thread Dominik Mostowiec
Hi, Thanks for Your help !! We've done again 'ceph osd reweight-by-utilization 105' Cluster stack on 10387 active+clean, 237 active+remapped; More info in attachments. -- Regards Dominik 2014-02-04 Sage Weil : > Hi, > > I spent a couple hours looking at your map because it did look like there >

[ceph-users] i'm stuck with one stuck pg

2014-02-04 Thread Ingo Ebel
Hey, I've got a mini cluster and one pg I can't get clean. I tried everything. Maybe someone here has an idea? Or can I just delete this pg somehow cause it has no objects... I'm use as tunables: tunable choose_local_tries 0 tunable choose_local_fallback_tries 0 tunable choose_total_tries 50