Re: [ceph-users] EU mirror now supports rsync

Hi Wido, I have a "connection refused" for a few days on your mirror using rsync (via IPv4). Is it a blacklist or an issue ? Thank you Florent On 04/09/2014 08:04 AM, Wido den Hollander wrote: > Hi, > > I just enabled rsync on the eu.ceph.com mirror. > > eu.ceph.com mirrors from Ceph.com every

Re: [ceph-users] cephfs survey results

On Tue, 4 Nov 2014, Blair Bethwaite wrote: > On 4 November 2014 01:50, Sage Weil wrote: > > In the Ceph session at the OpenStack summit someone asked what the CephFS > > survey results looked like. > > Thanks Sage, that was me! > > > Here's the link: > > > > https://www.surveymonkey.com

Re: [ceph-users] Ceph Giant not fixed RepllicatedPG:NotStrimming?

Hi Sam, I resend logs with debug options http://123.30.41.138/ceph-osd.21.log (Sorry about my spam :D) I saw many missing objects :| 2014-11-04 15:26:02.205607 7f3ab11a8700 10 osd.21 pg_epoch: 106407 pg[24.7d7( v 106407'491583 lc 106401'491579 (105805'487042,106407'491583] loca l-les=106403 n=

Re: [ceph-users] 0.87 rados df fault

Thanks for your answer Greg. Unfortunately, the three monitor were working perfectly for at least 30 minutes after the upgrade. I don't know their memory usage at the time. What I did was : upgrade mons, upgrade osds, upgrade mds (single mds), upgrade fuse clients. I checked that everything was o

Re: [ceph-users] cephfs survey results

On 11/04/2014 10:02 AM, Sage Weil wrote: > On Tue, 4 Nov 2014, Blair Bethwaite wrote: >> On 4 November 2014 01:50, Sage Weil wrote: >>> In the Ceph session at the OpenStack summit someone asked what the CephFS >>> survey results looked like. >> >> Thanks Sage, that was me! >> >>> Here's the link:

Re: [ceph-users] cephfs survey results

On Tue, 4 Nov 2014 10:36:07 +1100, Blair Bethwaite wrote: > > TBH I'm a bit surprised by a couple of these and hope maybe you guys > will apply a certain amount of filtering on this... > > fsck and quotas were there for me, but multimds and snapshots are what > I'd consider "icing" features - t

Re: [ceph-users] emperor -> firefly 0.80.7 upgrade problem

On Monday, November 03, 2014 17:34:06 you wrote: > If you have osds that are close to full, you may be hitting 9626. I > pushed a branch based on v0.80.7 with the fix, wip-v0.80.7-9626. > -Sam Thanks Sam I may have been hitting that as well. I certainly hit too_full conditions often. I am abl

[ceph-users] RBD - possible to query "used space" of images/clones ?

Hi, is there a way to query the used space of a RBD image created with format 2 (used for kvm)? Also, if I create a linked clone base on this image, how do I get the additional, individual used space of this clone? In zfs, I can query these kind of information by calling "zfs info .." (2). "rb

Re: [ceph-users] cephfs survey results

Agreed Multi-MDS is a nice to have but not required for full production use. TBH stability and recovery will win any IT person dealing with filesystems. On Tue, Nov 4, 2014 at 7:33 AM, Mariusz Gronczewski wrote: > On Tue, 4 Nov 2014 10:36:07 +1100, Blair Bethwaite > wrote: > >> >> TBH I'm a bit

Re: [ceph-users] Weight of new OSD

Hi, I filled a bug for this issue: https://tracker.ceph.com/issues/9998 W dniu 22.10.2014 o 23:12, Craig Lewis pisze: > I'm not sure on RedHat, but on Ubuntu, /etc/init/ceph-osd.conf calls > ceph osd crush create-or-move. Try adding some logging to that > script, something like > > echo "Create

Re: [ceph-users] cephfs survey results

(Sorry for top posting - on phone) Related to some extent. Multimds will help when your small file issue is metadata bound, but I was actually thinking of data path random io latency. So begs the question as to what the survey meant by it...? On 04/11/2014 4:34 pm, "Mariusz Gronczewski" < mariusz.

Re: [ceph-users] EU mirror now supports rsync

On 11/04/2014 09:18 AM, Florent Bautista wrote: > Hi Wido, > > I have a "connection refused" for a few days on your mirror using rsync > (via IPv4). > > Is it a blacklist or an issue ? > It was an issue on that box. rsync daemon was stopped. I just started it again! Wido > Thank you > Florent

[ceph-users] Is there an negative relationship between storage utilization and ceph performance?

Hi, since a long time I'm looking for performance improvements for our ceph-cluster. The last expansion got better performance, because we add another node (with 12 OSDs). The storage utilization was after that 60%. Now we reach again 69% (the next nodes are waiting for installation) and the perfo

Re: [ceph-users] Is there an negative relationship between storage utilization and ceph performance?

On Tue, Nov 4, 2014 at 10:49 PM, Udo Lembke wrote: > Hi, > since a long time I'm looking for performance improvements for our > ceph-cluster. > The last expansion got better performance, because we add another node > (with 12 OSDs). The storage utilization was after that 60%. > > Now we reach agai

Re: [ceph-users] Is there an negative relationship between storage utilization and ceph performance?

I'd say it's storage in general, though Ceph can be especially harsh on file systems (RBD can invoke particularly bad fragmentation in btrfs for example due to how COW works). So generally there's a lot of things that can cause slow downs as your disks get full: 1) More objects spread across

Re: [ceph-users] cephfs survey results

On 04/11/14 22:02, Sage Weil wrote: On Tue, 4 Nov 2014, Blair Bethwaite wrote: On 4 November 2014 01:50, Sage Weil wrote: In the Ceph session at the OpenStack summit someone asked what the CephFS survey results looked like. Thanks Sage, that was me! Here's the link: https://www

Re: [ceph-users] RBD - possible to query "used space" of images/clones ?

$ rbd diff rbd/myimage-1 | awk '{ SUM += $2 } END { print SUM/1024/1024 " MB" }' -- Regards, Sébastien Han. > On 04 Nov 2014, at 16:57, Daniel Schwager wrote: > > Hi, > > is there a way to query the used space of a RBD image created with format 2 > (used for kvm)? > Also, if I create a linked

Re: [ceph-users] cephfs survey results

On 11/04/2014 03:11 PM, Mark Kirkwood wrote: On 04/11/14 22:02, Sage Weil wrote: On Tue, 4 Nov 2014, Blair Bethwaite wrote: On 4 November 2014 01:50, Sage Weil wrote: In the Ceph session at the OpenStack summit someone asked what the CephFS survey results looked like. Thanks Sage, that was

Re: [ceph-users] cephfs survey results

On 05/11/14 10:58, Mark Nelson wrote: On 11/04/2014 03:11 PM, Mark Kirkwood wrote: Heh, not necessarily - I put multi mds in there, as we want the cephfs part to be of similar to the rest of ceph in its availability. Maybe its because we are looking at plugging it in with an Openstack setup and

Re: [ceph-users] cephfs survey results

On Wed, 5 Nov 2014, Mark Kirkwood wrote: > On 04/11/14 22:02, Sage Weil wrote: > > On Tue, 4 Nov 2014, Blair Bethwaite wrote: > > > On 4 November 2014 01:50, Sage Weil wrote: > > > > In the Ceph session at the OpenStack summit someone asked what the > > > > CephFS > > > > survey results looked lik

Re: [ceph-users] cephfs survey results

On 05/11/14 11:47, Sage Weil wrote: On Wed, 5 Nov 2014, Mark Kirkwood wrote: On 04/11/14 22:02, Sage Weil wrote: On Tue, 4 Nov 2014, Blair Bethwaite wrote: On 4 November 2014 01:50, Sage Weil wrote: In the Ceph session at the OpenStack summit someone asked what the CephFS survey results look

Re: [ceph-users] cephfs survey results

+1 for fsck and snapshots, being able to have snapshot backups and protect against accidental deletion, etc is something we are really looking forward to. Thanks, Shain On 11/04/2014 04:02 AM, Sage Weil wrote: On Tue, 4 Nov 2014, Blair Bethwaite wrote: On 4 November 2014 01:50, Sage Weil

Re: [ceph-users] Is there an negative relationship between storage utilization and ceph performance?

Hello, On Tue, 04 Nov 2014 20:49:02 +0100 Udo Lembke wrote: > Hi, > since a long time I'm looking for performance improvements for our > ceph-cluster. > The last expansion got better performance, because we add another node > (with 12 OSDs). The storage utilization was after that 60%. > Another

Re: [ceph-users] osd down question

The OSDs will heartbeat each other, and report back to the monitors if any other OSD fails to respond. An OSD that fails to respond is effectively down, since it's not doing the things that it's supposed to do. It is possible for this process to cause problems. For example, I've had some OSDs on

Re: [ceph-users] emperor -> firefly 0.80.7 upgrade problem

Incomplete usually means the pgs do not have any complete copies. Did you previously have more osds? -Sam On Tue, Nov 4, 2014 at 7:37 AM, Chad Seys wrote: > On Monday, November 03, 2014 17:34:06 you wrote: >> If you have osds that are close to full, you may be hitting 9626. I >> pushed a branch

[ceph-users] osd troubleshooting

Hi, I'm trying to run osd troubleshooting commands. *Use case: Stopping osd without re-balancing.* .#ceph osd noout // this command works. But, neither of the following work: #stop ceph-osd id=1 (Error message: *no valid command found; 10 closest matches:* ...) or # ceph osd stop osd.1 ( Error

Re: [ceph-users] Ceph Giant not fixed RepllicatedPG:NotStrimming?

Can you upload the entire log file? David > On Nov 4, 2014, at 1:03 AM, Ta Ba Tuan wrote: > > Hi Sam, > I resend logs with debug options http://123.30.41.138/ceph-osd.21.log > > (Sorry about my spam :D) > > I saw many missing objects :| > > 2014-11-

Re: [ceph-users] osd troubleshooting

Shiva, You need to connect to the host where the OSD is located and stop it by invoking: service stop ceph osd.1 I don't think there's a way to stop and start OSDs from an admin node, unless I missed a change that provides this functionality. -Steve On 11/04/2014 10:59 PM, shiva rkreddy wrote:

[ceph-users] Full backup/restore of Ceph cluster?

Hi folks, I was wondering if anyone has a solution for performing a complete backup and restore of a CEph cluster. A Google search came up with some articles/blog posts, some of which are old, and I don't really have a great idea of the feasibility of this. Here's what I've found: http://ceph.co