[ceph-users] FAILED assert(_size = 0) during recovery - need to understand what's going on

that dropping network packets should lead to corrupted data. Am I right? Any hints on what could be wrong here are appreciated! I don't like to run into a similar situation again. TIA Christian -- Dipl.-Inf. Christian Kauhaus · k...@gocept.com · systems administration gocept gmbh co. kg

Re: [ceph-users] OSDs

. A replication factor of 3 incurs significantly more space overhead. Has a replication factor of 2 been proven to be insecure? Regards Christian -- Dipl.-Inf. Christian Kauhaus · k...@gocept.com · systems administration gocept gmbh co. kg · Forsterstraße 29 · 06112 Halle (Saale) · Germany

[ceph-users] error (24) Too many open files

2014-06-08 22:15:35.191181 os/FileStore.cc: 2448: FAILED assert(0 == unexpected error) -- Dipl.-Inf. Christian Kauhaus · k...@gocept.com · systems administration gocept gmbh co. kg · Forsterstraße 29 · 06112 Halle (Saale) · Germany http://gocept.com · tel +49 345 219401-11 Python, Pyramid, Plone

[ceph-users] trying to interpret lines in osd.log

2014-06-21 07:44:29.437810 7fbc452cb700 0 -- 172.22.8.12:6810/31918 172.22.8.16:6802/31292 pipe(0x7fbe40002d90 sd=748 :6810 s=2 pgs=11345 cs=57 l=0 c=0x7fbf68eb2a70).fault with nothing to send, going to standby What does this mean? Anything to worry about? TIA Christian -- Dipl.-Inf. Christian

Re: [ceph-users] Behaviour of ceph pg repair on different replication levels

., when a local disk returns incorrect data). Or is there already a voting scheme in place during deep scrub? Regards Christian -- Dipl.-Inf. Christian Kauhaus · k...@gocept.com · systems administration gocept gmbh co. kg · Forsterstraße 29 · 06112 Halle (Saale) · Germany http://gocept.com · tel

Re: [ceph-users] Behaviour of ceph pg repair on different replication levels

-term goal). When thinking in petabytes scale, bit rot going to happen as a matter of fact. So I think Ceph should be prepared, at least when there are more than 2 replicas. Regards Christian -- Dipl.-Inf. Christian Kauhaus · k...@gocept.com · systems administration gocept gmbh co. kg

Re: [ceph-users] How to improve performance of ceph objcect storage cluster

in consequence, does this mean to go with a larger RBD object size than the default (4MiB)? Regards Christian -- Dipl.-Inf. Christian Kauhaus · k...@gocept.com · systems administration gocept gmbh co. kg · Forsterstraße 29 · 06112 Halle (Saale) · Germany http://gocept.com · tel +49 345 219401-11 Python

Re: [ceph-users] Ceph RBD and Backup.

. Christian Kauhaus · k...@gocept.com · systems administration gocept gmbh co. kg · Forsterstraße 29 · 06112 Halle (Saale) · Germany http://gocept.com · tel +49 345 219401-11 Python, Pyramid, Plone, Zope · consulting, development, hosting, operations ___ ceph

[ceph-users] nf_conntrack overflow crashes OSDs

since we use host-based firewalling and nf_conntrack is wired quite deeply into Linux' firewall code. Just to share our experience in case someone experiences the same problem. Regards Christian -- Dipl.-Inf. Christian Kauhaus · k...@gocept.com · systems administration gocept gmbh co. kg

Re: [ceph-users] nf_conntrack overflow crashes OSDs

.-Inf. Christian Kauhaus · k...@gocept.com · systems administration gocept gmbh co. kg · Forsterstraße 29 · 06112 Halle (Saale) · Germany http://gocept.com · tel +49 345 219401-11 Python, Pyramid, Plone, Zope · consulting, development, hosting, operations

Re: [ceph-users] Ceph Performance

on 7.2k rpm SATA disks against iSCSI on 15k rpm SAS disks is not fair. The random access times of 15k SAS disks are hugely better compared to 7.2k SATA disks. What would be far more interesting is to compare Ceph against iSCSI with identical disks. Regards Christian -- Dipl.-Inf. Christian Kauhaus

[ceph-users] filesystem fragmentation on ext4 OSD

Christian -- Dipl.-Inf. Christian Kauhaus · k...@gocept.com · systems administration gocept gmbh co. kg · Forsterstraße 29 · 06112 Halle (Saale) · Germany http://gocept.com · tel +49 345 219401-11 Python, Pyramid, Plone, Zope · consulting, development, hosting, operations

Re: [ceph-users] filesystem fragmentation on ext4 OSD

. But I'm not sure about the exact pattern of OSD/filesystem interaction. HTH Christian -- Dipl.-Inf. Christian Kauhaus · k...@gocept.com · systems administration gocept gmbh co. kg · Forsterstraße 29 · 06112 Halle (Saale) · Germany http://gocept.com · tel +49 345 219401-11 Python, Pyramid, Plone

Re: [ceph-users] filesystem fragmentation on ext4 OSD

-- Dipl.-Inf. Christian Kauhaus · k...@gocept.com · systems administration gocept gmbh co. kg · Forsterstraße 29 · 06112 Halle (Saale) · Germany http://gocept.com · tel +49 345 219401-11 Python, Pyramid, Plone, Zope · consulting, development, hosting, operations

Re: [ceph-users] filesystem fragmentation on ext4 OSD

due to COW and overwrites. There's a thread from a couple of weeks ago called rados io hints that you may want to look at/contribute to. Thank you for the hint. Sage's proposal on ceph-devel sounds good, so I'll wait for an implementation. Regards Christian -- Dipl.-Inf. Christian Kauhaus

Re: [ceph-users] Removing OSD, double data migration

of a cluster, I marked it out and removed it from the CRUSH map at the same time. Don't know if this is the recommended way but it seemed to work. Regards Christian [1] http://ceph.com/docs/master/rados/operations/add-or-rm-osds/#removing-osds-manual -- Dipl.-Inf. Christian Kauhaus · k

Re: [ceph-users] smart replication

://ceph.com/docs/master/rados/operations/crush-map/#placing-different-pools-on-different-osds The principles shown here can possibly adapted to you use case. Regards Christian -- Dipl.-Inf. Christian Kauhaus · k...@gocept.com · systems administration gocept gmbh co. kg · Forsterstraße 29 · 06112 Halle

[ceph-users] Blocked requests after "osd in"

-- Dipl-Inf. Christian Kauhaus <>< · k...@flyingcircus.io · +49 345 219401-0 Flying Circus Internet Operations GmbH · http://flyingcircus.io Forsterstraße 29 · 06112 Halle (Saale) · Deutschland HR Stendal 21169 · Geschäftsführer: Christian Theune

Re: [ceph-users] Blocked requests after "osd in"

. Our MONs don't use more than 5% CPU during the operation and don't cause significant amounts of disk I/O. Regards Christian -- Dipl-Inf. Christian Kauhaus <>< · k...@flyingcircus.io · +49 345 219401-0 Flying Circus Internet Operations GmbH · http://flyingcircus.io Forsterstraße

Re: [ceph-users] Blocked requests after "osd in"

> when I do try and tackle the problem next year. Is there already a ticket present for this issue in the bug tracker? I think this is an import issue. Regards Christian -- Dipl-Inf. Christian Kauhaus <>< · k...@flyingcircus.io · +49 345 219401-0 Flying Circus Interne

Re: [ceph-users] Blocked requests after "osd in"

uation is much appreciated. In the meantime, I'll be experimenting with pre-seeding the VFS cache to speed things up at least a little bit. Regards Christian -- Dipl-Inf. Christian Kauhaus <>< · k...@flyingcircus.io · +49 345 219401-0 Flying Circus Internet Operations GmbH · h

[ceph-users] rbd snap ls: how much locking is involved?

TIA Christian -- Dipl-Inf. Christian Kauhaus <>< · k...@flyingcircus.io · +49 345 219401-0 Flying Circus Internet Operations GmbH · http://flyingcircus.io Forsterstraße 29 · 06112 Halle (Saale) · Deutschland HR Stendal 21169 · Geschäftsführer: Christian Theune, Christia

Re: [ceph-users] rbd snap ls: how much locking is involved?

are also doing 'rbd export-diff' on snapshots. So this could be the cause, too. Regards Christian -- Dipl-Inf. Christian Kauhaus <>< · k...@flyingcircus.io · +49 345 219401-0 Flying Circus Internet Operations GmbH · http://flyingcircus.io Forsterstraße 29 · 06112 Halle (Saale) · Deut