Re: [ceph-users] Important security noticed regarding release signing key

2015-09-22 Thread wangsongbo
Hi Ken, Thank you, I will update my repo and continue my test. - Songbo On 15/9/23 上午10:50, Ken Dreyer wrote: Hi Songbo, It's been removed from Ansible now: https://github.com/ceph/ceph-cm-ansible/pull/137 - Ken On Tue, Sep 22, 2015 at 8:33 PM, wangsongbo wrote: Hi Ken, Thanks

Re: [ceph-users] Important security noticed regarding release signing key

2015-09-22 Thread Ken Dreyer
Hi Songbo, It's been removed from Ansible now: https://github.com/ceph/ceph-cm-ansible/pull/137 - Ken On Tue, Sep 22, 2015 at 8:33 PM, wangsongbo wrote: > Hi Ken, > Thanks for your reply. But in the ceph-cm-ansible project scheduled by > teuthology, "ceph.com/packages/ceph-extras" is in used

Re: [ceph-users] OSD crash

2015-09-22 Thread Alex Gorbachev
Hi Brad, This occurred on a system under moderate load - has not happened since and I do not know how to reproduce. Thank you, Alex On Tue, Sep 22, 2015 at 7:29 PM, Brad Hubbard wrote: > - Original Message - > > > From: "Alex Gorbachev" > > To: "ceph-users" > > Sent: Wednesday, 9 Sep

Re: [ceph-users] Important security noticed regarding release signing key

2015-09-22 Thread wangsongbo
Hi Ken, Thanks for your reply. But in the ceph-cm-ansible project scheduled by teuthology, "ceph.com/packages/ceph-extras" is in used now, such as qemu-kvm-0.12.1.2-2.415.el6.3ceph, qemu-kvm-tools-0.12.1.2-2.415.el6.3ceph etc. Any new releases will be provided ? On 15/9/22 下午10:24, Ke

Re: [ceph-users] IPv6 connectivity after website changes

2015-09-22 Thread Dan Mick
On 09/22/2015 05:22 AM, Sage Weil wrote: > On Tue, 22 Sep 2015, Wido den Hollander wrote: >> Hi, >> >> After the recent changes in the Ceph website the IPv6 connectivity got lost. >> >> www.ceph.com >> docs.ceph.com >> download.ceph.com >> git.ceph.com >> >> The problem I'm now facing with a couple

Re: [ceph-users] OSD crash

2015-09-22 Thread Brad Hubbard
- Original Message - > From: "Alex Gorbachev" > To: "ceph-users" > Sent: Wednesday, 9 September, 2015 6:38:50 AM > Subject: [ceph-users] OSD crash > Hello, > We have run into an OSD crash this weekend with the following dump. Please > advise what this could be. Hello Alex, As you kn

Re: [ceph-users] Potential OSD deadlock?

2015-09-22 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 This is IPoIB and we have the MTU set to 64K. There was some issues pinging hosts with "No buffer space available" (hosts are currently configured for 4GB to test SSD caching rather than page cache). I found that MTU under 32K worked reliable for pin

Re: [ceph-users] Backing up ceph rbd content to an external storage

2015-09-22 Thread Chris Taylor
I wrote some scripts based on this page. https://ceph.com/dev-notes/incremental-snapshots-with-rbd/ [1] We export the whole image to an external array, then export daily diffs. The array is then rotated weekly. Even with "--rbd-concurrent-management-ops 20" it is a very slow export/import

Re: [ceph-users] Potential OSD deadlock?

2015-09-22 Thread Sage Weil
On Tue, 22 Sep 2015, Samuel Just wrote: > I looked at the logs, it looks like there was a 53 second delay > between when osd.17 started sending the osd_repop message and when > osd.13 started reading it, which is pretty weird. Sage, didn't we > once see a kernel issue which caused some messages to

Re: [ceph-users] Potential OSD deadlock?

2015-09-22 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 -BEGIN PGP SIGNED MESSAGE- Hash: SHA256 4.2.0-1.el7.elrepo.x86_64 - - Robert LeBlanc PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 On Tue, Sep 22, 2015 at 3:41 PM, Samuel Just wrote: > I looked at the

Re: [ceph-users] Potential OSD deadlock?

2015-09-22 Thread Samuel Just
I looked at the logs, it looks like there was a 53 second delay between when osd.17 started sending the osd_repop message and when osd.13 started reading it, which is pretty weird. Sage, didn't we once see a kernel issue which caused some messages to be mysteriously delayed for many 10s of seconds

Re: [ceph-users] Potential OSD deadlock?

2015-09-22 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 OK, looping in ceph-devel to see if I can get some more eyes. I've extracted what I think are important entries from the logs for the first blocked request. NTP is running all the servers so the logs should be close in terms of time. Logs for 12:50 t

Re: [ceph-users] Receiving "failed to parse date for auth header"

2015-09-22 Thread Jens Hadlich
I had the same problem yesterday. The date has to be rfc 822 (no colons) but the pattern ("EEE, dd MMM HH:mm:ss z") at com.amazonaws.util.DateUtils#L55 has a "z" which can give "GMT" but also "+00:00". I couldn't figure out yet why I always get "+00:00" with my recent project but not with

[ceph-users] Ceph Days 2015

2015-09-22 Thread Patrick McGarry
Hey cephers, All of the planned Ceph Days through the end of the year are now live: http://ceph.com/cephdays/ 16 Oct - Shanghai (hosted by Intel) 22 Oct - Tokyo (hosted by Cyber Agent) 05 Nov - Melbourne (hosted by Monash University) Please sign up as soon as you are able to any of the events y

Re: [ceph-users] rbd and exclusive lock feature

2015-09-22 Thread Jason Dillaman
> > when you enable the "exclusive-lock" feature, only one RBD client is able > > to modify the image while the lock is held. > > means > > rbd_lock_exclusive > > > However, that won't stop other RBD clients from *requesting* that > > maintenance operations be performed on the image (e.g. snap

Re: [ceph-users] rbd and exclusive lock feature

2015-09-22 Thread Shinobu Kinjo
> when you enable the "exclusive-lock" feature, only one RBD client is able to > modify the image while the lock is held. means rbd_lock_exclusive > However, that won't stop other RBD clients from *requesting* that maintenance > operations be performed on the image (e.g. snapshot, resize).

Re: [ceph-users] lttng duplicate registration problem when using librados2 and libradosstriper

2015-09-22 Thread Jason Dillaman
> On 22/09/15 17:46, Jason Dillaman wrote: > > As a background, I believe LTTng-UST is disabled for RHEL7 in the Ceph > > project only due to the fact that EPEL 7 doesn't provide the required > > packages [1]. > > interesting. so basically our program might only work on RHEL7 by accident!! > It'

Re: [ceph-users] lttng duplicate registration problem when using librados2 and libradosstriper

2015-09-22 Thread Paul Mansfield
On 22/09/15 17:46, Jason Dillaman wrote: > As a background, I believe LTTng-UST is disabled for RHEL7 in the Ceph > project only due to the fact that EPEL 7 doesn't provide the required > packages [1]. interesting. so basically our program might only work on RHEL7 by accident!! We got the EL

Re: [ceph-users] lttng duplicate registration problem when using librados2 and libradosstriper

2015-09-22 Thread Jason Dillaman
As a background, I believe LTTng-UST is disabled for RHEL7 in the Ceph project only due to the fact that EPEL 7 doesn't provide the required packages [1]. [1] https://bugzilla.redhat.com/show_bug.cgi?id=1235461 -- Jason Dillaman - Original Message - > From: "Paul Mansfield" > To: c

Re: [ceph-users] lttng duplicate registration problem when using librados2 and libradosstriper

2015-09-22 Thread Paul Mansfield
On 18/09/15 17:15, Paul Mansfield wrote: > LTTng-UST: Error (-17) while registering tracepoint probe. Duplicate > registration of tracepoint probes having the same name is not allowed. > /bin/sh: line 1: 61001 Aborted (core dumped) ./$test I have made an interesting discovery. I wa

Re: [ceph-users] ceph-disk prepare error

2015-09-22 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 What does `ceph-disk list` report for the partition? You may need to run `partprobe /dev/sdb`. If ceph-disk list shows prepared, then just run `ceph-disk activate /dev/sdb1`. - Robert LeBlanc PGP Fingerprint 79A2 9CA4 6CC4 45DD A904

[ceph-users] Ceph Tech Talk on Thursday

2015-09-22 Thread Patrick McGarry
Hey cephers, Don't forget that this Thursday is the monthly Ceph Tech Talk (starting @ 2p EDT instead of 1p). This month Brent Compton will be discussing the particulars of building a Ceph reference architecture. Tune in on Thurs for details. http://ceph.com/ceph-tech-talks/ If you have questio

Re: [ceph-users] Potential OSD deadlock?

2015-09-22 Thread Gregory Farnum
On Tue, Sep 22, 2015 at 7:24 AM, Robert LeBlanc wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA256 > > Is there some way to tell in the logs that this is happening? You can search for the (mangled) name _split_collection > I'm not > seeing much I/O, CPU usage during these times. Is there

Re: [ceph-users] Potential OSD deadlock?

2015-09-22 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Is there some way to tell in the logs that this is happening? I'm not seeing much I/O, CPU usage during these times. Is there some way to prevent the splitting? Is there a negative side effect to doing so? We've had I/O block for over 900 seconds and

Re: [ceph-users] Important security noticed regarding release signing key

2015-09-22 Thread Ken Dreyer
On Tue, Sep 22, 2015 at 2:38 AM, Songbo Wang wrote: > Hi, all, > Since the last week‘s attack, “ceph.com/packages/ceph-extras” can be > opened never, but where can I get the releases of ceph-extra now? > > Thanks and Regards, > WangSongbo > The packages in "ceph-extras" were old and subje

Re: [ceph-users] Potential OSD deadlock?

2015-09-22 Thread Gregory Farnum
On Mon, Sep 21, 2015 at 11:43 PM, Robert LeBlanc wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA256 > > I'm starting to wonder if this has to do with some OSDs getting full > or the 0.94.3 code. Earlier this afternoon, I cleared out my test > cluster so there was no pools. I created anew r

[ceph-users] Double OSD failure

2015-09-22 Thread David Bierce
http://pastebin.com/BUm61Bbf On our cluster that hosts mainly RBDs, we have an OSD fail, the OSD was replaced. During the rebalance with the new OSD, another OSD failed. That OSD was replaced during the continuing rebalance. Now that the dust has settled most of are RBDs are hanging on PGs and

[ceph-users] Backing up ceph rbd content to an external storage

2015-09-22 Thread J-P Methot
Hi, We've been considering periodically backing up rbds from ceph to a different storage backend, just in case. I've thought of a few ways this could be possible, but I am curious if anybody on this list is currently doing that. Are you currently backing up data that is contained in ceph? What do

Re: [ceph-users] lttng duplicate registration problem when using librados2 and libradosstriper

2015-09-22 Thread Jason Dillaman
You can run the program under 'gdb' with a breakpoint on the 'abort' function to catch the program's abnormal exit. Assuming you have debug symbols installed, you should hopefully be able to see which probe is being re-registered. -- Jason Dillaman - Original Message - > From: "Pa

Re: [ceph-users] rbd and exclusive lock feature

2015-09-22 Thread Jason Dillaman
The naming of the "exclusive-lock" feature probably implies too much compared to what it actually does. In reality, when you enable the "exclusive-lock" feature, only one RBD client is able to modify the image while the lock is held. However, that won't stop other RBD clients from *requesting*

Re: [ceph-users] missing SRPMs - for librados2 and libradosstriper1?

2015-09-22 Thread Alfredo Deza
On Tue, Sep 22, 2015 at 8:05 AM, Paul Mansfield wrote: > On 18/09/15 15:48, Alfredo Deza wrote: >> The new locations are in: http://packages.ceph.com/ >> >> ceph-extras should no longer be needed. > > the DNS seems to be broken with no "packages" resource record Hi Paul. I am sorry, it seems I ga

Re: [ceph-users] IPv6 connectivity after website changes

2015-09-22 Thread Sage Weil
On Tue, 22 Sep 2015, Wido den Hollander wrote: > Hi, > > After the recent changes in the Ceph website the IPv6 connectivity got lost. > > www.ceph.com > docs.ceph.com > download.ceph.com > git.ceph.com > > The problem I'm now facing with a couple of systems is that they can't > download the Pack

[ceph-users] rbd and exclusive lock feature

2015-09-22 Thread Corin Langosch
Hi guys, when creating an rbd with feature "exclusive-lock" (and object-map, fast-diff, ..), do I have to pass any special arguments to qemu to activate it? How does this feature work with resize, snapshot creation, etc.? Form my work on ceph-ruby I know you have to call "rbd_open" and then pas

Re: [ceph-users] missing SRPMs - for librados2 and libradosstriper1?

2015-09-22 Thread Paul Mansfield
On 18/09/15 15:48, Alfredo Deza wrote: > The new locations are in: http://packages.ceph.com/ > > ceph-extras should no longer be needed. the DNS seems to be broken with no "packages" resource record $ dig packages.ceph.com @8.8.8.8 ; <<>> DiG 9.9.5-9ubuntu0.3-Ubuntu <<>> packages.ceph.com @8.8.

Re: [ceph-users] lttng duplicate registration problem when using librados2 and libradosstriper

2015-09-22 Thread Paul Mansfield
Thanks. I read the notes about mixing dynamic and static libraries, but at the moment I can't see why that affects me as I'm not doing anything clever with linking, my makefile simply has "-lrados -lradosstriper" in it, and I'm using gcc in a standard way. If I used "ldd" and "nm" on the .o and e

Re: [ceph-users] radosgw + civetweb latency issue on Hammer

2015-09-22 Thread Giridhar Yasa
I encountered the same issue in my setup (with an AWS SDK client) and on further investigation found that 'rgw print continue' was set to false for a civetweb driven rgw. Updated http://tracker.ceph.com/issues/12640 Giridhar -- Giridhar Yasa | Flipkart Engineering | http://www.flipkart.com/ On

Re: [ceph-users] radosgw + civetweb latency issue on Hammer

2015-09-22 Thread Giridhar Yasa
I encountered the same issue in my setup (with an AWS SDK client) and on further investigation found that 'rgw print continue' was set to false for a civetweb driven rgw. Updated http://tracker.ceph.com/issues/12640 Giridhar -- Giridhar Yasa | Flipkart Engineering | http://www.flipkart.com/ On

[ceph-users] ceph-disk prepare error

2015-09-22 Thread wikison
Hi, everybody When I use the ceph-disk utility to prepare the OSD, I executed the following orders: sudo ceph-disk prepare --cluster ceph --cluster-uuid aae7140c-7ee2-49f2-b8de-4c74f6f8651a --fs-type xfs /dev/sdb1 but I got: 2015-09-22 16:55:59.683674 7f2f3c97e7c0 -1 did not load config fi

Re: [ceph-users] Important security noticed regarding release signing key

2015-09-22 Thread Songbo Wang
Hi, all, Since the last week‘s attack, “ceph.com/packages/ceph-extras” can be opened never, but where can I get the releases of ceph-extra now? Thanks and Regards, WangSongbo 2015-09-18 0:29 GMT+08:00 Sage Weil : > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Last week, Red Hat in

[ceph-users] Maven repository lost after website changes

2015-09-22 Thread Wido den Hollander
Hi, http://ceph.com/maven/ no longer works. This maven repository was used to host the rados-java bindings, but also the cephfs java bindings. Can we put this location back up again? Wido ___ ceph-users mailing list ceph-users@lists.ceph.com http://li

[ceph-users] IPv6 connectivity after website changes

2015-09-22 Thread Wido den Hollander
Hi, After the recent changes in the Ceph website the IPv6 connectivity got lost. www.ceph.com docs.ceph.com download.ceph.com git.ceph.com The problem I'm now facing with a couple of systems is that they can't download the Package signing key from git.ceph.com or anything from download.ceph.com

[ceph-users] НА: Uneven data distribution across OSDs

2015-09-22 Thread Межов Игорь Александрович
Hi! It will be difficult to evenly distribute data with such difference in disk sizes. You can adjust a weight of most filled up ODSs with command #ceph osd reweight where new weight is a float in range 0.0-1.0. When you lower the weight of OSD, some PG will move from it to another location,