Re: [ceph-users] GPF kernel panics

2014-07-31 Thread Brad Hubbard
ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Kindest Regards, Brad Hubbard Senior Software Maintenance Engineer Red Hat Global Support Services Asia Pacific Region ___ ceph-users mailing list ceph-users

Re: [ceph-users] Ceph Block Device

2015-02-17 Thread Brad Hubbard
On 02/18/2015 11:48 AM, Garg, Pankaj wrote: libkmod: ERROR ../libkmod/libkmod.c:556 kmod_search_moddep: could not open moddep file Try sudo moddep and then running your modprobe again. This seems more like an OS issue than a Ceph specific issue. Cheers, Brad

Re: [ceph-users] Ceph Block Device

2015-02-17 Thread Brad Hubbard
? I am able to run Object storage and rados bench just fine on the cluster. Thanks Pankaj ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Kindest Regards, Brad Hubbard Senior

Re: [ceph-users] ceph-giant installation error on centos 6.6

2015-02-17 Thread Brad Hubbard
On 02/18/2015 12:43 PM, Wenxiao He wrote: Hello, I need some help as I am getting package dependency errors when trying to install ceph-giant on centos 6.6. See below for repo files and also the yum install output. --- Package python-imaging.x86_64 0:1.1.6-19.el6 will be installed --

Re: [ceph-users] Centos 7 OSD silently fail to start

2015-02-25 Thread Brad Hubbard
On 02/26/2015 09:05 AM, Kyle Hutson wrote: Thank you Thomas. You at least made me look it the right spot. Their long-form is showing what to do for a mon, not an osd. At the bottom of step 11, instead of sudo touch /var/lib/ceph/mon/{cluster-name}-{hostname}/sysvinit It should read sudo touch

Re: [ceph-users] Centos 7 OSD silently fail to start

2015-02-25 Thread Brad Hubbard
On 02/26/2015 03:24 PM, Kyle Hutson wrote: Just did it. Thanks for suggesting it. No, definitely thank you. Much appreciated. On Wed, Feb 25, 2015 at 5:59 PM, Brad Hubbard bhubb...@redhat.com mailto:bhubb...@redhat.com wrote: On 02/26/2015 09:05 AM, Kyle Hutson wrote: Thank

Re: [ceph-users] stuck ceph-deploy mon create-initial / giant

2015-02-24 Thread Brad Hubbard
On 02/24/2015 09:06 PM, Loic Dachary wrote: On 24/02/2015 12:00, Christian Balzer wrote: On Tue, 24 Feb 2015 11:17:22 +0100 Loic Dachary wrote: On 24/02/2015 09:58, Stephan Seitz wrote: Hi Loic, this is the content of our ceph.conf [global] fsid = 719f14b2-7475-4b25-8c5f-3ffbcf594d13

Re: [ceph-users] QEMU Venom Vulnerability

2015-05-20 Thread Brad Hubbard
On 05/20/2015 11:02 AM, Robert LeBlanc wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA256 I've downloaded the new tarball, placed it in rpmbuild/SOURCES then with the extracted spec file in rpmbuild/SPEC, I update it to the new version and then rpmbuild -ba program.spec. If you install the

Re: [ceph-users] QEMU Venom Vulnerability

2015-05-20 Thread Brad Hubbard
On 05/21/2015 08:47 AM, Brad Hubbard wrote: On 05/20/2015 11:02 AM, Robert LeBlanc wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA256 I've downloaded the new tarball, placed it in rpmbuild/SOURCES then with the extracted spec file in rpmbuild/SPEC, I update it to the new version

Re: [ceph-users] QEMU Venom Vulnerability

2015-05-21 Thread Brad Hubbard
am very new at building RPMs is something else that I should be aware of or take care? Any guidelines maybe Best regards, George On Thu, 21 May 2015 09:25:32 +1000, Brad Hubbard wrote: On 05/21/2015 08:47 AM, Brad Hubbard wrote: On 05/20/2015 11:02 AM, Robert LeBlanc wrote: -BEGIN PGP

Re: [ceph-users] QEMU Venom Vulnerability

2015-05-21 Thread Brad Hubbard
On 05/21/2015 09:36 PM, Brad Hubbard wrote: On 05/21/2015 03:39 PM, Georgios Dimitrakakis wrote: Hi Brad! Thanks for pointing out that for CentOS 6 the fix is included! Good to know that! No problem. But I think that the original package doesn't support RBD by default so it has

Re: [ceph-users] problem with RGW

2015-07-31 Thread Brad Hubbard
- Original Message - From: Butkeev Stas staer...@ya.ru To: ceph-us...@ceph.com, ceph-commun...@lists.ceph.com, supp...@ceph.com Sent: Friday, 31 July, 2015 9:10:40 PM Subject: [ceph-users] problem with RGW Hello everybody We have ceph cluster that consist of 8 host with 12 osd per each

Re: [ceph-users] fedora core 22

2015-10-27 Thread Brad Hubbard
- Original Message - > From: "Andrew Hume" > To: ceph-users@lists.ceph.com > Sent: Tuesday, 27 October, 2015 11:13:04 PM > Subject: [ceph-users] fedora core 22 > > a while back, i had installed ceph (firefly i believe) on my fedora core > system and all went smoothly.

Re: [ceph-users] Rados: Undefined symbol error

2015-08-27 Thread Brad Hubbard
- Original Message - From: Brad Hubbard bhubb...@redhat.com To: Aakanksha Pudipeddi-SSI aakanksha...@ssi.samsung.com Cc: ceph-us...@ceph.com Sent: Friday, 28 August, 2015 10:54:04 AM Subject: Re: [ceph-users] Rados: Undefined symbol error - Original Message - From

Re: [ceph-users] Rados: Undefined symbol error

2015-08-26 Thread Brad Hubbard
- Original Message - From: Aakanksha Pudipeddi-SSI aakanksha...@ssi.samsung.com To: Jason Dillaman dilla...@redhat.com Cc: ceph-us...@ceph.com Sent: Thursday, 27 August, 2015 6:22:45 AM Subject: Re: [ceph-users] Rados: Undefined symbol error Hello Jason, I checked the version of

Re: [ceph-users] Rados: Undefined symbol error

2015-08-31 Thread Brad Hubbard
- Original Message - > From: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > To: "Brad Hubbard" <bhubb...@redhat.com> > Cc: ceph-us...@ceph.com > Sent: Tuesday, 1 September, 2015 3:33:38 AM > Subject: RE: [ceph-users] Rados: Und

Re: [ceph-users] Rados: Undefined symbol error

2015-08-31 Thread Brad Hubbard
- Original Message - > From: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > To: "Brad Hubbard" <bhubb...@redhat.com> > Cc: ceph-us...@ceph.com > Sent: Tuesday, 1 September, 2015 7:27:04 AM > Subject: RE: [ceph-users] Rados: Unde

Re: [ceph-users] Rados: Undefined symbol error

2015-08-31 Thread Brad Hubbard
- Original Message - > From: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > To: "Brad Hubbard" <bhubb...@redhat.com> > Cc: "ceph-users" <ceph-us...@ceph.com> > Sent: Tuesday, 1 September, 2015 7:58:33 AM > Su

Re: [ceph-users] Rados: Undefined symbol error

2015-08-31 Thread Brad Hubbard
- Original Message - > From: "Brad Hubbard" <bhubb...@redhat.com> > To: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > Cc: "ceph-users" <ceph-us...@ceph.com> > Sent: Tuesday, 1 September, 2015 8:36:33

Re: [ceph-users] Rados: Undefined symbol error

2015-09-01 Thread Brad Hubbard
- Original Message - > From: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > To: "Brad Hubbard" <bhubb...@redhat.com> > Sent: Wednesday, 2 September, 2015 6:25:49 AM > Subject: RE: [ceph-users] Rados: Undefined symbol error > &

Re: [ceph-users] Cannot add/create new monitor on ceph v0.94.3

2015-09-06 Thread Brad Hubbard
- Original Message - > From: "Fangzhe Chang (Fangzhe)" > To: ceph-users@lists.ceph.com > Sent: Saturday, 5 September, 2015 6:26:16 AM > Subject: [ceph-users] Cannot add/create new monitor on ceph v0.94.3 > > > > Hi, > > I’m trying to add a second

Re: [ceph-users] Cannot add/create new monitor on ceph v0.94.3

2015-09-08 Thread Brad Hubbard
I'd suggest starting the mon with debugging turned right up and taking a good look at the output. Cheers, Brad - Original Message - > From: "Fangzhe Chang (Fangzhe)" <fangzhe.ch...@alcatel-lucent.com> > To: "Brad Hubbard" <bhubb...@redhat.com>

Re: [ceph-users] 9 PGs stay incomplete

2015-09-11 Thread Brad Hubbard
- Original Message - > From: "Wido den Hollander" > To: "ceph-users" > Sent: Friday, 11 September, 2015 6:46:11 AM > Subject: [ceph-users] 9 PGs stay incomplete > > Hi, > > I'm running into a issue with Ceph 0.94.2/3 where after doing a recovery >

Re: [ceph-users] OSD crash

2015-09-22 Thread Brad Hubbard
- Original Message - > From: "Alex Gorbachev" > To: "ceph-users" > Sent: Wednesday, 9 September, 2015 6:38:50 AM > Subject: [ceph-users] OSD crash > Hello, > We have run into an OSD crash this weekend with the following dump.

Re: [ceph-users] a couple of radosgw questions

2015-08-28 Thread Brad Hubbard
- Original Message - From: Tom Deneau tom.den...@amd.com To: ceph-us...@ceph.com Sent: Saturday, 29 August, 2015 4:01:08 AM Subject: [ceph-users] a couple of radosgw questions A couple of questions on the radosgw... 1. I noticed when I use s3cmd to put a 10M object into a bucket

Re: [ceph-users] Error while installing ceph

2015-08-28 Thread Brad Hubbard
Did you follow this first? http://docs.ceph.com/docs/v0.80.5/start/quick-start-preflight/ It doesn't seem to be able to locate the repos for the ceph rpms. - Original Message - From: pavana bhat pavanakrishnab...@gmail.com To: ceph-users@lists.ceph.com Sent: Saturday, 29 August, 2015

Re: [ceph-users] Rados: Undefined symbol error

2015-08-27 Thread Brad Hubbard
- Original Message - From: Aakanksha Pudipeddi-SSI aakanksha...@ssi.samsung.com To: Brad Hubbard bhubb...@redhat.com Cc: Jason Dillaman dilla...@redhat.com, ceph-us...@ceph.com Sent: Friday, 28 August, 2015 6:15:12 AM Subject: RE: [ceph-users] Rados: Undefined symbol error Hello

Re: [ceph-users] Error while installing ceph

2015-08-28 Thread Brad Hubbard
- Original Message - From: pavana bhat pavanakrishnab...@gmail.com To: Brad Hubbard bhubb...@redhat.com Cc: ceph-users@lists.ceph.com Sent: Saturday, 29 August, 2015 9:40:50 AM Subject: Re: [ceph-users] Error while installing ceph Yes I did follow all the preflight steps. After

Re: [ceph-users] a couple of radosgw questions

2015-08-28 Thread Brad Hubbard
- Original Message - From: Ben Hines bhi...@gmail.com To: Brad Hubbard bhubb...@redhat.com Cc: Tom Deneau tom.den...@amd.com, ceph-users ceph-us...@ceph.com Sent: Saturday, 29 August, 2015 9:49:00 AM Subject: Re: [ceph-users] a couple of radosgw questions 16:22:38 root@sm-cephrgw4

Re: [ceph-users] Error while installing ceph

2015-08-28 Thread Brad Hubbard
- Original Message - From: Travis Rhoden trho...@gmail.com To: Brad Hubbard bhubb...@redhat.com Cc: pavana bhat pavanakrishnab...@gmail.com, ceph-users@lists.ceph.com Sent: Saturday, 29 August, 2015 10:11:21 AM Subject: Re: [ceph-users] Error while installing ceph A couple

Re: [ceph-users] OSD error

2015-12-08 Thread Brad Hubbard
+ceph-devel - Original Message - > From: "Dan Nica" > To: ceph-us...@ceph.com > Sent: Tuesday, 8 December, 2015 7:54:20 PM > Subject: [ceph-users] OSD error > Hi guys, > Recently I installed ceph cluster version 9.2.0, and on my osd logs I see > these

Re: [ceph-users] ceph new installation of ceph 0.9.2 issue and crashing osds

2015-12-08 Thread Brad Hubbard
Looks like it's failing to create a thread. Try setting kernel.pid_max to 4194303 in /etc/sysctl.conf Cheers, Brad - Original Message - > From: "Kenneth Waegeman" > To: ceph-users@lists.ceph.com > Sent: Tuesday, 8 December, 2015 10:45:11 PM > Subject:

Re: [ceph-users] infernalis osd activation on centos 7

2015-12-02 Thread Brad Hubbard
- Original Message - > From: "Dan Nica" > To: ceph-us...@ceph.com > Sent: Thursday, 3 December, 2015 1:39:16 AM > Subject: [ceph-users] infernalis osd activation on centos 7 > Hi guys, > After managing to get the mons up, I am stuck at activating the

Re: [ceph-users] Crashing OSDs (suicide timeout, following a single pool)

2016-06-02 Thread Brad Hubbard
On Thu, Jun 2, 2016 at 9:07 AM, Brandon Morris, PMP wrote: > The only way that I was able to get back to Health_OK was to export/import. > * Please note, any time you use the ceph_objectstore_tool you risk data > loss if not done carefully. Never remove a

Re: [ceph-users] Ceph Status - Segmentation Fault

2016-05-24 Thread Brad Hubbard
/usr/bin/ceph is a python script so it's not segfaulting but some binary it's launching is and there doesn't appear to be much information about it in the log you uploaded. Are you able to capture a core file and generate a stack trace from gdb? The following may help to get some data. $ ulimit

Re: [ceph-users] Ceph Status - Segmentation Fault

2016-05-25 Thread Brad Hubbard
Hi John, This looks a lot like http://tracker.ceph.com/issues/12417 which is, of course, fixed. Worth gathering debug-auth=20 ? Maybe on the MON end as well? Cheers, Brad - Original Message - > From: "Mathias Buresch" > To: jsp...@redhat.com > Cc:

Re: [ceph-users] Ceph Status - Segmentation Fault

2016-06-13 Thread Brad Hubbard
working on something else and saw your bug this morning. Cheers, Brad -Original Message- > From: Brad Hubbard <bhubb...@redhat.com> > To: Mathias Buresch <mathias.bure...@de.clara.net> > Cc: jsp...@redhat.com <jsp...@redhat.com>, ceph-us...@ceph.com e...@c

Re: [ceph-users] Ceph Status - Segmentation Fault

2016-06-01 Thread Brad Hubbard
, in=..., this=0x7fffea882470) > at auth/cephx/../Crypto.h:110 > #1 encode_encrypt_enc_bl (cct=, > error="", out=..., key=..., t=) > at auth/cephx/CephxProtocol.h:464 > #2 encode_encrypt (cct=, error="", > out=..., key=..., t=) > at auth/cephx/Cep

Re: [ceph-users] Ceph 10.1.1 rbd map fail

2016-06-21 Thread Brad Hubbard
On Wed, Jun 22, 2016 at 1:35 PM, 王海涛 wrote: > Hi All > > I'm using ceph-10.1.1 to map a rbd image ,but it dosen't work ,the error > messages are: > > root@heaven:~#rbd map rbd/myimage --id admin > 2016-06-22 11:16:34.546623 7fc87ca53d80 -1 WARNING: the following dangerous > and

Re: [ceph-users] [Ceph-community] Regarding Technical Possibility of Configuring Single Ceph Cluster on Different Networks

2016-06-16 Thread Brad Hubbard
On Fri, Jun 10, 2016 at 3:01 AM, Venkata Manojawa Paritala wrote: > Hello Friends, > > I am Manoj Paritala, working in Vedams Software Solutions India Pvt Ltd, > Hyderabad, India. We are developing a POC with the below specification. I > would like to know if it is

Re: [ceph-users] Installing ceph monitor on Ubuntu denial: segmentation fault

2016-06-17 Thread Brad Hubbard
On Fri, May 20, 2016 at 7:32 PM, Daniel Wilhelm wrote: > Hi > > > > I relieved to have found a solution to this problem. > > > > The ansible script for generating the key did not pass the key to the > following command line and sent therefore an empty string to this script

Re: [ceph-users] Ceph 10.1.1 rbd map fail

2016-06-23 Thread Brad Hubbard
; features: layering, exclusive-lock, object-map, fast-diff, deep-flatten > flags: > > It looks like that some of the features are not supported by my rbd kernel > module. > Because when I get rid of the last 4 features, and only keep the "layering" > feature, > the i

Re: [ceph-users] Ceph 10.1.1 rbd map fail

2016-06-22 Thread Brad Hubbard
w the output of the following command please? # ceph osd crush show-tunables -f json-pretty I believe you'll need to use "ceph osd crush tunables " to adjust this. > > Thanks! > > Kind Regards, > Haitao Wang > > > At 2016-06-22 12:33:42, "Brad Hubbard" &l

Re: [ceph-users] ceph not replicating to all osds

2016-06-27 Thread Brad Hubbard
On Tue, Jun 28, 2016 at 1:00 AM, Ishmael Tsoaela wrote: > Hi ALL, > > Anyone can help with this issue would be much appreciated. > > I have created an image on one client and mounted it on both 2 client I > have setup. > > When I write data on one client, I cannot access the

Re: [ceph-users] VM shutdown because of PG increase

2016-06-28 Thread Brad Hubbard
On Tue, Jun 28, 2016 at 7:39 PM, Torsten Urbas wrote: > Hello, > > are you sure about your Ceph version? Below’s output states "0.94.1“. I suspect it's quite likely that the cluster was upgraded but not the clients or, if the clients were upgraded, that the VMs were not

Re: [ceph-users] ceph not replicating to all osds

2016-06-28 Thread Brad Hubbard
On Tue, Jun 28, 2016 at 4:17 PM, Ishmael Tsoaela wrote: > Hi, > > I am new to Ceph and most of the concepts are new. > > image mounted on nodeA, FS is XFS > > sudo mkfs.xfs /dev/rbd/data/data_01 > > sudo mount /dev/rbd/data/data_01 /mnt > > cluster_master@nodeB:~$ mount|grep

Re: [ceph-users] librados: how to get notified when a certain object is created

2016-02-23 Thread Brad Hubbard
- Original Message - > From: "Sorin Manolache" > To: ceph-users@lists.ceph.com > Sent: Sunday, 21 February, 2016 8:20:13 AM > Subject: [ceph-users] librados: how to get notified when a certain object is > created > > Hello, > > I can set a watch on an object in

Re: [ceph-users] radosgw crash - Infernalis

2016-04-28 Thread Brad Hubbard
- Original Message - > From: "Karol Mroz" <km...@suse.com> > To: "Brad Hubbard" <bhubb...@redhat.com> > Cc: "Ben Hines" <bhi...@gmail.com>, "ceph-users" <ceph-users@lists.ceph.com> > Sent: Thursday, 28 April, 20

Re: [ceph-users] radosgw crash - Infernalis

2016-04-27 Thread Brad Hubbard
- Original Message - > From: "Karol Mroz" > To: "Ben Hines" > Cc: "ceph-users" > Sent: Wednesday, 27 April, 2016 7:06:56 PM > Subject: Re: [ceph-users] radosgw crash - Infernalis > > On Tue, Apr 26, 2016 at 10:17:31PM -0700,

Re: [ceph-users] radosgw crash - Infernalis

2016-04-27 Thread Brad Hubbard
- Original Message - > From: "Ben Hines" <bhi...@gmail.com> > To: "Brad Hubbard" <bhubb...@redhat.com> > Cc: "Karol Mroz" <km...@suse.com>, "ceph-users" <ceph-users@lists.ceph.com> > Sent: Thursday, 28 April, 2

Re: [ceph-users] Recovery stuck after adjusting to recent tunables

2016-07-25 Thread Brad Hubbard
e recovery? >>> >>> You could try to increase the pgs to 128 (it is always better to use powers >>> of 2) and see if the recover completes.. >>> >>> Cheers >>> G. >>> >>> From: ceph-users [cep

Re: [ceph-users] mon_osd_nearfull_ratio (unchangeable) ?

2016-07-25 Thread Brad Hubbard
On Tue, Jul 26, 2016 at 12:16:35PM +1000, Goncalo Borges wrote: > Hi Brad > > Thanks for replying. > > Answers inline. > > > > > I am a bit confused about the 'unchachable' message we get in Jewel 10.2.2 > > > when I try to change some cluster configs. > > > > > > For example: > > > > > >

Re: [ceph-users] mon_osd_nearfull_ratio (unchangeable) ?

2016-07-25 Thread Brad Hubbard
On Tue, Jul 26, 2016 at 11:01:49AM +1000, Goncalo Borges wrote: > Dear Cephers... Hi Goncalo, > > I am a bit confused about the 'unchachable' message we get in Jewel 10.2.2 > when I try to change some cluster configs. > > For example: > > 1./ if I try to change mon_osd_nearfull_ratio from

Re: [ceph-users] syslog broke my cluster

2016-07-26 Thread Brad Hubbard
On Tue, Jul 26, 2016 at 03:48:33PM +0100, Sergio A. de Carvalho Jr. wrote: > As per my previous messages on the list, I was having a strange problem in > my test cluster (Hammer 0.94.6, CentOS 6.5) where my monitors were > literally crawling to a halt, preventing them to ever reach quorum and >

Re: [ceph-users] mon_osd_nearfull_ratio (unchangeable) ?

2016-07-26 Thread Brad Hubbard
On Tue, Jul 26, 2016 at 09:37:37AM +0200, Dan van der Ster wrote: > On Tue, Jul 26, 2016 at 3:52 AM, Brad Hubbard <bhubb...@redhat.com> wrote: > >> 1./ if I try to change mon_osd_nearfull_ratio from 0.85 to 0.90, I get > >> > >># ceph tell mon.* injec

Re: [ceph-users] ceph master build fails on src/gmock, workaround?

2016-07-12 Thread Brad Hubbard
This was resolved in http://tracker.ceph.com/issues/16646 On Sun, Jul 10, 2016 at 5:09 PM, Brad Hubbard <bhubb...@redhat.com> wrote: > On Sat, Jul 09, 2016 at 10:43:52AM +, Kevan Rehm wrote: >> Greetings, >> >> I cloned the master branch of ceph at https://githu

Re: [ceph-users] ceph-fuse segfaults ( jewel 10.2.2)

2016-07-14 Thread Brad Hubbard
og seems related to issues on the management of objects in cache. This > > > pointed to a memory related problem. > > > > > > 4./ On the cluster where the application run successfully, machines have > > > 48GB of RAM and 96GB of SWAP (don't know why we have such a l

Re: [ceph-users] Try to install ceph hammer on CentOS7

2016-07-22 Thread Brad Hubbard
On Sat, Jul 23, 2016 at 1:41 AM, Ruben Kerkhof wrote: > Please keep the mailing list on the CC. > > On Fri, Jul 22, 2016 at 3:40 PM, Manuel Lausch wrote: >> oh. This was a copy failure. >> Of course I checked my config again. Some other variations

Re: [ceph-users] Recovery stuck after adjusting to recent tunables

2016-07-22 Thread Brad Hubbard
On Sat, Jul 23, 2016 at 12:17 AM, Kostis Fardelas wrote: > Hello, > being in latest Hammer, I think I hit a bug with more recent than > legacy tunables. > > Being in legacy tunables for a while, I decided to experiment with > "better" tunables. So first I went from argonaut

Re: [ceph-users] blocked ops

2016-08-11 Thread Brad Hubbard
On Thu, Aug 11, 2016 at 11:33:29PM +0100, Roeland Mertens wrote: > Hi, > > I was hoping someone on this list may be able to help? > > We're running a 35 node 10.2.1 cluster with 595 OSDs. For the last 12 hours > we've been plagued with blocked requests which completely kills the > performance of

Re: [ceph-users] installing multi osd and monitor of ceph in single VM

2016-08-09 Thread Brad Hubbard
On Wed, Aug 10, 2016 at 12:26 AM, agung Laksono wrote: > > Hi Ceph users, > > I am new in ceph. I've been succeed installing ceph in 4 VM using Quick > installation guide in ceph documentation. > > And I've also done to compile > ceph from source code, build and install in

Re: [ceph-users] Recover Data from Deleted RBD Volume

2016-08-09 Thread Brad Hubbard
On Tue, Aug 9, 2016 at 7:39 AM, George Mihaiescu wrote: > Look in the cinder db, the volumes table to find the Uuid of the deleted > volume. You could also look through the logs at the time of the delete and I suspect you should be able to see how the rbd image was

Re: [ceph-users] Recover Data from Deleted RBD Volume

2016-08-10 Thread Brad Hubbard
On Wed, Aug 10, 2016 at 3:16 PM, Georgios Dimitrakakis wrote: > > Hello! > > Brad, > > is that possible from the default logging or verbose one is needed?? > > I 've managed to get the UUID of the deleted volume from OpenStack but don't > really know how to get the

Re: [ceph-users] installing multi osd and monitor of ceph in single VM

2016-08-10 Thread Brad Hubbard
f the repo. 2) ./do_cmake.sh 3) cd build 4) make 5) OSD=3 MON=3 MDS=1 ../src/vstart.sh -n -x -l 6) bin/ceph -s That should give you a working cluster with 3 MONs, 3 OSDs and 1 MDS. -- Cheers, Brad > > > On Wed, Aug 10, 2016 at 9:14 AM, Brad Hubbard <bhubb...@redhat.com> wrote:

Re: [ceph-users] blocked ops

2016-08-12 Thread Brad Hubbard
hosting the broken pg. > > > > > On 12 August 2016 at 04:12, Brad Hubbard <bhubb...@redhat.com> wrote: > > > On Thu, Aug 11, 2016 at 11:33:29PM +0100, Roeland Mertens wrote: > > > Hi, > > > > > > I was hoping someone on this list may be

Re: [ceph-users] installing multi osd and monitor of ceph in single VM

2016-08-10 Thread Brad Hubbard
> It should, sure. > > > > Try this. > > > > 1) Clone a fresh copy of the repo. > > 2) ./do_cmake.sh > > 3) cd build > > 4) make > > 5) OSD=3 MON=3 MDS=1 ../src/vstart.sh -n -x -l > > 6) bin/ceph -s > > > > That should give you a working cluster wit

Re: [ceph-users] osd failing to start

2016-07-13 Thread Brad Hubbard
On Thu, Jul 14, 2016 at 06:06:58AM +0200, Martin Wilderoth wrote: > Hello, > > I have a ceph cluster where the one osd is failng to start. I have been > upgrading ceph to see if the error dissappered. Now I'm running jewel but I > still get the error message. > > -1> 2016-07-13

Re: [ceph-users] Fwd: Ceph OSD suicide himself

2016-07-11 Thread Brad Hubbard
On Mon, Jul 11, 2016 at 04:53:36PM +0200, Lionel Bouton wrote: > Le 11/07/2016 11:56, Brad Hubbard a écrit : > > On Mon, Jul 11, 2016 at 7:18 PM, Lionel Bouton > > <lionel-subscript...@bouton.name> wrote: > >> Le 11/07/2016 04:48, 한승진 a écrit : > >>>

Re: [ceph-users] ceph-fuse segfaults ( jewel 10.2.2)

2016-07-14 Thread Brad Hubbard
only have one instance of the user application running, ceph-fuse (in > > 10.2.2) slowly rises with time up to 10 GB of memory usage. > > > > if I submit a large number of user applications simultaneously, ceph-fuse > > goes very fast to ~10GB. > > > > PI

Re: [ceph-users] ceph-fuse segfaults ( jewel 10.2.2)

2016-07-04 Thread Brad Hubbard
On Tue, Jul 5, 2016 at 12:13 PM, Shinobu Kinjo wrote: > Can you reproduce with debug client = 20? In addition to this I would suggest making sure you have debug symbols in your build and capturing a core file. You can do that by setting "ulimit -c unlimited" in the

Re: [ceph-users] ceph-fuse segfaults ( jewel 10.2.2)

2016-07-04 Thread Brad Hubbard
On Tue, Jul 5, 2016 at 1:34 PM, Patrick Donnelly wrote: > Hi Goncalo, > > I believe this segfault may be the one fixed here: > > https://github.com/ceph/ceph/pull/10027 Ah, nice one Patrick. Goncalo, the patch is fairly simple, just the addition of a lock on two lines to

Re: [ceph-users] Is anyone seeing iissues with task_numa_find_cpu?

2016-07-05 Thread Brad Hubbard
On Sun, Jul 3, 2016 at 7:51 AM, Alex Gorbachev wrote: >> Thank you Stefan and Campbell for the info - hope 4.7rc5 resolves this >> for us - please note that my workload is purely RBD, no QEMU/KVM. >> Also, we do not have CFQ turned on, neither scsi-mq and blk-mq, so I >>

Re: [ceph-users] Should I restart VMs when I upgrade ceph client version

2016-07-05 Thread Brad Hubbard
On Wed, Jul 6, 2016 at 3:28 PM, 한승진 wrote: > Hi Cephers, > > I implemented Ceph with OpenStack. > > Recently, I upgrade Ceph server from Hammer to Jewel. > > Also, I plan to upgrade ceph clients that are OpenStack Nodes. > > There are a lot of VMs running in Compute Nodes. > >

Re: [ceph-users] ceph-fuse segfaults ( jewel 10.2.2)

2016-07-06 Thread Brad Hubbard
On Thu, Jul 7, 2016 at 12:31 AM, Patrick Donnelly wrote: > > The locks were missing in 9.2.0. There were probably instances of the > segfault unreported/unresolved. Or even unseen :) Race conditions are funny things and extremely subtle changes in timing introduced by any

Re: [ceph-users] Data recovery stuck

2016-07-08 Thread Brad Hubbard
On Sat, Jul 9, 2016 at 1:20 AM, Pisal, Ranjit Dnyaneshwar wrote: > Hi All, > > > > I am in process of adding new OSDs to Cluster however after adding second > node Cluster recovery seems to be stopped. > > > > Its more than 3 days but Objects degraded % has not improved

Re: [ceph-users] ceph master build fails on src/gmock, workaround?

2016-07-10 Thread Brad Hubbard
On Sat, Jul 09, 2016 at 10:43:52AM +, Kevan Rehm wrote: > Greetings, > > I cloned the master branch of ceph at https://github.com/ceph/ceph.git > onto a Centos 7 machine, then did > > ./autogen.sh > ./configure --enable-xio > make BTW, you should be defaulting to cmake if you don't have a

Re: [ceph-users] ceph master build fails on src/gmock, workaround?

2016-07-10 Thread Brad Hubbard
On Sat, Jul 09, 2016 at 10:43:52AM +, Kevan Rehm wrote: > Greetings, > > I cloned the master branch of ceph at https://github.com/ceph/ceph.git > onto a Centos 7 machine, then did > > ./autogen.sh > ./configure --enable-xio > make > > but the build fails when it references the src/gmock

Re: [ceph-users] Fwd: Ceph OSD suicide himself

2016-07-10 Thread Brad Hubbard
On Mon, Jul 11, 2016 at 11:48:57AM +0900, 한승진 wrote: > Hi cephers. > > I need your help for some issues. > > The ceph cluster version is Jewel(10.2.1), and the filesytem is btrfs. > > I run 1 Mon and 48 OSD in 4 Nodes(each node has 12 OSDs). > > I've experienced one of OSDs was killed himself.

Re: [ceph-users] Fwd: Ceph OSD suicide himself

2016-07-10 Thread Brad Hubbard
On Mon, Jul 11, 2016 at 1:21 PM, Brad Hubbard <bhubb...@redhat.com> wrote: > On Mon, Jul 11, 2016 at 11:48:57AM +0900, 한승진 wrote: >> Hi cephers. >> >> I need your help for some issues. >> >> The ceph cluster version is Jewel(10.2.1), and the filesytem is b

Re: [ceph-users] ceph admin socket protocol

2016-07-10 Thread Brad Hubbard
On Sun, Jul 10, 2016 at 09:32:33PM +0200, Stefan Priebe - Profihost AG wrote: > > Am 10.07.2016 um 16:33 schrieb Daniel Swarbrick: > > If you can read C code, there is a collectd plugin that talks directly > > to the admin socket: > > > >

Re: [ceph-users] Fwd: Ceph OSD suicide himself

2016-07-11 Thread Brad Hubbard
On Mon, Jul 11, 2016 at 7:18 PM, Lionel Bouton wrote: > Le 11/07/2016 04:48, 한승진 a écrit : >> Hi cephers. >> >> I need your help for some issues. >> >> The ceph cluster version is Jewel(10.2.1), and the filesytem is btrfs. >> >> I run 1 Mon and 48 OSD in 4

Re: [ceph-users] ceph-fuse segfaults ( jewel 10.2.2)

2016-07-07 Thread Brad Hubbard
Hi Goncalo, If possible it would be great if you could capture a core file for this with full debugging symbols (preferably glibc debuginfo as well). How you do that will depend on the ceph version and your OS but we can offfer help if required I'm sure. Once you have the core do the following.

Re: [ceph-users] Hammer: PGs stuck creating

2016-06-30 Thread Brad Hubbard
s-up-too-soon That should hopefully give some insight. HTH, Brad > > Brian > > On Wed, Jun 29, 2016 at 6:25 PM, Brad Hubbard <bhubb...@redhat.com> wrote: >> >> On Thu, Jun 30, 2016 at 3:22 AM, Brian Felton <bjfel...@gmail.com> wrote: >> > Greetings,

Re: [ceph-users] Hammer: PGs stuck creating

2016-06-29 Thread Brad Hubbard
On Thu, Jun 30, 2016 at 3:22 AM, Brian Felton wrote: > Greetings, > > I have a lab cluster running Hammer 0.94.6 and being used exclusively for > object storage. The cluster consists of four servers running 60 6TB OSDs > each. The main .rgw.buckets pool is using k=3 m=1

Re: [ceph-users] RADOSGW buckets via NFS?

2016-07-03 Thread Brad Hubbard
On Sun, Jul 3, 2016 at 9:07 PM, Sean Redmond wrote: > Hi, > > I noticed in the jewel release notes: > > "You can now access radosgw buckets via NFS (experimental)." > > Are there any docs that explain the configuration of NFS to access RADOSGW > buckets? Here's what I

Re: [ceph-users] High CPU usage by ceph-mgr on idle Ceph cluster

2017-02-20 Thread Brad Hubbard
t;> > for >> > this issue ? >> >> Not that I'm aware of, you could go ahead and open one. >> >> Cheers, >> John >> >> > Thanks, >> > Muthu >> > >> > On 14 February 2017 at 03:13, Brad Hubbard <bhubb...@redhat.com>

Re: [ceph-users] Fwd: Upgrade Woes on suse leap with OBS ceph.

2017-02-23 Thread Brad Hubbard
ceph-users] Upgrade Woes on suse leap with OBS ceph. > To: Brad Hubbard <bhubb...@redhat.com> > > > So setting the above to 0 by sheer brute force didn't work, so it's > not crush or osd problem.. also, the errors still say mon0, so I > suspect it's related to commu

Re: [ceph-users] Upgrade Woes on suse leap with OBS ceph.

2017-02-23 Thread Brad Hubbard
ables3": 1, > "has_v3_rules": 0, > "has_v4_buckets": 0, > "require_feature_tunables5": 1, I suspect setting the above to 0 would resolve the issue with the client but there may be a reason why this is set? Where did those packages come from?

Re: [ceph-users] Fwd: Upgrade Woes on suse leap with OBS ceph.

2017-02-23 Thread Brad Hubbard
Did you dump out the crushmap and look? On Fri, Feb 24, 2017 at 1:36 PM, Schlacta, Christ <aarc...@aarcane.org> wrote: > insofar as I can tell, yes. Everything indicates that they are in effect. > > On Thu, Feb 23, 2017 at 7:14 PM, Brad Hubbard <bhubb...@redhat.com> wro

Re: [ceph-users] Fwd: Upgrade Woes on suse leap with OBS ceph.

2017-02-23 Thread Brad Hubbard
d_ruleset { > ruleset 0 > type replicated > min_size 1 > max_size 10 > step take default > step chooseleaf firstn 0 type host > step emit > } > > # end crush map > > On Thu, Feb 23, 2017 at 7:37 PM, Brad Hubbard

Re: [ceph-users] Fwd: Upgrade Woes on suse leap with OBS ceph.

2017-02-23 Thread Brad Hubbard
Kefu has just pointed out that this has the hallmarks of https://github.com/ceph/ceph/pull/13275 On Fri, Feb 24, 2017 at 3:00 PM, Brad Hubbard <bhubb...@redhat.com> wrote: > Hmm, > > What's interesting is the feature set reported by the servers has only > changed from > >

Re: [ceph-users] Fwd: Upgrade Woes on suse leap with OBS ceph.

2017-02-23 Thread Brad Hubbard
kraken http://tracker.ceph.com/issues/18842 > > On Feb 23, 2017 21:06, "Brad Hubbard" <bhubb...@redhat.com> wrote: >> >> Kefu has just pointed out that this has the hallmarks of >> https://github.com/ceph/ceph/pull/13275 >> >> On Fri, Feb 24, 201

Re: [ceph-users] Upgrade Woes on suse leap with OBS ceph.

2017-02-23 Thread Brad Hubbard
On Thu, Feb 23, 2017 at 5:18 PM, Schlacta, Christ wrote: > So I updated suse leap, and now I'm getting the following error from > ceph. I know I need to disable some features, but I'm not sure what > they are.. Looks like 14, 57, and 59, but I can't figure out what > they

Re: [ceph-users] Authentication error CEPH installation

2017-02-23 Thread Brad Hubbard
You need ceph.client.admin.keyring in /etc/ceph/ On Thu, Feb 23, 2017 at 8:13 PM, Chaitanya Ravuri wrote: > Hi Team, > > I have recently deployed a new CEPH cluster for OEL6 boxes for my testing. I > am getting below error on the admin host. not sure how can i fix

Re: [ceph-users] High CPU usage by ceph-mgr on idle Ceph cluster

2017-02-13 Thread Brad Hubbard
utilization, and ceph-mgr was 300% of that. I > have 3 AIO nodes, and only one of them seemed to be affected. > > On Sat, Jan 14, 2017 at 12:18 AM, Brad Hubbard <bhubb...@redhat.com> wrote: >> >> Want to install debuginfo packages and use something like this to try &g

Re: [ceph-users] Cannot shutdown monitors

2017-02-10 Thread Brad Hubbard
That looks like dmesg output from the libceph kernel module. Do you have the libceph kernel module loaded? If the answer to that question is "yes" the follow-up question is "Why?" as it is not required for a MON or OSD host. On Sat, Feb 11, 2017 at 1:18 PM, Michael Andersen

Re: [ceph-users] Cannot shutdown monitors

2017-02-10 Thread Brad Hubbard
how to not need this step. Any > further info I can give to help? > > > > On Fri, Feb 10, 2017 at 8:42 PM, Michael Andersen <mich...@steelcode.com> > wrote: >> >> Sorry this email arrived out of order. I will do the modprobe -r test >> >> O

Re: [ceph-users] OSD Repeated Failure

2017-02-10 Thread Brad Hubbard
On Sat, Feb 11, 2017 at 2:51 PM, Ashley Merrick wrote: > Hello, > > > > I have a particular OSD (53), which at random will crash with the OSD > process stopping. > > > > OS: Debian 8.x > > CEPH : ceph version 10.2.5 (c461ee19ecbc0c5c330aca20f7392c9a00730367) > > > > From

Re: [ceph-users] Cannot shutdown monitors

2017-02-10 Thread Brad Hubbard
On Sat, Feb 11, 2017 at 2:58 PM, Brad Hubbard <bhubb...@redhat.com> wrote: > Just making sure the list sees this for those that are following. > > On Sat, Feb 11, 2017 at 2:49 PM, Michael Andersen <mich...@steelcode.com> > wrote: >> Right, so yes libceph is loaded

Re: [ceph-users] build and Compile ceph in development mode takes an hour

2016-08-17 Thread Brad Hubbard
On Thu, Aug 18, 2016 at 1:12 AM, agung Laksono wrote: > Hi Ceph User, > > When I make change inside ceph codes in the development mode, > I found that recompiling takes around an hour because I have to remove > a build folder and all the contest and then reproduce it. > >

  1   2   3   4   5   >