[ceph-users] Re: ceph osd df results

+1 From: Marc Sent: Thursday, February 11, 2021 12:09 PM To: ceph-users Subject: [ceph-users] ceph osd df results Check twice before you click! This email originated from outside PNNL. Should the ceph osd df results not have this result for every

[ceph-users] Re: cephadm upgrade issue persisting with one node

Its all good, finally got it working, some of the osd nodes had the incorrect default gw. cheers Darrin On 12/2/21 9:41 am, Darrin Hodges wrote: > Hi all, > > Still getting upgrade issue with cephadm " Upgrade: failed to pull > target image".  On each of the nodes in the cluster I can do: > > >

[ceph-users] Re: Cannot access "Object Gateway" in dashboard after setting rgw api keys

Hi Troels, 1) It seems you need to set up the user id like this: ceph dashboard set-rgw-api-user-id More info here: https://docs.ceph.com/en/nautilus/mgr/dashboard/#enabling-the-object-gateway-management-frontend 2) Have you set up multisite configuration (realms/zonegroups/zones) ? Please

[ceph-users] Some slow writes over time

I am running a simple workload (just 1 client and 1 file) of random writings on Ceph FS and I noticed that approximately 3% of the operations (well spread over time) show latencies higher than the other 97% (100 ms x 10 ms). Is there any reason for this to happen? - I'm using fio with

[ceph-users] File I/O with mixed read/write and high streaming performance

Hi all, I'm trying to understand if the CephFS is a good approach for the following scenario. From some of the OLD benchmarks, GlusterFS significantly beat the CephFS when many file I/Os were required. But... this was an OLD benchmark. I'd like your thoughts on the matter. What I need to

[ceph-users] cephadm upgrade issue persisting with one node

Hi all, Still getting upgrade issue with cephadm " Upgrade: failed to pull target image".  On each of the nodes in the cluster I can do: docker pull docker.io/ceph/ceph:v15.2.8 And there is no error but the upgrade command fails still. I can see an entry in the logs for: Feb 11

[ceph-users] adding a second rgw instance on the same zone

Hi guys, I have a Mimic cluster with only one RGW machine.  My setup is simple - one realm, one zonegroup, one zone.  How can I safely add a second RGW server to the same zone ? Is it safe to just run "ceph-deploy rgw create" for the second server without impacting the existing metadata

[ceph-users] ceph osd df results

Should the ceph osd df results not have this result for every device class? I do not think that there people mixing these classes in pools. MIN/MAX VAR: 0.78/4.28 STDDEV: 6.15 ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an

[ceph-users] Re: Proper solution of slow_ops

On 2/11/21 1:39 PM, Davor Cubranic wrote: > But the config reference says “high” is already the default value? > (https://docs.ceph.com/en/latest/rados/configuration/osd-config-ref/) > It is not default in Nautilus. See

[ceph-users] Re: db_devices doesn't show up in exported osd service spec

I ran into the same situation when I created my first Octopus cluster. After purging everything, I started over and included a “model” instead of “rotational: 0” for data_devices in the spec, and this time it worked fine (it appears both in the output of `orch apply` and `orch ls —export`, as

[ceph-users] Re: Increasing QD=1 performance (lowering latency)

Hi Wido, do you know what happened to mellanox's ceph rdma project of 2018? We will test ARM Ampere for all-flash this half-year and probably get the opportunity to experiment with software defined memory. Regards, Joachim ___ Clyso GmbH Am 08.02.2021 um

[ceph-users] Re: Proper solution of slow_ops

But the config reference says “high” is already the default value? (https://docs.ceph.com/en/latest/rados/configuration/osd-config-ref/ ) This selects which priority ops will be sent to the strict queue verses the normal

[ceph-users] Re: db_devices doesn't show up in exported osd service spec

/dev/sdb is the SSD holding DB LVs for multiple HDDs. What I expect is that, as long as there is sufficient space on db_devices specified in service spec, a LV should be created. Now, circling back to the original question, how does OSD replacement work? I've been trying for a few weeks and

[ceph-users] Re: Storage-class split objects

On Thu, Feb 11, 2021 at 9:31 AM Marcelo wrote: > > Hi Casey, thank you for the reply. > > I was wondering, just as the placement target is in the bucket metadata in > the index, if it would not be possible to insert the storage-class > information in the metadata of the object that is in the

[ceph-users] RGW/Swift 404 error when listing/deleting a newly created empty bucket

So, as the subject states I have an issue with buckets returning a 404 error when they are listed immediately after being created; as well the bucket fails to be deleted if you try to delete it immediately after creation. The behaviour is intermittent. If I leave the bucket in place for a few

[ceph-users] Re: Storage-class split objects

Hi Casey, thank you for the reply. I was wondering, just as the placement target is in the bucket metadata in the index, if it would not be possible to insert the storage-class information in the metadata of the object that is in the index as well. Or did I get it wrong and there is absolutely no

[ceph-users] Re: krbd crc

On Thu, Feb 11, 2021 at 12:44 PM Seena Fallah wrote: > > Many thanks for your response. > One more question, In the case of a CRC mismatch how many times does it retry > and does it raise any error logs in the kernel to see if it had a CRC > mismatch or not? You will see bad "crc/signature"

[ceph-users] Re: krbd crc

Many thanks for your response. One more question, In the case of a CRC mismatch how many times does it retry and does it raise any error logs in the kernel to see if it had a CRC mismatch or not? On Thu, Feb 11, 2021 at 3:05 PM Ilya Dryomov wrote: > On Thu, Feb 11, 2021 at 1:34 AM Seena Fallah

[ceph-users] Re: krbd crc

On Thu, Feb 11, 2021 at 1:34 AM Seena Fallah wrote: > > Hi, > I have a few questions about krbd on kernel 4.15 > > 1. Does it support msgr v2? (If not which kernel supports msgr v2?) No. Support for msgr2 has been merged into kernel 5.11, due to be released this weekend. Note that the kernel

[ceph-users] how far can we go using vstart.sh script for fake dev cluster-HELP

Hi, Ceph source code contains a script called vstart.sh which allows developers to quickly test their code using a simple deployment on your development system. Here: https://docs.ceph.com/en/latest//dev/quick_guide/ I am really curious that how far we can go with vstart.sh script. While my

[ceph-users] Data sync init vs bucket sync init

Hi, What’s the difference between data sync init and bucket sync init? Data initialise the complete cluster? Bucket only bucket? I see when initialise finished, have shards behind but doesn’t do anything with it? What is the proper steps to bring things back to sync? Init Run Restart ??

[ceph-users] Re: 15.2.8 mgr keep crashing every few days

Hi, The following thread on this emailing list might be relevant: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/IAJRTIMFALJTZD3KYBHT4G7GEL6EHRR5/#IAJRTIMFALJTZD3KYBHT4G7GEL6EHRR5 Best regards, Sebastian El jue, 11 feb 2021 a las 10:32, levin ng () escribió: > Hi all, > > I’d

[ceph-users] Data sync init vs bucket sync init

Hi, What’s the difference between data sync init and bucket sync init? Data initialise the complete cluster? Bucket only bucket? I see when initialise finished, have shards behind but doesn’t do anything with it? What is the proper steps to bring things back to sync? Init Run Restart

[ceph-users] 15.2.8 mgr keep crashing every few days

Hi all, I’d recently deployed ceph 15.2.8 with 3(mon,mgr,rgw,mds) and 4 (osd) total 7 host, however I encountered mgr crash a few times a week, the crashing mgr can be any one of 3. I couldn’t identify the problem behind and here is the crash info, appreciate anyone if you have suggestions that

[ceph-users] Re: Dashboard : Block image listing and infos

Hello Ernesto, Le 2021-02-10 18:37, Ernesto Puerta a écrit : Thanks, Gilles. I recently opened a PR to improve RBD image listing (https://github.com/ceph/ceph/pull/39344). In your specific case, I think that part of the issue could come from calculating the actually provisioned capacity. Could