[ceph-users] recommended Linux distro for Ceph Pacific small cluster

Hi, What is the recommended Linux distro for Ceph Pacific. I would like to set up a small cluster having around 4-5 OSDs, one monitor node and one client node. Earlier I have been using CentOS. Is it recommended to continue with CentOS? or should I go for another distro? Please do comment.

[ceph-users] Re: Archive in Ceph similar to Hadoop Archive Utility (HAR)

thanks Anthony and Janneexactly what I have been looking for! On Fri, Feb 25, 2022 at 9:25 AM Janne Johansson wrote: > Den fre 25 feb. 2022 kl 08:49 skrev Anthony D'Atri < > anthony.da...@gmail.com>: > > There was a similar discussion last year around Software Heritage’s > archive project,

[ceph-users] Archive in Ceph similar to Hadoop Archive Utility (HAR)

Hi, Is there any archive utility in Ceph similar to Hadoop Archive Utility (HAR)? Or in other words. how can one archive small files in Ceph? Thanks ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to

[ceph-users] Monitor dashboard notification: "will be full in less than 5 days......"

Hello all, Please excuse if my question is too basic and I should have known it already. Given my OSDs in Ceph storage cluster are not at all full, I get this Monitor notification "will be full in less than 5 days assuming the average fill-up rate of the past 48 hours". Any idea how to handle

[ceph-users] Ceph source code build bug in Pacific for Ubuntu 18.04?

Hi, Is there any Ubuntu 18.04 related bug for Ceph latest release Pacific? I never had a problem building Ceph source code as compared to now. Every time it points to CMake related errors. I am using Cmake 3.22. I have made sure all dependencies are installed but I simply fail to build the

[ceph-users] Re: Cephalocon 2022 deadline extended?

one typing mistakeI meant 19 December 2021 On Fri, Dec 10, 2021 at 8:21 PM Bobby wrote: > > Hi all, > > Has the CfP deadline for Cephalcoon 2022 been extended to 19 December > 2022? Please confirm if anyone knows it... > > > Thanks > _

[ceph-users] Cephalocon 2022 deadline extended?

Hi all, Has the CfP deadline for Cephalcoon 2022 been extended to 19 December 2022? Please confirm if anyone knows it... Thanks ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Ceph rbd-nbd performance benchmark

Hi, I am trying to benchmark the Ceph rbd-nbd performance. Are there any authentic existing benchmark results of rbd-nbd for comparison? BR Bobby ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le

[ceph-users] Re: struggling to achieve high bandwidth on Ceph dev cluster - HELP

@Marc: thanks a lot.. your results have been helpful to understand. @Mark: mainly HDDs.not even one SSD.so yes, pretty slow. On Wed, Feb 10, 2021 at 9:22 PM Marc wrote: > > Some more questions please: > > How many OSDs have you been using in your second email tests for 1gbit > > [1] >

[ceph-users] how far can we go using vstart.sh script for fake dev cluster-HELP

Hi, Ceph source code contains a script called vstart.sh which allows developers to quickly test their code using a simple deployment on your development system. Here: https://docs.ceph.com/en/latest//dev/quick_guide/ I am really curious that how far we can go with vstart.sh script. While my

[ceph-users] Re: struggling to achieve high bandwidth on Ceph dev cluster - HELP

thanks. Ceph source code contains a script called vstart.sh which allows developers to quickly test their code using a simple deployment on your development system. Here: https://docs.ceph.com/en/latest//dev/quick_guide/ Although I completely agree with your manual deployment part, I thought

[ceph-users] Re: struggling to achieve high bandwidth on Ceph dev cluster - HELP

thanks, this looks really helpful and it proves me that I am not doing the right way. And you had the hit the nail by asking about *replication factor*. Because I don't know how to change the replication factor. AFAIK, by default it is *3x*. But I would like to change, for example to* 2x*. So

[ceph-users] struggling to achieve high bandwidth on Ceph dev cluster - HELP

block sizes 4K, 8K, 16K, 32K, 64K, 128K, 256K, 512K. And I have also been changing the -t parameter in the shell to increase concurrent IOs. Looking forward to help. Bobby ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email

[ceph-users] Re: rados bench error after running vstart script- HELP PLEASE

yes, correct.it was in older releasesI remember once I saw this video from Sage where he had run the rados bench on a default 'rbd'. On Tue, Jan 26, 2021 at 2:23 PM Janne Johansson wrote: > Den tis 26 jan. 2021 kl 14:20 skrev Bobby : > > well, you are right. I forgot

[ceph-users] Re: rados bench error after running vstart script- HELP PLEASE

well, you are right. I forgot to create the pool. I thought 'rbd' pool is created by default. Now it works after creating it :-) On Tue, Jan 26, 2021 at 1:52 PM Eugen Block wrote: > The message is quite clear, it seems as if you don't have a pool > "rbd", do you? >

[ceph-users] rados bench error after running vstart script- HELP PLEASE

Hello, I am having an error while trying to run rados benchmark after running vstart script I run : ../src/vstart.sh -d -n -l and then when I try to run: bin/rados -p rbd bench 30 write it gives me error saying: error opening pool rbd: (2) No such file or directory Can someone please help

[ceph-users] Ceph on vector machines

Hi all, Just out of curiosity.Considering vector machines are being used in HPC applications to accelerate certain kernels, do you think there are some workloads in Ceph that could be good candidates to be offloaded and accelerated on vector machines ? Thanks in advance. BR

[ceph-users] uniform and list crush bucket algorithm usage in data centers

Hi all, For placement purposes ceph uses the default straw2 bucket algorithm. I am curious if the other two bucket algorithms like uniform and list are also being used in some present use cases in data centers? Are there any use cases where straw2 is not being used at all ? BR

[ceph-users] using fio tool in ceph development cluster (vstart.sh)

Hi, I am using the Ceph development cluster through vstart.sh script. I would like to measure/benchmark read and write performance (benchmark ceph at a low level). For that I want to use the fio tool. Can we use fio on the development cluster? AFAIK, we can. I have seen the fio option in the

[ceph-users] Re: [Ceph-qa] Using rbd-nbd tool in Ceph development cluster

Thanks a lot ! It works :-) On Mon, Nov 16, 2020 at 2:15 PM Mykola Golub wrote: > On Mon, Nov 16, 2020 at 12:19:35PM +0100, Bobby wrote: > > > My question is: Can we use this *rbd-nbd* tool in the Ceph cluster? By > Ceph > > cluster I mean the development cluster we bui

[ceph-users] Using rbd-nbd tool in Ceph development cluster

Hi, I have to use this *rbd-nbd *tool from Ceph. This is part of Ceph source code. Here: https://github.com/ceph/ceph/tree/master/src/tools/rbd_nbd My question is: Can we use this *rbd-nbd* tool in the Ceph cluster? By Ceph cluster I mean the development cluster we build through *vstart.sh*

[ceph-users] rbd-nbd multi queue

driver? Thanks Bobby ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: Bonus Ceph Tech Talk: Edge Application - Stream Multiple Video Sources

thanks! On Thursday, August 20, 2020, Mike Perez wrote: > Here's the video in case you missed it: > > https://www.youtube.com/watch?v=Q8bU-m07Czo > > On 8/20/20 10:03 AM, Mike Perez wrote: >> >> And we're live! Please join us and bring questions! >> >> https://bluejeans.com/908675367 >> >> On

[ceph-users] Re: Bonus Ceph Tech Talk: Edge Application - Stream Multiple Video Sources

Hi...Will it be available on youtube? On Thursday, August 20, 2020, Marc Roos wrote: > > Can't join as guest without enabling mic and/or camera??? > > -Original Message- > From: Mike Perez [mailto:mipe...@redhat.com] > Sent: donderdag 20 augustus 2020 19:03 > To: ceph-users@ceph.io >

[ceph-users] Re: Can you block gmail.com or so!!!

No please :-( ! I'm a Ceph user with a gmail account. On Thursday, August 6, 2020, David Galloway wrote: > Oh, interesting. You appear to be correct. I'm running each of the > mailing lists' services in their own containers so the private IP makes > sense. > > I just commented on a FR for

[ceph-users] which exact decimal value is meant here for S64_MIN in CRUSH Mapper

w > high_draw) { high = i; high_draw = draw; } } return bucket->h.items[high]; } Thanks Bobby ! ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] weight_set array in Ceph CRUSH

, this _weight_set_ array should be a 2D array, am I right? struct crush_choose_arg { __s32 *ids; /*!< values to use instead of items */ __u32 ids_size; /*!< size of the __ids__ array */ struct crush_weight_set *weight_set; /*!< weight replacements for a given position */ __u32 weight_set_positions; };

[ceph-users] Re: script for compiling and running the Ceph source code

And to put it more precisely, I would like to figure out how many times this particular function is called during the execution of the program? BR Bobby ! On Tue, Jul 21, 2020 at 1:24 PM Bobby wrote: > > Hi, > > I am trying to profile the number of invocations to a particu

[ceph-users] script for compiling and running the Ceph source code

Hi, I am trying to profile the number of invocations to a particular function in Ceph source code. I have instrumented the code with time functions. Can someone please share the script for compiling and running the Ceph source code? I am struggling with it. That would be great help ! BR Bobby

[ceph-users] Re: client - monitor communication.

Hi Budai, When you ask "*how often the client is retrieving the Cluster Map?*" . The obvious answer to that is there is nothing 'often' in it. Whenever there is a change in the map, the monitor will inform the client. I think you need to read about the CRUSH algorithm in Ceph. Because that will

[ceph-users] Ceph and Red Hat Summit 2020

Hi, Any Ceph related event in Red Hat Summit 2020 happening today? BR Bobby ! ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] multiple BLK-MQ queues for Ceph's RADOS Block Device (RBD) and CephFS

(Filesystem in User Space) I can develop a multi-queue driver for Ceph? Asking because this way I can avoid kernel space. ( https://docs.ceph.com/docs/nautilus/start/quick-cephfs/) Looking forward for some help BR Bobby ___ ceph-users mailing list -- ceph

[ceph-users] Research and Industrial conferences for Ceph research results

forward to hearing from you. BR Bobby !! ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Pointers in __crush_do_rule__ function of CRUSH mapper file

j; int numrep; int out_size; Thanks Bobby ! ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Ceph and linux multi queue block IO layer

Hi all, One question please. Does Ceph uses the linux multi queue block IO layer ? BR Bobby ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] struct crush_bucket **buckets in Ceph CRUSH

Hi, I have a question regarding Ceph CRUSH. I have been going through Crush.h file. It says that *struct crush_bucket **buckets * (below) is an array of pointers. My understanding is that this particular array of pointers is a collection of addresses of six scalar values namely __s32 id;

[ceph-users] Purpose of crush_ln() function

Hi, I am trying to understand Straw2 Bucket of Ceph CRUSH algorithm. Can someone please tell what is the purpose of* crush_ln?* And what does "*compute 2^44*log2(input+1)*" means in the comment section above above *crush_ln* function? Thanks in advance

[ceph-users] Maximum size of data in crush_choose_firstn Ceph CRUSH source code

, - int *out2, - const struct crush_choose_arg *choose_args *- const struct crush_map *map.* What is the maximum size of data involved here? I mean what is the upper bound? BR Bobby ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send

[ceph-users] Ceph and iSCSI

Hi all, I am new to Ceph. But I have a some good understanding of iSCSI protocol. I will dive into Ceph because it looks promising. I am particularly interested in Ceph-RBD. I have a request. Can you please tell me, if any, what are the common similarities between iSCSI and Ceph. If someone has

[ceph-users] Unit testing of CRUSH Algorithm

Hi, Are there any more resources of unit tests for CRUSH algorithm other than the test cases here: : https://github.com/ceph/ceph/tree/master/src/test/crush Or more unit testing of CRUSH apart from the these test cases would be an overkill? BR Bobby

[ceph-users] Workload in Unit testing

is the workload of unit tests? Are these tests enough for profiling function calls count, loop counts, parallelism to a good extent? Thanks in advance ! BR Bobby ! ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph

[ceph-users] Re: asynchronous/non-sequential example read and write test codes Librados

and here I would like to ask you and fellow Ceph people about the workload in: https://github.com/ceph/ceph/tree/master/src/test/crush. Thanks in advance BR Bobby! On Mon, May 4, 2020 at 6:19 PM Casey Bodley wrote: > On Mon, May 4, 2020 at 9:30 AM Bobby wrote: > > > > Hi Cepher

[ceph-users] asynchronous/non-sequential example read and write test codes Librados

in advance Bobby ! ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Ceph crushtool in developer mode

Hi Cephers, Can we use *crushtool* in developer mode? I have deployed a fake local cluster for development purpose as described by Ceph documentation here ( https://docs.ceph.com/docs/mimic/dev/dev_cluster_deployement/) Best regards Bobby ! ___ ceph

[ceph-users] Re: Newbie Question: CRUSH and Librados Profiling

Hi once again ! Can someone please help me on this question :-) Bobby ! On Wed, Apr 29, 2020 at 2:05 PM Bobby wrote: > > > Hi, > > It is a newbie question. I would be really thankful if you can answer it > please. I want to compile the Ceph source code. Because I want to p

[ceph-users] Newbie Question: CRUSH and Librados Profiling

to profile the function stacks. Is this the correct way for *CPU profiling*? Please let me know if it is fine or is there something more also. Bobby ! ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le

[ceph-users] Re: Increase number of read and writes

://github.com/ceph/ceph/blob/master/examples/librbd/hello_world.cc ) .. On Thu, Apr 23, 2020 at 4:16 PM Janne Johansson wrote: > > > Den tors 23 apr. 2020 kl 16:07 skrev Bobby : > >> Hi, >> >> I am using Ceph in developer mode. Currently I am implementing Libra

[ceph-users] Increase number of read and writes

Hi, I am using Ceph in developer mode. Currently I am implementing Librados examples which are also available in Introduction to Librados section https://docs.ceph.com/docs/master/rados/api/librados-intro/#step-3-creating-an-i-o-context. It says once your app has a cluster handle and a connection