Re: [ceph-users] How to know if an object is stored in clients?

Dear Wido, Is there a command to check the ACK? Or, may you tell me a source code function for the received ACK? Thanks, Jae On Thu, Dec 29, 2016 at 6:56 PM Wido den Hollander wrote: > > > Op 28 december 2016 om 12:58 schreef Jaemyoun Lee < > jaemy...@hanyang.ac.kr>: > > > > > >

Re: [ceph-users] Crush - nuts and bolts

First off either on write / on read, client access to primary OSD directly first. More specifically clients access to the MON 1st to get cluster map, then primary OSD. So it doesn't matter to think of difference between write/read. Only difference between those 2 operations basically is that you

Re: [ceph-users] osd removal problem

This was dealt with on ceph-devel mailing list. On Thu, Dec 29, 2016 at 11:08 PM, Łukasz Chrustek wrote: > Hi, > > As I wrote at first mail - I have already done that, but I'm affraid > to load it back - is there any chance, that something will go wrong ? > > Thanks for answer

Re: [ceph-users] ceph program uses lots of memory

I accidentally replied to the wrong thread. this was meant for a different one. [cid:image5d7d18.JPG@87f9fba8.42bf12bd] David Turner | Cloud Operations Engineer | StorageCraft Technology Corporation 380

Re: [ceph-users] ceph program uses lots of memory

And we may be interested in your cluster's configuration. # ceph --show-config > $(hostname).$(date +%Y%m%d).ceph_conf.txt On Fri, Dec 30, 2016 at 7:48 AM, David Turner wrote: > Another thing that I need to make sure on is that your number of PGs in > the pool

Re: [ceph-users] ceph program uses lots of memory

Another thing that I need to make sure on is that your number of PGs in the pool with 90% of the data is a power of 2 (256, 512, 1024, 2048, etc). If that is the case, then I need the following information. 1) Pool replica size 2) The number of the pool with the data 3) A copy of your osdmap

[ceph-users] ceph program uses lots of memory

Does anyone know why the 'ceph' program uses so much memory? If I run it with an address space rlimit of less than 300M, it usually dies with messages about not being able to allocate memory. I'm curious as to what it could be doing that requires so much address space. It doesn't matter what

Re: [ceph-users] CEPH - best books and learning sites

I would start with for CentOS7 because if you get into problems you can always buy a redhat license and get support. > On Thu, Dec 29, 2016 at 6:20 AM, Andre Forigato > > wrote: >> >> Hello, >> >> I'm starting to study Ceph for implementation in our company. >> >>

Re: [ceph-users] CEPH - best books and learning sites

I always tend to jump into: https://github.com/ceph Everything is there. On Fri, Dec 30, 2016 at 2:34 AM, Michael Hackett wrote: > Hello Andre, > > The Ceph site would be the best place to get the information you are looking > for, specifically the docs section:

Re: [ceph-users] CEPH - best books and learning sites

Hello Andre, The Ceph site would be the best place to get the information you are looking for, specifically the docs section: http://docs.ceph.com/docs/master/. Karan Singh actually wrote two books which can be useful as initial resources as well Learning Ceph:

Re: [ceph-users] osd removal problem

Hi, As I wrote at first mail - I have already done that, but I'm affraid to load it back - is there any chance, that something will go wrong ? Thanks for answer ! > Hi, > Hmm, could you try and dump the crush map - decompile it - modify > it to remove the DNE osd's, compile it and load it

Re: [ceph-users] osd removal problem

Hi, Hmm, could you try and dump the crush map - decompile it - modify it to remove the DNE osd's, compile it and load it back into ceph? http://docs.ceph.com/docs/master/rados/operations/crush-map/#get-a-crush-map Thanks On Thu, Dec 29, 2016 at 1:01 PM, Łukasz Chrustek wrote:

Re: [ceph-users] osd removal problem

Hi, ]# ceph osd tree IDWEIGHTTYPE NAME UP/DOWN REWEIGHT PRIMARY-AFFINITY -7 16.89590 root ssd-disks -11 0 host ssd1 598798032 0 osd.598798032 DNE0 21940 0 osd.21940 DNE

[ceph-users] osd removal problem

Hi, I was trying to delete 3 osds from cluster, deletion procces took very long time and I interrupted it. mon process then crushed, and in ceph osd tree (after restart ceph-mon) I saw: ~]# ceph osd tree ID WEIGHTTYPE NAMEUP/DOWN REWEIGHT PRIMARY-AFFINITY -7

[ceph-users] CEPH - best books and learning sites

Hello, I'm starting to study Ceph for implementation in our company. I need the help of the community. I'm looking for Ceph's best books and learning sites. Are the people using Suse or Redhat distribution? My question is what best Linux distribution should I use? Thanks to the Ceph

[ceph-users] Unbalanced OSD's

Hello, I currently have 5 servers within my CEPH Cluster 2 x (10 * 8TB Disks) 3 x (10 * 4TB Disks) Currently seeing a larger difference in OSD use across the two separate server types, as well as within the server itself. For example on one 4TB server I have an OSD at 64% and one at 84%,

[ceph-users] osd removal problem

Hi, I was trying to delete 3 osds from cluster, deletion procces took very long time and I interrupted it. mon process then crushed, and in ceph osd tree (after restart ceph-mon) I saw: ~]# ceph osd tree ID WEIGHTTYPE NAMEUP/DOWN REWEIGHT PRIMARY-AFFINITY -7

Re: [ceph-users] How to know if an object is stored in clients?

> Op 28 december 2016 om 12:58 schreef Jaemyoun Lee : > > > Hello, > > I executed the RADOS tool to store an object as follows: > ``` > user@ClientA:~$ rados put -p=rbd objectA a.txt > ``` > > I wonder how the client knows a completion of storing the object in some >

[ceph-users] Why is file extents size observed by "rbd diff" much larger than observed by "du" the object file on the OSD's machie?

Hi, everyone. Recently, I've got a need to check the real size of an rbd image. I followed the instructions in "http://ceph.com/planet/rbd-image-real-size/;. the result is shown as follows: [xuxuehan@localhost ~]$ rbd diff xxh_pool/clone_test_img2 OffsetLength Type 0 4194304 data