Re: [ceph-users] What is difference in storing data between rbd and rados ?

2014-08-07 Thread debian Only
Hope expert give me some light 2014-08-06 18:01 GMT+07:00 debian Only onlydeb...@gmail.com: I am confuse to understand how File store in Ceph. I do two test. where is the File or the object for the File ①rados put Python.msi Python.msi -p data ②rbd -p testpool create fio_test --size 2048

[ceph-users] Regarding cache tier understanding

2014-08-07 Thread Somnath Roy
Hi Sage, I went through the tiering agent code base and here is my understanding on the agent behavior. Please let me know if that is correct. 1. Agent will be always in idle state if target_max_bytes or target_max_objects not set on the pool irrespective of other tiering params set in

Re: [ceph-users] slow OSD brings down the cluster

2014-08-07 Thread Luis Periquito
Hi Mark, I've been playing with the reweight on 3 of the OSDs (BTW each OSD is backed by a HDD, with a SSD backing all the 4 journals on each host) and these slower ones were given a reweight of 0.5, 0.66 and 0.66. From what I gathered the reweight would also reduce the number of I/O directed at

Re: [ceph-users] ceph rbd volume can't remove because image still has watchers

2014-08-07 Thread Karan Singh
Make sure the volume volume-17d9397b-d6e5-45e0-80fa-4bc7b7998842” does no have a snapshot or cloned linked to it , it might sometimes cause problems while deletion. - Karan Singh On 07 Aug 2014, at 08:55, 杨万元 yangwanyuan8...@gmail.com wrote: Hi all: we use ceph rbd with openstack

Re: [ceph-users] Ceph writes stall for long perioids with no disk/network activity

2014-08-07 Thread Mariusz Gronczewski
I've often wished for some sort of bottleneck finder for ceph. An easy way for the system to say where it is experiencing critical latencies e.g. network, journals, osd data disks, etc. This would assist troubleshooting and initial deployments immensely. As mentioned above, it's

Re: [ceph-users] Ceph writes stall for long perioids with no disk/network activity

2014-08-07 Thread Christian Balzer
On Thu, 7 Aug 2014 14:21:30 +0200 Mariusz Gronczewski wrote: I've often wished for some sort of bottleneck finder for ceph. An easy way for the system to say where it is experiencing critical latencies e.g. network, journals, osd data disks, etc. This would assist

Re: [ceph-users] What is difference in storing data between rbd and rados ?

2014-08-07 Thread Sage Weil
On Thu, 7 Aug 2014, debian Only wrote: Hope expert give me some light 2014-08-06 18:01 GMT+07:00 debian Only onlydeb...@gmail.com: I am confuse to understand how File store in Ceph. I do two test. where is the File or the object for the File ?rados put Python.msi Python.msi -p

Re: [ceph-users] Regarding cache tier understanding

2014-08-07 Thread Sage Weil
On Thu, 7 Aug 2014, Somnath Roy wrote: Hi Sage, I went through the tiering agent code base and here is my understanding on the agent behavior. Please let me know if that is correct.   1.   Agent will be always in idle state if target_max_bytes or target_max_objects not set on the

[ceph-users] Ceph can't seem to forget

2014-08-07 Thread Sean Sullivan
I think I have a split issue or I can't seem to get rid of these objects. How can I tell ceph to forget the objects and revert? How this happened is that due to the python 2.7.8/ceph bug ( a whole rack of ceph went town (it had ubuntu 14.10 and that seemed to have 2.7.8 before 14.04). I didn't

Re: [ceph-users] Openstack Havana root fs resize don't work

2014-08-07 Thread Hauke Bruno Wollentin
Yes, I use cloud-init with cloud-initramfs-growroot without other scripts. I tested your advices within a fresh image, but poorly I do not see any result. The only thing the log said about my mounts oder FS' is [CLOUDINIT] helpers.py[DEBUG]: Running config-mounts using lock (FileLock using

Re: [ceph-users] Regarding cache tier understanding

2014-08-07 Thread Somnath Roy
Thanks Sage, this helps ! Regards Somnath -Original Message- From: Sage Weil [mailto:sw...@redhat.com] Sent: Thursday, August 07, 2014 7:12 AM To: Somnath Roy Cc: ceph-de...@vger.kernel.org; ceph-users@lists.ceph.com; Anirban Ray; Allen Samuels Subject: Re: Regarding cache tier

[ceph-users] Is there a Ceph quick reference card?

2014-08-07 Thread O'Reilly, Dan
See the above subject. AKA a cheat sheet? Dan O'Reilly UNIX Systems Administration [cid:image001.jpg@01CFB232.9F0DE2B0] 9601 S. Meridian Blvd. Englewood, CO 80112 720-514-6293 ___ ceph-users mailing list ceph-users@lists.ceph.com

[ceph-users] ceph-deploy activate actually didn't activate the OSD

2014-08-07 Thread German Anders
Hi to all, I'm having some issues while trying to deploy a OSD: ceph@cephdeploy01:~/ceph-deploy$ ceph-deploy osd prepare --fs-type btrfs cephosd01:sdd:sde [ceph_deploy.cli][INFO ] Invoked (1.4.0): /usr/bin/ceph-deploy osd prepare --fs-type btrfs cephosd01:sdd:sde [ceph_deploy.osd][DEBUG

Re: [ceph-users] Ceph can't seem to forget

2014-08-07 Thread Craig Lewis
Have you re-formatted and re-added all of the lost OSDs? I've found that if you lose an OSD, you can tell Ceph the data is gone (ceph osd lost OSDID), but it won't believe you until it can talk to that OSDID again. If you have OSDs that are offline, you can verify that Ceph is waiting on them

[ceph-users] Can't start OSD

2014-08-07 Thread O'Reilly, Dan
# idweight type name up/down reweight -1 7.2 root default -2 1.8 host tm1cldosdl01 0 0.45osd.0 up 1 1 0.45osd.1 up 1 2 0.45osd.2 up 1 3 0.45

[ceph-users] Start clients during boot

2014-08-07 Thread O'Reilly, Dan
How do I get ceph clients to start after a system boot? Dan O'Reilly UNIX Systems Administration [cid:image001.jpg@01CFB258.1469ADD0] 9601 S. Meridian Blvd. Englewood, CO 80112 720-514-6293 ___ ceph-users mailing list ceph-users@lists.ceph.com

Re: [ceph-users] ceph-deploy activate actually didn't activate the OSD

2014-08-07 Thread Mark Kirkwood
On 08/08/14 07:07, German Anders wrote: Hi to all, I'm having some issues while trying to deploy a OSD: ceph@cephmon01:~$ *sudo ceph osd tree* # idweighttype nameup/downreweight -12.73root default -22.73host cephosd01 02.73osd.0

Re: [ceph-users] Ceph can't seem to forget

2014-08-07 Thread Craig Lewis
For your RDB volumes, you've lost random 4MiB chunks from your virtual disks. Think of it as unrecoverable bad sectors on the HDD. It was only a few unfound objects though (ceph status said 23 out of 5128982). You can probably recovery from that. I'd fsck all of the volumes, and perform any

Re: [ceph-users] rados bench no clean cleanup

2014-08-07 Thread zhu qiang
Not cleanup, it is --no-cleanup -Original Message- From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Kenneth Waegeman Sent: Wednesday, August 06, 2014 4:49 PM To: ceph-users Subject: [ceph-users] rados bench no clean cleanup Hi, I did a test with 'rados -p ecdata