Re: [ceph-users] Using straw2 crush also with Hammer

On 11/13/2015 09:11 AM, Karan Singh wrote: > > >> On 11 Nov 2015, at 22:49, David Clarke wrote: >> >> On 12/11/15 09:37, Gregory Farnum wrote: >>> On Wednesday, November 11, 2015, Wido den Hollander >> > wrote: >>> >>>On

Re: [ceph-users] rbd create => seg fault

On Fri, Nov 13, 2015 at 5:25 AM, Mark Kirkwood wrote: > When you do: > > $ rbd create > > You are using the kernel (i.e 3.13) code for rbd, and this is likely much > older than the code you just built for the rest of Ceph. You *might* have > better luck installing

Re: [ceph-users] about PG_Number

Hi wah peng, Just a thought. If you have a large amount of OSDs but less pg number. You will find your data write unevenly. Some OSD have no change to write data. In the other side, pg number too large but OSD number too small that have a chance to cause data lost. Best wishes, Mika

Re: [ceph-users] about PG_Number

why data lost happens? thanks. On 2015/11/13 星期五 16:13, Vickie ch wrote: In the other side, pg number too large but OSD number too small that have a chance to cause data lost. ___ ceph-users mailing list ceph-users@lists.ceph.com

Re: [ceph-users] SL6/Centos6 rebuild question

Well... I misinterpreted the error. It is not systemd related but selinux related. I must be missing some selinux component. Will investigate better. From: Goncalo Borges [goncalo.bor...@sydney.edu.au] Sent: 13 November 2015 16:51 To:

Re: [ceph-users] Using straw2 crush also with Hammer

> On 11 Nov 2015, at 22:49, David Clarke wrote: > > On 12/11/15 09:37, Gregory Farnum wrote: >> On Wednesday, November 11, 2015, Wido den Hollander > > wrote: >> >>On 11/10/2015 09:49 PM, Vickey Singh wrote: >>> On Mon, Nov 9,

Re: [ceph-users] data balancing/crush map issue

I've just discovered the hashpspool setting and found that it is set to false on all of my pools. I can't really work out what this setting does though. Can anyone please explain what this setting does and whether it would improve my situation? Thanks J On 11 November 2015 at 14:51, James

Re: [ceph-users] Ceph OSDs with bcache experience

2015-10-20 16:00 GMT+02:00 Wido den Hollander : ... > The system consists out of 39 hosts: > > 2U SuperMicro chassis: > * 80GB Intel SSD for OS > * 240GB Intel S3700 SSD for Journaling + Bcache > * 6x 3TB disk I'm currently testing a similar setup, but it turns out that setup and

[ceph-users] all pgs of erasure coded pool stuck stale

Hi all, What could be the reason that all pgs of a whole Erasure Coded pool are stuck stale? All OSDS are restarted and up.. The details: We have a setup with 14 OSD hosts with specific OSDs for an Erasure coded pool and 2 SSDS for a cache pool, and 3 seperate monitor/metadata nodes with

Re: [ceph-users] about PG_Number

"Learning Ceph" book gives us the following formula: PGs = OSDs × 100 / (replicas × pools) Saying, you have 10 OSDs and 5 pools with replica 2, you get: PGs = 10 × 100 / (2 × 5) = 100 PGs (per pool) It is also advised to round PGs count up to nearest power of 2. In this case, to 128. In

Re: [ceph-users] Unable to install ceph

Looks like ceph-deploy 1.5.20 thinks your Ubuntu 15.10 wily system is an Upstart-based system, and it's systemd instead. - Ken On Fri, Nov 13, 2015 at 7:51 AM, Robert Shore wrote: > OS: Linux b260-space-pc62 4.2.0-18-generic #22-Ubuntu SMP Fri Nov 6 18:25:50 > UTC 2015

[ceph-users] Ceph object mining

Hi, I setup ceph cluster for storing pictures. I want to introduce a data mining program in ceph osd nodes to dig objects with concrete properties. I hope some kind of map-reduce framework can use ceph object interface directly,while not using posix file system interface. Can somebody help give

Re: [ceph-users] FW: RGW performance issue

No documentation that am aware of. The idea is to avoid having multiple RGW instances, if there is enough cluster bandwidth that a single RGW instance can drive through. -Original Message- From: Jens Rosenboom [mailto:j.rosenb...@x-ion.de] Sent: Friday, November 13, 2015 8:58 PM To:

Re: [ceph-users] about PG_Number

Use the following link, it should give an idea about pg_number. http://ceph.com/pgcalc/ Number of PGs/OSd has implication on number of TCP connection in the system along with some resources on cpu/memory. So, if you have lots of PG/OSD it may degrade performance, I think mainly because of

Re: [ceph-users] FW: RGW performance issue

2015-11-13 5:47 GMT+01:00 Pavan Rallabhandi : > If you are on >=hammer builds, you might want to consider the option of > using 'rgw_num_rados_handles', which opens up more handles to the cluster > from RGW. This would help in scenarios, where you have enough number

Re: [ceph-users] all pgs of erasure coded pool stuck stale

Somebody else will need to do the diagnosis, but it'll help them if you can get logs with "debug ms = 1", "debug osd = 20" in the log. Based on the required features update in the crush map, it looks like maybe you've upgraded some of your OSDs — is that a thing happening right now? Perhaps you

Re: [ceph-users] Ceph object mining

I think I saw somebody working on a RADOS interface to Apache Hadoop once, maybe search for that? Your other option is to try and make use of object classes directly, but that's a bit orimitive to build full map-reduce on top of without a lot of effort. -Greg On Friday, November 13, 2015, min

Re: [ceph-users] Missing bucket

On Fri, Nov 13, 2015 at 12:53 PM, Łukasz Jagiełło wrote: > Hi all, > > Recently I've noticed a problem with one of our buckets: > > I cannot list or stats on a bucket: > #v+ > root@ceph-s1:~# radosgw-admin bucket stats --bucket=problematic_bucket > error getting bucket

[ceph-users] Infernalis and xattr striping

Hi All, If I have upgraded a cluster from Hammer to Infernalis and I have a situation where some of my xattrs are larger than what could be stored inline in Hammer. http://lists.ceph.com/pipermail/ceph-users-ceph.com/2015-June/002607.html How do I take advantage of this new striping feature. Do

Re: [ceph-users] Missing bucket

On Fri, Nov 13, 2015 at 1:37 PM, Łukasz Jagiełło wrote: >> >> > Recently I've noticed a problem with one of our buckets: >> >> > >> >> > I cannot list or stats on a bucket: >> >> > #v+ >> >> > root@ceph-s1:~# radosgw-admin bucket stats >> >> >

Re: [ceph-users] Missing bucket

> > >> > Recently I've noticed a problem with one of our buckets: > >> > > >> > I cannot list or stats on a bucket: > >> > #v+ > >> > root@ceph-s1:~# radosgw-admin bucket stats > --bucket=problematic_bucket > >> > error getting bucket stats ret=-22 > >> > >> That's EINVAL, not ENOENT. It could

Re: [ceph-users] Missing bucket

On Fri, Nov 13, 2015 at 1:07 PM, Yehuda Sadeh-Weinraub wrote: > > Recently I've noticed a problem with one of our buckets: > > > > I cannot list or stats on a bucket: > > #v+ > > root@ceph-s1:~# radosgw-admin bucket stats --bucket=problematic_bucket > > error getting bucket

Re: [ceph-users] Missing bucket

On Fri, Nov 13, 2015 at 1:47 PM, Yehuda Sadeh-Weinraub wrote: > >> >> > Recently I've noticed a problem with one of our buckets: > >> >> > > >> >> > I cannot list or stats on a bucket: > >> >> > #v+ > >> >> > root@ceph-s1:~# radosgw-admin bucket stats > >> >> >

[ceph-users] Missing bucket

Hi all, Recently I've noticed a problem with one of our buckets: I cannot list or stats on a bucket: #v+ root@ceph-s1:~# radosgw-admin bucket stats --bucket=problematic_bucket error getting bucket stats ret=-22 ➜ ~ s3cmd -c /etc/s3cmd/prod.cfg ls s3://problematic_bucket/images/e/e0/file.png

Re: [ceph-users] Missing bucket

On Fri, Nov 13, 2015 at 1:14 PM, Łukasz Jagiełło wrote: > On Fri, Nov 13, 2015 at 1:07 PM, Yehuda Sadeh-Weinraub > wrote: >> >> > Recently I've noticed a problem with one of our buckets: >> > >> > I cannot list or stats on a bucket: >> > #v+ >> >

Re: [ceph-users] rbd create => seg fault

Hello... Want to share some more info about the rbd problem I am have. I took Jason's suggestion to heart as there was a past errant configure that was run with prefix not getting set so it installed into /. I never did clean that up but today I configured a Ceph Makefile for / and ran `make

Re: [ceph-users] ms crc header: seeking info?

On Sat, Nov 14, 2015 at 8:29 AM, Artie Ziff wrote: > Hello! > > I see similar behavior on a build of version 9.2.0-702-g7d926ce > > Single node. > Ceph Mon only service that is running. > > In Ceph configuration file (/etc/ceph/ceph.conf) > ms_crc_header = false > > $ ceph

Re: [ceph-users] rbd create => seg fault

On Sat, Nov 14, 2015 at 9:23 AM, Artie Ziff wrote: >>> >> Yes, this is definitely an old version of librados getting picked up >> somewhere in your library load path. >> >> You can find where the old librados is via: >> >> strace -f -e open ./rbd ls 2>&1 | grep librados.so >

Re: [ceph-users] rbd create => seg fault

On 11/13/2015 03:47 PM, Artie Ziff wrote: Hello... Want to share some more info about the rbd problem I am have. I took Jason's suggestion to heart as there was a past errant configure that was run with prefix not getting set so it installed into /. I never did clean that up but today I

Re: [ceph-users] Ceph object mining

Thanks Gregory. I find intel introduced a technology for running hadoop on rgw direclty(http://www.slideshare.net/zhouyuan/hadoop-over-rgw), but I think it is complex for my usage. There is another technology storlet(

Re: [ceph-users] ms crc header: seeking info?

Hello! I see similar behavior on a build of version 9.2.0-702-g7d926ce Single node. Ceph Mon only service that is running. In Ceph configuration file (/etc/ceph/ceph.conf) ms_crc_header = false $ ceph -s 2015-11-13 16:06:24.594453 7f6944221700 0 -- 17.10.10.60:0/1019560 >> 17.10.10.60:6789/0

[ceph-users] Ceph Meta-data Server (MDS) installation giving error

Hi All, I installed the Ceph cluster on CentOS using the following configuration file: *[global]fsid = f1fccdcf-f53f-4a6d-93f2-002f392e98damon_initial_members = ceph-mon1mon_host = 192.168.122.213auth_cluster_required = cephxauth_service_required =

[ceph-users] Multipath Support on Infernalis

Hi, It appears that Multipath support is available on 512 and not 4k sector size. This is on RHEL 7.1. Can someone please confirm? 4k Sector size == Nov 13 16:20:16 colusa5-ceph kernel: device-mapper: table: 253:60: len=5119745 not aligned to h/w logical block size 4096 of dm-16

[ceph-users] librbd ports to other language

Hi, I found there is only librbd's python wrapper. Do you know how to ports this library to other language such as Java/Ruby/Perl etc? -- Master user for YYcloud Groups masteru...@groups.yyclouds.com ___ ceph-users mailing list

Re: [ceph-users] librbd ports to other language

On 11/13/2015 09:20 PM, Master user for YYcloud Groups wrote: Hi, I found there is only librbd's python wrapper. Do you know how to ports this library to other language such as Java/Ruby/Perl etc? Here are a few other ports of librbd: Java: https://github.com/ceph/rados-java Ruby:

Re: [ceph-users] ceph-deploy for "deb http://ceph.com/debian-hammer/ trusty main"

Hi, can someone shed some light on the status of this issue? I can see that Loic removed the target version a few days ago. Is there any way we can help to fix this? cheers, Jaime On Thu, Oct 22, 2015 at 10:16 PM, David Clarke wrote: > On 23/10/15 09:08, Kjetil

[ceph-users] Question about OSD activate with ceph-deploy

Hi all, I'm having some issues while trying to run the osd activate command with ceph-deploy tool (1.5.28), the osd prepare command run fine, but then... osd: sdf1 journal: /dev/sdc1 $ ceph-deploy osd activate cibn01:sdf1:/dev/sdc1 [ceph_deploy.conf][DEBUG ] found configuration file at:

Re: [ceph-users] about PG_Number

In our experience too few PGS leads to non-uniform disk load as well. We had lots of blocked IO when many of the disks were idle because there were and equal number always at 100% utilized. Lots of blocked IO when OSDS restarted and scanning the huge PGS (data). Scrubs were also painful for

Re: [ceph-users] cephfs: Client hp-s3-r4-compute failing torespondtocapabilityrelease

On Tue, Nov 10, 2015 at 12:06 AM, Burkhard Linke < burkhard.li...@computational.bio.uni-giessen.de> wrote: > Hi, > > On 11/09/2015 04:03 PM, Gregory Farnum wrote: >> >> On Mon, Nov 9, 2015 at 6:57 AM, Burkhard Linke >> wrote: >>> >>> Hi, >>> >>> On

[ceph-users] Unable to install ceph

OS: Linux b260-space-pc62 4.2.0-18-generic #22-Ubuntu SMP Fri Nov 6 18:25:50 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux (wily werewolf) Command: ceph-deploy mon create-initial Log fragment: [ceph_deploy.conf][DEBUG ] found configuration file at: /home/dfs/.cephdeploy.conf

Re: [ceph-users] about PG_Number

Hi, On 13/11/2015 09:13, Vickie ch wrote: > If you have a large amount of OSDs but less pg number. You will find your > data write unevenly. > Some OSD have no change to write data. > In the other side, pg number too large but OSD number too small that have a > chance to cause data lost. Data

Re: [ceph-users] Ceph OSDs with bcache experience

On 13-11-15 10:56, Jens Rosenboom wrote: > 2015-10-20 16:00 GMT+02:00 Wido den Hollander : > ... >> The system consists out of 39 hosts: >> >> 2U SuperMicro chassis: >> * 80GB Intel SSD for OS >> * 240GB Intel S3700 SSD for Journaling + Bcache >> * 6x 3TB disk > > I'm currently