Hello,
I have a test env. with a single centos-7.5 ceph server and one rbd client,
running Fedora 28.
I have set the minimum compatibility level to luminous, as shown in ceph osd
dump below.
When I use krbd for mapping rbd/demo, then it shows up as a "Jewel" client in
ceph features.
When I use rbd-nbd-12.2.5 for mapping rbd/demo, then it shows up as a
"Luminous" client in ceph features.
I have 2 questions:
#1 Does the krbd "Jewel" client understand upmap ?
#2 How can I enforce krbd client to present itself as Luminous compliant?
Details are pasted below.
Regards
Heðin
Server is CentOS-7.5
Client is Fedora 28
Both are VM's.
#### Server data ####
# ceph -v
ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable)
# ceph osd dump
epoch 55
fsid 3d9ea97f-3490-4266-894f-e770a742ec9e
created 2018-05-13 20:52:22.288571
modified 2018-05-14 00:08:31.955018
flags sortbitwise,recovery_deletes,purged_snapdirs
crush_version 15
full_ratio 0.95
backfillfull_ratio 0.9
nearfull_ratio 0.85
require_min_compat_client luminous
min_compat_client luminous
require_osd_release luminous
pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins
pg_num 256 pgp_num 256 last_change 38 flags
hashpspool stripe_width 0 application rbd
removed_snaps [1~3]
max_osd 5
osd.0 up in weight 1 up_from 54 up_thru 54 down_at 53 last_clean_interval
[46,49) 10.10.1.109:6809/2095
10.10.1.109:6810/2095 10.10.1.109:6811/2095 10.10.1.109:6812/2095 exists,up
af0e4141-6396-426d-ab3b-1fd94451a205
osd.1 up in weight 1 up_from 51 up_thru 54 down_at 50 last_clean_interval
[45,49) 10.10.1.109:6800/1477
10.10.1.109:6801/1477 10.10.1.109:6802/1477 10.10.1.109:6803/1477 exists,up
33ef93fc-62ad-4a4f-a0e0-1f2abf511255
osd.2 up in weight 1 up_from 54 up_thru 54 down_at 50 last_clean_interval
[46,49) 10.10.1.109:6817/2153
10.10.1.109:6818/2153 10.10.1.109:6819/2153 10.10.1.109:6820/2153 exists,up
88d7464e-ff15-4549-9555-db5d21c0ad9c
osd.3 up in weight 1 up_from 54 up_thru 54 down_at 50 last_clean_interval
[47,49) 10.10.1.109:6805/2071
10.10.1.109:6806/2071 10.10.1.109:6807/2071 10.10.1.109:6808/2071 exists,up
3ab68921-008c-476b-8d2c-e681571218c8
osd.4 up in weight 1 up_from 54 up_thru 54 down_at 50 last_clean_interval
[46,49) 10.10.1.109:6813/2144
10.10.1.109:6814/2144 10.10.1.109:6815/2144 10.10.1.109:6816/2144 exists,up
ba7ebc90-9013-41d7-82ca-e10f38f3189b
pg_upmap_items 1.1 [4,0,3,0]
pg_upmap_items 1.4 [3,0,1,0]
# rbd info rbd/demo
rbd image 'demo':
size 6144 MB in 1536 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.104774b0dc51
format: 2
features: layering
flags:
create_timestamp: Sun May 13 21:24:42 2018
# rbd info rbd/demo2
rbd image 'demo2':
size 6144 MB in 1536 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.5e8074b0dc51
format: 2
features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
flags:
create_timestamp: Mon May 14 00:39:40 2018
# ceph features #### With client having mapped as follows: rbd map rbd/demo
{
"mon": {
"group": {
"features": "0x1ffddff8eea4fffb",
"release": "luminous",
"num": 1
}
},
"osd": {
"group": {
"features": "0x1ffddff8eea4fffb",
"release": "luminous",
"num": 5
}
},
"client": {
"group": {
"features": "0x7010fb86aa42ada",
"release": "jewel",
"num": 1
},
"group": {
"features": "0x1ffddff8eea4fffb",
"release": "luminous",
"num": 2
}
}
}
# ceph features #### With client having mapped as follows: rbd nbd map rbd/demo
{
"mon": {
"group": {
"features": "0x1ffddff8eea4fffb",
"release": "luminous",
"num": 1
}
},
"osd": {
"group": {
"features": "0x1ffddff8eea4fffb",
"release": "luminous",
"num": 5
}
},
"client": {
"group": {
"features": "0x1ffddff8eea4fffb",
"release": "luminous",
"num": 3
}
}
}
#### Client data ####
# uname -r
4.16.7-300.fc28.x86_64
# rbd -v
ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable)
# dnf list installed|grep -i -E "ceph|rbd"
ceph-common.x86_64 1:12.2.5-1.fc28 @updates
ceph-deploy.noarch 1.5.32-5.fc28 @fedora
libcephfs2.x86_64 1:12.2.5-1.fc28 @updates
librbd1.x86_64 1:12.2.5-1.fc28 @updates
libvirt-daemon-driver-storage-rbd.x86_64 4.1.0-2.fc28 @anaconda
python-cephfs.x86_64 1:12.2.5-1.fc28 @updates
python-rbd.x86_64 1:12.2.5-1.fc28 @updates
qemu-block-rbd.x86_64 2:2.11.1-2.fc28 @anaconda
rbd-nbd.x86_64 1:12.2.5-1.fc28 @updates
_______________________________________________
ceph-users mailing list
[email protected]
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
