Injectargs causes an immediate runtime change; rebooting the mon would negate the change.
On Wed., Jan. 22, 2020, 4:41 p.m. St-Germain, Sylvain (SSC/SPC), < sylvain.st-germ...@canada.ca> wrote: > ///////////////////////// Problem /////////////////////////// > > I've got a Warning on my cluster that I cannot remove : > > "1 pools have many more objects per pg than average" > > Does somebody has some insight ? I think it's normal to have this warning > because I have just one pool in use, but how can I remove this warning ? > > Thx ! > > ///////////////////////// INFORMATION /////////////////////////// > > *** Here's some information about the cluster > > # ceph health detail > HEALTH_WARN 1 pools have many more objects per pg than average > MANY_OBJECTS_PER_PG 1 pools have many more objects per pg than average > pool default.rgw.buckets.data objects per pg (50567) is more than > 14.1249 times cluster average (3580) > > # sudo ceph-conf -D | grep mon_pg_warn_max_object_skew > mon_pg_warn_max_object_skew = 10.000000 > > # ceph daemon mon.dao-wkr-04 config show | grep mon_pg_warn_max_object_skew > "mon_pg_warn_max_object_skew": "10.000000" > > # ceph -v > ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus > (stable) > > # ceph df > RAW STORAGE: > CLASS SIZE AVAIL USED RAW USED %RAW > USED > hdd 873 TiB 823 TiB 50 TiB 51 TiB > 5.80 > TOTAL 873 TiB 823 TiB 50 TiB 51 TiB > 5.80 > > POOLS: > POOL ID STORED > OBJECTS USED %USED MAX AVAIL > .rgw.root 11 3.5 KiB 8 > 1.5 MiB 0 249 TiB > default.rgw.control 12 0 B 8 > 0 B 0 249 TiB > default.rgw.meta 13 52 KiB 186 > 34 MiB 0 249 TiB > default.rgw.log 14 0 B > 207 0 B 0 249 TiB > default.rgw.buckets.index 15 1.2 GiB 131 > 1.2 GiB 0 249 TiB > cephfs_data 29 915 MiB 202 > 1.5 GiB 0 467 TiB > cephfs_metadata 30 145 KiB > 23 2.1 MiB 0 249 TiB > default.rgw.buckets.data 31 30 TiB > 12.95M 50 TiB 6.32 467 TiB > > > # ceph osd dump | grep default.rgw.buckets.data pool 31 > 'default.rgw.buckets.data' erasure size 8 min_size 6 crush_rule 2 > object_hash rjenkins pg_num 256 pgp_num 256 autoscale_mode on last_change > 9502 lfor 0/2191/7577 flags hashpspool stripe_width 20480 target_size_ratio > 0.4 application rgw > > /////////////////////////// SOLUTION TRIED /////////////////////////// > > 1- I try to increase the value of mon_pg_warn_max_object_skew parameter > > #sudo ceph tell mon.* injectargs '--mon_pg_warn_max_object_skew 20' > #sudo ceph tell osd.* injectargs '--mon_pg_warn_max_object_skew 20' > > + And reboot the monitor > > The parameter didn't change. > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com