Re: [ceph-users] 10.2.6 upgrade
Hello Sage, Thanks for the response. I new fairly new to ceph. Is there any commands that would help confirm the issue? Kind regards, Glen Baars T 1300 733 328 NZ +64 9280 3561 MOB +61 447 991 234 This e-mail may contain confidential and/or privileged information.If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. -Original Message- From: Sage Weil Sent: Wednesday, 18 July 2018 10:38 PM To: Glen Baars Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] 10.2.6 upgrade On Wed, 18 Jul 2018, Glen Baars wrote: > Hello Ceph Users, > > We installed 12.2.6 on a single node in the cluster ( new node added, > 80TB moved ) Disabled scrub/deepscrub once the issues with 12.2.6 were > discovered. > > > Today we upgrade the one affected node to 12.2.7 today, set osd skip data > digest = true and re enabled the scrubs. It's a 500TB all bluestore cluster. > > > We are now seeing inconsistent PGs and scrub errors now the scrubbing has > resumed. It is likely the inconsistencies were tehre from teh period running 12.2.6, not due ot 12.2.7. I would suggest continuing the upgrade. The scrub errors will either go away on their own or need to wait until 12.2.8 for scrub to learn how to repair them for you. Can you share the scrub error you got to confirm it is the digest issue in 12.2.6 that is to blame? sage > What is the best way forward? > > > 1. Upgrade all nodes to 12.2.7? > 2. Remove the 12.2.7 node and rebuild? > Kind regards, > Glen Baars > BackOnline Manager > This e-mail is intended solely for the benefit of the addressee(s) and any > other named recipient. It is confidential and may contain legally privileged > or confidential information. If you are not the recipient, any use, > distribution, disclosure or copying of this e-mail is prohibited. The > confidentiality and legal privilege attached to this communication is not > waived or lost by reason of the mistaken transmission or delivery to you. If > you have received this e-mail in error, please notify us immediately. > This e-mail is intended solely for the benefit of the addressee(s) and any other named recipient. It is confidential and may contain legally privileged or confidential information. If you are not the recipient, any use, distribution, disclosure or copying of this e-mail is prohibited. The confidentiality and legal privilege attached to this communication is not waived or lost by reason of the mistaken transmission or delivery to you. If you have received this e-mail in error, please notify us immediately. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] 10.2.6 upgrade
On Wed, 18 Jul 2018, Glen Baars wrote: > Hello Ceph Users, > > We installed 12.2.6 on a single node in the cluster ( new node added, 80TB > moved ) > Disabled scrub/deepscrub once the issues with 12.2.6 were discovered. > > > Today we upgrade the one affected node to 12.2.7 today, set osd skip data > digest = true and re enabled the scrubs. It's a 500TB all bluestore cluster. > > > We are now seeing inconsistent PGs and scrub errors now the scrubbing has > resumed. It is likely the inconsistencies were tehre from teh period running 12.2.6, not due ot 12.2.7. I would suggest continuing the upgrade. The scrub errors will either go away on their own or need to wait until 12.2.8 for scrub to learn how to repair them for you. Can you share the scrub error you got to confirm it is the digest issue in 12.2.6 that is to blame? sage > What is the best way forward? > > > 1. Upgrade all nodes to 12.2.7? > 2. Remove the 12.2.7 node and rebuild? > Kind regards, > Glen Baars > BackOnline Manager > This e-mail is intended solely for the benefit of the addressee(s) and any > other named recipient. It is confidential and may contain legally privileged > or confidential information. If you are not the recipient, any use, > distribution, disclosure or copying of this e-mail is prohibited. The > confidentiality and legal privilege attached to this communication is not > waived or lost by reason of the mistaken transmission or delivery to you. If > you have received this e-mail in error, please notify us immediately. > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] 10.2.6 upgrade
Hello Ceph Users, We installed 12.2.6 on a single node in the cluster ( new node added, 80TB moved ) Disabled scrub/deepscrub once the issues with 12.2.6 were discovered. Today we upgrade the one affected node to 12.2.7 today, set osd skip data digest = true and re enabled the scrubs. It's a 500TB all bluestore cluster. We are now seeing inconsistent PGs and scrub errors now the scrubbing has resumed. What is the best way forward? 1. Upgrade all nodes to 12.2.7? 2. Remove the 12.2.7 node and rebuild? Kind regards, Glen Baars BackOnline Manager This e-mail is intended solely for the benefit of the addressee(s) and any other named recipient. It is confidential and may contain legally privileged or confidential information. If you are not the recipient, any use, distribution, disclosure or copying of this e-mail is prohibited. The confidentiality and legal privilege attached to this communication is not waived or lost by reason of the mistaken transmission or delivery to you. If you have received this e-mail in error, please notify us immediately. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
