Gary, No prob with the info, thanks for providing it.
Since you're using Storpool, I'd suggest you reach out to them on this directly and see whether they have any information that could be helpful. There was an issue a while ago (Storpool actually reported it) where a kernel commit introduced a bug that caused file corruption. That was back in about 2018 - https://storpool.com/blog/beware-silent-data-corruption-discovered-in-linux-kernels-4-10-4-17/ I believe ACS 4.15.x uses Debian 10.5 (Buster) for the VR images (dates to August 2020), That release is based on kernel 4.19.0-10. -Si ________________________________ From: Gary Dixon <gary.di...@quadris.co.uk.INVALID> Sent: Wednesday, July 20, 2022 3:00 PM To: users@cloudstack.apache.org <users@cloudstack.apache.org> Subject: Re: Virtual Router filesystem corruption EXTERNAL EMAIL: This message originated outside of ENA. Use caution when clicking links, opening attachments, or complying with requests. Click the "Phish Alert Report" button above the email, or contact MIS, regarding any suspicious message. Hi SI Sure. Sorry for the lack of info. First time posting on the forum. We are using KVM hyper visor on Ubuntu 20.04 hosts. Primary storage is Storpool. Let me know if you need more info Best regards Gary Get Outlook for iOS<https://aka.ms/o0ukef> Gary Dixon Technical Consultant T: 0161 537 4980<tel:0161%20537%204980> W: www.quadris.co.uk [cid:image937435.png@813B89FF.AD6D2675] The information contained in this e-mail from Quadris may be confidential and privileged for the private use of the named recipient. The contents of this e-mail may not necessarily represent the official views of Quadris. If you have received this information in error you must not copy, distribute or take any action or reliance on its contents. Please destroy any hard copies and delete this message. ________________________________ From: Simon Weller <swel...@ena.com.INVALID> Sent: Wednesday, July 20, 2022 8:55:22 PM To: users@cloudstack.apache.org <users@cloudstack.apache.org> Subject: Re: Virtual Router filesystem corruption Gary, Can you provide some information about the OS, underlying hypervisor and primary storage in use? -Si ________________________________ From: Gary Dixon <gary.di...@quadris.co.uk.INVALID> Sent: Wednesday, July 20, 2022 11:15 AM To: users@cloudstack.apache.org <users@cloudstack.apache.org> Subject: Virtual Router filesystem corruption EXTERNAL EMAIL: This message originated outside of ENA. Use caution when clicking links, opening attachments, or complying with requests. Click the "Phish Alert Report" button above the email, or contact MIS, regarding any suspicious message. Hi All We are seeing ext4 filesystem corruption on a number of virtual routers recently and manually running fsck doesn’t appear to help at all in fixing the issue (Corrupt inode bitmap) We end up having to restart the associated VPC with cleanup enable to rebuild a new VR. Is this a common issue with ACS 4.15.1 ? Or are there specific circumstances that are causing the VR fs corruption that we could perhaps mitigate ? Kind regards Gary Gary Dixon Technical Consultant T: 0161 537 4980<tel:0161%20537%204980> W: https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.quadris.co.uk%2F&data=05%7C01%7CGary.Dixon%40quadris.co.uk%7C6494994721954e76957d08da6a89d5be%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C637939437472349569%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=qmSsPmr6P17hETukglH7IHduYr0TFdKtmjIk61MF1w8%3D&reserved=0 [cid:image001.png@01D89C5B.5685DCC0] The information contained in this e-mail from Quadris may be confidential and privileged for the private use of the named recipient. The contents of this e-mail may not necessarily represent the official views of Quadris. If you have received this information in error you must not copy, distribute or take any action or reliance on its contents. Please destroy any hard copies and delete this message.