[ovirt-users] Re: Constantly XFS in memory corruption inside VMs

[Vinícius Ferrão via Users]

Hi again,

I had to shutdown everything because of a power outage in the office. When 
trying to get the infra up again, even the Engine have corrupted:

[  772.466982] XFS (dm-4): Invalid superblock magic number
mount: /var: wrong fs type, bad option, bad superblock on 
/dev/mapper/ovirt-var, missing codepage or helper program, or other error.
[  772.472885] XFS (dm-3): Mounting V5 Filesystem
[  773.629700] XFS (dm-3): Starting recovery (logdev: internal)
[  773.731104] XFS (dm-3): Metadata CRC error detected at 
xfs_agfl_read_verify+0xa1/0xf0 [xfs], xfs_agfl block 0xf3
[  773.734352] XFS (dm-3): Unmount and run xfs_repair
[  773.736216] XFS (dm-3): First 128 bytes of corrupted metadata buffer:
[  773.738458] : 23 31 31 35 36 35 35 34 29 00 2d 20 52 65 62 75  
#1156554).- Rebu
[  773.741044] 0010: 69 6c 74 20 66 6f 72 20 68 74 74 70 73 3a 2f 2f  ilt 
for https://
[  773.743636] 0020: 66 65 64 6f 72 61 70 72 6f 6a 65 63 74 2e 6f 72  
fedoraproject.or
[  773.746191] 0030: 67 2f 77 69 6b 69 2f 46 65 64 6f 72 61 5f 32 33  
g/wiki/Fedora_23
[  773.748818] 0040: 5f 4d 61 73 73 5f 52 65 62 75 69 6c 64 00 2d 20  
_Mass_Rebuild.-
[  773.751399] 0050: 44 72 6f 70 20 6f 62 73 6f 6c 65 74 65 20 64 65  Drop 
obsolete de
[  773.753933] 0060: 66 61 74 74 72 20 73 74 61 6e 7a 61 73 20 28 23  fattr 
stanzas (#
[  773.756428] 0070: 31 30 34 37 30 33 31 29 00 2d 20 49 6e 73 74 61  
1047031).- Insta
[  773.758873] XFS (dm-3): metadata I/O error in "xfs_trans_read_buf_map" at 
daddr 0xf3 len 1 error 74
[  773.763756] XFS (dm-3): xfs_do_force_shutdown(0x8) called from line 446 of 
file fs/xfs/libxfs/xfs_defer.c. Return address = 962bd5ee
[  773.769363] XFS (dm-3): Corruption of in-memory data detected.  Shutting 
down filesystem
[  773.772643] XFS (dm-3): Please unmount the filesystem and rectify the 
problem(s)
[  773.776079] XFS (dm-3): xfs_imap_to_bp: xfs_trans_read_buf() returned error 
-5.
[  773.779113] XFS (dm-3): xlog_recover_clear_agi_bucket: failed to clear agi 
3. Continuing.
[  773.783039] XFS (dm-3): xfs_imap_to_bp: xfs_trans_read_buf() returned error 
-5.
[  773.785698] XFS (dm-3): xlog_recover_clear_agi_bucket: failed to clear agi 
3. Continuing.
[  773.790023] XFS (dm-3): Ending recovery (logdev: internal)
[  773.792489] XFS (dm-3): Error -5 recovering leftover CoW allocations.
mount: /var/log: can't read superblock on /dev/mapper/ovirt-log.
mount: /var/log/audit: mount point does not exist.

/var seems to be completely trashed.

The only time that I’ve seem something like this was faulty hardware. But 
nothing shows up on logs, as far as I know.

After forcing repairs with -L I’ve got other issues:

mount -a
[  326.170941] XFS (dm-4): Mounting V5 Filesystem
[  326.404788] XFS (dm-4): Ending clean mount
[  326.415291] XFS (dm-3): Mounting V5 Filesystem
[  326.611673] XFS (dm-3): Ending clean mount
[  326.621705] XFS (dm-2): Mounting V5 Filesystem
[  326.784067] XFS (dm-2): Starting recovery (logdev: internal)
[  326.792083] XFS (dm-2): Metadata CRC error detected at 
xfs_agi_read_verify+0xc7/0xf0 [xfs], xfs_agi block 0x2
[  326.794445] XFS (dm-2): Unmount and run xfs_repair
[  326.795557] XFS (dm-2): First 128 bytes of corrupted metadata buffer:
[  326.797055] : 4d 33 44 34 39 56 00 00 80 00 00 00 f0 cf 00 00  
M3D49V..
[  326.799685] 0010: 00 00 00 00 02 00 00 00 23 10 00 00 3d 08 01 08  
#...=...
[  326.802290] 0020: 21 27 44 34 39 56 00 00 00 d0 00 00 01 00 00 00  
!'D49V..
[  326.804748] 0030: 50 00 00 00 00 00 00 00 23 10 00 00 41 01 08 08  
P...#...A...
[  326.807296] 0040: 21 27 44 34 39 56 00 00 10 d0 00 00 02 00 00 00  
!'D49V..
[  326.809883] 0050: 60 00 00 00 00 00 00 00 23 10 00 00 41 01 08 08  
`...#...A...
[  326.812345] 0060: 61 2f 44 34 39 56 00 00 00 00 00 00 00 00 00 00  
a/D49V..
[  326.814831] 0070: 50 34 00 00 00 00 00 00 23 10 00 00 82 08 08 04  
P4..#...
[  326.817237] XFS (dm-2): metadata I/O error in "xfs_trans_read_buf_map" at 
daddr 0x2 len 1 error 74
mount: /var/log/audit: mount(2) system call failed: Structure needs cleaning.

But after more xfs_repair -L the engine is up…

Now I need to scavenge other VMs and do the same thing.

That’s it.

Thanks all,
V.

PS: For those interested, there’s a paste of the fixes: 
https://pastebin.com/jsMguw6j

On 29 Nov 2020, at 17:03, Strahil Nikolov 
mailto:hunter86...@yahoo.com>> wrote:

Damn...

You are using EFI boot. Does this happen only to EFI machines ?
Did you notice if only EL 8 is affected ?

Best Regards,
Strahil Nikolov






В неделя, 29 ноември 2020 г., 19:36:09 Гринуич+2, Vinícius Ferrão 
mailto:fer...@versatushpc.com.br>> написа:





Yes!

I have a live VM right now that will de dead on a reboot:

[root@kontainerscomk ~]# cat /etc/*release
NAME="Red Hat Enterprise Linux"
VERSION="8.3 (Ootpa)"
ID="rhel"
ID_LIKE="fedora"
VERSION_ID="8.3"
PLATFORM_ID="platform:el8"
PRETTY_NAME="Red Hat Enterp

[ovirt-users] Re: Guest OS Memory Free/Cached/Buffered: Not Configured

[Stefan Seifried]

Thanks, I will play around a little with the settings. 

The VM is a build agent so disk caching is not too much of a concern. I 
originally started with only 4GB of memory and build times only slightly 
improved with 16GB (104 minutes to 100 minutes).
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/GENLHWWEHHFH7XOQF2E32PD3KUIQWVT5/

[ovirt-users] Re: Guest OS Memory Free/Cached/Buffered: Not Configured

[Stefan Seifried]

Thanks Liran, that issue fits my problem indeed.

Installing ovirt-guest-agent on the older VM's (CentOS 7) did the trick. 
However, on a CentOS 8 (Kernel 4.18) + qemu-guest-agent (2.12.0) the values 
still do not show. But maybe the guest agents are still too old.
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/VXIM2VYLQC5UIWQJ56UO3N2TDPE4BORC/

[ovirt-users] Re: How to install win-virtio Drivers (aka guest tools) silently

[Sandro Bonazzola]

Il giorno lun 30 nov 2020 alle ore 15:25  ha
scritto:

> Hi,
>
> i am currently trying to automate an upgrade process from the "old" oVirt
> 4.3 Guest Tools new one which should using starting with oVirt 4.4
> To achieve this I have to install the win-virtio tools quietly. This works
> even if I use the parameters /install /passive /norestart. But then the
> oVirt Guest Agent is not installed. Is there a parameter or another way to
> install it during a silent installation?
>

+Gal Zaidman  can you help here?



>
> Thanks in advance.
>
>  - Tim
> ___
> Users mailing list -- users@ovirt.org
> To unsubscribe send an email to users-le...@ovirt.org
> Privacy Statement: https://www.ovirt.org/privacy-policy.html
> oVirt Code of Conduct:
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
> https://lists.ovirt.org/archives/list/users@ovirt.org/message/43BP5RIM5RZYLHD6RXXDQAQWYAWT2GWA/
>


-- 

Sandro Bonazzola

MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV

Red Hat EMEA 

sbona...@redhat.com


*Red Hat respects your work life balance. Therefore there is no need to
answer this email out of your office hours.
*
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/JDWB5E4ZX2YYS4IZ2EMPXRHPVOKDRKIB/

[ovirt-users] How to install win-virtio Drivers (aka guest tools) silently

[t . hofmann]

Hi,

i am currently trying to automate an upgrade process from the "old" oVirt 4.3 
Guest Tools new one which should using starting with oVirt 4.4
To achieve this I have to install the win-virtio tools quietly. This works even 
if I use the parameters /install /passive /norestart. But then the oVirt Guest 
Agent is not installed. Is there a parameter or another way to install it 
during a silent installation?

Thanks in advance.

 - Tim
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/43BP5RIM5RZYLHD6RXXDQAQWYAWT2GWA/