Re: [CentOS-virt] Centos 7 Kernel 3.10.0-693.11.6.el7.x86_64 does not boot PV

[Shaun Reitan]

Weird, Just did a new PV deploy of CentOS 7 and upgraded the kernel and 
it worked fine this time.


--
Shaun Reitan
NDCHost.com

-- Original Message --
From: "Johnny Hughes" 
To: centos-virt@centos.org
Sent: 2018-01-09 07:33:26 AM
Subject: Re: [CentOS-virt] Centos 7 Kernel 3.10.0-693.11.6.el7.x86_64 
does not boot PV



On 01/08/2018 02:10 PM, Shaun Reitan wrote:
While installing the experemental kernel on a CentOS 7 PV the 
following
happened. After a reboot of the PV the kernel looks to be installed 
but

there is no option for booting it in grub.  I attempted to run yum
reinstall kernel-4.9.75-204.el7.centos.x86_64 and it installed fine 
but
still no entry in grub. No initramfs existed and I found 
kernel-modules
did not install properly so I then ran yum reinstall kernel-modules 
and

received a ton of errors that looked like the following..

depmod: ERROR: failed to load symbols from
/lib/modules/4.9.75-204.el7.centos.x86_64/kernel/drivers/misc/sgi-xp/xpc.ko.xz:
Exec format error

after which a initramfs does exist however on reboot still no option 
for

the new kernel.


Installed and works fine for me.

Very odd.

from my Dom0 machine:
[root@xendom0 ~]# uname -a
Linux xendom0 4.9.75-29.el7.x86_64 #1 SMP Fri Jan 5 19:42:28 UTC 2018
x86_64 x86_64 x86_64 GNU/Linux

From my DomU CentOS-7 PV VM:
Linux x7-x8664-pv 4.9.75-204.el7.centos.x86_64 #1 SMP Fri Jan 5 
17:51:39

UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

My CentOS-7 PV config:
[root@xendom0 ~]# cat /etc/xen/config.d/c7-x8664.pv.cfg
bootloader= "/usr/lib/xen/bin/pygrub"
name = "c7-x8664.pv"
memory = 4096
vcpus = 2
vif = [ 'mac=00:16:3E:29:00:02,bridge=xenbr0' ]
disk = [ 'phy:/dev/cl/c7-x8664-pv,xvda,rw' ]
vfb = [ 'type=vnc,vncdisplay=1,vncpasswd=supersecret' ]






[root@CC0A2543 ~]# [  587.145018] [ cut here ]
[  587.145018] kernel BUG at arch/x86/kernel/paravirt.c:244!
[  587.145018] invalid opcode:  [#1] SMP
[  587.145018] Modules linked in: xen_netfront coretemp pcspkr 
ip_tables

ext4 mbcache jbd2 xen_blkfront
[  587.145018] CPU: 0 PID: 2126 Comm: dracut Not tainted
3.10.0-123.4.4.el7.x86_64 #1
[  587.145018] task: 880002da5b00 ti: 8800f6088000 task.ti:
8800f6088000
[  587.145018] RIP: e030:[]  []
enter_lazy.part.0+0x4/0x6
[  587.145018] RSP: e02b:8800ff403ab0  EFLAGS: 00010002
[  587.145018] RAX: 0001 RBX: 8800f8ad4040 RCX:
3000
[  587.145018] RDX: 8840 RSI: 8800 RDI:
0005a52cc067
[  587.145018] RBP: 8800ff403ab0 R08: 8800ff403b78 R09:
81362409
[  587.145018] R10: 8800fa001e00 R11: 8800 R12:
c9609000
[  587.145018] R13: c9608000 R14:  R15:
8100a6b0
[  587.145018] FS:  7f14b0680740() GS:8800ff40()
knlGS:
[  587.145018] CS:  e033 DS:  ES:  CR0: 8005003b
[  587.145018] CR2: 7f14b0473000 CR3: f6099000 CR4:
2660
[  587.145018] DR0:  DR1:  DR2:

[  587.145018] DR3:  DR6: 0ff0 DR7:
0400
[  587.145018] Stack:
[  587.145018]  8800ff403ac0 81046bc7 8800ff403b60
8116d8d6
[  587.145018]  c9608fff c9609000 818cec90
c9608fff
[  587.145018]  c9609000 8800fa04d000 0004
c9608fff
[  587.145018] Call Trace:
[  587.145018]  
[  587.145018]  [] paravirt_enter_lazy_mmu+0x27/0x30
[  587.145018]  [] apply_to_page_range+0x266/0x440
[  587.145018]  [] arch_gnttab_map_status+0x3b/0x70
[  587.145018]  [] gnttab_map_frames_v2+0xd6/0x150
[  587.145018]  [] gnttab_map+0xa1/0x140
[  587.145018]  [] get_free_entries+0x100/0x2e0
[  587.145018]  [] 
gnttab_alloc_grant_references+0x15/0x30

[  587.145018]  [] do_blkif_request+0x683/0x850
[xen_blkfront]
[  587.145018]  [] __blk_run_queue+0x33/0x40
[  587.145018]  [] blk_start_queue+0x29/0x40
[  587.145018]  []
kick_pending_request_queues+0x21/0x30 [xen_blkfront]
[  587.145018]  [] blkif_interrupt+0x5c7/0x670
[xen_blkfront]
[  587.145018]  [] 
handle_irq_event_percpu+0x3e/0x1e0

[  587.145018]  [] handle_irq_event+0x3d/0x60
[  587.145018]  [] handle_edge_irq+0x77/0x130
[  587.145018]  [] 
__xen_evtchn_do_upcall+0x227/0x350

[  587.145018]  [] xen_evtchn_do_upcall+0x2b/0x50
[  587.145018]  [] 
xen_do_hypervisor_callback+0x1e/0x30

[  587.145018]  
[  587.145018]  [] ? free_cpumask_var+0x9/0x10
[  587.145018]  [] ? unmap_page_range+0x5f8/0x860
[  587.145018]  [] ? unmap_single_vma+0x81/0xf0
[  587.145018]  [] ? unmap_vmas+0x49/0x90
[  587.145018]  [] ? exit_mmap+0xac/0x1a0
[  587.145018]  [] ? mmput+0x67/0xf0
[  587.145018]  [] ? flush_old_exec+0x422/0x880
[  587.145018]  [] ? load_elf_binary+0x33c/0xde0
[  587.145018]  [] ? ima_get_action+0x23/0x30
[  587.145018]  [] ? process_measurement+0x8e/0x250
[  587.145018]  [] ? ima_bprm_check+0x49/0x50
[  587.145018]  [] ? 

[CentOS-virt] Centos 7 Kernel 3.10.0-693.11.6.el7.x86_64 does not boot PV

[Caribe Schreiber]

I thought I'd chime in and say that I'm seeing the same kernel-plus boot
failure that Shaun Reitan reported earlier.  Is there likely to be another
build 3.10 kernel build coming down the pipeline that might fix this
issue?  Here's the output of my failed PV domU boot:


[0.00] Initializing cgroup subsys cpuset
[0.00] Initializing cgroup subsys cpu
[0.00] Initializing cgroup subsys cpuacct
[0.00] Linux version 3.10.0-693.11.6.el7.centos.plus.x86_64 (
buil...@kbuilder.dev.centos.org) (gcc version 4.8.5 20150623 (Red Hat
4.8.5-16) (GCC) ) #1 SMP Thu Jan 4 14:27:13 UTC 2018
[0.00] Command line: root=/dev/xvda1 root=/dev/xvda1
[0.00] ACPI in unprivileged domain disabled
[0.00] e820: BIOS-provided physical RAM map:
[0.00] Xen: [mem 0x-0x0009] usable
[0.00] Xen: [mem 0x000a-0x000f] reserved
[0.00] Xen: [mem 0x0010-0x] usable
[0.00] NX (Execute Disable) protection: active
[0.00] DMI not present or invalid.
[0.00] e820: last_pfn = 0x10 max_arch_pfn = 0x4
[0.00] RAMDISK: [mem 0x0243e000-0x034befff]
[0.00] NUMA turned off
[0.00] Faking a node at [mem 0x-0x]
[0.00] NODE_DATA(0) allocated [mem 0xff802000-0xff828fff]
[0.00] Zone ranges:
[0.00]   DMA  [mem 0x1000-0x00ff]
[0.00]   DMA32[mem 0x0100-0x]
[0.00]   Normal   empty
[0.00] Movable zone start for each node
[0.00] Early memory node ranges
[0.00]   node   0: [mem 0x1000-0x0009]
[0.00]   node   0: [mem 0x0010-0x]
[0.00] Initmem setup node 0 [mem 0x1000-0x]
[0.00] SFI: Simple Firmware Interface v0.81
http://simplefirmware.org
[0.00] No local APIC present
[0.00] APIC: disable apic facility
[0.00] APIC: switched to apic NOOP
[0.00] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
[0.00] PM: Registered nosave memory: [mem 0x000a-0x000f]
[0.00] e820: cannot find a gap in the 32bit address range
[0.00] e820: PCI devices with unassigned 32bit BARs may break!
[0.00] e820: [mem 0x10010-0x1004f] available for PCI
devices
[0.00] Booting paravirtualized kernel on Xen
[0.00] Xen version: 4.7.2 (preserve-AD)
[0.00] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:4 nr_cpu_ids:4
nr_node_ids:1
[0.00] PERCPU: Embedded 35 pages/cpu @8800ff20 s104600
r8192 d30568 u524288
[0.00] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes)
[0.00] Built 1 zonelists in Node order, mobility grouping on.
Total pages: 1032074
[0.00] Policy zone: DMA32
[0.00] Kernel command line: root=/dev/xvda1 root=/dev/xvda1
[0.00] PID hash table entries: 4096 (order: 3, 32768 bytes)
[0.00] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[0.00] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using
standard form
[0.00] Memory: 2194120k/4194304k available (6984k kernel code, 388k
absent, 116588k reserved, 4581k data, 1800k init)
[0.00] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[0.00] x86/pti: Xen PV detected, disabling PTI protection
[0.00] Hierarchical RCU implementation.
[0.00]  RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=4.
[0.00] NR_IRQS:327936 nr_irqs:48 0
[0.00] Console: colour dummy device 80x25
[0.00] console [tty0] enabled
[0.00] console [hvc0] enabled
[0.00] allocated 16777216 bytes of page_cgroup
[0.00] please try 'cgroup_disable=memory' option if you don't want
memory cgroups
[0.00] installing Xen timer for CPU 0
[0.00] tsc: Fast TSC calibration failed
[0.00] tsc: Unable to calibrate against PIT
[0.00] tsc: No reference (HPET/PMTIMER) available
[0.00] tsc: Detected 2394.058 MHz processor
[0.002000] Calibrating delay loop (skipped), value calculated using
timer frequency.. 4788.11 BogoMIPS (lpj=2394058)
[0.002000] pid_max: default: 32768 minimum: 301
[0.002000] Security Framework initialized
[0.002000] SELinux:  Initializing.
[0.002000] Yama: becoming mindful.
[0.002714] Dentry cache hash table entries: 524288 (order: 10, 4194304
bytes)
[0.004757] Inode-cache hash table entries: 262144 (order: 9, 2097152
bytes)
[0.005495] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes)
[0.005532] Mountpoint-cache hash table entries: 8192 (order: 4, 65536
bytes)
[0.006056] Initializing cgroup subsys memory
[0.006092] Initializing cgroup subsys devices
[0.006104] Initializing cgroup subsys freezer
[0.006116] Initializing cgroup subsys net_cls
[0.006127] Initializing cgroup subsys blkio
[0.006137] Initializing cgroup subsys perf_event
[  

Re: [CentOS-virt] Centos 7 Kernel 3.10.0-693.11.6.el7.x86_64 does not boot PV

[Johnny Hughes]

On 01/08/2018 02:10 PM, Shaun Reitan wrote:
> While installing the experemental kernel on a CentOS 7 PV the following
> happened. After a reboot of the PV the kernel looks to be installed but
> there is no option for booting it in grub.  I attempted to run yum
> reinstall kernel-4.9.75-204.el7.centos.x86_64 and it installed fine but
> still no entry in grub. No initramfs existed and I found kernel-modules
> did not install properly so I then ran yum reinstall kernel-modules and
> received a ton of errors that looked like the following..
> 
> depmod: ERROR: failed to load symbols from
> /lib/modules/4.9.75-204.el7.centos.x86_64/kernel/drivers/misc/sgi-xp/xpc.ko.xz:
> Exec format error
> 
> after which a initramfs does exist however on reboot still no option for
> the new kernel.

Installed and works fine for me.

Very odd.

from my Dom0 machine:
[root@xendom0 ~]# uname -a
Linux xendom0 4.9.75-29.el7.x86_64 #1 SMP Fri Jan 5 19:42:28 UTC 2018
x86_64 x86_64 x86_64 GNU/Linux

From my DomU CentOS-7 PV VM:
Linux x7-x8664-pv 4.9.75-204.el7.centos.x86_64 #1 SMP Fri Jan 5 17:51:39
UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

My CentOS-7 PV config:
[root@xendom0 ~]# cat /etc/xen/config.d/c7-x8664.pv.cfg
bootloader= "/usr/lib/xen/bin/pygrub"
name = "c7-x8664.pv"
memory = 4096
vcpus = 2
vif = [ 'mac=00:16:3E:29:00:02,bridge=xenbr0' ]
disk = [ 'phy:/dev/cl/c7-x8664-pv,xvda,rw' ]
vfb = [ 'type=vnc,vncdisplay=1,vncpasswd=supersecret' ]



> 
> 
> [root@CC0A2543 ~]# [  587.145018] [ cut here ]
> [  587.145018] kernel BUG at arch/x86/kernel/paravirt.c:244!
> [  587.145018] invalid opcode:  [#1] SMP
> [  587.145018] Modules linked in: xen_netfront coretemp pcspkr ip_tables
> ext4 mbcache jbd2 xen_blkfront
> [  587.145018] CPU: 0 PID: 2126 Comm: dracut Not tainted
> 3.10.0-123.4.4.el7.x86_64 #1
> [  587.145018] task: 880002da5b00 ti: 8800f6088000 task.ti:
> 8800f6088000
> [  587.145018] RIP: e030:[]  []
> enter_lazy.part.0+0x4/0x6
> [  587.145018] RSP: e02b:8800ff403ab0  EFLAGS: 00010002
> [  587.145018] RAX: 0001 RBX: 8800f8ad4040 RCX:
> 3000
> [  587.145018] RDX: 8840 RSI: 8800 RDI:
> 0005a52cc067
> [  587.145018] RBP: 8800ff403ab0 R08: 8800ff403b78 R09:
> 81362409
> [  587.145018] R10: 8800fa001e00 R11: 8800 R12:
> c9609000
> [  587.145018] R13: c9608000 R14:  R15:
> 8100a6b0
> [  587.145018] FS:  7f14b0680740() GS:8800ff40()
> knlGS:
> [  587.145018] CS:  e033 DS:  ES:  CR0: 8005003b
> [  587.145018] CR2: 7f14b0473000 CR3: f6099000 CR4:
> 2660
> [  587.145018] DR0:  DR1:  DR2:
> 
> [  587.145018] DR3:  DR6: 0ff0 DR7:
> 0400
> [  587.145018] Stack:
> [  587.145018]  8800ff403ac0 81046bc7 8800ff403b60
> 8116d8d6
> [  587.145018]  c9608fff c9609000 818cec90
> c9608fff
> [  587.145018]  c9609000 8800fa04d000 0004
> c9608fff
> [  587.145018] Call Trace:
> [  587.145018]  
> [  587.145018]  [] paravirt_enter_lazy_mmu+0x27/0x30
> [  587.145018]  [] apply_to_page_range+0x266/0x440
> [  587.145018]  [] arch_gnttab_map_status+0x3b/0x70
> [  587.145018]  [] gnttab_map_frames_v2+0xd6/0x150
> [  587.145018]  [] gnttab_map+0xa1/0x140
> [  587.145018]  [] get_free_entries+0x100/0x2e0
> [  587.145018]  [] gnttab_alloc_grant_references+0x15/0x30
> [  587.145018]  [] do_blkif_request+0x683/0x850
> [xen_blkfront]
> [  587.145018]  [] __blk_run_queue+0x33/0x40
> [  587.145018]  [] blk_start_queue+0x29/0x40
> [  587.145018]  []
> kick_pending_request_queues+0x21/0x30 [xen_blkfront]
> [  587.145018]  [] blkif_interrupt+0x5c7/0x670
> [xen_blkfront]
> [  587.145018]  [] handle_irq_event_percpu+0x3e/0x1e0
> [  587.145018]  [] handle_irq_event+0x3d/0x60
> [  587.145018]  [] handle_edge_irq+0x77/0x130
> [  587.145018]  [] __xen_evtchn_do_upcall+0x227/0x350
> [  587.145018]  [] xen_evtchn_do_upcall+0x2b/0x50
> [  587.145018]  [] xen_do_hypervisor_callback+0x1e/0x30
> [  587.145018]  
> [  587.145018]  [] ? free_cpumask_var+0x9/0x10
> [  587.145018]  [] ? unmap_page_range+0x5f8/0x860
> [  587.145018]  [] ? unmap_single_vma+0x81/0xf0
> [  587.145018]  [] ? unmap_vmas+0x49/0x90
> [  587.145018]  [] ? exit_mmap+0xac/0x1a0
> [  587.145018]  [] ? mmput+0x67/0xf0
> [  587.145018]  [] ? flush_old_exec+0x422/0x880
> [  587.145018]  [] ? load_elf_binary+0x33c/0xde0
> [  587.145018]  [] ? ima_get_action+0x23/0x30
> [  587.145018]  [] ? process_measurement+0x8e/0x250
> [  587.145018]  [] ? ima_bprm_check+0x49/0x50
> [  587.145018]  [] ? load_elf_library+0x230/0x230
> [  587.145018]  [] ? search_binary_handler+0xf5/0x310
> [  587.145018]  [] ? do_execve_common.isra.22+0x559/0x650
> [  587.145018]  [] ? SyS_execve+0x36/0x50
> [  587.145018]  [] ?