Regards, Peter
http://ri.mu Startups start here. Hosting. DNS. Offsite backups.
Monitoring. Email.
On 27/02/18 12:42 AM, Juergen Gross wrote:
On 22/02/18 21:38, x...@randomwebstuff.com wrote:
On 22/02/18 6:35 PM, Juergen Gross wrote:
On 22/02/18 05:37, x...@randomwebstuff.com wrote:
Hi. I have a domU. Its params file has: vcpus = 8. It will start with
pv, but not type="pvh". It will not start (on pvh) with vcpus = 7 or 6
or 5. It does start with vcpus = 4.
I diffed the xl -v create logs, no difference there on either startup.
I grabbed the domU console output for a vcpus = 5 start (attached). It
dies right after:
[ 0.007110] cpu 3 spinlock event irq 23
[ 0.007336] installing Xen timer for CPU 4
Can you please post the hypervisor log ("xl dmesg")?
Juergen
Attached.
Can you please try again with "loglvl=all guest_loglvl=all" in the
hypervisor's boot parameters and after the pvh guest failing?
Juergen
I added those options. I am attaching a log of 1) xl create -v 2) domU
console 3) xl dmesg 4) params file.
Reminder this issue seems to be only on certain CPUs. e.g. this one is
on a 2xE5420 host.
xl create -v log:
Parsing config from /home/users/ot.glenn/params
domainbuilder: detail: xc_dom_allocate: cmdline="root=/dev/xvda1 ro",
features=""
domainbuilder: detail: xc_dom_kernel_file: filename="/home/users/ot.glenn/linux"
domainbuilder: detail: xc_dom_malloc_filemap : 9325 kB
domainbuilder: detail: xc_dom_malloc : 32 MB
domainbuilder: detail: xc_dom_do_gunzip: unzip ok, 0x91b5aa -> 0x20ed940
domainbuilder: detail: xc_dom_boot_xen_init: ver 4.10, caps xen-3.0-x86_64
xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
domainbuilder: detail: xc_dom_parse_image: called
domainbuilder: detail: xc_dom_find_loader: trying ELF-generic loader ...
domainbuilder: detail: loader probe OK
xc: detail: ELF: phdr: paddr=0x1000000 memsz=0x1522000
xc: detail: ELF: phdr: paddr=0x2600000 memsz=0x5c5000
xc: detail: ELF: phdr: paddr=0x2bc5000 memsz=0x21d18
xc: detail: ELF: phdr: paddr=0x2be7000 memsz=0x1cf000
xc: detail: ELF: memory: 0x1000000 -> 0x2db6000
xc: detail: ELF: note: GUEST_OS = "linux"
xc: detail: ELF: note: GUEST_VERSION = "2.6"
xc: detail: ELF: note: XEN_VERSION = "xen-3.0"
xc: detail: ELF: note: VIRT_BASE = 0xffffffff80000000
xc: detail: ELF: note: INIT_P2M = 0x8000000000
xc: detail: ELF: note: ENTRY = 0xffffffff82be7180
xc: detail: ELF: note: HYPERCALL_PAGE = 0xffffffff81001000
xc: detail: ELF: note: FEATURES = "!writable_page_tables|pae_pgdir_above_4gb"
xc: detail: ELF: note: SUPPORTED_FEATURES = 0x801
xc: detail: ELF: note: PAE_MODE = "yes"
xc: detail: ELF: note: LOADER = "generic"
xc: detail: ELF: note: unknown (0xd)
xc: detail: ELF: note: SUSPEND_CANCEL = 0x1
xc: detail: ELF: note: MOD_START_PFN = 0x1
xc: detail: ELF: note: HV_START_LOW = 0xffff800000000000
xc: detail: ELF: note: PADDR_OFFSET = 0
xc: detail: ELF: note: PHYS32_ENTRY = 0x1000360
xc: detail: ELF: addresses:
xc: detail: virt_base = 0xffffffff80000000
xc: detail: elf_paddr_offset = 0x0
xc: detail: virt_offset = 0xffffffff80000000
xc: detail: virt_kstart = 0xffffffff81000000
xc: detail: virt_kend = 0xffffffff82db6000
xc: detail: virt_entry = 0xffffffff82be7180
xc: detail: p2m_base = 0x8000000000
domainbuilder: detail: xc_dom_parse_elf_kernel: hvm-3.0-x86_32:
0xffffffff81000000 -> 0xffffffff82db6000
domainbuilder: detail: xc_dom_mem_init: mem 2000 MB, pages 0x7d000 pages, 4k
each
domainbuilder: detail: xc_dom_mem_init: 0x7d000 pages
domainbuilder: detail: xc_dom_boot_mem_init: called
domainbuilder: detail: xc_dom_malloc : 4000 kB
xc: detail: PHYSICAL MEMORY ALLOCATION:
xc: detail: 4KB PAGES: 0x0000000000000000
xc: detail: 2MB PAGES: 0x00000000000001e8
xc: detail: 1GB PAGES: 0x0000000000000001
S3 disabled
S4 disabled
CONV disabled
domainbuilder: detail: xc_dom_build_image: called
domainbuilder: detail: xc_dom_malloc : 178 kB
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn
0x1000+0x1db6 at 0x7fd8d1521000
domainbuilder: detail: xc_dom_alloc_segment: kernel :
0xffffffff81000000 -> 0xffffffff82db6000 (pfn 0x1000 + 0x1db6 pages)
xc: detail: ELF: phdr 0 at 0x7fd8d1521000 -> 0x7fd8d2a43000
xc: detail: ELF: phdr 1 at 0x7fd8d2b21000 -> 0x7fd8d30e6000
xc: detail: ELF: phdr 2 at 0x7fd8d30e6000 -> 0x7fd8d3107d18
xc: detail: ELF: phdr 3 at 0x7fd8d3108000 -> 0x7fd8d320e000
domainbuilder: detail: xc_dom_load_acpi: 64 bytes at address fffc0
domainbuilder: detail: xc_dom_load_acpi: 4096 bytes at address fc000000
domainbuilder: detail: xc_dom_load_acpi: 28672 bytes at address fc001000
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x2db6+0x1
at 0x7fd8d7c4f000
domainbuilder: detail: xc_dom_alloc_segment: HVM start info :
0xffffffff82db6000 -> 0xffffffff82db7000 (pfn 0x2db6 + 0x1 pages)
domainbuilder: detail: alloc_pgtables_hvm: doing nothing
domainbuilder: detail: xc_dom_build_image : virt_alloc_end : 0xffffffff82db7000
domainbuilder: detail: xc_dom_build_image : virt_pgtab_end : 0x0
domainbuilder: detail: xc_dom_boot_image: called
domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64
domainbuilder: detail: xc_dom_compat_check: supported guest type:
xen-3.0-x86_32p
domainbuilder: detail: xc_dom_compat_check: supported guest type:
hvm-3.0-x86_32 <= matches
domainbuilder: detail: xc_dom_compat_check: supported guest type:
hvm-3.0-x86_32p
domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_64
domainbuilder: detail: domain builder memory footprint
domainbuilder: detail: allocated
domainbuilder: detail: malloc : 37 MB
domainbuilder: detail: anon mmap : 0 bytes
domainbuilder: detail: mapped
domainbuilder: detail: file mmap : 9325 kB
domainbuilder: detail: domU mmap : 30428 kB
domainbuilder: detail: vcpu_hvm: called
domainbuilder: detail: xc_dom_gnttab_hvm_seed: called, pfn=0xff000
domainbuilder: detail: xc_dom_gnttab_hvm_seed: called, pfn=0xff001
domainbuilder: detail: xc_dom_release: called
[root@host713 ~]# xl list
Name ID Mem VCPUs State Time(s)
Domain-0 0 2048 2 r----- 68.9
domU console:
[ 0.001000] cpu 0 spinlock event irq 5
[ 0.001000] Performance Events: unsupported p6 CPU model 23 no PMU driver,
software events only.
[ 0.001000] Hierarchical SRCU implementation.
[ 0.001249] smp: Bringing up secondary CPUs ...
[ 0.001582] installing Xen timer for CPU 1
[ 0.001642] x86: Booting SMP configuration:
[ 0.001653] .... node #0, CPUs: #1
[ 0.003157] cpu 1 spinlock event irq 11
[ 0.003305] installing Xen timer for CPU 2
[ 0.003385] #2
[ 0.005152] cpu 2 spinlock event irq 17
[ 0.005311] installing Xen timer for CPU 3
[ 0.005375] #3
[ 0.007107] cpu 3 spinlock event irq 23
[ 0.007341] installing Xen timer for CPU 4
C
xl dmesg:
(XEN) System RAM: 24574MB (25164656kB)
(XEN) No NUMA configuration found
(XEN) Faking a node at 0000000000000000-0000000620000000
(XEN) Domain heap initialised
(XEN) CPU Vendor: Intel, Family 6 (0x6), Model 23 (0x17), Stepping 10 (raw
0001067a)
(XEN) found SMP MP-table at 000f5a40
(XEN) DMI present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x1008 (32 bits)
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1004,1:0], pm1x_evt[1:1000,1:0]
(XEN) ACPI: wakeup_vec[dff5afcc], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x04] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x05] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x06] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x03] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
(XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
(XEN) ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode: Flat. Using 1 I/O APICs
(XEN) Xen ERST support is initialized.
(XEN) HEST: Table parsing has been initialized
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 8 CPUs (0 hotplug CPUs)
(XEN) IRQ limits: 24 GSI, 1528 MSI/MSI-X
(XEN) xstate: size: 0x240 and states: 0x3
(XEN) CPU0: Intel machine check reporting enabled
(XEN) Speculative mitigation facilities:
(XEN) BTI mitigations: Thunk N/A, Others: RSB_NATIVE RSB_VMEXIT
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Platform timer is 3.579MHz ACPI PM Timer
(XEN) Detected 2500.009 MHz processor.
(XEN) Initing memory sharing.
(XEN) alt table ffff82d080412558 -> ffff82d080413f08
(XEN) PCI: MCFG configuration 0: base e0000000 segment 0000 buses 00 - 06
(XEN) PCI: MCFG area at e0000000 reserved in E820
(XEN) PCI: Using MCFG for segment 0000 bus 00-06
(XEN) I/O virtualisation disabled
(XEN) nr_sockets: 2
(XEN) ENABLING IO-APIC IRQs
(XEN) -> Using new ACK method
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) Allocated console ring of 64 KiB.
(XEN) mwait-idle: does not run on family 6 model 23
(XEN) VMX: Supported advanced features:
(XEN) - APIC MMIO access virtualisation
(XEN) - APIC TPR shadow
(XEN) - Virtual NMI
(XEN) - MSR direct-access bitmap
(XEN) HVM: ASIDs disabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) not detected
(XEN) Brought up 8 CPUs
(XEN) build-id: 09fb06b9811afd2db7c80b691b329fde884c8bc7
(XEN) CPUIDLE: disabled due to no HPET. Force enable with 'cpuidle'.
(XEN) ACPI sleep modes: S3
(XEN) VPMU: disabled
(XEN) mcheck_poll: Machine check polling timer started.
(XEN) Dom0 has maximum 408 PIRQs
(XEN) NX (Execute Disable) protection active
(XEN) *** LOADING DOMAIN 0 ***
(XEN) Xen kernel: 64-bit, lsb, compat32
(XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x26f9000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN) Dom0 alloc.: 0000000604000000->0000000608000000 (500597 pages to be
allocated)
(XEN) Init. ramdisk: 000000061e375000->000000061ffffc00
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN) Loaded kernel: ffffffff81000000->ffffffff826f9000
(XEN) Init. ramdisk: 0000000000000000->0000000000000000
(XEN) Phys-Mach map: 0000008000000000->0000008000400000
(XEN) Start info: ffffffff826f9000->ffffffff826f94b4
(XEN) Page tables: ffffffff826fa000->ffffffff82711000
(XEN) Boot stack: ffffffff82711000->ffffffff82712000
(XEN) TOTAL: ffffffff80000000->ffffffff82800000
(XEN) ENTRY ADDRESS: ffffffff8239f180
(XEN) Dom0 has maximum 2 VCPUs
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Scrubbing Free RAM on 1 nodes using 8 CPUs
(XEN) .........................done.
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to
Xen)
(XEN) Freed 444kB init memory
(XEN) PCI add device 0000:00:00.0
(XEN) PCI add device 0000:00:02.0
(XEN) PCI add device 0000:00:04.0
(XEN) PCI add device 0000:00:06.0
(XEN) PCI add device 0000:00:08.0
(XEN) PCI add device 0000:00:10.0
(XEN) PCI add device 0000:00:10.1
(XEN) PCI add device 0000:00:10.2
(XEN) PCI add device 0000:00:11.0
(XEN) PCI add device 0000:00:13.0
(XEN) PCI add device 0000:00:15.0
(XEN) PCI add device 0000:00:16.0
(XEN) PCI add device 0000:00:1a.0
(XEN) PCI add device 0000:00:1a.7
(XEN) PCI add device 0000:00:1c.0
(XEN) PCI add device 0000:00:1c.4
(XEN) PCI add device 0000:00:1c.5
(XEN) PCI add device 0000:00:1d.0
(XEN) PCI add device 0000:00:1d.1
(XEN) PCI add device 0000:00:1d.2
(XEN) PCI add device 0000:00:1d.7
(XEN) PCI add device 0000:00:1e.0
(XEN) PCI add device 0000:00:1f.0
(XEN) PCI add device 0000:00:1f.2
(XEN) PCI add device 0000:00:1f.3
(XEN) PCI add device 0000:05:00.0
(XEN) PCI add device 0000:06:00.0
(XEN) PCI add device 0000:07:00.0
(XEN) PCI add device 0000:07:01.0
(XEN) HVM1 save: CPU
(XEN) HVM1 save: PIC
(XEN) HVM1 save: IOAPIC
(XEN) HVM1 save: LAPIC
(XEN) HVM1 save: LAPIC_REGS
(XEN) HVM1 save: PCI_IRQ
(XEN) HVM1 save: ISA_IRQ
(XEN) HVM1 save: PCI_LINK
(XEN) HVM1 save: PIT
(XEN) HVM1 save: RTC
(XEN) HVM1 save: HPET
(XEN) HVM1 save: PMTIMER
(XEN) HVM1 save: MTRR
(XEN) HVM1 save: VIRIDIAN_DOMAIN
(XEN) HVM1 save: CPU_XSAVE
(XEN) HVM1 save: VIRIDIAN_VCPU
(XEN) HVM1 save: VMCE_VCPU
(XEN) HVM1 save: TSC_ADJUST
(XEN) HVM1 save: CPU_MSR
(XEN) HVM1 restore: CPU 0
(XEN) HVM3 save: CPU
(XEN) HVM3 save: PIC
(XEN) HVM3 save: IOAPIC
(XEN) HVM3 save: LAPIC
(XEN) HVM3 save: LAPIC_REGS
(XEN) HVM3 save: PCI_IRQ
(XEN) HVM3 save: ISA_IRQ
(XEN) HVM3 save: PCI_LINK
(XEN) HVM3 save: PIT
(XEN) HVM3 save: RTC
(XEN) HVM3 save: HPET
(XEN) HVM3 save: PMTIMER
(XEN) HVM3 save: MTRR
(XEN) HVM3 save: VIRIDIAN_DOMAIN
(XEN) HVM3 save: CPU_XSAVE
(XEN) HVM3 save: VIRIDIAN_VCPU
(XEN) HVM3 save: VMCE_VCPU
(XEN) HVM3 save: TSC_ADJUST
(XEN) HVM3 save: CPU_MSR
(XEN) HVM3 restore: CPU 0
(XEN) HVM4 save: CPU
(XEN) HVM4 save: PIC
(XEN) HVM4 save: IOAPIC
(XEN) HVM4 save: LAPIC
(XEN) HVM4 save: LAPIC_REGS
(XEN) HVM4 save: PCI_IRQ
(XEN) HVM4 save: ISA_IRQ
(XEN) HVM4 save: PCI_LINK
(XEN) HVM4 save: PIT
(XEN) HVM4 save: RTC
(XEN) HVM4 save: HPET
(XEN) HVM4 save: PMTIMER
(XEN) HVM4 save: MTRR
(XEN) HVM4 save: VIRIDIAN_DOMAIN
(XEN) HVM4 save: CPU_XSAVE
(XEN) HVM4 save: VIRIDIAN_VCPU
(XEN) HVM4 save: VMCE_VCPU
(XEN) HVM4 save: TSC_ADJUST
(XEN) HVM4 save: CPU_MSR
(XEN) HVM4 restore: CPU 0
(XEN) HVM6 save: CPU
(XEN) HVM6 save: PIC
(XEN) HVM6 save: IOAPIC
(XEN) HVM6 save: LAPIC
(XEN) HVM6 save: LAPIC_REGS
(XEN) HVM6 save: PCI_IRQ
(XEN) HVM6 save: ISA_IRQ
(XEN) HVM6 save: PCI_LINK
(XEN) HVM6 save: PIT
(XEN) HVM6 save: RTC
(XEN) HVM6 save: HPET
(XEN) HVM6 save: PMTIMER
(XEN) HVM6 save: MTRR
(XEN) HVM6 save: VIRIDIAN_DOMAIN
(XEN) HVM6 save: CPU_XSAVE
(XEN) HVM6 save: VIRIDIAN_VCPU
(XEN) HVM6 save: VMCE_VCPU
(XEN) HVM6 save: TSC_ADJUST
(XEN) HVM6 save: CPU_MSR
(XEN) HVM6 restore: CPU 0
(XEN) HVM7 save: CPU
(XEN) HVM7 save: PIC
(XEN) HVM7 save: IOAPIC
(XEN) HVM7 save: LAPIC
(XEN) HVM7 save: LAPIC_REGS
(XEN) HVM7 save: PCI_IRQ
(XEN) HVM7 save: ISA_IRQ
(XEN) HVM7 save: PCI_LINK
(XEN) HVM7 save: PIT
(XEN) HVM7 save: RTC
(XEN) HVM7 save: HPET
(XEN) HVM7 save: PMTIMER
(XEN) HVM7 save: MTRR
(XEN) HVM7 save: VIRIDIAN_DOMAIN
(XEN) HVM7 save: CPU_XSAVE
(XEN) HVM7 save: VIRIDIAN_VCPU
(XEN) HVM7 save: VMCE_VCPU
(XEN) HVM7 save: TSC_ADJUST
(XEN) HVM7 save: CPU_MSR
(XEN) HVM7 restore: CPU 0
[root@host713 ~]#
Xen domU params file:
cat /home/users/ot.glenn/params
kernel = "/home/users/ot.glenn/linux"
memory = 2000
swap = 128
name = "ot.glenn"
ipaddr = "72.x.x.x"
disk = [ 'phy:/dev/users/ot.glenn+centos6-x86_64-4.ext3,xvda1,w',
'phy:/dev/users/ot.glenn+swapfs.swp,xvda9,w' ]
root = "/dev/xvda1 ro"
restart = 'onreboot'
console = 50089
type = "pvh"
vcpus = 5
vif = [ 'mac=aa:00:0b:67:50:64,bridge=br0' ]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
