Re: [Xen-devel] [PULL 0/1] Xen tree 2015-01-26

2015-01-26 Thread Peter Maydell
On 26 January 2015 at 12:00, Stefano Stabellini stefano.stabell...@eu.citrix.com wrote: The following changes since commit b3a4755a67a52aa7297eb8927b482d09dabdefec: Merge remote-tracking branch 'remotes/kraxel/tags/pull-vnc-20150122-1' into staging (2015-01-22 12:14:19 +) are

[Xen-devel] [PATCH v3 04/19] Pass host to toolstack()

2015-01-26 Thread Ian Campbell
This will be needed in a future patch. Everywhere already has a $ho in hand. Also cache the answer as $ho-{Toolstack}. I scanned the source with: find -name \*.pm -exec perl -c {} \; for i in ts-* ; do perl -c $i; done which reported Not enough arguments for

[Xen-devel] [PATCH v3 17/19] Toolstack: Remove Command field for all toolstacks.

2015-01-26 Thread Ian Campbell
Nothing in generic code uses this now, so remove. xl+xend retain as _Command for internal use only. Signed-off-by: Ian Campbell ian.campb...@citrix.com Acked-by: Ian Jackson ian.jack...@eu.citrix.com --- Osstest/Toolstack/libvirt.pm | 1 - Osstest/Toolstack/xend.pm| 2 +-

[Xen-devel] [PATCH v3 15/19] libvirt: Implement initscript restart which has some hope of working.

2015-01-26 Thread Ian Campbell
... by refactoring start/stop actions into the functions which are expected by restart. Signed-off-by: Ian Campbell ian.campb...@citrix.com --- v3: Refactor into start/stop functions --- ts-libvirt-build | 20 +++- 1 file changed, 15 insertions(+), 5 deletions(-) diff --git

[Xen-devel] [PATCH v3 19/19] Toolstack: Pass $gho to create method

2015-01-26 Thread Ian Campbell
The cfg file can be obtained from $gho-{CfgPath}. This is more consistent with other methods. Signed-off-by: Ian Campbell ian.campb...@citrix.com --- v3: New patch, implementing suggesting from review of Toolstack: Refactor guest lifecycle. --- Osstest/TestSupport.pm | 2 +-

[Xen-devel] [PATCH v3 13/19] Toolstack: Refactor migration support.

2015-01-26 Thread Ian Campbell
Note that since the previous patch arranges for ts-migration-support-check to continue to fail for libvirt the libvirt code is not actually called yet (and will die if it is). This patch is mainly included to reduce the number of users of toolstack()-{Command} closer to zero. Signed-off-by: Ian

Re: [Xen-devel] [xen-unstable test] 33690: regressions - FAIL

2015-01-26 Thread Boris Ostrovsky
On 01/26/2015 09:49 AM, Andrew Cooper wrote: On 26/01/15 11:38, Jan Beulich wrote: On 26.01.15 at 12:04, jbeul...@suse.com wrote: On 24.01.15 at 13:54, ian.jack...@eu.citrix.com wrote: test-amd64-amd64-xl-qemut-win7-amd64 7 windows-install fail REGR. vs. 33637 Jan 24 00:35:16.262627

Re: [Xen-devel] [RFC PATCH v1] xen/arm: split the init_xen_time() in 2 parts

2015-01-26 Thread Julien Grall
Hi Oleksandr, Thank you for the patch. See few comments below. On 23/01/15 15:49, Oleksandr Tyshchenko wrote: Create preinit_xen_time() and move to it minimum required subset of operations needed to properly initialized cpu_khz and boot_count vars. This is allow us to use udelay()

Re: [Xen-devel] [PATCH] x86: also use tzcnt instead of bsf in __scanbit()

2015-01-26 Thread Andrew Cooper
On 26/01/15 12:03, Jan Beulich wrote: ... when available, i.e. by runtime patching. This saves the conditional move, having a back-to-back dependency on BSF's (EFLAGS) result. The need to include asm/cpufeatures.h from asm/bitops.h requires a workaround for an otherwise resulting circular

Re: [Xen-devel] [RFC PATCH v1] xen/arm: split the init_xen_time() in 2 parts

2015-01-26 Thread Oleksandr Tyshchenko
On Mon, Jan 26, 2015 at 3:32 PM, Julien Grall julien.gr...@linaro.org wrote: Hi Oleksandr, Hi Julien Thank you for your comments. Thank you for the patch. See few comments below. On 23/01/15 15:49, Oleksandr Tyshchenko wrote: Create preinit_xen_time() and move to it minimum required subset

Re: [Xen-devel] [PATCH 0/5]arm64: Add multiboot support (via fdt) for Xen boot

2015-01-26 Thread Stefano Stabellini
Ping? I think it would be great to have multiboot support in grub. As a matter of fact without it grub cannot load xen on arm. On Wed, 21 Jan 2015, Fu Wei wrote: Hi everybody, any suggestion for my patchset? if these patches look fine, can they be merged? Any feedback is welcome! :-)

[Xen-devel] [PATCH v3 OSSTEST 0/19] Implement for driving libvirt via virsh

2015-01-26 Thread Ian Campbell
The following series switches osstest to implement the toolstack via get_host_method_object()-method rather than toolstack()-{Command}. method etc. This is needed because virsh differs from xm/xl in a few commands. It also implements partial virsh support (simple lifecycle stuff, but not e.g.

Re: [Xen-devel] [xen-unstable test] 33690: regressions - FAIL

2015-01-26 Thread Andrew Cooper
On 26/01/15 11:38, Jan Beulich wrote: On 26.01.15 at 12:04, jbeul...@suse.com wrote: On 24.01.15 at 13:54, ian.jack...@eu.citrix.com wrote: test-amd64-amd64-xl-qemut-win7-amd64 7 windows-install fail REGR. vs. 33637 Jan 24 00:35:16.262627 (XEN) [ Xen-4.6-unstable x86_64 debug=y

[Xen-devel] [PATCH v3 05/19] ts-rumpuserxen-demo-xenstorels: Use standard functions for things

2015-01-26 Thread Ian Campbell
Specifically guest_create and guest_find_domid. Signed-off-by: Ian Campbell ian.campb...@citrix.com Acked-by: Ian Jackson ian.jack...@eu.citrix.com --- ts-rumpuserxen-demo-xenstorels | 6 ++ 1 file changed, 2 insertions(+), 4 deletions(-) diff --git a/ts-rumpuserxen-demo-xenstorels

Re: [Xen-devel] [PATCH 2/2] swiotlb-xen: pass dev_addr to swiotlb_tbl_unmap_single

2015-01-26 Thread Jiri Slaby
On 01/26/2015, 11:53 AM, Ian Campbell wrote: On Fri, 2014-11-21 at 17:00 +, Stefano Stabellini wrote: Need to pass the pointer within the swiotlb internal buffer to the swiotlb library, that in the case of xen_unmap_single is dev_addr, not paddr. Signed-off-by: Stefano Stabellini

[Xen-devel] [PATCH v3 07/19] TestSupport: always use xl for generic operations.

2015-01-26 Thread Ian Campbell
Unless the toolstack is xend (for compatibility with pre-xl Xen versions), when we use xm. For several operations in TestSupport.pm the actual toolstack isn't really relevant, since we want info straight from Xen. For simplicity just use xl (or xm) in these cases, to avoid needing to implement

[Xen-devel] [PATCH v3 10/19] Toolstack: Refactor consolecmd handling

2015-01-26 Thread Ian Campbell
Signed-off-by: Ian Campbell ian.campb...@citrix.com --- Osstest/Toolstack/libvirt.pm | 6 ++ Osstest/Toolstack/xl.pm | 6 ++ ts-logs-capture | 2 +- 3 files changed, 13 insertions(+), 1 deletion(-) diff --git a/Osstest/Toolstack/libvirt.pm b/Osstest/Toolstack/libvirt.pm

[Xen-devel] [PATCH v3 02/19] apt: lock osstest's usages of apt-get against each other

2015-01-26 Thread Ian Campbell
Currently we rely on all apt-get invocations being in a single ts-xen-build-prep job which can't run on a shared host. That is a bit inflexible so instead use our own lock. We wait indefinitely and rely on osstest's existing command timeout infrastructure to catch problems.

[Xen-devel] [PATCH v3 16/19] libvirt: Implement shutdown_wait

2015-01-26 Thread Ian Campbell
virsh does not include a --wait option to shutdown as xl and xm do, so we implement it by hand. Needs new guest_await_destroy helper. Note the guest_await_shutdown requires on_shutdown='preserve' Signed-off-by: Ian Campbell ian.campb...@citrix.com Acked-by: Ian Jackson ian.jack...@eu.citrix.com

[Xen-devel] [PATCH v3 03/19] ts-logs-capture: Collect some libvirt logs and capabilities

2015-01-26 Thread Ian Campbell
Signed-off-by: Ian Campbell ian.campb...@citrix.com Acked-by: Ian Jackson ian.jack...@eu.citrix.com --- ts-logs-capture | 4 1 file changed, 4 insertions(+) diff --git a/ts-logs-capture b/ts-logs-capture index 21974a9..6cf51c1 100755 --- a/ts-logs-capture +++ b/ts-logs-capture @@ -117,6

[Xen-devel] [PATCH v3 14/19] Toolstack: Refactor save/restore support

2015-01-26 Thread Ian Campbell
Use $gho-{CfgPath} rather than constructing it again. Still stubbed out for libvirt. Signed-off-by: Ian Campbell ian.campb...@citrix.com --- v3: Switch to CfgPath defered from incorrect home in earlier patch to here. RestoreNeedsConfig is an xl/xm ism, not relevant to libvirt, so

[Xen-devel] [PATCH v3 09/19] Toolstack: Refactor guest lifecycle.

2015-01-26 Thread Ian Campbell
Implement destory/create as per toolstack methods, including implementing the libvirt version which previously didn't work. To do this we use the virsh capability to convert an xl/xm style config file into the correct XML. xend basically calls into the xl helper since they are compatible. xl/xm,

[Xen-devel] [PATCH v3 18/19] ts-guest-start: Use guest_create

2015-01-26 Thread Ian Campbell
This allows us to abolish CfgPathVar which was inconsistently used, appears redundant with $gho-{CfgPath} and in any case never set to anything other than 'cfgpath'. I suppose it was intended to deal with toolstacks with a cfg format completely dissimilar to xm/xl's. I think if this arises in a

[Xen-devel] [PATCH v3 06/19] Toolstack: use get_host_method_object() to manage toolstack selection

2015-01-26 Thread Ian Campbell
This will allow us to more easily have per-toolstack methods etc. The previous hash of toolstack parameters is now a blessed object. For now the callers don't need to change but over the following patches we will refactor things to use method calls. In particular we will be aiming to remove

[Xen-devel] [PATCH v3 11/19] Toolstack: Refactor shutdown support

2015-01-26 Thread Ian Campbell
Signed-off-by: Ian Campbell ian.campb...@citrix.com --- v3: Timeout is set in the caller, not the method handler. Different guests might take different times to shut down - but different toolstacks shouldn't. --- Osstest/Toolstack/libvirt.pm | 6 ++ Osstest/Toolstack/xl.pm | 7

[Xen-devel] [PATCH v3 01/19] TestSupport: Add helper to wait for a guest to shutdown

2015-01-26 Thread Ian Campbell
Refactor the guts of guest_await_reboot into a helper and use for both shutdown and reboot handling. Signed-off-by: Ian Campbell ian.campb...@citrix.com --- v3: Refactor common code with guest_await_reboot. --- Osstest/TestSupport.pm | 24 ++-- 1 file changed, 18

[Xen-devel] [PATCH v3 12/19] Toolstack: Refactor migration support check.

2015-01-26 Thread Ian Campbell
Not implemented for libvirt (the check itself that is, the hook is present). Signed-off-by: Ian Campbell ian.campb...@citrix.com Acked-by: Ian Jackson ian.jack...@eu.citrix.com --- Osstest/Toolstack/libvirt.pm | 5 + Osstest/Toolstack/xend.pm| 3 +++ Osstest/Toolstack/xl.pm | 9

Re: [Xen-devel] [PATCH 12/14] xen-blkback: safely unmap grants in case they are still in use

2015-01-26 Thread David Vrabel
On 19/01/15 15:51, David Vrabel wrote: From: Jenny Herbert jennifer.herb...@citrix.com Use gnttab_unmap_refs_async() to wait until the mapped pages are no longer in use before unmapping them. This allows blkback to use network storage which may retain refs to pages in queued skbs after

Re: [Xen-devel] [PATCH 12/14] xen-blkback: safely unmap grants in case they are still in use

2015-01-26 Thread David Vrabel
On 23/01/15 16:00, David Vrabel wrote: On 23/01/15 15:47, Roger Pau Monné wrote: El 23/01/15 a les 15.54, David Vrabel ha escrit: On 23/01/15 14:31, Roger Pau Monné wrote: El 19/01/15 a les 16.51, David Vrabel ha escrit: + if (invcount) { + ret =

Re: [Xen-devel] [xen-unstable test] 33690: regressions - FAIL

2015-01-26 Thread Boris Ostrovsky
On 01/26/2015 09:56 AM, Andrew Cooper wrote: On 26/01/15 14:51, Boris Ostrovsky wrote: On 01/26/2015 09:49 AM, Andrew Cooper wrote: On 26/01/15 11:38, Jan Beulich wrote: On 26.01.15 at 12:04, jbeul...@suse.com wrote: On 24.01.15 at 13:54, ian.jack...@eu.citrix.com wrote:

[Xen-devel] EFI GetNextVariableName crashes when running under Xen, but not under Linux. efi-rs=0 works. No memmap issues

2015-01-26 Thread Konrad Rzeszutek Wilk
Hey Jan, Andrew, I am hoping you can help me in directing me where I ought to go next in debugging this. This is a Lenovo Thinkpad x230 with the latest BIOS and Xen 4.6 (todays 'staging' + my patches). Initially when I installed Xen the first time it would hang when loading the efi_vars module

Re: [Xen-devel] Problem building xon with cross-compiler

2015-01-26 Thread Jan Beulich
On 26.01.15 at 16:38, stefan.ku...@gmx.net wrote: I try to compile xen-4.5.0 in the uclibc buildroot. Of course a first step would be to try to build in a more conventional environment. On make xen I get this error: mkdir -p compat/.xlat grep -v '^[[:blank:]]*#' xlat.lst | sed -ne

[Xen-devel] open-coded page list manipulation in shadow code

2015-01-26 Thread Jan Beulich
Tim, in the course of adding 16Tb support to the hypervisor, I ran into issues with you having added several open-coded page list accesses while breaking up non-order-0 allocations there. I looked at that code for quite a while, but wasn't really able to figure how to properly convert these. In

[Xen-devel] Problem building xon with cross-compiler

2015-01-26 Thread Stefan Kuhne
Hello, I try to compile xen-4.5.0 in the uclibc buildroot. On make xen I get this error: mkdir -p compat/.xlat grep -v '^[[:blank:]]*#' xlat.lst | sed -ne 's,@arch@,x86_32,g' -re 's,[[:blank:]]+xen\.h[[:blank:]]*$,,p' compat/.xlat/xen.lst.new if ! cmp -s compat/.xlat/xen.lst.new

Re: [Xen-devel] [PATCH RFC 0/5] Split off mini-os to a separate tree

2015-01-26 Thread Ian Jackson
Wei Liu writes (Re: [PATCH RFC 0/5] Split off mini-os to a separate tree): Cc Ian and Ian and some folks who might be interested in this work. Thanks. This is all good. I think we need some changes to osstest too because we will want a push gate for xen's minios. I don't think we want to keep

[Xen-devel] [PATCH RFC] xen: arm: context switch vtimer PPI state.

2015-01-26 Thread Ian Campbell
... instead of artificially masking the timer interrupt in the timer state and relying on the guest to unmask (which it isn't required to do per the h/w spec, although Linux does) To do this introduce the concept of routing a PPI to the currently running VCPU. For such interrupts irq_get_domain

Re: [Xen-devel] [xen-unstable test] 33690: regressions - FAIL

2015-01-26 Thread Andrew Cooper
On 26/01/15 14:51, Boris Ostrovsky wrote: On 01/26/2015 09:49 AM, Andrew Cooper wrote: On 26/01/15 11:38, Jan Beulich wrote: On 26.01.15 at 12:04, jbeul...@suse.com wrote: On 24.01.15 at 13:54, ian.jack...@eu.citrix.com wrote: test-amd64-amd64-xl-qemut-win7-amd64 7 windows-install fail

Re: [Xen-devel] [PATCH for-4.5 v8 4/7] xen: Add vmware_port support

2015-01-26 Thread Don Slutz
On 01/22/15 03:32, Jan Beulich wrote: On 21.01.15 at 18:52, dsl...@verizon.com wrote: On 01/16/15 05:09, Jan Beulich wrote: On 03.10.14 at 00:40, dsl...@verizon.com wrote: This is a new domain_create() flag, DOMCRF_vmware_port. It is passed to domctl as XEN_DOMCTL_CDF_vmware_port. Can you

[Xen-devel] Xen Project Document Day this Wednesday, January 28: The Great 4.5 Clean-Up

2015-01-26 Thread Russ Pavlicek
We want to begin this year by making sure that our documentation is correct for the recent 4.5 release. Do you have new feature information? Do you see old information which will confuse new users (especially those which rely on the xm command instead of xl)? Do you know of best practices which

Re: [Xen-devel] [PATCH for-4.5 v8 4/7] xen: Add vmware_port support

2015-01-26 Thread Jan Beulich
On 26.01.15 at 16:58, dsl...@verizon.com wrote: On 01/22/15 03:32, Jan Beulich wrote: On 21.01.15 at 18:52, dsl...@verizon.com wrote: On 01/16/15 05:09, Jan Beulich wrote: On 03.10.14 at 00:40, dsl...@verizon.com wrote: + +/* Only adjust byte_cnt 1 time */ +if ( bytes[0] ==

[Xen-devel] [PATCH v2 22/29] Ovmf/Xen: implement XenHypercallLib for ARM

2015-01-26 Thread Ard Biesheuvel
This patch adds an implementation of XenHypercallLib for both AArch64 and AArch32 execution modes on ARM systems. Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ard Biesheuvel ard.biesheu...@linaro.org --- OvmfPkg/Include/IndustryStandard/Xen/arch-arm/xen.h| 436

[Xen-devel] [PATCH v2 29/29] ArmVirtualizationPkg: add platform description for Xen guests

2015-01-26 Thread Ard Biesheuvel
This adds the .dsc and .fdf descriptions to build a UEFI image that is bootable by a Xen guest on 64-bit ARM (AArch64) Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ard Biesheuvel ard.biesheu...@linaro.org --- ArmPlatformPkg/ArmVirtualizationPkg/ArmVirtualizationXen.dsc

[Xen-devel] [PATCH v2 28/29] ArmVirtualizationPkg/VirtFdtDxe: wire up XenBusDxe to xen, xen DT node

2015-01-26 Thread Ard Biesheuvel
This patchs adds support to VirtFdtDxe for the Xen DT node which contains the base address of the Grant Table. This data is communicated to XenBusDxe using a XENIO_PROTOCOL instance. Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ard Biesheuvel ard.biesheu...@linaro.org

[Xen-devel] [PATCH v2 27/29] ArmVirtualizationPkg: add XenIoMmioLib

2015-01-26 Thread Ard Biesheuvel
This adds a XenIoMmioLib declaration and implementation that can be invoked to install the XENIO_PROTOCOL and a corresponding grant table address on a EFI handle. Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ard Biesheuvel ard.biesheu...@linaro.org ---

[Xen-devel] [PATCH v2 20/29] Ovmf/Xen: add separate driver for Xen PCI device

2015-01-26 Thread Ard Biesheuvel
Prepare for making XenBusDxe suitable for use with non-PCI devices (such as the DT node exposed by Xen on ARM) by introducing a separate DXE driver that binds to the Xen virtual PCI device and exposes the abstract XENIO_PROTOCOL for XenBusDxe to bind against. Contributed-under: TianoCore

[Xen-devel] [PATCH v2 14/29] ArmVirtualizationPkg: Xen/PV relocatable platformlib instance

2015-01-26 Thread Ard Biesheuvel
Add a ArmPlatformLib instance that can deal with the self relocation and truly dynamic discovery of system RAM base and size. Signed-off-by: Ard Biesheuvel ard.biesheu...@linaro.org --- .../ArmVirtualizationPkg/Library/ArmXenRelocatablePlatformLib/AARCH64/MemnodeParser.S | 232

[Xen-devel] [PATCH v2 17/29] Ovmf/Xen: refactor XenBusDxe hypercall implementation

2015-01-26 Thread Ard Biesheuvel
This refactors the Xen hypercall implementation that is part of the XenBusDxe driver, in preparation of splitting it off entirely into a XenHypercallLib library. This involves: - removing the dependency on XENBUS_DEVICE* pointers in the XenHypercall() prototypes - moving the discovered hyperpage

[Xen-devel] [PATCH v2 19/29] Ovmf/Xen: introduce XENIO_PROTOCOL

2015-01-26 Thread Ard Biesheuvel
This introduces the abstract XENIO_PROTOCOL that will be used to communicate the Xen grant table address to drivers supporting this protocol. Primary purpose is allowing us to change the XenBusDxe implementation so that it can support non-PCI Xen implementations such as Xen on ARM.

[Xen-devel] [PATCH v2 23/29] Ovmf/Xen: add ARM and AArch64 support to XenBusDxe

2015-01-26 Thread Ard Biesheuvel
This patch adds support to XenBusDxe for executing on ARM and AArch64 machines (the former only when built with GCC). Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ard Biesheuvel ard.biesheu...@linaro.org --- OvmfPkg/XenBusDxe/AtomicsGcc.c | 44

[Xen-devel] [PATCH v2 13/29] ArmVirtualizationPkg: allow patchable PCD for FV base address

2015-01-26 Thread Ard Biesheuvel
Allow the use of a patchable PCD for gArmTokenSpaceGuid.PcdFvBaseAddress by moving it from the [FixedPcd] to the [Pcd] section in the INF file of PlatformPeiLib. Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ard Biesheuvel ard.biesheu...@linaro.org ---

[Xen-devel] [PATCH v2 26/29] Ovfm/Xen: add a Vendor Hardware device path GUID for the XenBus root

2015-01-26 Thread Ard Biesheuvel
On non-PCI Xen guests (such as ARM), the XenBus root is not a PCI device but an abstract 'platform' device. Add a dedicated Vendor Hardware device path GUID to identify this node. Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ard Biesheuvel ard.biesheu...@linaro.org ---

[Xen-devel] [PATCH v2 21/29] Ovmf/Xen: move XenBusDxe to abstract XENIO_PROTOCOL

2015-01-26 Thread Ard Biesheuvel
While Xen on Intel uses a virtual PCI device to communicate the base address of the grant table, the ARM implementation uses a DT node, which is fundamentally incompatible with the way XenBusDxe is implemented, i.e., as a UEFI Driver Model implementation for a PCI device. Contributed-under:

[Xen-devel] [PATCH v2 25/29] Ovmf/Xen: implement dummy RealTimeClockLib for Xen

2015-01-26 Thread Ard Biesheuvel
This implements a dummy RealTimeClockLib for Xen, as there is no guest interface to access the time kept by Xen that can be shared between UEFI and the OS. Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ard Biesheuvel ard.biesheu...@linaro.org ---

Re: [Xen-devel] [PATCHv4 12/14] xen-blkback: safely unmap grants in case they are still in use

2015-01-26 Thread Roger Pau Monné
El 26/01/15 a les 18.01, David Vrabel ha escrit: From: Jennifer Herbert jennifer.herb...@citrix.com Use gnttab_unmap_refs_async() to wait until the mapped pages are no longer in use before unmapping them. This allows blkback to use network storage which may retain refs to pages in queued

[Xen-devel] [linux-3.14 test] 33780: regressions - FAIL

2015-01-26 Thread xen . org
flight 33780 linux-3.14 real [real] http://www.chiark.greenend.org.uk/~xensrcts/logs/33780/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-i386-xl-qemut-winxpsp3-vcpus1 5 xen-boot fail REGR. vs. 33341

Re: [Xen-devel] [PATCH v1 14/21] Ovmf/Xen: allow non-PCI usage of XenBusDxe

2015-01-26 Thread Laszlo Ersek
On 01/26/15 14:52, Ard Biesheuvel wrote: Well, the problem is that the XenConsoleSerialPortLib implementation also needs to issue Xen hypercalls, and needs to do so very early. In general virtual serial consoles, be they Xen or virtio, are a huge impedance mismatch (is that the right term?)

[Xen-devel] [PATCH] docs/commandline: Correct information for 'x2apic_phys' parameter

2015-01-26 Thread Andrew Cooper
Signed-off-by: Andrew Cooper andrew.coop...@citrix.com CC: Keir Fraser k...@xen.org CC: Jan Beulich jbeul...@suse.com CC: Tim Deegan t...@xen.org CC: Ian Campbell ian.campb...@citrix.com CC: Ian Jackson ian.jack...@eu.citrix.com --- docs/misc/xen-command-line.markdown |6 -- 1 file

Re: [Xen-devel] [PATCHv4 10/14] xen/gntdev: convert priv-lock to a mutex

2015-01-26 Thread David Vrabel
On 26/01/15 18:57, Stefano Stabellini wrote: @@ -443,14 +443,14 @@ static void mn_invl_range_start(struct mmu_notifier *mn, struct gntdev_priv *priv = container_of(mn, struct gntdev_priv, mn); struct grant_map *map; -spin_lock(priv-lock); +mutex_lock(priv-lock);

[Xen-devel] [PATCH v2 12/29] ArmVirtualizationPkg: implement custom MemoryInitPeiLib

2015-01-26 Thread Ard Biesheuvel
This implements a MemoryInitPeiLib instance that differs from the stock ArmPlatformPkg version only in the fact that it does not remove the memory used by the flash device (FD). The reason is that, when using PrePi, the DXE core is started immediately and never returns so there is no reason to

[Xen-devel] [PATCH v2 00/29] Xen/ARM guest support

2015-01-26 Thread Ard Biesheuvel
This series implements support for executing Tianocore inside a Xen guest domain on 64-bit ARM systems (AArch64) The first part addresses ARM platform specifics, primarily to allow a Tianocore binary image to be runtime relocatable, and execute from DRAM. The second part refactors the XenBus

[Xen-devel] [PATCH v2 08/29] ArmVirtualizationPkg: add padding to FDT allocation

2015-01-26 Thread Ard Biesheuvel
Our primary user QEMU/mach-virt presents us with a FDT blob padded to 64 KB with plenty of room to set additional properties. However, in the general case, we should only add properties after making sure there is enough room available. Contributed-under: TianoCore Contribution Agreement 1.0

[Xen-devel] [PATCH v2 02/29] ArmPkg: allow patchable PCDs for memory, FD and FV addresses

2015-01-26 Thread Ard Biesheuvel
In order to allow a runtime self relocating PrePi instance, change the allowable PCD types for the following PCDs: gArmTokenSpaceGuid.PcdSystemMemoryBase gArmTokenSpaceGuid.PcdSystemMemorySize gArmTokenSpaceGuid.PcdFdBaseAddress gArmTokenSpaceGuid.PcdFvBaseAddress to include

[Xen-devel] [PATCH v2 11/29] ArmPlatformPkg/PrePi: add a relocatable version of PrePi

2015-01-26 Thread Ard Biesheuvel
This patch introduces a relocatable PrePi, which can execute from arbitrary offsets in RAM. This is intendend to be run from a boot loader which passes a description of the actual platform in a device tree, for instance. Signed-off-by: Ard Biesheuvel ard.biesheu...@linaro.org ---

[Xen-devel] [PATCH v2 10/29] ArmPlatformPkg/PrePi: allow unicore PrePi on multicore capable CPU

2015-01-26 Thread Ard Biesheuvel
Under virtualization, typically, the guest is entered with only a single CPU turned on, and any remaining CPUs are started by the OS using PSCI. So refactor the PrePi code in such a way that we can implement a unicore flavor which can be allowed to execute on a MPcore CPU. Contributed-under:

[Xen-devel] [PATCH v2 18/29] Ovmf/Xen: move XenBusDxe hypercall code to separate library

2015-01-26 Thread Ard Biesheuvel
This moves all of the Xen hypercall code that was private to XenBusDxe to a new library class XenHypercallLib. This will allow us to reimplement it for ARM, and to export the Xen hypercall functionality to other parts of the code, such as a Xen console SerialPortLib driver. Contributed-under:

[Xen-devel] [PATCH v2 16/29] Ovmf/Xen: fix pointer to int cast in XenBusDxe

2015-01-26 Thread Ard Biesheuvel
On ARM, xen_pfn_t is 64 bits but the size of a pointer is only 32 bits, so casting between them needs to go via (UINTN). Also move the xen_pfn_t cast outside the shift so that we can avoid shifting 64-bit quantities on 32-bit architectures, which may require runtime library support.

[Xen-devel] [PATCH v2 07/29] ArmVirtualizationPkg: use a HOB to store device tree blob

2015-01-26 Thread Ard Biesheuvel
Instead of using a dynamic PCD, store the device tree address in a HOB so that we can also run under a configuration that does not support dynamic PCDs. Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ard Biesheuvel ard.biesheu...@linaro.org ---

Re: [Xen-devel] [PATCH for-4.5 v8 4/7] xen: Add vmware_port support

2015-01-26 Thread Don Slutz
On 01/26/15 11:46, Jan Beulich wrote: On 26.01.15 at 16:58, dsl...@verizon.com wrote: On 01/22/15 03:32, Jan Beulich wrote: On 21.01.15 at 18:52, dsl...@verizon.com wrote: On 01/16/15 05:09, Jan Beulich wrote: On 03.10.14 at 00:40, dsl...@verizon.com wrote: ... As stated before - if

[Xen-devel] [PATCH v2 05/29] ArmVirtualizationPkg: allow patchable PCD for device tree base address

2015-01-26 Thread Ard Biesheuvel
To allow a runtime self relocating PrePi instance to discover the base address of the device tree at runtime, allow the use of a patchable PCD for gArmVirtualizationTokenSpaceGuid.PcdDeviceTreeInitialBaseAddress. We will not be using the build time patch tool in this case, but using a patchable

[Xen-devel] [PATCH v2 04/29] ArmVirtualizationPkg: add GICv3 detection to VirtFdtDxe

2015-01-26 Thread Ard Biesheuvel
This adds support for detecting the presence of a GICv3 interrupt controller from the device tree, and recording its distributor base address in a PCD. Contributed-under: TianoCore Contribution Agreement 1.0 Reviewed-by: Olivier Martin olivier.mar...@arm.com Acked-by: Laszlo Ersek

[Xen-devel] [PATCH v2 03/29] ArmPlatformPkg: allow patchable PCD for FD base address

2015-01-26 Thread Ard Biesheuvel
This moves the reference to gArmTokenSpaceGuid.PcdFdBaseAddress from the [FixedPcd] to the [Pcd] section in the INF file of PrePiArmPlatformGlobalVariableLib so that its users may choose to use a patchable PCD instead. Contributed-under: TianoCore Contribution Agreement 1.0 Signed-off-by: Ard

[Xen-devel] [PATCH v2 06/29] ArmVirtualizationPkg: move early UART discovery to PlatformPeim

2015-01-26 Thread Ard Biesheuvel
This is partially motivated by the desire to use PrePi in a virt environment, and in that configuration, ArmPlatformInitializeSystemMemory() is never called. But actually, this is a more suitable place anyway. Contributed-under: TianoCore Contribution Agreement 1.0 Reviewed-by: Laszlo Ersek

Re: [Xen-devel] [PATCHv4 09/14] xen/grant-table: add a mechanism to safely unmap pages that are in use

2015-01-26 Thread Stefano Stabellini
On Mon, 26 Jan 2015, David Vrabel wrote: From: Jennifer Herbert jennifer.herb...@citrix.com Introduce gnttab_unmap_refs_async() that can be used to safely unmap pages that may be in use (ref count 1). If the pages are in use the unmap is deferred and retried later. This polling is not

Re: [Xen-devel] [PATCHv4 10/14] xen/gntdev: convert priv-lock to a mutex

2015-01-26 Thread Stefano Stabellini
On Mon, 26 Jan 2015, David Vrabel wrote: Unmapping may require sleeping and we unmap while holding priv-lock, so convert it to a mutex. Signed-off-by: David Vrabel david.vra...@citrix.com --- drivers/xen/gntdev.c | 40 1 file changed, 20

[Xen-devel] [PATCH] libxl_set_memory_target: only remove videoram from absolute targets

2015-01-26 Thread Stefano Stabellini
If the new target is relative to the current target, do not remove videoram again: it has already been removed from the current target. Signed-off-by: Stefano Stabellini stefano.stabell...@eu.citrix.com --- Changes in v2: - add videoram when setting maxmem. --- tools/libxl/libxl.c | 12

[Xen-devel] [PATCHv4 13/14] xen/gntdev: mark userspace PTEs as special on x86 PV guests

2015-01-26 Thread David Vrabel
In an x86 PV guest, get_user_pages_fast() on a userspace address range containing foreign mappings does not work correctly because the M2P lookup of the MFN from a userspace PTE may return the wrong page. Force get_user_pages_fast() to fail on such addresses by marking the PTEs as special. If

Re: [Xen-devel] [PATCH 12/14] xen-blkback: safely unmap grants in case they are still in use

2015-01-26 Thread Jens Axboe
On 01/26/2015 08:02 AM, David Vrabel wrote: On 19/01/15 15:51, David Vrabel wrote: From: Jenny Herbert jennifer.herb...@citrix.com Use gnttab_unmap_refs_async() to wait until the mapped pages are no longer in use before unmapping them. This allows blkback to use network storage which may

Re: [Xen-devel] EFI GetNextVariableName crashes when running under Xen, but not under Linux. efi-rs=0 works. No memmap issues

2015-01-26 Thread Konrad Rzeszutek Wilk
On Mon, Jan 26, 2015 at 04:36:03PM +, Andrew Cooper wrote: On 26/01/15 16:27, Konrad Rzeszutek Wilk wrote: Hey Jan, Andrew, I am hoping you can help me in directing me where I ought to go next in debugging this. This is a Lenovo Thinkpad x230 with the latest BIOS and Xen 4.6

Re: [Xen-devel] [PATCH RFC 0/5] Split off mini-os to a separate tree

2015-01-26 Thread Anil Madhavapeddy
On 26 Jan 2015, at 18:21, Martin Lucina mar...@lucina.net wrote: a...@recoil.org said: On 26 Jan 2015, at 17:42, Martin Lucina mar...@lucina.net wrote: tal...@gmail.com said: In case it's useful: for the standalone version of Mini-OS used by Mirage, I had to include these directories too:

Re: [Xen-devel] [PATCH RFC] p2m: p2m_mmio_direct set RW permissions

2015-01-26 Thread Elena Ufimtseva
On Fri, Jan 23, 2015 at 10:50:23AM +, Jan Beulich wrote: On 22.01.15 at 18:34, elena.ufimts...@oracle.com wrote: On Thu, Jan 22, 2015 at 04:42:52PM +0100, Roger Pau Monné wrote: El 22/01/15 a les 16.18, Elena Ufimtseva ha escrit: - jbeul...@suse.com wrote: On 22.01.15

[Xen-devel] [PATCH v2] libxl_set_memory_target: retain the same maxmem offset on top of the current target

2015-01-26 Thread Stefano Stabellini
In libxl_set_memory_target when setting the new maxmem, retain the same offset on top of the current target. The offset includes memory allocated by QEMU for rom files. Signed-off-by: Stefano Stabellini stefano.stabell...@eu.citrix.com --- Changes in v2: - remove LIBXL_MAXMEM_CONSTANT from

[Xen-devel] [PATCHv4 11/14] xen/gntdev: safely unmap grants in case they are still in use

2015-01-26 Thread David Vrabel
From: Jennifer Herbert jennifer.herb...@citrix.com Use gnttab_unmap_refs_async() to wait until the mapped pages are no longer in use before unmapping them. This allows userspace programs to safely use Direct I/O and AIO to a network filesystem which may retain refs to pages in queued skbs after

[Xen-devel] [PATCHv4 14/14] xen/gntdev: provide find_special_page VMA operation

2015-01-26 Thread David Vrabel
For a PV guest, use the find_special_page op to find the right page. To handle VMAs being split, remember the start of the original VMA so the correct index in the pages array can be calculated. Signed-off-by: David Vrabel david.vra...@citrix.com --- drivers/xen/gntdev.c | 12 1

[Xen-devel] [PATCHv4 12/14] xen-blkback: safely unmap grants in case they are still in use

2015-01-26 Thread David Vrabel
From: Jennifer Herbert jennifer.herb...@citrix.com Use gnttab_unmap_refs_async() to wait until the mapped pages are no longer in use before unmapping them. This allows blkback to use network storage which may retain refs to pages in queued skbs after the block I/O has completed. Signed-off-by:

[Xen-devel] [PATCHv4 10/14] xen/gntdev: convert priv-lock to a mutex

2015-01-26 Thread David Vrabel
Unmapping may require sleeping and we unmap while holding priv-lock, so convert it to a mutex. Signed-off-by: David Vrabel david.vra...@citrix.com --- drivers/xen/gntdev.c | 40 1 file changed, 20 insertions(+), 20 deletions(-) diff --git

Re: [Xen-devel] [PATCH RFC 0/5] Split off mini-os to a separate tree

2015-01-26 Thread Martin Lucina
tal...@gmail.com said: In case it's useful: for the standalone version of Mini-OS used by Mirage, I had to include these directories too: 1. xen/include/public 2. xen/common/libfdt 3. xen/include/xen/libfdt 4. config ( https://github.com/talex5/xen/tree/minios-releases ) Ah, so that's

[Xen-devel] [OSSTEST PATCH 2/3] mg-branch-setup: New script

2015-01-26 Thread Ian Jackson
Also, update the README.dev accordingly Signed-off-by: Ian Jackson ian.jack...@eu.citrix.com --- README.dev | 77 +++- mg-branch-setup | 106 +++ 2 files changed, 134 insertions(+), 49 deletions(-)

[Xen-devel] [OSSTEST PATCH 3/3] linux-3.16: New branch

2015-01-26 Thread Ian Jackson
Test this too. We fetch this from the Canonical Kernel Team (ckt) repo, but do not encode `ckt' in the branch name, in case this becomes a proper stable tree. (I have set up this branch on the osstest with the mg-branch-setup script in this version of this tree.) Signed-off-by: Ian Jackson

[Xen-devel] [OSSTEST PATCH 1/3] ap-common: Have ap-push for linux trees use refs/heads/

2015-01-26 Thread Ian Jackson
As per the docs in README.dev. Signed-off-by: Ian Jackson ian.jack...@eu.citrix.com --- ap-common |2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/ap-common b/ap-common index e2c3e42..014dd76 100644 --- a/ap-common +++ b/ap-common @@ -136,7 +136,7 @@ info_linux_tree () {

[Xen-devel] [PATCHv4 04/14] xen: remove scratch frames for ballooned pages and m2p override

2015-01-26 Thread David Vrabel
The scratch frame mappings for ballooned pages and the m2p override are broken. Remove them in preparation for replacing them with simpler mechanisms that works. The scratch pages did not ensure that the page was not in use. In particular, the foreign page could still be in use by hardware. If

[Xen-devel] [PATCHv4 03/14] xen/grant-table: pre-populate kernel unmap ops for xen_gnttab_unmap_refs()

2015-01-26 Thread David Vrabel
When unmapping grants, instead of converting the kernel map ops to unmap ops on the fly, pre-populate the set of unmap ops. This allows the grant unmap for the kernel mappings to be trivially batched in the future. Signed-off-by: David Vrabel david.vra...@citrix.com ---

[Xen-devel] [PATCHv4 05/14] x86/xen: require ballooned pages for grant maps

2015-01-26 Thread David Vrabel
From: Jennifer Herbert jennifer.herb...@citrix.com Ballooned pages are always used for grant maps which means the original frame does not need to be saved in page-index nor restored after the grant unmap. This allows the workaround in netback for the conflicting use of the (unionized) page-index

[Xen-devel] [PATCHv4 02/14] mm: add 'foreign' alias for the 'pinned' page flag

2015-01-26 Thread David Vrabel
From: Jennifer Herbert jennifer.herb...@citrix.com The foreign page flag will be used by Xen guests to mark pages that have grant mappings of frames from other (foreign) guests. The foreign flag is an alias for the existing (Xen-specific) pinned flag. This is safe because pinned is only used on

[Xen-devel] [PATCHv4 08/14] xen-netback: use foreign page information from the pages themselves

2015-01-26 Thread David Vrabel
From: Jennifer Herbert jennifer.herb...@citrix.com Use the foreign page flag in netback to get the domid and grant ref needed for the grant copy. This signficiantly simplifies the netback code and makes netback work with foreign pages from other backends (e.g., blkback). This allows blkback to

[Xen-devel] [PATCHv4 07/14] xen: mark grant mapped pages as foreign

2015-01-26 Thread David Vrabel
From: Jennifer Herbert jennifer.herb...@citrix.com Use the foreign page flag to mark pages that have a grant map. Use page-private to store information of the grant (the granting domain and the grant reference). Signed-off-by: Jennifer Herbert jennifer.herb...@citrix.com Signed-off-by: David

[Xen-devel] [PATCHv4 06/14] xen/grant-table: add helpers for allocating pages

2015-01-26 Thread David Vrabel
Add gnttab_alloc_pages() and gnttab_free_pages() to allocate/free pages suitable to for granted maps. Signed-off-by: David Vrabel david.vra...@citrix.com --- drivers/block/xen-blkback/blkback.c |8 drivers/net/xen-netback/interface.c |7 +++ drivers/xen/gntdev.c

[Xen-devel] [PATCHv4 00/14] xen: fix many long-standing grant mapping bugs

2015-01-26 Thread David Vrabel
This series fixes a number of long-standing bugs in the handling of grant maps. Refer to the following for all the details. http://xenbits.xen.org/people/dvrabel/grant-improvements-C.pdf In summary, the important uses that this enables are: 1. Block backends can use networked storage safely.

[Xen-devel] [PATCHv4 09/14] xen/grant-table: add a mechanism to safely unmap pages that are in use

2015-01-26 Thread David Vrabel
From: Jennifer Herbert jennifer.herb...@citrix.com Introduce gnttab_unmap_refs_async() that can be used to safely unmap pages that may be in use (ref count 1). If the pages are in use the unmap is deferred and retried later. This polling is not very clever but it should be good enough if the

Re: [Xen-devel] [PATCH RFC] p2m: p2m_mmio_direct set RW permissions

2015-01-26 Thread Elena Ufimtseva
On Mon, Jan 26, 2015 at 05:06:12PM +, Jan Beulich wrote: On 26.01.15 at 17:57, elena.ufimts...@oracle.com wrote: On Fri, Jan 23, 2015 at 10:50:23AM +, Jan Beulich wrote: On 22.01.15 at 18:34, elena.ufimts...@oracle.com wrote: (XEN) d56f - d5fff000 (reserved)

Re: [Xen-devel] [PATCH RFC 0/5] Split off mini-os to a separate tree

2015-01-26 Thread Anil Madhavapeddy
On 26 Jan 2015, at 17:42, Martin Lucina mar...@lucina.net wrote: tal...@gmail.com said: In case it's useful: for the standalone version of Mini-OS used by Mirage, I had to include these directories too: 1. xen/include/public 2. xen/common/libfdt 3. xen/include/xen/libfdt 4. config (

  1   2   >