Re: [Xen-devel] [v7][RFC][PATCH 06/13] hvmloader/ram: check if guest memory is out of reserved device memory maps

2014-11-12 Thread Chen, Tiejun
#2 flags field in each specific device of new domctl would control whether this device need to check/reserve its own RMRR range. But its not dependent on current device assignment domctl, so the user can use them to control which devices need to work as hotplug later, separately. And this could

Re: [Xen-devel] [v7][RFC][PATCH 06/13] hvmloader/ram: check if guest memory is out of reserved device memory maps

2014-11-12 Thread Chen, Tiejun
On 2014/11/12 17:02, Jan Beulich wrote: On 12.11.14 at 09:45, tiejun.c...@intel.com wrote: #2 flags field in each specific device of new domctl would control whether this device need to check/reserve its own RMRR range. But its not dependent on current device assignment domctl, so the user can

Re: [Xen-devel] [TestDay] VMX test report for Xen 4.5.0-rc1

2014-11-12 Thread Jan Beulich
On 12.11.14 at 07:58, robert...@intel.com wrote: 2. Failed to hotplug a VT-d device with XEN4.5-RC1 http://bugzilla-archived.xenproject.org/bugzilla/show_bug.cgi?id=1894 First of all I'm not sure it is really useful to use the old, discontinued bugzilla to report bugs. I think it would be

Re: [Xen-devel] Wrong cpupool handling

2014-11-12 Thread Dietmar Hahn
Am Dienstag 11 November 2014, 15:21:01 schrieb Juergen Gross: Hi again, On 11/11/2014 01:18 PM, Dietmar Hahn wrote: Hi list, When creating a cpupool, starting and destroying a guest within this pool, then removing this pool doesn't work because of EBUSY. It seems the cause of this

Re: [Xen-devel] [v7][RFC][PATCH 06/13] hvmloader/ram: check if guest memory is out of reserved device memory maps

2014-11-12 Thread Jan Beulich
On 12.11.14 at 10:13, tiejun.c...@intel.com wrote: On 2014/11/12 17:02, Jan Beulich wrote: On 12.11.14 at 09:45, tiejun.c...@intel.com wrote: #2 flags field in each specific device of new domctl would control whether this device need to check/reserve its own RMRR range. But its not dependent

Re: [Xen-devel] [TestDay] VMX test report for Xen 4.5.0-rc1

2014-11-12 Thread Fabio Fantoni
Il 12/11/2014 07:58, Hu, Robert ha scritto: Hi All, This is a bug summary for Xen 4.5-rc1 on Intel Server platforms. Test environment: Xen: Xen 4.5-rc1 Dom0: Linux kernel 3.17.0 Hardware: Intel IVT-EX, Haswell-EP, BDW Client, HSW-EX, IVT-EX, HSW-UP New bugs(9): 1. with xen_platform_pci=0

Re: [Xen-devel] [PATCH for-4.5] libxl: add missing action in DEFINE_DEVICE_ADD

2014-11-12 Thread Ian Campbell
On Tue, 2014-11-11 at 13:46 +, Wei Liu wrote: Signed-off-by: Wei Liu wei.l...@citrix.com Cc: Ian Campbell ian.campb...@citrix.com Cc: Ian Jackson ian.jack...@eu.citrix.com Cc: George Dunlap george.dun...@eu.citrix.com Cc: Konrad Wilk konrad.w...@oracle.com --- This is a simple enough

Re: [Xen-devel] PCI passthrough (pci-attach) to HVM guests bug (BAR64 addresses are bogus)

2014-11-12 Thread Malcolm Crossley
On 12/11/14 09:24, Jan Beulich wrote: On 12.11.14 at 02:37, konrad.w...@oracle.com wrote: When we PCI insert an device, the BARs are not set at all - and hence the Linux kernel is the one that tries to set the BARs in. The reason it cannot fit the device in the MMIO region is due to the _CRS

Re: [Xen-devel] Is: QXL in Xen (busted) Was :Re: Xen 4.5-rc1 update (RC1 is out 2014-Oct-24th)

2014-11-12 Thread Fabio Fantoni
Il 06/11/2014 16:12, Fabio Fantoni ha scritto: Il 03/11/2014 17:03, Konrad Rzeszutek Wilk ha scritto: On Mon, Nov 03, 2014 at 12:05:44PM +0100, Fabio Fantoni wrote: Il 31/10/2014 15:33, Konrad Rzeszutek Wilk ha scritto: I always posted all versions of the patch in xen-devel, the latest was

Re: [Xen-devel] [v7][RFC][PATCH 06/13] hvmloader/ram: check if guest memory is out of reserved device memory maps

2014-11-12 Thread Chen, Tiejun
On 2014/11/12 18:24, Jan Beulich wrote: On 12.11.14 at 11:18, tiejun.c...@intel.com wrote: On 2014/11/12 16:55, Jan Beulich wrote: On 12.11.14 at 04:05, tiejun.c...@intel.com wrote: I don't see any feedback to this point, so I think you still prefer we should do all check in the callback

Re: [Xen-devel] [OSSTEST PATCH 0/9] Host allocation scoring improvements

2014-11-12 Thread Ian Campbell
On Tue, 2014-11-11 at 19:41 +, Ian Jackson wrote: Here, I'm trying to fix the way that osstest gets far too obsessed about particular failing hosts. All fine by me, not that I've really grokked the bits towards the end. (I will try to if you want) 1/9 cs-adjust-flight: Fix doc about

Re: [Xen-devel] [PATCH for-4.5] libxl: add missing action in DEFINE_DEVICE_ADD

2014-11-12 Thread Wei Liu
On Wed, Nov 12, 2014 at 10:01:24AM +, Ian Campbell wrote: On Tue, 2014-11-11 at 13:46 +, Wei Liu wrote: Signed-off-by: Wei Liu wei.l...@citrix.com Cc: Ian Campbell ian.campb...@citrix.com Cc: Ian Jackson ian.jack...@eu.citrix.com Cc: George Dunlap george.dun...@eu.citrix.com Cc:

Re: [Xen-devel] Wrong cpupool handling

2014-11-12 Thread Dietmar Hahn
Am Mittwoch 12 November 2014, 11:25:14 schrieb Juergen Gross: On 11/12/2014 10:53 AM, Dietmar Hahn wrote: Am Dienstag 11 November 2014, 15:21:01 schrieb Juergen Gross: Hi again, On 11/11/2014 01:18 PM, Dietmar Hahn wrote: Hi list, When creating a cpupool, starting and destroying a

[Xen-devel] [PATCH for-4.5] libxl: add missing action in DEFINE_DEVICE_ADD

2014-11-12 Thread Wei Liu
... otherwise when device add operation fails, the error message looks like libxl: error: libxl.c:1897:device_addrm_aocomplete: unable to (null) device, which is not very helpful. Signed-off-by: Wei Liu wei.l...@citrix.com Cc: Ian Campbell ian.campb...@citrix.com Cc: Ian Jackson

Re: [Xen-devel] PCI passthrough (pci-attach) to HVM guests bug (BAR64 addresses are bogus)

2014-11-12 Thread Malcolm Crossley
On 12/11/14 10:11, Jan Beulich wrote: On 12.11.14 at 11:01, malcolm.cross...@citrix.com wrote: As for the CRS regions: These typically describe the BIOS set limits in hardware configuration for the MMIO hole itself. On single socket systems anything which isn't RAM or another predefined region

Re: [Xen-devel] [TestDay] VMX test report for Xen 4.5.0-rc1

2014-11-12 Thread Hu, Robert
Best Regards, Robert Ho -Original Message- From: Jan Beulich [mailto:jbeul...@suse.com] Sent: Wednesday, November 12, 2014 5:49 PM To: Hu, Robert Cc: xen-devel@lists.xen.org; Konrad Rzeszutek Wilk Subject: Re: [TestDay] VMX test report for Xen 4.5.0-rc1 On 12.11.14 at 07:58,

Re: [Xen-devel] [PATCH for-4.5] libxl: add missing action in DEFINE_DEVICE_ADD

2014-11-12 Thread Ian Campbell
On Wed, 2014-11-12 at 10:39 +, Wei Liu wrote: ... otherwise when device add operation fails, the error message looks like libxl: error: libxl.c:1897:device_addrm_aocomplete: unable to (null) device, which is not very helpful. Thanks. Signed-off-by: Wei Liu wei.l...@citrix.com Acked-by:

Re: [Xen-devel] [PATCH] fix commit xen/arm: Add support for GICv3 for domU

2014-11-12 Thread Ian Campbell
On Tue, 2014-11-11 at 21:24 -0500, Konrad Rzeszutek Wilk wrote: On Tue, Nov 11, 2014 at 08:28:38PM +, M A Young wrote: The build of xen-4.5.0-rc2 fails if XSM_ENABLE=y due to an inconsistency in commit fda1614 xen/arm: Add support for GICv3 for domU which uses

Re: [Xen-devel] [PATCH for-4.5] libxl: add missing action in DEFINE_DEVICE_ADD

2014-11-12 Thread Wei Liu
And of course this is v2 of this patch. Sorry for not having added that in the subject line. ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel

Re: [Xen-devel] [PATCH] Adjust number of domains in cpupools when destroying domain

2014-11-12 Thread Jan Beulich
On 12.11.14 at 11:46, andrew.coop...@citrix.com wrote: On 12/11/14 10:40, Juergen Gross wrote: --- a/xen/common/cpupool.c +++ b/xen/common/cpupool.c @@ -225,6 +225,35 @@ static int cpupool_destroy(struct cpupool *c) } /* + * Move domain to another cpupool + */ +static int

Re: [Xen-devel] [PATCH] Adjust number of domains in cpupools when destroying domain

2014-11-12 Thread Jürgen Groß
On 11/12/2014 11:46 AM, Andrew Cooper wrote: On 12/11/14 10:40, Juergen Gross wrote: Commit bac6334b51d9bcfe57ecf4a4cb5288348fcf044a (move domain to cpupool0 before destroying it) introduced an error in the accounting of cpupools regarding the number of domains. The number of domains is nor

[Xen-devel] [PATCH for-4.5] xl: correct test condition on libxl_domain_info

2014-11-12 Thread Wei Liu
The `if' statement considered return value 0 from libxl_domain_info an error, while 0 actually means success. Signed-off-by: Wei Liu wei.l...@citrix.com Cc: Ian Campbell ian.campb...@citrix.com Cc: Ian Jackson ian.jack...@eu.citrix.com --- This is a bug fix for PSR feature. This feature was added

Re: [Xen-devel] [TestDay] VMX test report for Xen 4.5.0-rc1

2014-11-12 Thread Wei Liu
On Wed, Nov 12, 2014 at 06:58:49AM +, Hu, Robert wrote: Hi All, This is a bug summary for Xen 4.5-rc1 on Intel Server platforms. 9. xl psr-cmt-show cache_occupancy $dom_id will report error http://bugzilla-archived.xenproject.org/bugzilla/show_bug.cgi?id=1901 See

[Xen-devel] [PATCH] Adjust number of domains in cpupools when destroying domain

2014-11-12 Thread Juergen Gross
Commit bac6334b51d9bcfe57ecf4a4cb5288348fcf044a (move domain to cpupool0 before destroying it) introduced an error in the accounting of cpupools regarding the number of domains. The number of domains is nor adjusted when a domain is moved to cpupool0 in kill_domain(). Correct this by introducing

Re: [Xen-devel] [PATCH] Adjust number of domains in cpupools when destroying domain

2014-11-12 Thread George Dunlap
On Wed, Nov 12, 2014 at 10:40 AM, Juergen Gross jgr...@suse.com wrote: Commit bac6334b51d9bcfe57ecf4a4cb5288348fcf044a (move domain to cpupool0 before destroying it) introduced an error in the accounting of cpupools regarding the number of domains. The number of domains is nor adjusted when a

Re: [Xen-devel] [PATCH] Adjust number of domains in cpupools when destroying domain

2014-11-12 Thread George Dunlap
On Wed, Nov 12, 2014 at 11:10 AM, Juergen Gross jgr...@suse.com wrote: Commit bac6334b51d9bcfe57ecf4a4cb5288348fcf044a (move domain to cpupool0 before destroying it) introduced an error in the accounting of cpupools regarding the number of domains. The number of domains is nor adjusted when a

Re: [Xen-devel] [PATCH for-4.5] xl: correct test condition on libxl_domain_info

2014-11-12 Thread Ian Campbell
CCing the folks who signed-of-by is on the original patch On Wed, 2014-11-12 at 11:05 +, Wei Liu wrote: The `if' statement considered return value 0 from libxl_domain_info an error, while 0 actually means success. Signed-off-by: Wei Liu wei.l...@citrix.com Acked-by: Ian Campbell

Re: [Xen-devel] [PATCH for-xen-4.5] tools/hotplug: use configure --sysconfdir result

2014-11-12 Thread Ian Campbell
You forgot to add the release manager... I've done that for you. In 1413279117.1497.25.ca...@citrix.com I said: Acked-by: Ian Campbell ian.campb...@citrix.com Is this a bug fix or a feature? What are the risks? IsLKonrad OK with it? On Wed, 2014-11-12 at 12:06 +0100, Olaf Hering wrote:

Re: [Xen-devel] [PATCH] Adjust number of domains in cpupools when destroying domain

2014-11-12 Thread Juergen Gross
On 11/12/2014 12:10 PM, George Dunlap wrote: On Wed, Nov 12, 2014 at 10:40 AM, Juergen Gross jgr...@suse.com wrote: Commit bac6334b51d9bcfe57ecf4a4cb5288348fcf044a (move domain to cpupool0 before destroying it) introduced an error in the accounting of cpupools regarding the number of domains.

Re: [Xen-devel] xl list -l doesn't work for incoming domain

2014-11-12 Thread Wei Liu
On Tue, Nov 11, 2014 at 11:42:04AM -0500, Zhigang Wang wrote: On 11/11/2014 10:20 AM, Wei Liu wrote: On Tue, Nov 11, 2014 at 09:41:32AM -0500, Zhigang Wang wrote: On 11/11/2014 06:01 AM, Wei Liu wrote: On Mon, Nov 10, 2014 at 12:54:18PM -0500, Zhigang Wang wrote: [...] Could you please

[Xen-devel] [PATCH v9 04/13] arm64: introduce is_device_dma_coherent

2014-11-12 Thread Stefano Stabellini
Introduce a boolean flag and an accessor function to check whether a device is dma_coherent. Set the flag from set_arch_dma_coherent_ops. Signed-off-by: Stefano Stabellini stefano.stabell...@eu.citrix.com Signed-off-by: Catalin Marinas catalin.mari...@arm.com Reviewed-by: Catalin Marinas

[Xen-devel] [PATCH v9 02/13] xen/arm: remove outer_*_range call

2014-11-12 Thread Stefano Stabellini
Dom0 is not actually capable of issuing outer_inv_range or outer_clean_range calls. Signed-off-by: Stefano Stabellini stefano.stabell...@eu.citrix.com Acked-by: Ian Campbell ian.campb...@citrix.com Reviewed-by: Catalin Marinas catalin.mari...@arm.com --- arch/arm/xen/mm32.c |9 - 1

[Xen-devel] [PATCH v9 07/13] xen: add a dma_addr_t dev_addr argument to xen_dma_map_page

2014-11-12 Thread Stefano Stabellini
dev_addr is the machine address of the page. The new parameter can be used by the ARM and ARM64 implementations of xen_dma_map_page to find out if the page is a local page (pfn == mfn) or a foreign page (pfn != mfn). dev_addr could be retrieved again from the physical address, using pfn_to_mfn,

[Xen-devel] [PATCH v9 10/13] xen/arm/arm64: introduce xen_arch_need_swiotlb

2014-11-12 Thread Stefano Stabellini
Introduce an arch specific function to find out whether a particular dma mapping operation needs to bounce on the swiotlb buffer. On ARM and ARM64, if the page involved is a foreign page and the device is not coherent, we need to bounce because at unmap time we cannot execute any required cache

[Xen-devel] [PATCH v9 09/13] xen/arm/arm64: merge xen/mm32.c into xen/mm.c

2014-11-12 Thread Stefano Stabellini
Merge xen/mm32.c into xen/mm.c. As a consequence the code gets compiled on arm64 too. Signed-off-by: Stefano Stabellini stefano.stabell...@eu.citrix.com Reviewed-by: Catalin Marinas catalin.mari...@arm.com --- arch/arm/xen/Makefile |2 +- arch/arm/xen/mm.c

[Xen-devel] [PATCH v9 12/13] swiotlb-xen: pass dev_addr to xen_dma_unmap_page and xen_dma_sync_single_for_cpu

2014-11-12 Thread Stefano Stabellini
xen_dma_unmap_page and xen_dma_sync_single_for_cpu take a dma_addr_t handle as argument, not a physical address. Signed-off-by: Stefano Stabellini stefano.stabell...@eu.citrix.com Reviewed-by: Catalin Marinas catalin.mari...@arm.com --- drivers/xen/swiotlb-xen.c |6 +++--- 1 file changed, 3

[Xen-devel] [PATCH v9 13/13] swiotlb-xen: remove BUG_ON in xen_bus_to_phys

2014-11-12 Thread Stefano Stabellini
On x86 truncation cannot occur because config XEN depends on X86_64 || (X86_32 X86_PAE). On ARM truncation can occur without CONFIG_ARM_LPAE, when the dma operation involves foreign grants. However in that case the physical address returned by xen_bus_to_phys is actually invalid (there is no mfn

[Xen-devel] [PATCH v9 11/13] xen/arm: introduce GNTTABOP_cache_flush

2014-11-12 Thread Stefano Stabellini
Introduce support for new hypercall GNTTABOP_cache_flush. Use it to perform cache flashing on pages used for dma when necessary. If GNTTABOP_cache_flush is supported by the hypervisor, we don't need to bounce dma map operations that involve foreign grants and non-coherent devices. Signed-off-by:

Re: [Xen-devel] configure: error: Unable to find Python development headers

2014-11-12 Thread Ian Campbell
On Tue, 2014-11-11 at 00:56 -0800, Steve Freitas wrote: configure: error: Unable to find Python development headers configure: error: ./configure failed for tools config.log/status (perhaps the ones under tools/) might give a clue as to why it thinks it can't find them. Ian.

Re: [Xen-devel] RFC: vNUMA project

2014-11-12 Thread Wei Liu
On Tue, Nov 11, 2014 at 06:03:22PM +, David Vrabel wrote: On 11/11/14 17:36, Wei Liu wrote: # What's already implemented? PV vNUMA support in libxl/xl and Linux kernel. Linux doesn't have vnuma yet, although the last set of patches I saw looked fine and were waiting for acks from

Re: [Xen-devel] [PATCH] fix commit xen/arm: Add support for GICv3 for domU

2014-11-12 Thread Julien Grall
On 11/11/2014 08:28 PM, M A Young wrote: The build of xen-4.5.0-rc2 fails if XSM_ENABLE=y due to an inconsistency in commit fda1614 xen/arm: Add support for GICv3 for domU which uses XEN_DOMCTL_configure_domain in xen/xsm/flask/hooks.c and xen/xsm/flask/policy/access_vectors but

Re: [Xen-devel] [TestDay] VMX test report for Xen 4.5.0-rc1

2014-11-12 Thread Boris Ostrovsky
On 11/12/2014 01:58 AM, Hu, Robert wrote: 2. Failed to hotplug a VT-d device with XEN4.5-RC1 http://bugzilla-archived.xenproject.org/bugzilla/show_bug.cgi?id=1894 This should be addressed by these two: http://lists.xenproject.org/archives/html/xen-devel/2014-11/msg00875.html

Re: [Xen-devel] [TestDay] VMX test report for Xen 4.5.0-rc1

2014-11-12 Thread Ian Campbell
On Wed, 2014-11-12 at 10:53 +, Hu, Robert wrote: I think it shall be stored somewhere and be tracked, rather than one by one mail thread. To follow your suggestion, I would next time in addition send each bug per mail, with descriptions contained. If you send each bug as a separate email

Re: [Xen-devel] RFC: vNUMA project

2014-11-12 Thread Wei Liu
On Wed, Nov 12, 2014 at 09:35:01AM +, Jan Beulich wrote: On 11.11.14 at 19:03, david.vra...@citrix.com wrote: On 11/11/14 17:36, Wei Liu wrote: Option #1 requires less modification to guest, because guest won't need to switch to new hypercall. It's unclear at this point if a guest

[Xen-devel] [qemu-mainline test] 31497: regressions - trouble: broken/fail/pass

2014-11-12 Thread xen . org
flight 31497 qemu-mainline real [real] http://www.chiark.greenend.org.uk/~xensrcts/logs/31497/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-armhf-armhf-xl 9 guest-start fail REGR. vs. 30603

Re: [Xen-devel] RFC: vNUMA project

2014-11-12 Thread Jan Beulich
On 12.11.14 at 14:45, wei.l...@citrix.com wrote: On Wed, Nov 12, 2014 at 09:35:01AM +, Jan Beulich wrote: On 11.11.14 at 19:03, david.vra...@citrix.com wrote: On 11/11/14 17:36, Wei Liu wrote: Option #1 requires less modification to guest, because guest won't need to switch to new

Re: [Xen-devel] [PATCH v9 0/13] introduce GNTTABOP_cache_flush

2014-11-12 Thread Julien Grall
Hi, On 11/12/2014 11:39 AM, Stefano Stabellini wrote: Hi all, this patch series introduces support for GNTTABOP_cache_flush to perform cache maintenance operation on foreign pages and reverts the current code based on XENFEAT_grant_map_identity. It also provides a very slow fallback by

Re: [Xen-devel] [PATCH OSSTEST v2 18/20] Osstest/Debian: Add clk_ignore_unused to default command line

2014-11-12 Thread Julien Grall
On 11/12/2014 10:07 AM, Ian Campbell wrote: On Tue, 2014-11-11 at 17:50 +0100, Julien Grall wrote: Hi, Somehow I missed this email. On 30/10/2014 13:33, Ian Campbell wrote: create ! title it arm: domain 0 disables clocks which are in fact being used thanks On Wed, 2014-10-29 at 16:39

Re: [Xen-devel] RFC: vNUMA project

2014-11-12 Thread Wei Liu
On Wed, Nov 12, 2014 at 02:13:09PM +, Jan Beulich wrote: On 12.11.14 at 14:45, wei.l...@citrix.com wrote: On Wed, Nov 12, 2014 at 09:35:01AM +, Jan Beulich wrote: On 11.11.14 at 19:03, david.vra...@citrix.com wrote: On 11/11/14 17:36, Wei Liu wrote: Option #1 requires less

Re: [Xen-devel] RFC: vNUMA project

2014-11-12 Thread David Vrabel
On 12/11/14 14:27, Wei Liu wrote: On Wed, Nov 12, 2014 at 02:13:09PM +, Jan Beulich wrote: On 12.11.14 at 14:45, wei.l...@citrix.com wrote: On Wed, Nov 12, 2014 at 09:35:01AM +, Jan Beulich wrote: On 11.11.14 at 19:03, david.vra...@citrix.com wrote: On 11/11/14 17:36, Wei Liu wrote:

Re: [Xen-devel] xl list -l doesn't work for incoming domain

2014-11-12 Thread Zhigang Wang
On 11/12/2014 06:31 AM, Wei Liu wrote: On Tue, Nov 11, 2014 at 11:42:04AM -0500, Zhigang Wang wrote: On 11/11/2014 10:20 AM, Wei Liu wrote: On Tue, Nov 11, 2014 at 09:41:32AM -0500, Zhigang Wang wrote: On 11/11/2014 06:01 AM, Wei Liu wrote: On Mon, Nov 10, 2014 at 12:54:18PM -0500, Zhigang

Re: [Xen-devel] xl list -l doesn't work for incoming domain

2014-11-12 Thread Ian Campbell
On Wed, 2014-11-12 at 09:36 -0500, Zhigang Wang wrote: Also I want clarify one thing: the @introduceDomain watch is triggered at the same time for xm/xend and xl: when VM fully migrated. The different between xm/xend and xl is: xend will populate destination side VM xenstore entries at

Re: [Xen-devel] RFC: vNUMA project

2014-11-12 Thread Wei Liu
On Wed, Nov 12, 2014 at 02:29:56PM +, David Vrabel wrote: On 12/11/14 14:27, Wei Liu wrote: On Wed, Nov 12, 2014 at 02:13:09PM +, Jan Beulich wrote: On 12.11.14 at 14:45, wei.l...@citrix.com wrote: On Wed, Nov 12, 2014 at 09:35:01AM +, Jan Beulich wrote: On 11.11.14 at 19:03,

Re: [Xen-devel] xl list -l doesn't work for incoming domain

2014-11-12 Thread Zhigang Wang
On 11/12/2014 09:40 AM, Ian Campbell wrote: On Wed, 2014-11-12 at 09:36 -0500, Zhigang Wang wrote: Also I want clarify one thing: the @introduceDomain watch is triggered at the same time for xm/xend and xl: when VM fully migrated. The different between xm/xend and xl is: xend will populate

Re: [Xen-devel] RFC: vNUMA project

2014-11-12 Thread Jan Beulich
On 12.11.14 at 15:40, wei.l...@citrix.com wrote: So what's the usual technique in Linux to make sure if a specific Xen feature is present? Jan, is it suitable to use a XENFEAT_* bit for this? Yes, that would be the canonical way. Jan ___

Re: [Xen-devel] xl list -l doesn't work for incoming domain

2014-11-12 Thread Zhigang Wang
On 11/12/2014 09:52 AM, Ian Campbell wrote: On Wed, 2014-11-12 at 09:48 -0500, Zhigang Wang wrote: On 11/12/2014 09:40 AM, Ian Campbell wrote: On Wed, 2014-11-12 at 09:36 -0500, Zhigang Wang wrote: Also I want clarify one thing: the @introduceDomain watch is triggered at the same time for

[Xen-devel] [PATCH] mkdeb previously set the package architecture to be 'amd64' for anything other than XEN_TARGET_ARCH=x86_32. This patch attempts to correctly map the architecture from GNU names to

2014-11-12 Thread Clark Laughlin
Signed-off-by: Clark Laughlin clark.laugh...@linaro.org --- tools/misc/mkdeb | 15 ++- 1 file changed, 10 insertions(+), 5 deletions(-) diff --git a/tools/misc/mkdeb b/tools/misc/mkdeb index 3bbf881..4d14d9e 100644 --- a/tools/misc/mkdeb +++ b/tools/misc/mkdeb @@ -13,11 +13,16 @@ fi

[Xen-devel] [PATCH 1/3] dma, ia64: add dma_get_required_mask_from_max_pfn()

2014-11-12 Thread David Vrabel
ia64 provides a duplicate of the generic dma_get_required_mask() because it has ARCH_HAS_GET_REQUIRED_MASK. Provide a common dma_get_require_mask_max_pfn() instead. Signed-off-by: David Vrabel david.vra...@citrix.com Cc: Tony Luck tony.l...@intel.com Cc: Fenghua Yu fenghua...@intel.com Cc:

[Xen-devel] [PATCH 3/3] x86/xen: use the maximum MFN to calculate the required DMA mask

2014-11-12 Thread David Vrabel
On a Xen PV guest the DMA addresses and physical addresses are not 1:1 (such as Xen PV guests) and the generic dma_get_required_mask() does not return the correct mask (since it uses max_pfn). Some device drivers (such as mptsas, mpt2sas) use dma_get_required_mask() to set the device's DMA mask

[Xen-devel] [PATCH 2/3] x86: allow dma_get_required_mask() to be overridden

2014-11-12 Thread David Vrabel
Use dma_ops-get_required_mask() if provided, defaulting to dma_get_requried_mask_from_max_pfn(). This is needed on systems (such as Xen PV guests) where the DMA address and the physical address are not equal. Signed-off-by: David Vrabel david.vra...@citrix.com --- arch/x86/include/asm/device.h

[Xen-devel] [PATCHv2 0/3]: dma, x86, xen: reduce SWIOTLB usage in Xen guests

2014-11-12 Thread David Vrabel
On systems where DMA addresses and physical addresses are not 1:1 (such as Xen PV guests), the generic dma_get_required_mask() will not return the correct mask (since it uses max_pfn). Some device drivers (such as mptsas, mpt2sas) use dma_get_required_mask() to set the device's DMA mask to allow

Re: [Xen-devel] [PATCH] mkdeb previously set the package architecture to be 'amd64' for anything other than XEN_TARGET_ARCH=x86_32. This patch attempts to correctly map the architecture from GNU names

2014-11-12 Thread Ian Campbell
On Wed, 2014-11-12 at 09:27 -0600, Clark Laughlin wrote: Signed-off-by: Clark Laughlin clark.laugh...@linaro.org Acked-by: Ian Campbell ian.campb...@citrix.com The mapping is a bit more zealous that strictly needed: +# map the architecture, if necessary +arch=$XEN_TARGET_ARCH +case

[Xen-devel] [PATCH RFC 7/7] tools/tests: Remove superfluous and incomplete spinlock from xen-access

2014-11-12 Thread Tamas K Lengyel
The spin-lock implementation in the xen-access test program is implemented in a fashion that is actually incomplete. The x86 assembly that guarantees that the lock is held by only one thread lacks the lock; instruction. However, the spin-lock is not actually necessary in xen-access as it is not

[Xen-devel] [PATCH RFC 2/7] xen/mem_event: Rename the mem_event ring from 'access' to 'monitor'

2014-11-12 Thread Tamas K Lengyel
The name of the ring still implies it is used only for memory accesses, which is no longer the case. It is also used to deliver variuos HVM events, thus the name monitor is more appropriate in this setting. Signed-off-by: Tamas K Lengyel tamas.leng...@zentific.com ---

[Xen-devel] [PATCH RFC 0/7] xen: Clean-up of mem_event subsystem

2014-11-12 Thread Tamas K Lengyel
This patch series aims to clean up the mem_event subsystem within Xen. The original use-case for this system was to allow external helper applications running in privileged domains to control various memory operations performed by Xen. Amongs these were paging, sharing and access control. The

[Xen-devel] [PATCH RFC 6/7] xen/vm_event: Decouple vm_event and mem_access.

2014-11-12 Thread Tamas K Lengyel
The vm_event subsystem has been artifically tied to the presence of mem_access. While mem_access does depend on vm_event, vm_event is an entirely independent subsystem that can be used for arbitrary function-offloading to helper apps in domains. This patch removes the dependency that mem_access

[Xen-devel] [PATCH RFC 4/7] x86/hvm: rename hvm_memory_event_* functions to hvm_event_*

2014-11-12 Thread Tamas K Lengyel
The function names currently imply that these events are to be delivered via the memory_event subsystem. However, the naming is confusing as these events have nothing to do with actual memory events. Simply naming these functions hvm_event_* more accurately describe their usage. Signed-off-by:

Re: [Xen-devel] [PATCH v2] mkdeb: correctly map package architectures for x86 and ARM

2014-11-12 Thread Ian Campbell
On Wed, 2014-11-12 at 09:38 -0600, Clark Laughlin wrote: mkdeb previously set the package architecture to be 'amd64' for anything other than XEN_TARGET_ARCH=x86_32. This patch attempts to correctly map the architecture from GNU names to debian names for x86 and ARM architectures, or

[Xen-devel] [PATCH] xen_disk: fix unmapping of persistent grants

2014-11-12 Thread Roger Pau Monne
This patch fixes two issues with persistent grants and the disk PV backend (Qdisk): - Don't use batch mappings when using persistent grants, doing so prevents unmapping single grants (the whole area has to be unmapped at once). - Unmap persistent grants before switching to the closed state,

Re: [Xen-devel] [PATCH 3/3] x86/xen: use the maximum MFN to calculate the required DMA mask

2014-11-12 Thread Jan Beulich
On 12.11.14 at 16:25, david.vra...@citrix.com wrote: +u64 +xen_swiotlb_get_required_mask(struct device *dev) +{ + u64 max_mfn; + + max_mfn = HYPERVISOR_memory_op(XENMEM_maximum_ram_page, NULL); + + return DMA_BIT_MASK(fls64(max_mfn PAGE_SHIFT) + 1); +} The value the

Re: [Xen-devel] [PATCH RFC 1/7] xen/mem_event: Cleanup of mem_event structures

2014-11-12 Thread Andrew Cooper
On 12/11/14 15:31, Tamas K Lengyel wrote: diff --git a/xen/include/public/mem_event.h b/xen/include/public/mem_event.h index 599f9e8..c0e9394 100644 --- a/xen/include/public/mem_event.h +++ b/xen/include/public/mem_event.h @@ -49,15 +49,19 @@ #define MEM_EVENT_FLAG_EMULATE_NOWRITE (1 6)

Re: [Xen-devel] [PATCH for-xen-4.5] tools/hotplug: use configure --sysconfdir result

2014-11-12 Thread Konrad Rzeszutek Wilk
On Wed, Nov 12, 2014 at 11:12:06AM +, Ian Campbell wrote: You forgot to add the release manager... I've done that for you. In 1413279117.1497.25.ca...@citrix.com I said: Acked-by: Ian Campbell ian.campb...@citrix.com Is this a bug fix or a feature? What are the risks? IsLKonrad OK

Re: [Xen-devel] [PATCH for-4.5] libxl: add missing action in DEFINE_DEVICE_ADD

2014-11-12 Thread Konrad Rzeszutek Wilk
On Wed, Nov 12, 2014 at 10:56:24AM +, Ian Campbell wrote: On Wed, 2014-11-12 at 10:39 +, Wei Liu wrote: ... otherwise when device add operation fails, the error message looks like libxl: error: libxl.c:1897:device_addrm_aocomplete: unable to (null) device, which is not very helpful.

Re: [Xen-devel] [PATCH] Adjust number of domains in cpupools when destroying domain

2014-11-12 Thread Konrad Rzeszutek Wilk
On Wed, Nov 12, 2014 at 11:11:15AM +, George Dunlap wrote: On Wed, Nov 12, 2014 at 11:10 AM, Juergen Gross jgr...@suse.com wrote: Commit bac6334b51d9bcfe57ecf4a4cb5288348fcf044a (move domain to cpupool0 before destroying it) introduced an error in the accounting of cpupools regarding

Re: [Xen-devel] [PATCH] Adjust number of domains in cpupools when destroying domain

2014-11-12 Thread Konrad Rzeszutek Wilk
On Wed, Nov 12, 2014 at 12:10:02PM +0100, Juergen Gross wrote: Commit bac6334b51d9bcfe57ecf4a4cb5288348fcf044a (move domain to cpupool0 before destroying it) introduced an error in the accounting of cpupools regarding the number of domains. The number of domains is nor adjusted when a domain

Re: [Xen-devel] [PATCH 3/3] x86/xen: use the maximum MFN to calculate the required DMA mask

2014-11-12 Thread David Vrabel
On 12/11/14 15:55, Jan Beulich wrote: On 12.11.14 at 16:25, david.vra...@citrix.com wrote: +u64 +xen_swiotlb_get_required_mask(struct device *dev) +{ +u64 max_mfn; + +max_mfn = HYPERVISOR_memory_op(XENMEM_maximum_ram_page, NULL); + +return DMA_BIT_MASK(fls64(max_mfn

Re: [Xen-devel] [TestDay] Xen-4.5.0 RC1 bug: with xen_platform_pci=0 option, the guest with VT-d device fails to boot up and qemu-xen

2014-11-12 Thread Konrad Rzeszutek Wilk
Basic root-causing log: -- [root@vt-hsw1 carl]# xl cr xlexample.hvm Parsing config from xlexample.hvm libxl: error: libxl_qmp.c:287:qmp_handle_error_response: received an error message from QMP server: Unsupported bus. Bus doesn't have property 'acpi-pcihp-bsel' set

Re: [Xen-devel] RFC: vNUMA project

2014-11-12 Thread Wei Liu
On Wed, Nov 12, 2014 at 09:23:58AM -0500, Konrad Rzeszutek Wilk wrote: On Wed, Nov 12, 2014 at 12:14:48PM +, Wei Liu wrote: On Tue, Nov 11, 2014 at 06:03:22PM +, David Vrabel wrote: On 11/11/14 17:36, Wei Liu wrote: # What's already implemented? PV vNUMA support in

[Xen-devel] [PATCH for-4.5 0/2] xl/libxl: return and print partial config

2014-11-12 Thread Wei Liu
This small series change the behavior of libxl_retrieve_domain_configuration, to make it continue to retrieve information from xenstore even if JSON template is not available. This change of API behaviour is only internal. Conceptually speaking, any non-zero return value means d_config is

Re: [Xen-devel] [PATCH for-xen-4.5] tools/hotplug: use configure --sysconfdir result

2014-11-12 Thread Konrad Rzeszutek Wilk
On Wed, Nov 12, 2014 at 06:06:57PM +0100, Olaf Hering wrote: On Wed, Nov 12, Konrad Rzeszutek Wilk wrote: What happens if we do not take that in now but delay to Xen 4.6? I will be very unhappy... I mean, what exactly is the concern here?! I need to know what the risk is if this does

[Xen-devel] [PATCH for-4.5 2/2] xl: print out partial configuration in long mode of list command

2014-11-12 Thread Wei Liu
Unconditionally print out the partial configuration. Signed-off-by: Wei Liu wei.l...@citrix.com Cc: Zhigang Wang zhigang.x.w...@oracle.com Cc: Ian Campbell ian.campb...@citrix.com Cc: Ian Jackson ian.jack...@eu.citrix.com --- tools/libxl/xl_cmdimpl.c |6 ++ 1 file changed, 2

[Xen-devel] [PATCH for-4.5 1/2] libxl: continue when encounter ERROR_JSON_CONFIG_EMPTY

2014-11-12 Thread Wei Liu
Continue when libxl_retrieve_domain_configuration encounters ERROR_JSON_CONFIG_EMPTY, as caller might be interested in the partial configuration pulled from xenstore. In this case ERROR_JSON_CONFIG_EMPTY is used as return value as before, if no other error happens along the way. Signed-off-by:

[Xen-devel] [PATCH for 4.5] xl: Return proper error codes for block-attach and block-detach

2014-11-12 Thread George Dunlap
Return proper error codes on failure so that scripts can tell whether the command completed properly or not. Signed-off-by: George Dunlap george.dun...@eu.citrix.com --- CC: Ian Campbell ian.campb...@citrix.com CC: Ian Jackson ian.jack...@citrix.com CC: Wei Liu wei.l...@citrix.com CC: Konrad Wilk

Re: [Xen-devel] [PATCH for 4.5] xl: Return proper error codes for block-attach and block-detach

2014-11-12 Thread Wei Liu
On Wed, Nov 12, 2014 at 05:31:33PM +, George Dunlap wrote: Return proper error codes on failure so that scripts can tell whether the command completed properly or not. Signed-off-by: George Dunlap george.dun...@eu.citrix.com --- CC: Ian Campbell ian.campb...@citrix.com CC: Ian Jackson

[Xen-devel] [linux-3.10 test] 31505: regressions - FAIL

2014-11-12 Thread xen . org
flight 31505 linux-3.10 real [real] http://www.chiark.greenend.org.uk/~xensrcts/logs/31505/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-amd64-xl-qemut-winxpsp3 7 windows-install fail REGR. vs. 26303 Regressions which are

Re: [Xen-devel] [PATCH for-4.5 0/2] xl/libxl: return and print partial config

2014-11-12 Thread Wei Liu
On Wed, Nov 12, 2014 at 02:54:00PM -0500, Zhigang Wang wrote: On 11/12/2014 12:04 PM, Wei Liu wrote: This small series change the behavior of libxl_retrieve_domain_configuration, to make it continue to retrieve information from xenstore even if JSON template is not available.

Re: [Xen-devel] [PATCH V3 2/8] xen: Delay remapping memory of pv-domain

2014-11-12 Thread Konrad Rzeszutek Wilk
On Tue, Nov 11, 2014 at 06:43:40AM +0100, Juergen Gross wrote: Early in the boot process the memory layout of a pv-domain is changed to match the E820 map (either the host one for Dom0 or the Xen one) regarding placement of RAM and PCI holes. This requires removing memory pages initially

[Xen-devel] [rumpuserxen test] 31509: regressions - FAIL

2014-11-12 Thread xen . org
flight 31509 rumpuserxen real [real] http://www.chiark.greenend.org.uk/~xensrcts/logs/31509/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-i386-rumpuserxen-i386 11 rumpuserxen-demo-xenstorels/xenstorels fail REGR. vs. 31437

Re: [Xen-devel] [PATCH V3 4/8] xen: Delay invalidating extra memory

2014-11-12 Thread Konrad Rzeszutek Wilk
@@ -376,12 +374,14 @@ void __init xen_build_dynamic_phys_to_machine(void) unsigned long max_pfn; unsigned long pfn; - if (xen_feature(XENFEAT_auto_translated_physmap)) + if (xen_feature(XENFEAT_auto_translated_physmap)) Spurious change. .. snip.. diff --git

Re: [Xen-devel] [PATCH V3 6/8] xen: Hide get_phys_to_machine() to be able to tune common path

2014-11-12 Thread Konrad Rzeszutek Wilk
On Tue, Nov 11, 2014 at 06:43:44AM +0100, Juergen Gross wrote: Today get_phys_to_machine() is always called when the mfn for a pfn is to be obtained. Add a wrapper __pfn_to_mfn() as inline function to be able to avoid calling get_phys_to_machine() when possible as s/when/where/ soon as the

Re: [Xen-devel] [TestDay] VMX test report for Xen 4.5.0-rc1

2014-11-12 Thread Konrad Rzeszutek Wilk
On Wed, Nov 12, 2014 at 12:06:20PM -0400, Konrad Rzeszutek Wilk wrote: On Wed, Nov 12, 2014 at 06:58:49AM +, Hu, Robert wrote: Hi All, This is a bug summary for Xen 4.5-rc1 on Intel Server platforms. Yeey! Thank you for doing those tests. Test environment: Xen: Xen 4.5-rc1

[Xen-devel] About sharing pages between Xen and guest kernel

2014-11-12 Thread Amaro, Emmanuel
Hello, I am trying to set up a shared page between the hypervisor and a Linux guest kernel. In Xen I am doing: void *ptr = alloc_xenheap_page(); share_xen_page_with_guest(virt_to_page(ptr), current-domain, XENSHARE_writable); unsigned int mfn = virt_to_mfn(ptr); And my plan was to pass the

Re: [Xen-devel] [PATCH for-4.5] xl: correct test condition on libxl_domain_info

2014-11-12 Thread Konrad Rzeszutek Wilk
On November 12, 2014 8:01:21 PM EST, Chao Peng chao.p.p...@linux.intel.com wrote: On Wed, Nov 12, 2014 at 10:22:07AM -0500, Konrad Rzeszutek Wilk wrote: On Wed, Nov 12, 2014 at 11:10:52AM +, Ian Campbell wrote: CCing the folks who signed-of-by is on the original patch On Wed,

Re: [Xen-devel] [TestDay] VMX test report for Xen 4.5.0-rc1

2014-11-12 Thread Hu, Robert
-Original Message- From: Wei Liu [mailto:wei.l...@citrix.com] Sent: Wednesday, November 12, 2014 7:07 PM To: Hu, Robert Cc: xen-devel@lists.xen.org; jbeul...@suse.com; wei.l...@citrix.com Subject: Re: [Xen-devel] [TestDay] VMX test report for Xen 4.5.0-rc1 On Wed, Nov 12, 2014 at

[Xen-devel] [linux-3.14 test] 31504: regressions - FAIL

2014-11-12 Thread xen . org
flight 31504 linux-3.14 real [real] http://www.chiark.greenend.org.uk/~xensrcts/logs/31504/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-armhf-armhf-xl 9 guest-start fail REGR. vs. 30755 build-i386

[Xen-devel] [libvirt test] 31508: tolerable FAIL - PUSHED

2014-11-12 Thread xen . org
flight 31508 libvirt real [real] http://www.chiark.greenend.org.uk/~xensrcts/logs/31508/ Failures :-/ but no regressions. Tests which did not succeed, but are not blocking: test-amd64-i386-libvirt 9 guest-start fail never pass test-amd64-amd64-libvirt 9

[Xen-devel] [TestDay]Xen-4.5.0-RC1: Not all PFs are available if assign multi VT-d devices to Wndows guest VM

2014-11-12 Thread Hu, Robert
Hi, This is a separated bug report for http://bugzilla-archived.xenproject.org/bugzilla/show_bug.cgi?id=1896. Environment: Service Arch (ia32/ia32e/IA64): ia32e Guest Arch (ia32/ia32e/IA64): ia32e Guest OS Type (Linux/Windows): Windows8.1, Windows2012 Change Set: Xen4.5-RC1

Re: [Xen-devel] [TestDay] VMX test report for Xen 4.5.0-rc1

2014-11-12 Thread Hu, Robert
-Original Message- From: Fabio Fantoni [mailto:fabio.fant...@m2r.biz] Sent: Wednesday, November 12, 2014 5:59 PM To: Hu, Robert; xen-devel@lists.xen.org Cc: jbeul...@suse.com Subject: Re: [Xen-devel] [TestDay] VMX test report for Xen 4.5.0-rc1 Il 12/11/2014 07:58, Hu, Robert ha

[Xen-devel] [linux-linus test] 31507: regressions - FAIL

2014-11-12 Thread xen . org
flight 31507 linux-linus real [real] http://www.chiark.greenend.org.uk/~xensrcts/logs/31507/ Regressions :-( Tests which did not succeed and are blocking, including tests which could not be run: test-amd64-amd64-rumpuserxen-amd64 8 guest-start fail REGR. vs. 31241

Re: [Xen-devel] [PATCH V3 2/8] xen: Delay remapping memory of pv-domain

2014-11-12 Thread Juergen Gross
On 11/12/2014 10:45 PM, Konrad Rzeszutek Wilk wrote: On Tue, Nov 11, 2014 at 06:43:40AM +0100, Juergen Gross wrote: diff --git a/arch/x86/xen/mmu.c b/arch/x86/xen/mmu.c index a8a1a3d..d3e492b 100644 --- a/arch/x86/xen/mmu.c +++ b/arch/x86/xen/mmu.c @@ -1223,6 +1223,10 @@ static void __init

  1   2   >