Re: [Xen-devel] PVH backports to 4.9 and 4.8

2018-03-02 Thread Roger Pau Monné
On Fri, Mar 02, 2018 at 08:23:50AM -0700, Jan Beulich wrote:
> >>> On 02.03.18 at 15:36,  wrote:
> > On Fri, Mar 02, 2018 at 07:31:43AM -0700, Jan Beulich wrote:
> >> >>> On 02.03.18 at 15:22,  wrote:
> >> > I'd be in favor of merging the 4.8.3pre-shim-comet and
> >> > 4.10.0-shim-comet branches into staging-4.8 and staging-4.10
> >> > respectively (assuming that's suitable).  Are there any other fixes to
> >> > PVH / PVshim hosting that we'd need to backport as well?
> >> 
> >> That depends on how well those branches have been maintained
> >> wrt fixes posted / applied during the last couple of weeks.
> >> 
> > 
> > I can cherry-pick relevant fixes to 4.10-comet and then merge 4.10-comet
> > with 4.10 staging.
> 
> Fine with me.
> 
> > If that's agreed we can discuss on what criteria do patches get picked
> > for backporting.
> 
> Until we've shipped a stable version from those branches (to be honest
> I'm not sure about doing this for 4.8 when we don#t mean to do it for
> 4.9),

We avoided 4.9 at the time due to the pressure of getting something
out fast, I'm not sure if it would be very complicated to pick the
'type=pvh' 4.8 backports and apply them 4.9, I'm fairly sure the code
base is not that different (and at most this is going to involve
dropping patches from the 4.8 branch).

Roger.

___
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

Re: [Xen-devel] PVH backports to 4.9 and 4.8

2018-03-02 Thread Jan Beulich
>>> On 02.03.18 at 15:36,  wrote:
> On Fri, Mar 02, 2018 at 07:31:43AM -0700, Jan Beulich wrote:
>> >>> On 02.03.18 at 15:22,  wrote:
>> > I'd be in favor of merging the 4.8.3pre-shim-comet and
>> > 4.10.0-shim-comet branches into staging-4.8 and staging-4.10
>> > respectively (assuming that's suitable).  Are there any other fixes to
>> > PVH / PVshim hosting that we'd need to backport as well?
>> 
>> That depends on how well those branches have been maintained
>> wrt fixes posted / applied during the last couple of weeks.
>> 
> 
> I can cherry-pick relevant fixes to 4.10-comet and then merge 4.10-comet
> with 4.10 staging.

Fine with me.

> If that's agreed we can discuss on what criteria do patches get picked
> for backporting.

Until we've shipped a stable version from those branches (to be honest
I'm not sure about doing this for 4.8 when we don#t mean to do it for
4.9), I think this can be a little relaxed. Later the criteria should match
that of other changes going into stable.

Jan


___
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

Re: [Xen-devel] PVH backports to 4.9 and 4.8

2018-03-02 Thread Wei Liu
On Fri, Mar 02, 2018 at 07:31:43AM -0700, Jan Beulich wrote:
> >>> On 02.03.18 at 15:22,  wrote:
> > I'd be in favor of merging the 4.8.3pre-shim-comet and
> > 4.10.0-shim-comet branches into staging-4.8 and staging-4.10
> > respectively (assuming that's suitable).  Are there any other fixes to
> > PVH / PVshim hosting that we'd need to backport as well?
> 
> That depends on how well those branches have been maintained
> wrt fixes posted / applied during the last couple of weeks.
> 

I can cherry-pick relevant fixes to 4.10-comet and then merge 4.10-comet
with 4.10 staging.

If that's agreed we can discuss on what criteria do patches get picked
for backporting.

Wei.


> Jan
> 

___
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

Re: [Xen-devel] PVH backports to 4.9 and 4.8

2018-03-02 Thread Jan Beulich
>>> On 02.03.18 at 15:22,  wrote:
> I'd be in favor of merging the 4.8.3pre-shim-comet and
> 4.10.0-shim-comet branches into staging-4.8 and staging-4.10
> respectively (assuming that's suitable).  Are there any other fixes to
> PVH / PVshim hosting that we'd need to backport as well?

That depends on how well those branches have been maintained
wrt fixes posted / applied during the last couple of weeks.

Jan


___
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

Re: [Xen-devel] PVH backports to 4.9 and 4.8

2018-03-02 Thread George Dunlap
On Wed, Feb 28, 2018 at 6:38 PM, Hans-Joachim Kliemeck  wrote:
>
> George Dunlap:
>
> /On 01/23/2018 04:06 AM, Simon Gaiser wrote:/
> /> George Dunlap:/
> />> Part of our solution to XSA-254 SP3 (aka "Meltdown") is to backport/
> />> the PVH mode from 4.10 to 4.9 and 4.8. This will first allow people/
> />> able to run PVH kernels to switch their PV guests directly to PVH/
> />> guests; and second, eventually enable the backport of patches which/
> />> will enable transparent changing of PV guests into PVH guests./
> />>/
> />> All of the hypervisor support seems to have existed already in 4.8, so/
> />> the only backports involve toolstack patches./
> />>/
> />> I've put up two trees for a first-cut backport of the PVH/
> />> functionality, to 4.9 and 4.8 here:/
> />>/
> />> git://xenbits.xen.org/people/gdunlap/xen.git/
> />>/
> />> Branches out/pvh-backport/4.8/v1 and out/pvh-backport/4.9/v1/
> />>/
> />> Below are the patches backported from 4.10 to 4.9 (23 patches total):/
> /> [...]/
> />/
> /> So future 4.8 releases will include the backports, right? Asking because/
> /> the AFAICS the 4.8.3-pre-shim-comet branch include them but staging-4.8/
> /> does not./
> //
> /Some of us have had informal conversations about backporting PVH and/
> /Comet host/toolstack patches to 4.8, and a number of us think it's a/
> /good idea, but we haven't had an official discussion with all the/
> /stakeholders yet. We'll come back to it once more of the fires have/
> /been put out./
> //
> /Feel free to remind us in a month or so if you still haven't seen any/
> /patches in the stable-4.8 branch. :-)/
>
> Ok, thank you for the quick reply. In Qubes we are using PVH with 4.8
> using the old device_model_version=none config option. And changing this
> would be much easier before release (So the change should be in our rc
> now). Anyway if it's not decided yet, we will have to guess what ends up
> in future 4.8.z releases.
>
>
>
> Hi,
>
> is there an update for the backports for 4.8 and 4.9? Or is there some
> documentation available to see which parts are missing on 4.9 vs 4.10 (or
> 4.8 vs 4.10) to get PVH running (device_model_version=none, ...)?

[CC'ing some more people]

Have we come to any firm conclusion about backported PVH functionality for 4.8?

I'd be in favor of merging the 4.8.3pre-shim-comet and
4.10.0-shim-comet branches into staging-4.8 and staging-4.10
respectively (assuming that's suitable).  Are there any other fixes to
PVH / PVshim hosting that we'd need to backport as well?

 -George

___
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

Re: [Xen-devel] PVH backports to 4.9 and 4.8

2018-02-28 Thread Hans-Joachim Kliemeck

> George Dunlap:
>> /On 01/23/2018 04:06 AM, Simon Gaiser wrote:/
>> /> George Dunlap:/
>> />> Part of our solution to XSA-254 SP3 (aka "Meltdown") is to backport/
>> />> the PVH mode from 4.10 to 4.9 and 4.8. This will first allow people/
>> />> able to run PVH kernels to switch their PV guests directly to PVH/
>> />> guests; and second, eventually enable the backport of patches which/
>> />> will enable transparent changing of PV guests into PVH guests./
>> />>/
>> />> All of the hypervisor support seems to have existed already in 4.8, so/
>> />> the only backports involve toolstack patches./
>> />>/
>> />> I've put up two trees for a first-cut backport of the PVH/
>> />> functionality, to 4.9 and 4.8 here:/
>> />>/
>> />> git://xenbits.xen.org/people/gdunlap/xen.git/
>> />>/
>> />> Branches out/pvh-backport/4.8/v1 and out/pvh-backport/4.9/v1/
>> />>/
>> />> Below are the patches backported from 4.10 to 4.9 (23 patches total):/
>> /> [...]/
>> />/
>> /> So future 4.8 releases will include the backports, right? Asking because/
>> /> the AFAICS the 4.8.3-pre-shim-comet branch include them but staging-4.8/
>> /> does not./
>> //
>> /Some of us have had informal conversations about backporting PVH and/
>> /Comet host/toolstack patches to 4.8, and a number of us think it's a/
>> /good idea, but we haven't had an official discussion with all the/
>> /stakeholders yet. We'll come back to it once more of the fires have/
>> /been put out./
>> //
>> /Feel free to remind us in a month or so if you still haven't seen any/
>> /patches in the stable-4.8 branch. :-)/
> Ok, thank you for the quick reply. In Qubes we are using PVH with 4.8
> using the old device_model_version=none config option. And changing this
> would be much easier before release (So the change should be in our rc
> now). Anyway if it's not decided yet, we will have to guess what ends up
> in future 4.8.z releases.
>
>

Hi,

is there an update for the backports for 4.8 and 4.9? Or is there some
documentation available to see which parts are missing on 4.9 vs 4.10
(or 4.8 vs 4.10) to get PVH running (device_model_version=none, ...)?

Best Regards
Hajo
___
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

Re: [Xen-devel] PVH backports to 4.9 and 4.8

2018-01-23 Thread Simon Gaiser
George Dunlap:
> On 01/23/2018 04:06 AM, Simon Gaiser wrote:
>> George Dunlap:
>>> Part of our solution to XSA-254 SP3 (aka "Meltdown") is to backport
>>> the PVH mode from 4.10 to 4.9 and 4.8.  This will first allow people
>>> able to run PVH kernels to switch their PV guests directly to PVH
>>> guests; and second, eventually enable the backport of patches which
>>> will enable transparent changing of PV guests into PVH guests.
>>>
>>> All of the hypervisor support seems to have existed already in 4.8, so
>>> the only backports involve toolstack patches.
>>>
>>> I've put up two trees for a first-cut backport of the PVH
>>> functionality, to 4.9 and 4.8 here:
>>>
>>> git://xenbits.xen.org/people/gdunlap/xen.git
>>>
>>> Branches out/pvh-backport/4.8/v1 and out/pvh-backport/4.9/v1
>>>
>>> Below are the patches backported from 4.10 to 4.9 (23 patches total):
>> [...]
>>
>> So future 4.8 releases will include the backports, right? Asking because
>> the AFAICS the 4.8.3-pre-shim-comet branch include them but staging-4.8
>> does not.
> 
> Some of us have had informal conversations about backporting PVH and
> Comet host/toolstack patches to 4.8, and a number of us think it's a
> good idea, but we haven't had an official discussion with all the
> stakeholders yet.  We'll come back to it once more of the fires have
> been put out.
> 
> Feel free to remind us in a month or so if you still haven't seen any
> patches in the stable-4.8 branch. :-)

Ok, thank you for the quick reply. In Qubes we are using PVH with 4.8
using the old device_model_version=none config option. And changing this
would be much easier before release (So the change should be in our rc
now). Anyway if it's not decided yet, we will have to guess what ends up
in future 4.8.z releases.



signature.asc
Description: OpenPGP digital signature
___
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

Re: [Xen-devel] PVH backports to 4.9 and 4.8

2018-01-23 Thread George Dunlap
On 01/23/2018 04:06 AM, Simon Gaiser wrote:
> George Dunlap:
>> Part of our solution to XSA-254 SP3 (aka "Meltdown") is to backport
>> the PVH mode from 4.10 to 4.9 and 4.8.  This will first allow people
>> able to run PVH kernels to switch their PV guests directly to PVH
>> guests; and second, eventually enable the backport of patches which
>> will enable transparent changing of PV guests into PVH guests.
>>
>> All of the hypervisor support seems to have existed already in 4.8, so
>> the only backports involve toolstack patches.
>>
>> I've put up two trees for a first-cut backport of the PVH
>> functionality, to 4.9 and 4.8 here:
>>
>> git://xenbits.xen.org/people/gdunlap/xen.git
>>
>> Branches out/pvh-backport/4.8/v1 and out/pvh-backport/4.9/v1
>>
>> Below are the patches backported from 4.10 to 4.9 (23 patches total):
> [...]
> 
> So future 4.8 releases will include the backports, right? Asking because
> the AFAICS the 4.8.3-pre-shim-comet branch include them but staging-4.8
> does not.

Some of us have had informal conversations about backporting PVH and
Comet host/toolstack patches to 4.8, and a number of us think it's a
good idea, but we haven't had an official discussion with all the
stakeholders yet.  We'll come back to it once more of the fires have
been put out.

Feel free to remind us in a month or so if you still haven't seen any
patches in the stable-4.8 branch. :-)

 -George

___
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

Re: [Xen-devel] PVH backports to 4.9 and 4.8

2018-01-22 Thread Simon Gaiser
George Dunlap:
> Part of our solution to XSA-254 SP3 (aka "Meltdown") is to backport
> the PVH mode from 4.10 to 4.9 and 4.8.  This will first allow people
> able to run PVH kernels to switch their PV guests directly to PVH
> guests; and second, eventually enable the backport of patches which
> will enable transparent changing of PV guests into PVH guests.
> 
> All of the hypervisor support seems to have existed already in 4.8, so
> the only backports involve toolstack patches.
> 
> I've put up two trees for a first-cut backport of the PVH
> functionality, to 4.9 and 4.8 here:
> 
> git://xenbits.xen.org/people/gdunlap/xen.git
> 
> Branches out/pvh-backport/4.8/v1 and out/pvh-backport/4.9/v1
> 
> Below are the patches backported from 4.10 to 4.9 (23 patches total):
[...]

So future 4.8 releases will include the backports, right? Asking because
the AFAICS the 4.8.3-pre-shim-comet branch include them but staging-4.8
does not.

Simon



signature.asc
Description: OpenPGP digital signature
___
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

Re: [Xen-devel] PVH backports to 4.9 and 4.8

2018-01-11 Thread George Dunlap
On 01/11/2018 12:01 PM, Roger Pau Monné wrote:
> On Thu, Jan 11, 2018 at 11:03:05AM +, George Dunlap wrote:
>> On 01/11/2018 10:58 AM, Roger Pau Monné wrote:
>>> On Tue, Jan 09, 2018 at 05:08:15PM +, George Dunlap wrote:
 Part of our solution to XSA-254 SP3 (aka "Meltdown") is to backport
 the PVH mode from 4.10 to 4.9 and 4.8.  This will first allow people
 able to run PVH kernels to switch their PV guests directly to PVH
 guests; and second, eventually enable the backport of patches which
 will enable transparent changing of PV guests into PVH guests.

 All of the hypervisor support seems to have existed already in 4.8, so
 the only backports involve toolstack patches.
>>>
>>> Thanks for looking into this.
>>>
>>> My general opinion given those are toolstack only patches is that if
>>> it works it's fine.
>>>
 I've put up two trees for a first-cut backport of the PVH
 functionality, to 4.9 and 4.8 here:

 git://xenbits.xen.org/people/gdunlap/xen.git

 Branches out/pvh-backport/4.8/v1 and out/pvh-backport/4.9/v1

 Below are the patches backported from 4.10 to 4.9 (23 patches total):

 Roger Pau Monnelibxl: add is_default checkers for string and timer_mode
 types
 Roger Pau Monnelibxl: introduce a way to mark fields as deprecated in
 the idl
>>>
>>> This or one of the related patches is going to add fields in
>>> domain_build_info, which will break the ABI. Is this expected/OK?
>>
>> Oh right -- this needs to be ported to add the fields at the end.
>>
>> Going back to the 4.10 series, it looks like there are also some "shim
>> host" patches having to do with enabling CPUID faulting in the guest.
>> Do we need to backport those to 4.9 and 4.8 as well?  ISTR they may rely
>> on some hypervisor infrastructure which would then also need to be
>> backported.
> 
> IIRC those are for AMD hardware?
> 
> Adding Andy who worked on those patches.

From what I recall there were two parts:
1. Allow AMD to even enable CPUID faulting if available
2. Enable CPUID faulting for shim guests (both Intel and AMD)

The point of #1 was to enable #2 on AMD hardware.

 -George

___
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

Re: [Xen-devel] PVH backports to 4.9 and 4.8

2018-01-11 Thread Roger Pau Monné
On Thu, Jan 11, 2018 at 11:03:05AM +, George Dunlap wrote:
> On 01/11/2018 10:58 AM, Roger Pau Monné wrote:
> > On Tue, Jan 09, 2018 at 05:08:15PM +, George Dunlap wrote:
> >> Part of our solution to XSA-254 SP3 (aka "Meltdown") is to backport
> >> the PVH mode from 4.10 to 4.9 and 4.8.  This will first allow people
> >> able to run PVH kernels to switch their PV guests directly to PVH
> >> guests; and second, eventually enable the backport of patches which
> >> will enable transparent changing of PV guests into PVH guests.
> >>
> >> All of the hypervisor support seems to have existed already in 4.8, so
> >> the only backports involve toolstack patches.
> > 
> > Thanks for looking into this.
> > 
> > My general opinion given those are toolstack only patches is that if
> > it works it's fine.
> > 
> >> I've put up two trees for a first-cut backport of the PVH
> >> functionality, to 4.9 and 4.8 here:
> >>
> >> git://xenbits.xen.org/people/gdunlap/xen.git
> >>
> >> Branches out/pvh-backport/4.8/v1 and out/pvh-backport/4.9/v1
> >>
> >> Below are the patches backported from 4.10 to 4.9 (23 patches total):
> >>
> >> Roger Pau Monnelibxl: add is_default checkers for string and timer_mode
> >> types
> >> Roger Pau Monnelibxl: introduce a way to mark fields as deprecated in
> >> the idl
> > 
> > This or one of the related patches is going to add fields in
> > domain_build_info, which will break the ABI. Is this expected/OK?
> 
> Oh right -- this needs to be ported to add the fields at the end.
> 
> Going back to the 4.10 series, it looks like there are also some "shim
> host" patches having to do with enabling CPUID faulting in the guest.
> Do we need to backport those to 4.9 and 4.8 as well?  ISTR they may rely
> on some hypervisor infrastructure which would then also need to be
> backported.

IIRC those are for AMD hardware?

Adding Andy who worked on those patches.

Roger.

___
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

Re: [Xen-devel] PVH backports to 4.9 and 4.8

2018-01-11 Thread George Dunlap
On 01/11/2018 10:58 AM, Roger Pau Monné wrote:
> On Tue, Jan 09, 2018 at 05:08:15PM +, George Dunlap wrote:
>> Part of our solution to XSA-254 SP3 (aka "Meltdown") is to backport
>> the PVH mode from 4.10 to 4.9 and 4.8.  This will first allow people
>> able to run PVH kernels to switch their PV guests directly to PVH
>> guests; and second, eventually enable the backport of patches which
>> will enable transparent changing of PV guests into PVH guests.
>>
>> All of the hypervisor support seems to have existed already in 4.8, so
>> the only backports involve toolstack patches.
> 
> Thanks for looking into this.
> 
> My general opinion given those are toolstack only patches is that if
> it works it's fine.
> 
>> I've put up two trees for a first-cut backport of the PVH
>> functionality, to 4.9 and 4.8 here:
>>
>> git://xenbits.xen.org/people/gdunlap/xen.git
>>
>> Branches out/pvh-backport/4.8/v1 and out/pvh-backport/4.9/v1
>>
>> Below are the patches backported from 4.10 to 4.9 (23 patches total):
>>
>> Roger Pau Monne  libxl: add is_default checkers for string and timer_mode
>> types
>> Roger Pau Monne  libxl: introduce a way to mark fields as deprecated in
>> the idl
> 
> This or one of the related patches is going to add fields in
> domain_build_info, which will break the ABI. Is this expected/OK?

Oh right -- this needs to be ported to add the fields at the end.

Going back to the 4.10 series, it looks like there are also some "shim
host" patches having to do with enabling CPUID faulting in the guest.
Do we need to backport those to 4.9 and 4.8 as well?  ISTR they may rely
on some hypervisor infrastructure which would then also need to be
backported.

But PVH shim guests seemed to boot fine under 4.9 / 4.8 without those
patches, so I'm not sure how critical they are.

 -George

___
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

Re: [Xen-devel] PVH backports to 4.9 and 4.8

2018-01-11 Thread Roger Pau Monné
On Tue, Jan 09, 2018 at 05:08:15PM +, George Dunlap wrote:
> Part of our solution to XSA-254 SP3 (aka "Meltdown") is to backport
> the PVH mode from 4.10 to 4.9 and 4.8.  This will first allow people
> able to run PVH kernels to switch their PV guests directly to PVH
> guests; and second, eventually enable the backport of patches which
> will enable transparent changing of PV guests into PVH guests.
> 
> All of the hypervisor support seems to have existed already in 4.8, so
> the only backports involve toolstack patches.

Thanks for looking into this.

My general opinion given those are toolstack only patches is that if
it works it's fine.

> I've put up two trees for a first-cut backport of the PVH
> functionality, to 4.9 and 4.8 here:
> 
> git://xenbits.xen.org/people/gdunlap/xen.git
> 
> Branches out/pvh-backport/4.8/v1 and out/pvh-backport/4.9/v1
> 
> Below are the patches backported from 4.10 to 4.9 (23 patches total):
> 
> Roger Pau Monne   libxl: add is_default checkers for string and timer_mode
> types
> Roger Pau Monne   libxl: introduce a way to mark fields as deprecated in
> the idl

This or one of the related patches is going to add fields in
domain_build_info, which will break the ABI. Is this expected/OK?

Roger.

___
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel