Re: [openstack-dev] [Nova] [Infra] Support for PCI Passthrough

2013-11-28 Thread yongli he

On 2013年11月27日 23:43, Jeremy Stanley wrote:

On 2013-11-27 11:18:46 +0800 (+0800), yongli he wrote:
[...]

if you post -1, you should post testing log somewhere for people
to debug it, so does third party testing can post testing log to
the infra log server?

Not at the moment--the "infra log server" is just an Apache
name-based virtual host on the static.openstack.org VM using
mod_autoindex to serve log files out of the DocumentRoot (plus a
custom filter CGI Sean Dague wrote recently), and our Jenkins has a
shell account it can use to SCP files onto it. We can't really scale
that access control particularly safely to accommodate third
parties, nor do we have an unlimited amount of space on that machine
(we currently only preserve 6 months of test logs, and even
compressing the limit on how much Cinder block storage we can attach
to the VM is coming into sight).

There has been recent discussion about designing a more scalable
build/test artifact publication system backed by Swift object
storage, and suggestion that once it's working we might consider
support for handing out authorization to third-party-specific
containers for the purpose you describe. Until we have developed
something like that, however, you'll need to provide your own place

this need appoved by my supervisor or IT, i can not do anything about this.
does any one hear of any free space can host such thing?

Yongli He

to publish your logs (something like we use--bog standard Apache on
a public VM--should work fine I'd think?).



___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova] [Infra] Support for PCI Passthrough

2013-11-27 Thread Jeremy Stanley
On 2013-11-27 11:18:46 +0800 (+0800), yongli he wrote:
[...]
> if you post -1, you should post testing log somewhere for people
> to debug it, so does third party testing can post testing log to
> the infra log server?

Not at the moment--the "infra log server" is just an Apache
name-based virtual host on the static.openstack.org VM using
mod_autoindex to serve log files out of the DocumentRoot (plus a
custom filter CGI Sean Dague wrote recently), and our Jenkins has a
shell account it can use to SCP files onto it. We can't really scale
that access control particularly safely to accommodate third
parties, nor do we have an unlimited amount of space on that machine
(we currently only preserve 6 months of test logs, and even
compressing the limit on how much Cinder block storage we can attach
to the VM is coming into sight).

There has been recent discussion about designing a more scalable
build/test artifact publication system backed by Swift object
storage, and suggestion that once it's working we might consider
support for handing out authorization to third-party-specific
containers for the purpose you describe. Until we have developed
something like that, however, you'll need to provide your own place
to publish your logs (something like we use--bog standard Apache on
a public VM--should work fine I'd think?).
-- 
Jeremy Stanley

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova] [Infra] Support for PCI Passthrough

2013-11-26 Thread yongli he

On 2013年11月23日 03:43, Jeremy Stanley wrote:
Hi, Jeremy

for currently, we need setup it up asap, so the third party seems the 
right way. but i have some concern,


if you post -1, you should post testing log somewhere for people to 
debug it, so does third party testing can

post testing log to the infra log server?


Yongli h...@intel.com

On 2013-11-22 08:59:16 + (+), Tan, Lin wrote:
[...]

Our module only works on the compute node that enables VT-d and
contains special PCIs which support the SR-IOV.

So is it possible to

1. setup compute node which enables pci passthrough.

2. modify the testing schedule logic allow the pci testing case
be scheduled to that machine

[...]

If you're asking about our official test infrastructure for the
OpenStack project, I believe this is infeasible for now. We
currently perform testing within generic virtual machines provided
by HPCloud and Rackspace, so the Nova compute nodes we build and
test are already running under virtualization and in turn manage
only paravirtualized QEMU instances.

In the near term, your best bet is to run your own test
infrastructure supporting the hardware features you require and
report advisory results back on proposed changes:

 http://ci.openstack.org/third_party.html

For a longer term solution, you may want to consult with the TripleO
project with regards to their bare-metal test plan:

 https://wiki.openstack.org/wiki/TripleO/TripleOCloud




___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova] [Infra] Support for PCI Passthrough

2013-11-24 Thread yongli he

On 2013年11月25日 02:13, Robert Collins wrote:

On 23 November 2013 08:43, Jeremy Stanley  wrote:

On 2013-11-22 08:59:16 + (+), Tan, Lin wrote:
[...]
In the near term, your best bet is to run your own test
infrastructure supporting the hardware features you require and
report advisory results back on proposed changes:

 http://ci.openstack.org/third_party.html

For a longer term solution, you may want to consult with the TripleO
project with regards to their bare-metal test plan:

 https://wiki.openstack.org/wiki/TripleO/TripleOCloud

I think using the donated resources to perform this sort of testing is
an ideal example of the value the TripleO cloud can bring to OpenStack
as a whole.

I don't know if we have the necessary hardware (I'm fairly sure we
have VT-d, but I'm not 100% sure we have anything setup for SR-IOV. If
we do, then cool - please come and work with us to get that testing
what you need.

A key consideration will be whether you want checking or gating. For
gating or infra run checking there need to be two regions (which the

we should want checking and gating, we definetely should put
effort on it, it seems a fairly straightforward solution for such
testing.

Yongli He(Pauli He)

TripleO cloud is aiming at) and infra running the tests; for checking
without infra running it the third-party system is a good mechanism
(and that can be run from a single TripleO region too, in principle.

-Rob




___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova] [Infra] Support for PCI Passthrough

2013-11-24 Thread Robert Collins
On 23 November 2013 08:43, Jeremy Stanley  wrote:
> On 2013-11-22 08:59:16 + (+), Tan, Lin wrote:
> [...]

> In the near term, your best bet is to run your own test
> infrastructure supporting the hardware features you require and
> report advisory results back on proposed changes:
>
> http://ci.openstack.org/third_party.html
>
> For a longer term solution, you may want to consult with the TripleO
> project with regards to their bare-metal test plan:
>
> https://wiki.openstack.org/wiki/TripleO/TripleOCloud

I think using the donated resources to perform this sort of testing is
an ideal example of the value the TripleO cloud can bring to OpenStack
as a whole.

I don't know if we have the necessary hardware (I'm fairly sure we
have VT-d, but I'm not 100% sure we have anything setup for SR-IOV. If
we do, then cool - please come and work with us to get that testing
what you need.

A key consideration will be whether you want checking or gating. For
gating or infra run checking there need to be two regions (which the
TripleO cloud is aiming at) and infra running the tests; for checking
without infra running it the third-party system is a good mechanism
(and that can be run from a single TripleO region too, in principle.

-Rob

-- 
Robert Collins 
Distinguished Technologist
HP Converged Cloud

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova] [Infra] Support for PCI Passthrough

2013-11-22 Thread Jeremy Stanley
On 2013-11-22 08:59:16 + (+), Tan, Lin wrote:
[...]
> Our module only works on the compute node that enables VT-d and
> contains special PCIs which support the SR-IOV.
> 
> So is it possible to
> 
> 1. setup compute node which enables pci passthrough.
> 
> 2. modify the testing schedule logic allow the pci testing case
> be scheduled to that machine
[...]

If you're asking about our official test infrastructure for the
OpenStack project, I believe this is infeasible for now. We
currently perform testing within generic virtual machines provided
by HPCloud and Rackspace, so the Nova compute nodes we build and
test are already running under virtualization and in turn manage
only paravirtualized QEMU instances.

In the near term, your best bet is to run your own test
infrastructure supporting the hardware features you require and
report advisory results back on proposed changes:

http://ci.openstack.org/third_party.html

For a longer term solution, you may want to consult with the TripleO
project with regards to their bare-metal test plan:

https://wiki.openstack.org/wiki/TripleO/TripleOCloud

-- 
Jeremy Stanley

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev