Re: [Openstack] Caching strategies in Nova ...
+1 to DBs being slow. But what if we used a combo of memcache and db. Or use couch/mongo. Comparision: http://kkovacs.eu/cassandra-vs-mongodb-vs-couchdb-vs-redis Anyone has experience on large deployments to see the kind of db traffic we need to optimize for? Another thing could be to avoid joins and then do sharding. debo -Original Message- From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Brian Lamar Sent: Friday, March 23, 2012 10:51 AM To: openstack@lists.launchpad.net Subject: Re: [Openstack] Caching strategies in Nova ... On Mar 23, 2012, at 11:22 AM, Kevin L. Mitchell wrote: On Fri, 2012-03-23 at 08:55 -0300, Sandy Walsh wrote: I don't doubt for a second the db is the culprit for many of our woes. The thing I like about internal caching using established tools is that it works for db issues too without having to resort to custom tables. SQL query optimization, I'm sure, will go equally far. For that matter, I wouldn't be surprised if there were things we could do to nova's DB to speed things up. For instance, what if we supported non-SQL data stores? Any database is going to be slow if you're talking to it more than necessary. Even if we replaced MySQL with the latest and greatest web-scale noSQL database out there we'd still be slow. I'd love to see a combination effort of improving the flexibility of the DB layer as well as improvements surrounding the sheer number of calls to the database. -- Kevin L. Mitchell kevin.mitch...@rackspace.com ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Enabling remote participation at Folsom Design Summit
SW side: Another option would be to run webex meetings or even google hangout! debo -Original Message- From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Stefano Maffulli Sent: Wednesday, March 21, 2012 3:35 PM To: openstack@lists.launchpad.net Subject: Re: [Openstack] Enabling remote participation at Folsom Design Summit I'm still loooking for *hardware* to make this happen. Lets try to make this more sexy and see where to cook hackers are: what if we buy a few beaglebone boards ($89 each) and spend a weekend hacking a streaming server on them? The boards are cheap enough and should have enough power to acquire audio, convert it to mp4/h264 using their hardware and send the stream over to a public icecast server. As with many other things, the software is already out there, it needs hammering, put it together, testing and praying it works at the summit. Any volunteer? Or any other option? Cheap desktops would work too: I wouldn't refuse Dell or HP to ship 6 of their smallest machines either :) let me know, please. Cheers, stef On Tue, 2012-03-06 at 13:47 -0800, Stefano Maffulli wrote: Hello folks, since the next design summit is sold out and many people are still interested in participating, I believe we should really make remote participation possible. Imitating Ubuntu Developer Summit, I think the ideal situation is to have in each room: - 1 omnidirectional microphone to capture discussions and questions - 1 streaming client hooked to a public icecast streaming server - 1 IRC channel per room - 1 projector showing the content of the IRC channel - 1 projector available for collaborative note taking via etherpad And for plenary session: - full audio/video service - IRC channel, not shown but monitored in case there are interesting questions We'll also need dedicated bandwidth from the Hyatt hotel, networking, firewalling and the whole shabang. Anything else? I will start investigating what Rackspace can provide but this is a big task and I would like to make this a shared effort. If you have experience with this, and want to help me get the equipment, software, services needed to enable remote participation to the Design Summit please email me. Thanks, stef [1] http://uds.ubuntu.com/community/remote-participation/ ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] User experience and simplified configurations
Have you tinkered with devstack Its simplifies some of the issues you raised for a dev guy. debo From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Aniruddha Khadkikar Sent: Wednesday, March 14, 2012 9:03 PM To: openstack@lists.launchpad.net Subject: [Openstack] User experience and simplified configurations Hi, Its only recently that I have started exploring openstack and the first thing that comes to my mind is the nature and amount of configuration required for the various components. The managed IT Deb packages for Diablo were very helpful in reaching a poc level implementation involving a separate cloud controller, volume and glance with swift and with a compute node. Are there any plans to simplify the configuration files and develop command line wizards for a better user experience? I believe that with every release an incrementally better experience will help in greater adoption of the platform. For example I could only get things working on my third trial. That too led to problems due to EC2 not working till a project was added using nova manage. I still remain confused between tenants and projects in Diablo. Logically one customer (tenant) should be able to run multiple projects. So I was a bit surprised at them being treated as equivalent. First target for simplification could be the various pipeline settings and the nova configuration. I have found these a bit complicated to understand. I have not started testing Essex yet. Regards Aniruddha ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] User experience and simplified configurations
Then you might want to start with some of the chef cookbooks people use. Ask Jay Pipes, he was planning to consolidate them! debo -Original Message- From: Aniruddha Khadkikar [mailto:askhadki...@gmail.com] Sent: Wednesday, March 14, 2012 9:37 PM To: Debo Dutta (dedutta) Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] User experience and simplified configurations On Thu, Mar 15, 2012 at 9:46 AM, Debo Dutta (dedutta) dedu...@cisco.com wrote: Have you tinkered with devstack Its simplifies some of the issues you raised for a dev guy. No, I have not used Devstack as the purpose is to simulate a close to production type POC and not a deployment on a single machine. Also we wanted to go through the documentation in detail to increase our understanding of the platform and implement the steps manually. Regards, Aniruddha From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Aniruddha Khadkikar Sent: Wednesday, March 14, 2012 9:03 PM To: openstack@lists.launchpad.net Subject: [Openstack] User experience and simplified configurations Hi, Its only recently that I have started exploring openstack and the first thing that comes to my mind is the nature and amount of configuration required for the various components. The managed IT Deb packages for Diablo were very helpful in reaching a poc level implementation involving a separate cloud controller, volume and glance with swift and with a compute node. Are there any plans to simplify the configuration files and develop command line wizards for a better user experience? I believe that with every release an incrementally better experience will help in greater adoption of the platform. For example I could only get things working on my third trial. That too led to problems due to EC2 not working till a project was added using nova manage. I still remain confused between tenants and projects in Diablo. Logically one customer (tenant) should be able to run multiple projects. So I was a bit surprised at them being treated as equivalent. First target for simplification could be the various pipeline settings and the nova configuration. I have found these a bit complicated to understand. I have not started testing Essex yet. Regards Aniruddha ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Netstack] Essex-4 milestone available for Quantum
Did you mean network creation using the dash. Quantum manager works with nova Sent from my iPhone On Mar 1, 2012, at 5:45 PM, Shake Chen shake.c...@gmail.com wrote: Hi Now the Dashboard whether can manage the Quantum? And whether the Devstack script can let dashbaord and Quantum working? On Fri, Mar 2, 2012 at 7:49 AM, Dan Wendlandt d...@nicira.com wrote: Hi all, The Essex-4 milestone for Quantum and updated documentation is available at: https://launchpad.net/quantum/essex/essex-4 Lots of great improvements in this release, including three new plugins (Linux Bridge, Nicira NVP, and Ryu Controller) as well as significant updates to the OVS plugin. We also added 1.1 API support to the quantum client, and squashed a good number of bugs. Great work! Equally important, Essex-4 saw a good number of new people making significant contributions to the project in terms of features, code reviews, and testing, which is crucial for the success of the project. Let's keep it up. Now its time to really test both code docs to make sure they are solid for the main Essex release. If there is an issue that you consider critical for Essex, let me know and we'll get it slotted for RC1: https://launchpad.net/quantum/+milestone/essex-rc1 (no date set, we will release it when we've fixed all issues identified as critical). If you're looking for the doc changes since the last release, you see see the review here: https://review.openstack.org/#change,4774 . Please give feedback via the review. Congrats to the whole team! Dan -- ~~~ Dan Wendlandt Nicira Networks: www.nicira.com twitter: danwendlandt ~~~ -- Mailing list: https://launchpad.net/~netstack Post to : netst...@lists.launchpad.net Unsubscribe : https://launchpad.net/~netstack More help : https://help.launchpad.net/ListHelp -- 陈沙克 手机：13661187180 msn：shake.c...@hotmail.com -- Mailing list: https://launchpad.net/~netstack Post to : netst...@lists.launchpad.net Unsubscribe : https://launchpad.net/~netstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Google Summer of Code-2012
I put my entries debo -Original Message- From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Russell Bryant Sent: Monday, February 27, 2012 5:32 AM To: openstack@lists.launchpad.net Subject: Re: [Openstack] Google Summer of Code-2012 On 02/09/2012 04:27 PM, Thierry Carrez wrote: Thierry Carrez wrote: You should start a wiki page to collect mentors and the subjects they propose... and based on how many we get, see if our application is warranted. Here it is: http://wiki.openstack.org/GSoC2012 Organizations must submit their application for GSoC 2012 sometime between today and March 9th. Nobody has signed up on the above wiki page to volunteer as a mentor. If you are interested in being a mentor, please put your name on the wiki sometime this week so we can decide if it makes sense to participate. Thanks, -- Russell Bryant ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] devstack: excercises script other than shell scripts
+1 IMO devstack scripts should be simple and test the system from a user's perspective. Hence it would be nice to stick to the external APIs. debo -Original Message- From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Jesse Andrews Sent: Saturday, February 25, 2012 8:39 AM To: Chmouel Boudjnah Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] devstack: excercises script other than shell scripts Those should probably go into tempest. The goal for exercises is that they are simple tests of the CLI that users can read to see how to use the cloud. Jesse On Sat, Feb 25, 2012 at 7:22 AM, Chmouel Boudjnah chmo...@chmouel.com wrote: Hi, I'd like to add a excercises to test swift3+s3token in devstack and was thinking to add a python script that use boto and do a few tests to the devstack instance. I was wondering if exercises/ devstack directory should be strictly shell scripts. Chmouel. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Donabe?
We are still pursuing it although the progress isn't as much as we would have liked. Going forward, we would love to solicit help from others. We also hope to push the discussions at the summit. Regards debo -Original Message- From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Glen Campbell Sent: Wednesday, February 15, 2012 11:48 AM To: openstack@lists.launchpad.net Subject: [Openstack] Donabe? Is anything still happening with the Donabe project? Are there plans to push things forward at the Folsom summit? Thanks, Glen ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Google Summer of Code-2012
I would like to volunteer too! Debo Sent from my iPhone On Feb 9, 2012, at 11:09 AM, Joshua Harlow harlo...@yahoo-inc.com wrote: I’m willing also (I think others at yahoo would be to). -Josh On 2/9/12 9:20 AM, Vishvananda Ishaya vishvana...@gmail.com wrote: We discussed it last year, but were a little too late. I'm willing to volunteer to be a mentor. Lets do it! Vish On Feb 9, 2012, at 7:59 AM, Armaan wrote: Hi folks, Google has announced Google Summer of Code -2012, Google Summer of Code is a global program that offers student developers stipends to write code for various open source software projects. More info is available here http://code.google.com/soc/. I wanted to know if there is any possibility of Openstack participating in Google Summer of Code. Thanks Regards Syed Armani ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Google Summer of Code-2012
I think the wiki idea is awesome. I will put in my proposals by tonight/tomorrow morning. debo -Original Message- From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Thierry Carrez Sent: Thursday, February 09, 2012 1:17 PM To: openstack@lists.launchpad.net Subject: Re: [Openstack] Google Summer of Code-2012 Russell Bryant wrote: On 02/09/2012 03:33 PM, Michael Still wrote: On 10/02/12 02:59, Armaan wrote: Hi folks, Google has announced Google Summer of Code -2012, /Google Summer of Code/ is a global program that offers student developers stipends to write code for various open source software projects. More info is available here http://code.google.com/soc/. I wanted to know if there is any possibility of Openstack participating in /Google Summer of Code/. I'd be happy to mentor as well, although it sounds like there is no shortage of mentors. The more the merrier, I would say (as long as they are qualified to be a mentor). Should there be criteria for who can officially mentor a student? Core reviewers? Volunteering as a mentor is just one part of the equation. You also need to come up with subjects... which is usually trickier :) You should start a wiki page to collect mentors and the subjects they propose... and based on how many we get, see if our application is warranted. -- Thierry Carrez (ttx) Release Manager, OpenStack ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] dashboard in oneric
Try devstack on oneric. debo -Original Message- From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Paras pradhan Sent: Monday, January 23, 2012 10:27 AM To: openstack@lists.launchpad.net Subject: [Openstack] dashboard in oneric Has anyone recently able to run dashboard/horizon in Ubuntu Oneric. If yes which one should I use? dashboard from ubuntu or horizon src from github? Thanks Paras. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] dashboard in oneric
FWIW I ran the old devstack and it worked (with horizon). Out of the box except for some UI issues (horizon!) and with quantum debo From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Denmat Sent: Monday, January 23, 2012 2:25 PM Cc: openstack Subject: Re: [Openstack] dashboard in oneric FWIW, I got horizon/keystone from devstack working on a separate host to my Ubuntu ppa openstack host. Couldn't get them on the one host due to python libs getting installed to different locations. Den On 24/01/2012, at 9:00, Joshua Harlow harlo...@yahoo-inc.com wrote: You should be able to use the newer devstack v2 to get horizon up and running. I haven’t tested it to well but I think it will do it. https://github.com/yahoo/Openstack-Devstack2 ./stack –c horizon –a install –d $HOME/youropenstackplace (will install all of horizons dependencies also) ./stack –c horizon –a start –d $HOME/youropenstackplace (should start horizon + dependencies, haven’t messed around with this yet, might need a little work) -Josh On 1/23/12 12:37 PM, Paras pradhan pradhanpa...@gmail.com wrote: I have seen folks at openstack IRC who could get it working but all packages from github. I have tried several options and the problem is related with openstackx. I run diablo from ubuntu repo and its working fine. Somebody told me that the dashboard / keystone at ubuntu is broken . I could run dashboard and keystone that I checkout from horizon. I could login in with errors but looks its really impossible to fix (at least to me) the openstackx issue. If anyone has working dashboard with diablo from Oneric please share how they handle the issues with openstackx Paras On Mon, Jan 23, 2012 at 1:25 PM, Vishvananda Ishaya vishvana...@gmail.com wrote: Dashboard requires keystone, so I don't know if this is possible without a lot of hacking. Vish On Jan 23, 2012, at 10:56 AM, Jorge Luiz Correa wrote: Well, I tried to install from Ubuntu (Oneiric) repos but just could get it working without keystone. So, in this case, I couldn't use horizon (requires keystone). Trying to use the dashboard from repos, it didn't work. Currently, I'm running Diablo from ubuntu repos without dashboard, just command line tools to manage the cloud (euca2ools). Regards. On Mon, Jan 23, 2012 at 4:26 PM, Paras pradhan pradhanpa...@gmail.com wrote: Has anyone recently able to run dashboard/horizon in Ubuntu Oneric. If yes which one should I use? dashboard from ubuntu or horizon src from github? Thanks Paras. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- - MSc. Correa, J.L. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] has anyone tried devstack this morning
Gabriel
As a control experiment I ran devstack on a fresh vm using non Quantum
Observations:
* When I try to add a rule for a security group, it goes back to
the main screen without remaining in the security group view.
* When I instantiate a vm, horizone goes from scheduling to
error to scheduling to error And so on
* We do get ip addresses
(nova.rpc): TRACE: File /opt/stack/nova/nova/compute/manager.py,
line 378, in _run_instance
(nova.rpc): TRACE: injected_files, admin_password)
(nova.rpc): TRACE: File /opt/stack/nova/nova/compute/manager.py,
line 511, in _spawn
(nova.rpc): TRACE: network_info, block_device_info)
(nova.rpc): TRACE: File /opt/stack/nova/nova/exception.py, line 126,
in wrapped
(nova.rpc): TRACE: return f(*args, **kw)
(nova.rpc): TRACE: File
/opt/stack/nova/nova/virt/libvirt/connection.py, line 679, in spawn
(nova.rpc): TRACE: domain = self._create_new_domain(xml)
(nova.rpc): TRACE: File
/opt/stack/nova/nova/virt/libvirt/connection.py, line 1253, in
_create_new_domain
(nova.rpc): TRACE: domain = self._conn.defineXML(xml)
(nova.rpc): TRACE: File /usr/lib/python2.7/dist-packages/libvirt.py,
line 1708, in defineXML
(nova.rpc): TRACE: if ret is None:raise
libvirtError('virDomainDefineXML() failed', conn=self)
(nova.rpc): TRACE: libvirtError: operation failed: domain
'instance-0002' already exists with uuid
522521ff-fabf-52ce-9093-0fcb745acd90
I am trying to get a working version of devstack without quantum 1st,
then try quantum to see what breaks etc. Else we will keep chasing too
many threads. Could you please help with the devstack sans quantum par t
of the experiment.
debo
From: openstack-bounces+dedutta=cisco@lists.launchpad.net
[mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On
Behalf Of Dan Wendlandt
Sent: Tuesday, January 17, 2012 9:46 PM
To: Gabriel Hurley
Cc: openstack
Subject: Re: [Openstack] has anyone tried devstack this morning
On Tue, Jan 17, 2012 at 7:22 PM, Gabriel Hurley
gabriel.hur...@nebula.com wrote:
Confirmed that as of about 5 PM PST today, devstack is no longer broken.
I used it to install quantum yesterday, and as far as I can tell,
Quantum is in a semi-working state in relation to Nova master. I am not
an expert on Quantum and can't speak for the status of quantum trunk,
but it's no longer a devstack issue, so I can't really help in debugging
what's amiss there.
Maybe when we get those integration tests going between projects this'll
be more consistent... ;-)
Indeed. There's a huge need for this, and debo and some other Quantum
team members will be working on it.
Dan
- Gabriel
From: Deepak Garg [mailto:deepakgarg.i...@gmail.com]
Sent: Tuesday, January 17, 2012 7:10 PM
To: Anthony Young
Cc: Gabriel Hurley; openstack
Subject: Re: [Openstack] has anyone tried devstack this morning
Each time I install Devstack, and try the Quantum cmds, it
doesn't work. So I have to manually do a
$ python setup.py build and $ python setup.py install
for the quantum package and then it works all fine.
Did anyone else face the same problem with any other packages ?
My env is Ubuntu 1110 64 bit on a Qemu hypervisor
and python version is 2.7. The unit tests run fine though.
Thanks,
Deepak
On Wed, Jan 18, 2012 at 7:17 AM, Anthony Young
sleepsonthefl...@gmail.com wrote:
You will need to make sure that all your dependent branches (in
particular openstackx) are up-to-date in order to test the changes. You
can do this with a clean run of devstack on a clean vm, by using
RECLONE=yes environment variable, or by manually updating the code using
git commands. By default, devstack does not update code directories in
/opt/stack if they already exist (if it did, it may accidentally delete
your in-progress changes)
A
On Tue, Jan 17, 2012 at 5:29 PM, Gabriel Hurley
gabriel.hur...@nebula.com wrote:
That fixed devstack, but there are still numerous broken import
statements in openstackx. That doesn't fix the overall problem at all,
sadly.
- Gabriel
From: Anthony Young [mailto:sleepsonthefl...@gmail.com]
Sent: Tuesday, January 17, 2012 5:09 PM
To: Debo Dutta (dedutta)
Cc: Gabriel Hurley; openstack
Subject: Re: [Openstack] has anyone tried devstack this morning
Hey Debo -
A fix has been merged for
https://bugs.launchpad.net/devstack/+bug/917457 - hopefully that
resolves your issue!
Anthony
On Tue, Jan 17, 2012 at 4:00 PM, Debo Dutta (dedutta)
dedu...@cisco.com wrote:
Thanks I tried installing devstack
Re: [Openstack] Proposal for new devstack (v2?)
On a different note: ideally we should have folks run a devstack build with
their changes before committing else we will have broken devstack builds e.g.
now.
debo
-Original Message-
From: openstack-bounces+dedutta=cisco@lists.launchpad.net
[mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of
Jesse Andrews
Sent: Tuesday, January 17, 2012 11:19 AM
To: Joshua Harlow
Cc: Andy Smith; Ken Thomas; openstack
Subject: Re: [Openstack] Proposal for new devstack (v2?)
I think a goal would be to have easy fabric integration.
Right now our fabric scripts for devstack look like:
@task
@parallel
def stop():
Kill devstack and all VMs running
run(killall -9 screen || true)
run(screen -wipe || true)
# note we can probably remove this once devstack supports removing instances
# which anthony is working on
sudo(rm -rf /etc/libvirt/qemu/inst*)
sudo(virsh list | grep inst | awk '{print $1}' | xargs -n1 virsh
destroy; true)
@task
def reserve_ips():
Remove IPs from nova's fixed ip pool for use by hosts
This is needed for both the compute hosts and the VPN instances
if env.host == config.master:
with cd('%s/nova' % config.dest):
for n in xrange(2, 10):
ip = 10.4.128.%s % n
run(bin/nova-manage fixed reserve %s % ip)
# reserve VPN client IPs too
for n in xrange(240, 254):
ip = 10.4.143.%s % n
run(bin/nova-manage fixed reserve %s % ip)
@task
@parallel
def users():
ensure our users exist
if env.host == config.master:
for name, password in config.users.iteritems():
# add_user(username, password)
with cd(config.dest + '/keystone'):
if not name in run(bin/keystone-manage tenant list):
run(bin/keystone-manage tenant add %s % name)
run(bin/keystone-manage user add %s %s % (name, password))
run(bin/keystone-manage credentials add %s EC2 %s
%s %s % (name, name, password, name))
run(bin/keystone-manage role grant sysadmin %s
%s % (name, name))
run(bin/keystone-manage role grant netadmin %s
%s % (name, name))
run(bin/keystone-manage role grant Member %s %s
% (name, name))
On Tue, Jan 17, 2012 at 11:01 AM, Joshua Harlow harlo...@yahoo-inc.com wrote:
Thx,
Yes we haven't been 100% doing the style stuff yet (which is ok I think for
now).
My idea for not using an underlying fabric was just to keep it as simple as
possible (but not to simple). Not always an easy choice :-)
On 1/17/12 10:56 AM, Andy Smith andys...@gmail.com wrote:
Looks cool :)
I've been trying to plant the seed of switching devstack to python (heavily
utilizing fabric and cuisine) in my team's head for a while now.
We are heavily dependent on devstack for our development and testing
workflows so it would be a pretty big decision for us to switch tools, and
we'd be doing very active development on whatever new tool we switched to.
The general flow and goals of the tool seem appropriate, and it looks like
it could be a good starting place for work in this direction.
The style of the code is pretty far from most of the common openstack style
guides, but that's pretty easily solvable, as are the other small things to
get the project looking more openstack-y.
I'd still be interested in using fabric and cuisine as the underlying layer
because of having a well-tested, built-in way of dealing with remote servers
allows for some more versatility.
--andy
On Tue, Jan 17, 2012 at 10:20 AM, Joshua Harlow harlo...@yahoo-inc.com
wrote:
Hi all,
I would just like to propose a new devstack (v2?) that we have been starting
to work on that uses python throughout as well as has componentized installs
(for glance, nova...) and a nice object oriented design and the like
(including having a json format for defining package and pip dependencies
that allows simple comments so people can know what the pkgs are). We are
currently trying to get equivalence going for ubuntu (and at the same time
rhel6.x) and I would like it if we could get peoples initial thoughts on
this.
I know the current devstack shell script is starting to explode (LOC wise)
and it seems like it is a good time to stop that from exploding by creating
something a little more flexible (and maintainable imho).
Please check it out @ https://github.com/yahoo/Openstack-Devstack2
Comments welcome!
We are working on getting as much equivalence as we can (while still
maintaining a clean design).
Thx,
Josh
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help : https://help.launchpad.net/ListHelp
___
Mailing list:
[Openstack] has anyone tried devstack this morning
Got this error
Environment:
Request Method: GET
Request URL: http://192.168.223.136/nova/images_and_snapshots/
Django Version: 1.3
Python Version: 2.7.2
Installed Applications:
['dashboard',
'django.contrib.sessions',
'django.contrib.messages',
'django.contrib.staticfiles',
'django_nose',
'horizon',
'horizon.dashboards.nova',
'horizon.dashboards.syspanel',
'horizon.dashboards.settings']
Installed Middleware:
('django.middleware.common.CommonMiddleware',
'django.middleware.csrf.CsrfViewMiddleware',
'django.contrib.sessions.middleware.SessionMiddleware',
'django.contrib.messages.middleware.MessageMiddleware',
'dashboard.middleware.DashboardLogUnhandledExceptionsMiddleware',
'horizon.middleware.HorizonMiddleware',
'django.middleware.doc.XViewMiddleware',
'django.middleware.locale.LocaleMiddleware')
Traceback:
File /usr/lib/pymodules/python2.7/django/core/handlers/base.py in
get_response
111. response = callback(request,
*callback_args, **callback_kwargs)
File /opt/stack/horizon/horizon/horizon/decorators.py in dec
41. return view_func(request, *args, **kwargs)
File /opt/stack/horizon/horizon/horizon/decorators.py in dec
41. return view_func(request, *args, **kwargs)
File /usr/lib/pymodules/python2.7/django/contrib/auth/decorators.py in
_wrapped_view
23. return view_func(request, *args, **kwargs)
File
/opt/stack/horizon/horizon/horizon/dashboards/nova/images_and_snapshots
/views.py in index
70. quotas = api.tenant_quota_get(request, request.user.tenant_id)
File /opt/stack/horizon/horizon/horizon/api/nova.py in
tenant_quota_get
286. return novaclient(request).quotas.get(tenant)
File /opt/stack/python-novaclient/novaclient/v1_1/quotas.py in get
34. return self._get(/os-quota-sets/%s % (tenant_id),
quota_set)
File /opt/stack/python-novaclient/novaclient/base.py in _get
126. resp, body = self.api.client.get(url)
File /opt/stack/python-novaclient/novaclient/client.py in get
130. return self._cs_request(url, 'GET', **kwargs)
File /opt/stack/python-novaclient/novaclient/client.py in _cs_request
118. **kwargs)
File /opt/stack/python-novaclient/novaclient/client.py in request
101. raise exceptions.from_response(resp, body)
Exception Type: ClientException at /nova/images_and_snapshots/
Exception Value: The server has either erred or is incapable of
performing the requested operation. (HTTP 500)
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help : https://help.launchpad.net/ListHelp
Re: [Openstack] has anyone tried devstack this morning
Thanks I tried installing devstack with Quantum and ignoring the
horizon error messages (for now) I see networks created but the VMs
don't spin up.
Do you know of any prev working state so that I can just checkout the
old code and get it to work?
debo
From: Gabriel Hurley [mailto:gabriel.hur...@nebula.com]
Sent: Tuesday, January 17, 2012 3:38 PM
To: Debo Dutta (dedutta); openstack
Subject: RE: has anyone tried devstack this morning
It's a known bug that was recently introduced. I refer you to the thread
last night/this morning about it:
https://lists.launchpad.net/openstack/msg06729.html
- Gabriel
From: openstack-bounces+gabriel.hurley=nebula@lists.launchpad.net
[mailto:openstack-bounces+gabriel.hurley=nebula@lists.launchpad.net]
On Behalf Of Debo Dutta (dedutta)
Sent: Tuesday, January 17, 2012 11:41 AM
To: openstack
Subject: [Openstack] has anyone tried devstack this morning
Got this error
Environment:
Request Method: GET
Request URL: http://192.168.223.136/nova/images_and_snapshots/
Django Version: 1.3
Python Version: 2.7.2
Installed Applications:
['dashboard',
'django.contrib.sessions',
'django.contrib.messages',
'django.contrib.staticfiles',
'django_nose',
'horizon',
'horizon.dashboards.nova',
'horizon.dashboards.syspanel',
'horizon.dashboards.settings']
Installed Middleware:
('django.middleware.common.CommonMiddleware',
'django.middleware.csrf.CsrfViewMiddleware',
'django.contrib.sessions.middleware.SessionMiddleware',
'django.contrib.messages.middleware.MessageMiddleware',
'dashboard.middleware.DashboardLogUnhandledExceptionsMiddleware',
'horizon.middleware.HorizonMiddleware',
'django.middleware.doc.XViewMiddleware',
'django.middleware.locale.LocaleMiddleware')
Traceback:
File /usr/lib/pymodules/python2.7/django/core/handlers/base.py in
get_response
111. response = callback(request,
*callback_args, **callback_kwargs)
File /opt/stack/horizon/horizon/horizon/decorators.py in dec
41. return view_func(request, *args, **kwargs)
File /opt/stack/horizon/horizon/horizon/decorators.py in dec
41. return view_func(request, *args, **kwargs)
File /usr/lib/pymodules/python2.7/django/contrib/auth/decorators.py in
_wrapped_view
23. return view_func(request, *args, **kwargs)
File
/opt/stack/horizon/horizon/horizon/dashboards/nova/images_and_snapshots
/views.py in index
70. quotas = api.tenant_quota_get(request, request.user.tenant_id)
File /opt/stack/horizon/horizon/horizon/api/nova.py in
tenant_quota_get
286. return novaclient(request).quotas.get(tenant)
File /opt/stack/python-novaclient/novaclient/v1_1/quotas.py in get
34. return self._get(/os-quota-sets/%s % (tenant_id),
quota_set)
File /opt/stack/python-novaclient/novaclient/base.py in _get
126. resp, body = self.api.client.get(url)
File /opt/stack/python-novaclient/novaclient/client.py in get
130. return self._cs_request(url, 'GET', **kwargs)
File /opt/stack/python-novaclient/novaclient/client.py in _cs_request
118. **kwargs)
File /opt/stack/python-novaclient/novaclient/client.py in request
101. raise exceptions.from_response(resp, body)
Exception Type: ClientException at /nova/images_and_snapshots/
Exception Value: The server has either erred or is incapable of
performing the requested operation. (HTTP 500)
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [OpenStack] Default User name and Password for Horizon i.e., Openstack-dashboard that i have been installed using [DevStack] script
The script asks you for the password ... or you put it in a file called localrc Here is my localrc MYSQL_PASSWORD=nova RABBIT_PASSWORD=nova SERVICE_TOKEN=nova ADMIN_PASSWORD=nova ENABLED_SERVICES=g-api,g-reg,key,n-api,n-cpu,n-net,n-sch,n-vnc,horizon,m ysql,rabbit,openstackx,quantum,q-svc,q-agt Q_PLUGIN=openvswitch debo From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of sn Sent: Thursday, December 15, 2011 10:28 AM To: Openstack Mailing List Subject: [Openstack] [OpenStack] Default User name and Password for Horizon i.e., Openstack-dashboard that i have been installed using [DevStack] script hi experts... i have just now installed successfully openstack without any errors.with the scripts mention in the devstack.org. but i could not login to my dashboard...if anyone know what are the default password for openstack dashboard that has been installed using devstack thanks -- I am on Twitter. Follow Me @SanjibNarzary http://www.twitter.com/SanjibNarzary ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] [donabe] call for participation and meetings
Hi The Donabe meetings are attended by very few. FYI its held at 2pm PST on Wednesdays Maybe we can re-start the regular meetings from next week. Canceling today's one. Regards debo ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [donabe] call for participation and meetings
Hi Duncan Thanks for your feedback. I think the Donabe info is a little scattered. Also the scope has changed over the last 6 months. The latest tech update is at http://www.slideshare.net/ddutta1/donabe-models-openstack-essex-summit I will update the pages and get back in a few days, definitely before next Wed, when we meet. Regards debo -Original Message- From: Duncan McGreggor [mailto:dun...@dreamhost.com] Sent: Wednesday, November 16, 2011 5:28 PM To: Debo Dutta (dedutta) Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] [donabe] call for participation and meetings On 16 Nov 2011 - 17:15, Duncan McGreggor wrote: On 16 Nov 2011 - 14:02, Debo Dutta (dedutta) wrote: Hi The Donabe meetings are attended by very few. FYI its held at 2pm PST on Wednesdays Maybe we can re-start the regular meetings from next week. Canceling today's one. Regards debo I think one of the things that could really help bolster attendance would be for more information to be provided on the wiki regarding Donabe. The only reliable mentions I have found are here: * http://openstack.org/projects/ (very short, no link, no code) * http://www.slideshare.net/ramdurairaj/donabe (this crashes by browser 5 out of 10 times, btw; there are some other slideshare Donabe links, too) * https://launchpad.net/donabe (very little text... doesn't present a definite sense of project goals) So, I have these questions (for starters): 1) What, specifically, does Donabe want to do with networking? (foregoing metaphors that the rest of us may not be as familiar with as the Donabe team) 2) How does Donabe relate to Quantum and other projects? 3) At what OSI layer does Donabe see itself? (I'm assuming layer 3) 4) Given an answer to #3, can we dive into #1 some more? Let's see some detailed examples (i.e. user stories) 5) Who's interested in Donabe right now? What companies are collaborating together on it? If these can be answered, and then placed somewhere folks can easily find them, I think we'd see an increase in meeting attendance and general interest in the project (provided, of course, that answers are, in fact, interesting!). Thanks, d Ah, I just found this, via another deck on slideshare: http://etherpad.openstack.org/Donabe That contains the most information I've see yet about Donabe. Note that it would be a *really* good idea, from the perspective of evangelism, to distill those notes into an easily communicable vision. d ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Donabe meetings on Wed 2pm (and cancelling this week's)
Apologies Thanks Glen for the clarifications. debo From: Glen Campbell [mailto:glen.campb...@rackspace.com] Sent: Wednesday, October 26, 2011 12:12 PM To: Debo Dutta (dedutta) Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] Donabe meetings on Wed 2pm (and cancelling this week's) For others outside of California, that's 2PM Pacific time. :-) Glen Campbell * Cloud 2.0 Architect glen.campb...@rackspace.com * (210) 446-9990 On Oct 26, 2011, at 2:07 PM, Debo Dutta (dedutta) wrote: Hi Lots of people had expressed interest but they were not aware of the meeting times (we did send out emails but maybe we should have re-sent a few times). We meet at 2pm on Wed, @#openstack-meetings . Please join us and help us make Donabe better. Also we are canceling this week's and hope to have a lot of folks for next week. Regards Debo/Rick ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] OpenStack Academic Alliance|Circle|Initiative#unconference
Hi It’s a great idea. Will help infuse fresh ideas. I would be very interested in helping out in the co-ordination. More thoughts inline -Original Message- From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Stefano Maffulli Sent: Tuesday, October 11, 2011 9:04 AM To: openstack@lists.launchpad.net Subject: [Openstack] OpenStack Academic Alliance|Circle|Initiative#unconference hello folks, a group of people interested in academia met in Boston during the unconference. I was there to take notes and facilitate this community run initiative. Here is what we agreed so far. I'm sharing it on the list to gather more ideas. /stef OpenStack Academic Initiative Mission: * provide a place for all research academics efforts can be advertised and found, about and around OpenStack (not generic about IaaS or PaaS) * a list of papers published and ongoing research * a list of conferences about cloud We can start with some of the papers from SIGCOMM, OSDI/SOSP, NSDI to begin with. And list the conferences. * maintain a list of ideas for the companies to sponsor research like a market * a place for the companies to say what they need and research can execute * undergrad level, gsoc-style, time starved but there are many of them. it's important to be easy for them to contribute They can contribute a lot of point features as part of academic projects. * masters level, more in depth work, empirical studies like performance evaluation Scalability analysis will be another area * phd level, exploratory type of research I think Donabe has a lot of scope. So does Quantum especially from a SDN perspective. * handle the funding, hr tasks, mentoring: who's going to manage this? * mentoring is intense and time consuming, but crucial for the success of research Crowdsourced mentoring isn’t a bad idea. Also less taxing. * provide resources, like hardware for tests, for researchers Could happen via industry grants or even partnering with NSF or some equivalent agency (NRC in Canada or some EU research agencies). * advertise this initiative among researchers * Example: setup OpenStack tracks at a couple of relevant conference Maybe have a pure academic track (algorithms, distributed systems relevant to OS) and a poster session for long term ideas/opinions. Next steps: Identify the group responsible for this initiative and define action items, deadlines and deliverables. I am ready to volunteer for this. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] OpenStack Academic Alliance|Circle|Initiative #unconference
Cool. I will put in a few IaaS/PaaS papers I read recently. Debo -Original Message- From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Stefano Maffulli Sent: Wednesday, October 12, 2011 5:07 PM To: openstack@lists.launchpad.net Subject: Re: [Openstack] OpenStack Academic Alliance|Circle|Initiative #unconference On Tue, 2011-10-11 at 09:04 -0700, Stefano Maffulli wrote: a group of people interested in academia met in Boston during the unconference. I was there to take notes and facilitate this community run initiative. Here is what we agreed so far. I'm sharing it on the list to gather more ideas. I got lots of interesting responses in private email. I put a page up on the wiki and I'll mention it in this week newsletter. http://wiki.openstack.org/AcademicInitiative in order to move the initiative forward we'll need a coordinator and a more stable point of contact for all the people interested in it, like a mailing list. Any volunteer? /stef ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] donabe meeting timings on IRC
Hi We are planning to have regular meets/syncups for Donabe. Possible timings include Wed 2pm PST (since 2pm seems to work for openstack meets). Please unicast myself/Rick if you want to participate but this time doesn't work for you ... and please suggest some alternatives. Will do my best to fix a consensus slot. Thx! debo ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Developer conference documentation
Donabe: http://etherpad.openstack.org/Donabe thx debo -Original Message- From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of bob.bl...@calxeda.com Sent: Monday, October 10, 2011 9:23 AM To: openstack@lists.launchpad.net Subject: [Openstack] Developer conference documentation Several sessions had slide presentations, but the only one I've been able to find is Geoff Arnold's. Where are they? Also, is there an index of the etherpads from the sessions? Bob Blair ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Database replacement?
+1 From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Joshua Harlow Sent: Monday, September 26, 2011 11:20 AM To: Monty Taylor; Brian Lamar Cc: openstack Subject: Re: [Openstack] Database replacement? We'll I think part of it is just having a good abstraction and having the possibility of hooking in nosql engines or sql engines (maybe this isn't in the end using SQLAlchemy? Or at least not directly) It would be nice neat if this was possible. At least for a company like yahoo, at its scale I can pretty much guarantee a simple centralized DB model wouldn't work. The concept provided in http://wiki.openstack.org/MultiClusterZones might help, but that isn't there yet (afaik). So this was more of just a thought exercise on how or if its possible to abstract out that part. On 9/25/11 5:15 PM, Monty Taylor mord...@inaugust.com wrote: On 09/24/2011 10:50 AM, Brian Lamar wrote: Hey Josh, Has there been any thought on having a nova-db service that responds to requests for information from the db (or something like a db). No plans that I'm aware of, there is a Database-as-a-Service project called 'Red Dwarf' which might fit this bill however. I honestly haven't looked too much into it. This could be useful for companies that don't necessarily want to have a limiting factor being a database. Since when u scale past a certain number of compute nodes the database connections themselves may become a bottleneck (especially the heartbeat mechanism which updates a table every X seconds). Not sure what you mean by this. Currently the OpenStack architecture was built to allow hundreds and thousands (maybe?) of compute nodes in the same environment. The keys is to group compute nodes into clusters as outlined here: http://wiki.openstack.org/MultiClusterZones Long story short the database isn't being shared between all compute clusters, but instead a hierarchy of clusters is formed (something I, in a pinch, would consider akin to a distributed Map/Reduce model of data sharing). What are the actual scaling concerns? Have you seen scaling problems, or are you just concerned that they might be hit? I'm not seeing any mention of numbers here that would even come close to exceeding the MySQL-scales-that-far-without-breaking-a-sweat range of things... so I'd love to try and help address specific problems rather than re-architect something before we even know what the problem we're trying to solve are. Does something like this help out with your scaling concerns? I do know that personally I'd be interested in a CouchDB/NoSQL alternative to the Nova database layer...but what we have right now seems to conceptual work for scaling out to many hundreds of compute nodes. Again - to what end? What is it that the current db setup isn't providing that CouchDB would do a better job of? It would be interesting if these types of request could go to the message queue instead 110% agree. Hopefully this is something we can talk about at the upcoming conference in Boston. :) I will definitely agree that message queues can be a way of adding scalability (async systems are often able to provide for interesting parallelism) ... but at the end of the day the unit of work still has to get accomplished, and if the request for data to the underlying message store is still slow (sql or nosql, whatever) - under extremely high load if your disk and/or cpu are saturated on the db infrastructure, async or sync is going to make a flips work of difference. So I'm going to be really annoying and again ask: to solve what actual problem? Example queries and/or any logging/capturing of system information during scaling issues would be a great start ... we can take a stab at solving any current problems that are there - and as part of solving those problems we can of course discuss approaches such as async message queues or nosql alternatives. Monty -Original Message- From: Joshua Harlow harlo...@yahoo-inc.com Sent: Friday, September 23, 2011 5:40pm To: openstack openstack@lists.launchpad.net Subject: [Openstack] Database replacement? ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp This email may include confidential information. If you received it in error, please delete it. Howdy all, congrats on the diablo release! Has there been any thought on having a nova-db service that responds to requests for information from the db (or something like a db). This could be useful for companies that don't necessarily want to have a limiting factor being a database. Since when u scale past a certain number of compute nodes the database connections themselves may become a bottleneck (especially the heartbeat mechanism
Re: [Openstack] Database replacement?
This is a good idea. Actually it might be a very good idea to think of scalable/distributed nosql engines to interface with nova and other Openstack projects. Regards debo From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Joshua Harlow Sent: Friday, September 23, 2011 2:40 PM To: openstack Subject: [Openstack] Database replacement? Howdy all, congrats on the diablo release! Has there been any thought on having a nova-db service that responds to requests for information from the db (or something like a db). This could be useful for companies that don't necessarily want to have a limiting factor being a database. Since when u scale past a certain number of compute nodes the database connections themselves may become a bottleneck (especially the heartbeat mechanism which updates a table every X seconds). It would be interesting if these types of request could go to the message queue instead and then the db backing could be swapped out with something more scalable (or still use mysql/sqlite...). Any thoughts? -Josh ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Database replacement?
Actually I see people have done django and Cassandra already so it might be doable without a huge churn http://stackoverflow.com/questions/2369793/how-to-use-cassandra-in-djang o-framework debo From: Joshua Harlow [mailto:harlo...@yahoo-inc.com] Sent: Friday, September 23, 2011 3:32 PM To: Debo Dutta (dedutta); openstack Subject: Re: [Openstack] Database replacement? Ya, that would be the ideal, make it more modular so that nosql engines could be hooked in (if applicable). It might also provide someone an opportunity to re-factor https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py which seems hairy (4000 lines??) On 9/23/11 3:10 PM, Debo Dutta (dedutta) dedu...@cisco.com wrote: This is a good idea. Actually it might be a very good idea to think of scalable/distributed nosql engines to interface with nova and other Openstack projects. Regards debo From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Joshua Harlow Sent: Friday, September 23, 2011 2:40 PM To: openstack Subject: [Openstack] Database replacement? Howdy all, congrats on the diablo release! Has there been any thought on having a nova-db service that responds to requests for information from the db (or something like a db). This could be useful for companies that don't necessarily want to have a limiting factor being a database. Since when u scale past a certain number of compute nodes the database connections themselves may become a bottleneck (especially the heartbeat mechanism which updates a table every X seconds). It would be interesting if these types of request could go to the message queue instead and then the db backing could be swapped out with something more scalable (or still use mysql/sqlite...). Any thoughts? -Josh ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [NetStack] Quantum Service API extension proposal
Hi
I think I was unclear. What I meant were having network wire constructs
like a T where there are actually 3 end points and one of the end points
of the T could be in sniff mode or in a bump-in-the-wire mode. I am not
sure how the current API would support these semantics.
Use case: imagine vm A talks to B and one wants to monitor the content
by sniffing and the monitoring agent is in vm C. This is not a uncommon
use case.
Regards
Debo
-Original Message-
From: Kyle Mestery (kmestery)
Sent: Monday, May 23, 2011 4:54 PM
To: Debo Dutta (dedutta)
Cc: Troy Toman; openstack@lists.launchpad.net
Subject: Re: [Openstack] [NetStack] Quantum Service API extension
proposal
Debo:
A tap is nothing different than a VM vnics from a switch perspective, it
still contains a portion owned by Nova (the tap itself) and it connects
to a port, which is owned by Quantum. So in essence, the tap still has
both a vif and a port in this terminology.
Thanks,
Kyle
On May 23, 2011, at 4:10 PM, Debo Dutta (dedutta) wrote:
Hi Troy
What about a tap? Its also like a port Should that be in quantum?
Regards
Debo
From: Troy Toman [mailto:troy.to...@rackspace.com]
Sent: Monday, May 23, 2011 2:10 PM
To: Debo Dutta (dedutta)
Cc: Alex Neefus; Ying Liu (yinliu2); openstack@lists.launchpad.net
Subject: Re: [Openstack] [NetStack] Quantum Service API extension
proposal
I think the idea was slightly different. We were equating a vif to
NIC in a physical server. A port was equated to a switch port on a
physical switch. Doesn't necessarily mean they have to be different.
But, there was a reason we used different terminology.
In particular, we felt the vif was something that would continue to be
in the server's domain and managed within Nova. A port was a construct
that is owned and managed by the network service (Quantum).
Troy
On May 23, 2011, at 3:56 PM, Debo Dutta (dedutta) wrote:
Quick question: it seems we are calling one end of the virtual wire a
port and the other a vif. Is there a reason to do that? Can we just call
say that that a wire connects 2 ports?
Also another interesting network scenario is when there is a wire
connecting 2 ports and you have a tap (for all sorts of scenarios). I
think the semantics of the tap might be quite basic.
Regards
debo
From: openstack-bounces+dedutta=cisco@lists.launchpad.net
[mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On
Behalf Of Alex Neefus
Sent: Monday, May 23, 2011 1:05 PM
To: Ying Liu (yinliu2); openstack@lists.launchpad.net
Subject: Re: [Openstack] [NetStack] Quantum Service API extension
proposal
Hi All -
I wanted to lend support to this proposal, however I don't think we
should be so quick to say this whole thing is an extension.
We benefit a lot from having a standard capabilities mechanism as part
of our core Quantum API. I like Ying's key value method as well. I think
it's logical, clean and scalable. I propose that basic read access of
cap off of our major objects: network, port, interface be included in
our first release.
So in summary I would like to encourage us to add:
GET /networks/{net_id}/conf
GET /networks/{net_id}/ports/{port_id}/conf/
GET {entity}/VIF/conf/
Each of these would return a list of keys.
Additionally Quantum base should support
GET /networks/{net_id}/conf/{key}
GET /networks/{net_id}/ports/{port_id}/conf/{key}
GET {entity}/VIF/conf/{key}
Where {key} is the name of either a standard capability or an
extention capability. We can define an error code now to designate a
capability not supported by the plugin. (i.e. 472 - CapNotSupported)
Finally we don't need to standardize on every capability that might be
supported if we provide this simple mechanism. Specific capabilities
Key,Value sets can be added later but or included as vendor specific
extensions.
I'm happy to add this to the wiki if there is consensus. Rick/Dan -
Maybe this should be a topic for Tuesdays meeting.
Alex
---
Alex Neefus
Senior System Engineer | Mellanox Technologies
(o) 617.337.3116 | (m) 201.208.5771 | (f) 617.337.3019
From: openstack-bounces+alex=mellanox@lists.launchpad.net
[mailto:openstack-bounces+alex=mellanox@lists.launchpad.net] On
Behalf Of Ying Liu (yinliu2)
Sent: Saturday, May 21, 2011 1:10 PM
To: openstack@lists.launchpad.net
Subject: [Openstack] [NetStack] Quantum Service API extension proposal
Hi all,
We just posted a proposal for OpenStack Quantum Service API extension
on community wiki page
athttp://wiki.openstack.org/QuantumAPIExtensions?action=AttachFiledo=vi
ewtarget=quantum_api_extension.pdf
or
http://wiki.openstack.org/QuantumAPIExtensions?action=AttachFiledo=view
target=quantum_api_extension.docx
Please review and let us know your comments/suggestions. An etherpad
page is created for API extension
discussionhttp://etherpad.openstack.org/uWXwqQNU4s
Best,
Ying
Re: [Openstack] [NetStack] Quantum Service API extension proposal
Quick question: it seems we are calling one end of the virtual wire a
port and the other a vif. Is there a reason to do that? Can we just call
say that that a wire connects 2 ports?
Also another interesting network scenario is when there is a wire
connecting 2 ports and you have a tap (for all sorts of scenarios). I
think the semantics of the tap might be quite basic.
Regards
debo
From: openstack-bounces+dedutta=cisco@lists.launchpad.net
[mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On
Behalf Of Alex Neefus
Sent: Monday, May 23, 2011 1:05 PM
To: Ying Liu (yinliu2); openstack@lists.launchpad.net
Subject: Re: [Openstack] [NetStack] Quantum Service API extension
proposal
Hi All -
I wanted to lend support to this proposal, however I don't think we
should be so quick to say this whole thing is an extension.
We benefit a lot from having a standard capabilities mechanism as part
of our core Quantum API. I like Ying's key value method as well. I think
it's logical, clean and scalable. I propose that basic read access of
cap off of our major objects: network, port, interface be included in
our first release.
So in summary I would like to encourage us to add:
GET /networks/{net_id}/conf
GET /networks/{net_id}/ports/{port_id}/conf/
GET {entity}/VIF/conf/
Each of these would return a list of keys.
Additionally Quantum base should support
GET /networks/{net_id}/conf/{key}
GET /networks/{net_id}/ports/{port_id}/conf/{key}
GET {entity}/VIF/conf/{key}
Where {key} is the name of either a standard capability or an extention
capability. We can define an error code now to designate a capability
not supported by the plugin. (i.e. 472 - CapNotSupported)
Finally we don't need to standardize on every capability that might be
supported if we provide this simple mechanism. Specific capabilities
Key,Value sets can be added later but or included as vendor specific
extensions.
I'm happy to add this to the wiki if there is consensus. Rick/Dan -
Maybe this should be a topic for Tuesdays meeting.
Alex
---
Alex Neefus
Senior System Engineer | Mellanox Technologies
(o) 617.337.3116 | (m) 201.208.5771 | (f) 617.337.3019
From: openstack-bounces+alex=mellanox@lists.launchpad.net
[mailto:openstack-bounces+alex=mellanox@lists.launchpad.net] On
Behalf Of Ying Liu (yinliu2)
Sent: Saturday, May 21, 2011 1:10 PM
To: openstack@lists.launchpad.net
Subject: [Openstack] [NetStack] Quantum Service API extension proposal
Hi all,
We just posted a proposal for OpenStack Quantum Service API extension on
community wiki page at
http://wiki.openstack.org/QuantumAPIExtensions?action=AttachFiledo=view
target=quantum_api_extension.pdf
or
http://wiki.openstack.org/QuantumAPIExtensions?action=AttachFiledo=view
target=quantum_api_extension.docx
Please review and let us know your comments/suggestions. An etherpad
page is created for API extension discussion
http://etherpad.openstack.org/uWXwqQNU4s
Best,
Ying
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [NetStack] Quantum Service API extension proposal
Hi Troy
What about a tap? Its also like a port Should that be in quantum?
Regards
Debo
From: Troy Toman [mailto:troy.to...@rackspace.com]
Sent: Monday, May 23, 2011 2:10 PM
To: Debo Dutta (dedutta)
Cc: Alex Neefus; Ying Liu (yinliu2); openstack@lists.launchpad.net
Subject: Re: [Openstack] [NetStack] Quantum Service API extension
proposal
I think the idea was slightly different. We were equating a vif to NIC
in a physical server. A port was equated to a switch port on a physical
switch. Doesn't necessarily mean they have to be different. But, there
was a reason we used different terminology.
In particular, we felt the vif was something that would continue to be
in the server's domain and managed within Nova. A port was a construct
that is owned and managed by the network service (Quantum).
Troy
On May 23, 2011, at 3:56 PM, Debo Dutta (dedutta) wrote:
Quick question: it seems we are calling one end of the virtual wire a
port and the other a vif. Is there a reason to do that? Can we just call
say that that a wire connects 2 ports?
Also another interesting network scenario is when there is a wire
connecting 2 ports and you have a tap (for all sorts of scenarios). I
think the semantics of the tap might be quite basic.
Regards
debo
From: openstack-bounces+dedutta=cisco@lists.launchpad.net
[mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On
Behalf Of Alex Neefus
Sent: Monday, May 23, 2011 1:05 PM
To: Ying Liu (yinliu2); openstack@lists.launchpad.net
Subject: Re: [Openstack] [NetStack] Quantum Service API extension
proposal
Hi All -
I wanted to lend support to this proposal, however I don't think we
should be so quick to say this whole thing is an extension.
We benefit a lot from having a standard capabilities mechanism as part
of our core Quantum API. I like Ying's key value method as well. I think
it's logical, clean and scalable. I propose that basic read access of
cap off of our major objects: network, port, interface be included in
our first release.
So in summary I would like to encourage us to add:
GET /networks/{net_id}/conf
GET /networks/{net_id}/ports/{port_id}/conf/
GET {entity}/VIF/conf/
Each of these would return a list of keys.
Additionally Quantum base should support
GET /networks/{net_id}/conf/{key}
GET /networks/{net_id}/ports/{port_id}/conf/{key}
GET {entity}/VIF/conf/{key}
Where {key} is the name of either a standard capability or an extention
capability. We can define an error code now to designate a capability
not supported by the plugin. (i.e. 472 - CapNotSupported)
Finally we don't need to standardize on every capability that might be
supported if we provide this simple mechanism. Specific capabilities
Key,Value sets can be added later but or included as vendor specific
extensions.
I'm happy to add this to the wiki if there is consensus. Rick/Dan -
Maybe this should be a topic for Tuesdays meeting.
Alex
---
Alex Neefus
Senior System Engineer | Mellanox Technologies
(o) 617.337.3116 | (m) 201.208.5771 | (f) 617.337.3019
From: openstack-bounces+alex=mellanox@lists.launchpad.net
[mailto:openstack-bounces+alex=mellanox@lists.launchpad.net] On
Behalf Of Ying Liu (yinliu2)
Sent: Saturday, May 21, 2011 1:10 PM
To: openstack@lists.launchpad.net
Subject: [Openstack] [NetStack] Quantum Service API extension proposal
Hi all,
We just posted a proposal for OpenStack Quantum Service API extension on
community wiki page
athttp://wiki.openstack.org/QuantumAPIExtensions?action=AttachFiledo=vi
ewtarget=quantum_api_extension.pdf
or
http://wiki.openstack.org/QuantumAPIExtensions?action=AttachFiledo=view
target=quantum_api_extension.docx
Please review and let us know your comments/suggestions. An etherpad
page is created for API extension
discussionhttp://etherpad.openstack.org/uWXwqQNU4s
Best,
Ying
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help : https://help.launchpad.net/ListHelp
Confidentiality Notice: This e-mail message (including any attached or
embedded documents) is intended for the exclusive and confidential use
of the
individual or entity to which this message is addressed, and unless
otherwise
expressly indicated, is confidential and privileged information of
Rackspace.
Any dissemination, distribution or copying of the enclosed material is
prohibited.
If you receive this transmission in error, please notify us immediately
by e-mail
at ab...@rackspace.com, and delete the original message.
Your cooperation is appreciated.
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Network Service meeting
Works for me . -Original Message- From: openstack-bounces+dedutta=cisco@lists.launchpad.net [mailto:openstack-bounces+dedutta=cisco@lists.launchpad.net] On Behalf Of Rick Clark Sent: Tuesday, May 10, 2011 2:12 AM To: Josh Wilmes (jwilmes) Cc: Jamey Meredith; Lew Tucker (letucker); openstack@lists.launchpad.net; Michael Smith (michsmit); openst...@lab.ntt.co.jp; Somik Behera; Ewan Mellor; Youcef Laribi Subject: [Openstack] Network Service meeting We had planned to have a network Service meeting after the release meeting today, but the PTL's have a conflicting meeting in the same channel. I suggest we move it to tomorrow at the same time. Would that be ok for everyone? Rick Clark ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
