Re: [Openstack] [Openstack-operators] Health Monitoring Blueprints
http://summit.openstack.org/sessions/view/68 I've submitted a proposal on a similar subject but got rejected :) Maybe because of redundancy. Looking forward to talking about this at the summit. Cheers, LZY On Thu, Apr 12, 2012 at 11:13 AM, Duncan McGreggor dun...@dreamhost.comwrote: On Wed, Apr 11, 2012 at 5:52 PM, Stefano Maffulli stef...@openstack.org wrote: On Wed, 2012-04-11 at 14:03 -0700, Matt Joyce wrote: Problem of course is many operators aren't on the design summit contributor list ( ala don't have codes to get into it ) and if it's later it's 500 USD to attend. There will be over 400 people at the summit, not all of them are developers. I expect lots of operators/users have a representation there. Will there be enough to justify having this discussion there? I don't know but we can try. On Wed, 2012-04-11 at 17:16 -0400, Duncan McGreggor wrote: That's a really good point. In the post-conference conversations that deal with attendance policy, this should be kept in mind. We probably should set a date for a post-mortem discussion, after the conference. I'm quite sure I'll take a few days off after April 20, maybe have a couple of live feedback sessions in the first week of May would work? In lieu of not being able to attend in person, keep in mind the live-casting that will be done, We're not yet sure to be able to offer this. Wait for an official communication. in combination with IRC channels. This we can do: use IRC but there will be only one projector in the rooms, not two like at UDS. Each track leader can decide how to use it (for IRC or something else). Since you are already familiar with UDS setup, would you mind setting up the IRC channels for each of the rooms at the summit? This is the layout of the rooms and their expected usage: Ballroom: Intro Plenary, Breakout tables, Lightning Talks Seacliff A+B: Design summit sessions (fishbowl setup)* Seacliff C: Design summit sessions (fishbowl setup)* Seacliff D: Design summit sessions (fishbowl setup)* Marina: Design summit sessions (fishbowl setup)* Bayview B: Design summit sessions (fishbowl setup)* Golden Gate: Unconference room (theater setup)* Bayview A: Developer's lounge The association between rooms+track will be published soon, once the revisions on summit.openstack.org are completed. The following channels have been created on Freenode and are registered. #osds-ballroom #osds-seacliff-a-b #osds-seacliff-c #osds-seacliff-d #osds-marina #osds-bayview-a #osds-bayview-b #osds-golden-gate Each channel is also getting logged, viewable via HTTP here: http://irclogs.osds.cogitat.io/ Feel free to put another logger in there ;-) At UDS, messages get sent to IRC channels at a countdown interval... not sure if we have anything that sophisticated for OSDS. At the very least, we can monitor the times ourselves and post messages to the channels. d ___ Openstack-operators mailing list openstack-operat...@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] Role of nova-manage network commands when using QuantumManager
It is my understanding that in multi-node setup : * nova-manage can be executed from any machine which may not be running nova-network process. (Or should nova-manage always be run on nova-network node ?) * nova-manage does DB operations and delegates the actual networking calls to nova-network process ? Is this understanding correct ? I traced nova-manage network create and nova-manage network delete using FlatDHCPManager (default for devstack/stack.sh) Both these calls seem to be doing only DB operations. BTW, nova-network process was shutdown during both network create and network delete - Still both operations were successful. But when using QuantumManager as network manager - nova-manage seems to be doing networking operations like iptables-save (during network create) and kill_dhcp (during network delete) (via linux-net L3 driver) Since nova-manage command may be executed on a host which isn't running nova-network - network commands like iptables and kill -9 pid of dnsmasq on host running nova-manage seems incorrect. For the first scenario (iptables-save during network create - there is already a defect in LP : https://bugs.launchpad.net/nova/+bug/977738 and review : https://review.openstack.org/6451 I would like your comments and opinions which would help me understand What nova-manage should and should NOT do Thanks, -Mandar __ Disclaimer:This email and any attachments are sent in strictest confidence for the sole use of the addressee and may contain legally privileged, confidential, and proprietary data. If you are not the intended recipient, please advise the sender by replying promptly to this email and then delete and destroy this email and any attachments without any further use, copying or forwarding___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] I18n issue for OpenStack
Sean Dague wrote: If we want to think about OpenStack as a basic building block like Apache, i18n is critical. Otherwise there are regions that won't adopt it solely because of a lack of i18n. Note that Apache HTTPd, for instance, does not seem to internationalize its error messages. Only the (enduser-facing) HTML pages it gives back in response to invalid requests are. Is there a metric on the completeness so far? Something automated that could be a jenkins coverage kind of test? Oddly enough, it's not a question of completeness of translations. Piggybacking on the awesome Launchpad Translations community always gave us great coverage. It's more a code support and CI integration issue. -- Thierry Carrez (ttx) Release Manager, OpenStack ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] I18n issue for OpenStack
Joshua Harlow wrote: So there is a question here that I don’t understand. There a different levels of I18N, for say user facing error messages, or for other things I consider UI (horizon). Those need to be I18N and all that. I think the larger part that I don’t understand is why the things that are not the above (log messages) are being internationalized. So what level do we want to have ;) And what level is normal for people to expect (do systems like hadoop do I18N on there error messages, do other apache projects?) I agree with you. Documentation and user-facing interfaces should definitely support I18N. That means Horizon, and (maybe) the Python client bindings. Operators-facing log messages... not so much. By internationalizing them we lose the ability to google for them, and I'm not convinced the trade-off is favorable for that particular population. If you come to the design summit and care about this, join us at the I18N in OpenStack session. Regards, -- Thierry Carrez (ttx) Release Manager, OpenStack ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] upgrade path from oneiric + managedit diablo to precise+essex?
Hi, is there yet documented upgrade path from using managedit repo for diablo on oneiric to use precise with essex? I installed my cluster according to instructions from docs.openstack.org for basic setup with dashboard. There are some things that don't work still (errors) and I think it might be better to upgrade it instead of start fixing old. But do you have experience on what exactly goes broken, or is it straight forward as just upgrading the packages and restarting ( it never is :) )? -i ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] Install instance failed on xenserver 6.0.2
Hi, I used devstack to install openstack on my xenserver 6.0.2. I followed the video found in this link http://wiki.openstack.org/XenServer/DevStack. After installation, I can access dashboard. But I failed to launch an instance. I tried to launch image tty, after launching, the instance status field shows Error and there has no new VM showing up in my xencenter. I did a ps ax on my domU VM, I see following nova processes: stack@ALLINONE:~/nova/bin$ ps ax | grep nova 5246 pts/6S+ 0:02 python /opt/stack/nova/bin/nova-api 5325 pts/8S+ 0:03 python /opt/stack/nova/bin/nova-cert 5346 pts/9S+ 0:03 python /opt/stack/nova/bin/nova-volume 5371 pts/10 S+ 0:03 python /opt/stack/nova/bin/nova-network 5426 pts/11 S+ 0:03 python /opt/stack/nova/bin/nova-scheduler 5457 pts/12 S+ 0:00 python ./utils/nova-novncproxy --config-file /etc/nova/nova.conf --web . 5477 pts/13 S+ 0:00 python ./bin/nova-xvpvncproxy --config-file /etc/nova/nova.conf 5497 pts/14 S+ 0:03 python ./bin/nova-consoleauth 5537 pts/16 S+ 0:00 python /opt/stack/nova/bin/nova-objectstore I'm not seeing nova-compute running. So I tried to start it manually, Then I got errors attached in later section. Can someone help to take a look to see if I have missed anything during the installation? Also, is there a way to see find more debug information when failed to launch a instance? BTW-- I checked Dom0, I have 1.3G free space, is that enough to run nova-compute? Thanks Yi 012-04-12 03:42:33 CRITICAL nova [-] Unable to log in to XenAPI (is the Dom0 disk full?) 2012-04-12 03:42:33 TRACE nova Traceback (most recent call last): 2012-04-12 03:42:33 TRACE nova File ./nova-compute, line 47, in module 2012-04-12 03:42:33 TRACE nova server = service.Service.create(binary='nova-compute') 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/service.py, line 272, in create 2012-04-12 03:42:33 TRACE nova periodic_fuzzy_delay=periodic_fuzzy_delay) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/service.py, line 167, in __init__ 2012-04-12 03:42:33 TRACE nova self.manager = manager_class(host=self.host, *args, **kwargs) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/compute/manager.py, line 198, in __init__ 2012-04-12 03:42:33 TRACE nova utils.import_object(compute_driver), 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/utils.py, line 90, in import_object 2012-04-12 03:42:33 TRACE nova return cls() 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/connection.py, line 76, in get_connection 2012-04-12 03:42:33 TRACE nova conn = xenapi_conn.get_connection(read_only) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/xenapi_conn.py, line 144, in get_connection 2012-04-12 03:42:33 TRACE nova return XenAPIConnection(url, username, password) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/xenapi_conn.py, line 152, in __init__ 2012-04-12 03:42:33 TRACE nova self._session = XenAPISession(url, user, pw) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/xenapi_conn.py, line 491, in __init__ 2012-04-12 03:42:33 TRACE nova url = self._create_first_session(url, user, pw, exception) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/xenapi_conn.py, line 500, in _create_first_session 2012-04-12 03:42:33 TRACE nova session.login_with_password(user, pw) 2012-04-12 03:42:33 TRACE nova File /usr/local/lib/python2.7/dist-packages/XenAPI.py, line 182, in lambda 2012-04-12 03:42:33 TRACE nova return lambda *params: self._login(name, params) 2012-04-12 03:42:33 TRACE nova File /usr/local/lib/python2.7/dist-packages/XenAPI.py, line 148, in _login 2012-04-12 03:42:33 TRACE nova result = _parse_result(getattr(self, 'session.%s' % method)(*params)) 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/xmlrpclib.py, line 1224, in __call__ 2012-04-12 03:42:33 TRACE nova return self.__send(self.__name, args) 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/xmlrpclib.py, line 1575, in __request 2012-04-12 03:42:33 TRACE nova verbose=self.__verbose 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/xmlrpclib.py, line 1264, in request 2012-04-12 03:42:33 TRACE nova return self.single_request(host, handler, request_body, verbose) 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/xmlrpclib.py, line 1292, in single_request 2012-04-12 03:42:33 TRACE nova self.send_content(h, request_body) 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/xmlrpclib.py, line 1439, in send_content 2012-04-12 03:42:33 TRACE nova connection.endheaders(request_body) 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/httplib.py, line 951, in endheaders 2012-04-12 03:42:33 TRACE nova self._send_output(message_body) 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/httplib.py, line 811, in _send_output
[Openstack] nova nodes hosted in kvm virtual machines: no access to the outside world.
Hi there ! My goal is to host an essex cloud on my laptop to study how it works, play with it, demo it and so on. I am experiencing a network problem with cloud instances: they are not allowed to access the internet (wget on google.com by example). Nodes runs as kvm virtual machines hosted in a laptop running Ubuntu Oneiric. So, in my laptop/hypervisor, i have created the following libvirt network used for the openstack nodes: network namedefault/name uuidd5d3dcc1-f863-9bbf-8d57-1149e361de6d/uuid forward mode='nat'/ bridge name='virbr0' stp='on' delay='0' / mac address='52:54:00:5C:7B:5D'/ ip address='192.168.122.1' netmask='255.255.255.0' /ip /network There is no libvirt dhcp, it is nated to the outside world, and the network used is 192.168.122.0/24 I have installed several nodes (Ubuntu precise). 192.168.122.2 orchestra This behave as a dhcp and cobbler server to install other nodes. 192.168.122.101 manager-node Runs nova-api, nova-scheduler, nova-objectstore, nova-volume, nova-cert and IScsi tgt. 192.168.122.102 messaging Runs rabbitMQ, MySql, Glance and keystone. 192.168.122.103 compute-a Runs nova-compute, nova-api and nova-network. Excerpt from the nova.conf file: --network_manager=nova.network.manager.FlatDHCPManager --fixed_range=10.0.0.0/24 --floating_range=192.168.123.0/24 --auto_assign_floating_ip --flat_network_dns=192.168.122.2 I can run some instances and log in to them from my hypervisor after adding a route to the 192.168.123.0/24 network via the node running nova-network (192.168.122.103) : sudo route add -net 192.168.123.0 netmask 255.255.255.0 gw 192.168.122.103 dev virbr0 So, i have a vm running on 192.168.123.3 : euca-describe-instances RESERVATION r-xu7c0o8y f45695cb80ca402a9a7f63852098b582default INSTANCEi-0007 ami-0003192.168.123.3 server-7 running adminkey (f45695cb80ca402a9a7f63852098b582, compute-a) 0 m1.small2012-04-12T08:58:36.000Znovaaki-0001ari-0002 It s private ip is 10.0.0.2 From it, I cannot download page from the internet: ubuntu@server-7:~$ wget http://www.yahoo.com/ --2012-04-12 09:36:55-- http://www.yahoo.com/ Resolving www.yahoo.com... 87.248.112.181 Connecting to www.yahoo.com|87.248.112.181|:80... failed: Connection refused. But, I can download page from http://192.168.122.1/ (hypervisor virbr0) as well as http://192.168.0.9/ (hypervisor wifi interface used to get access to the outside world). From compute-a, the node running nova-network, i can download pages from yahoo.com. An iptables-save file from my hypervisor is attached to this mail. I did try to remove all the REJECT line in the FORWARD table and reload the rules without success. I am afraid i m a bit lost in all those bridges. Has anyone : - any idea if my problem is in the nova configuration, or something to do with the hypervisor iptables rules ? - done something similar with good result ? - any idea on what to try next ? Have a nice day... # Generated by iptables-save v1.4.10 on Thu Apr 12 11:41:24 2012 *nat :PREROUTING ACCEPT [415:71017] :INPUT ACCEPT [88:7343] :OUTPUT ACCEPT [2282:152990] :POSTROUTING ACCEPT [2346:157728] -A POSTROUTING -s 192.168.122.0/24 ! -d 192.168.122.0/24 -p tcp -j MASQUERADE --to-ports 1024-65535 -A POSTROUTING -s 192.168.122.0/24 ! -d 192.168.122.0/24 -p udp -j MASQUERADE --to-ports 1024-65535 -A POSTROUTING -s 192.168.122.0/24 ! -d 192.168.122.0/24 -j MASQUERADE -A POSTROUTING -s 10.1.0.0/16 ! -d 10.1.0.0/16 -p tcp -j MASQUERADE --to-ports 1024-65535 -A POSTROUTING -s 10.1.0.0/16 ! -d 10.1.0.0/16 -p udp -j MASQUERADE --to-ports 1024-65535 -A POSTROUTING -s 10.1.0.0/16 ! -d 10.1.0.0/16 -j MASQUERADE COMMIT # Completed on Thu Apr 12 11:41:24 2012 # Generated by iptables-save v1.4.10 on Thu Apr 12 11:41:24 2012 *mangle :PREROUTING ACCEPT [159113:79914067] :INPUT ACCEPT [69979:40278276] :FORWARD ACCEPT [89107:39599033] :OUTPUT ACCEPT [60378:10029197] :POSTROUTING ACCEPT [150789:49724062] -A POSTROUTING -o virbr2 -p udp -m udp --dport 68 -j CHECKSUM --checksum-fill COMMIT # Completed on Thu Apr 12 11:41:24 2012 # Generated by iptables-save v1.4.10 on Thu Apr 12 11:41:24 2012 *filter :INPUT ACCEPT [69896:40270442] :FORWARD ACCEPT [0:0] :OUTPUT ACCEPT [60374:10028752] -A INPUT -i virbr1 -p udp -m udp --dport 53 -j ACCEPT -A INPUT -i virbr1 -p tcp -m tcp --dport 53 -j ACCEPT -A INPUT -i virbr1 -p udp -m udp --dport 67 -j ACCEPT -A INPUT -i virbr1 -p tcp -m tcp --dport 67 -j ACCEPT -A INPUT -i virbr0 -p udp -m udp --dport 53 -j ACCEPT -A INPUT -i virbr0 -p tcp -m tcp --dport 53 -j ACCEPT -A INPUT -i virbr0 -p udp -m udp --dport 67 -j ACCEPT -A INPUT -i virbr0 -p tcp -m tcp --dport 67 -j ACCEPT -A INPUT -i virbr2 -p udp -m udp --dport 53 -j ACCEPT -A INPUT -i virbr2 -p tcp -m tcp --dport 53 -j ACCEPT -A INPUT -i virbr2 -p udp -m udp --dport 67 -j ACCEPT -A INPUT -i virbr2 -p tcp -m tcp --dport 67 -j ACCEPT -A FORWARD -i virbr1 -o
Re: [Openstack] I18n issue for OpenStack
+1It is important that we distinguish between those who might contribute to the development of OpenStack, who often have advancedlanguage skills, as contrasted with those who might be asked to operate a cloud based on OpenStack. While it may be that the languageof open source development is English, it is not as likely that you'll findsomeone in IT operations at a company in a non-English language speakingcountry who has advanced (and in some cases, any) english language skills. For them, English language log messages might as well have beenwritten in Romulan.As a means of making this real, imagine trying to operate and debug OpenStack if all of the log messages were written in Simple Chinese.Who amongst us could do that, or would much less even attempt it? I rest my case.It is critically important that welocalize as much as possible, including log messages, install and operations manuals as wellas UI components for locales that we would like to see adopt OpenStack. Thorough globalization will be critical to broad adoption of OpenStack,especially in emerging geographies.Cheers,Christopher FerrisIBM Distinguished Engineer, CTO Industry and Cloud StandardsMember, IBM Academy of TechnologyIBM Software Group, Standards Strategyemail: chris...@us.ibm.comTwitter: christo4ferrisphone: +1 508 234 2986-openstack-bounces+chrisfer=us.ibm@lists.launchpad.net wrote: -To: openstack@lists.launchpad.netFrom: Sean DagueSent by: openstack-bounces+chrisfer=us.ibm@lists.launchpad.netDate: 04/11/2012 03:01PMSubject: Re: [Openstack] I18n issue for OpenStackOn 04/11/2012 08:41 AM, Thierry Carrez wrote: Sheng Bo Hou wrote: After the research done by my colleage Edward Zhang and myself, we have found the following issues for openstack. We have already raised bug https://bugs.launchpad.net/nova/+bug/974810 https://bugs.launchpad.net/nova/+bug/974810 . [...] Thanks for your analysis. We plan to discuss how to fix and extend I18N at the summit. One question that was raised on the ML in February was whether internationalization was actually worth the effort for infrastructure software like OpenStack. I'll be the first to admit that there are other languages than English, but all our open development is based in English already (bugs, reviews, commit messages, mailing-lists, IRC...), so I don't think supporting more languages in the software itself will help growing our developer community.I would tend to disagree with that. People are more likely to invest their time in software if they'll be able to use it better in their locale. I think this is definitely even more true in places where English has less of a dominant presence. It may even bring people to the table solely interested in helping with translation. I've seen that happen elsewhere. On our users community, do operators of OpenStack need translated error messages ? Given that translations are often incomplete, is it worth it ? What do comparable infrastructure open source software projects provide ? The effort to provide them has proven non-trivial, I'd like to make sure it's time well spent.If we want to think about OpenStack as a basic building block like Apache, i18n is critical. Otherwise there are regions that won't adopt it solely because of a lack of i18n.Is there a metric on the completeness so far? Something automated that could be a jenkins coverage kind of test? -Sean-- Sean DagueIBM Linux Technology Centeremail: slda...@us.ibm.comalt-email: sda...@linux.vnet.ibm.com___Mailing list: https://launchpad.net/~openstackPost to : openstack@lists.launchpad.netUnsubscribe : https://launchpad.net/~openstackMore help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] ERROR: string indices must be integers, not str
You may have his this bug : https://bugs.launchpad.net/nova/+bug/965826 Says : this occurs When auth_host (in api-paste.ini) has the wrong IP address Something to check ... -Mandar From: openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net [mailto:openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net] On Behalf Of Guilherme Birk Sent: Wednesday, April 11, 2012 10:38 PM To: Openstack Mail List Subject: [Openstack] ERROR: string indices must be integers, not str I've got OpenStack working with this tutorial http://www.hastexo.com/resources/docs/installing-openstack-essex-20121-ubuntu-1204-precise-pangolin. Now I'm trying to deploy a new installation with the official manual, http://docs.openstack.org/trunk/openstack-compute/install/content/index.html. I can access dashboard, upload images and other things, but when I try to execute a nova list, or after connect to dashboard, I got this error: ERROR: string indices must be integers, not str. Anyone had this problem too? Maybe some wrong configuration? __ Disclaimer:This email and any attachments are sent in strictest confidence for the sole use of the addressee and may contain legally privileged, confidential, and proprietary data. If you are not the intended recipient, please advise the sender by replying promptly to this email and then delete and destroy this email and any attachments without any further use, copying or forwarding___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] The Scheduling feature when reboot the instance
Hi. I'm using Openstack (2011.3 (2011.3-nova-milestone-tarball:tarmac-20110922115702-k9nkvxqzhj130av2) with 3 Compute nodes. My scheduling option is default. I have the problem as the following steps: Compute node 1 is installed the modules: nova-api, nova-compute and nova-network. The resource of node-1 max is fitfor 3 instances (m1.small): i-0001, i-0002, i-0003. I turn off i-0001. and then I request new ínstance by the euca-run-instance command , My new instance ( i-0004) is located on the node 1. The resources: RAM , CPU,.. of node-2 and node-3 is available. finally, I reboot the i-0001.What is happen? the i-0001 is rebooted on the node-1 , and It's shutdown off after reboot.I checked the libvirt's log : Failed to allocate 2147483648 B: Cannot allocate memory 2012-04-12 16:11:50.530: shutting down So , Do Openstack have the sheduling feature when rebooting the instance ? Example: As above , My instance (i-0001) will be migrated to node-2 or node-3 when the resource of node-1 is not available. Văn �ình Phúc Manager - Cloud Team Techno Department Bkav Specialization Division Office: Bkav Building - Yen Hoa New Town, Cau Giay Dist, Hanoi Tel: (84-4) 3763.2552 Mobile: 0169 4702 388 Do your best, the rest will come ! Hãy làm việc hết mình, những đi��u tốt đẹp sẽ đến với bạn ! Disclaimer: This e-mail and any files transmitted with it are confidential and may contain privileged information. It is intended solely for the use of the individual to whom it is addressed and others authorized to receive it. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. If you have received this message in error, please notify the sender immediately by reply e-mail and delete completely this e-mail from your system, without reproducing, distributing or retaining copies. inline: phucvdbmail.gif___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] I18n issue for OpenStack
My cents: Apache HTTP is not so equivelant to OpenStack here. Generally it doesn't care about the application errors or exceptions thrown by web applications. In openstack, exceptions have been defined in nova, horizon, keystone etc. The messages of these exceptions are important for different users to understand what has happened. These messages always need to be localized, returned and displayed on user interface, not just be logged in backend system. It is very common practice for a global software project. Sean Dague wrote: If we want to think about OpenStack as a basic building block like Apache, i18n is critical. Otherwise there are regions that won't adopt it solely because of a lack of i18n. Note that Apache HTTPd, for instance, does not seem to internationalize its error messages. Only the (enduser-facing) HTML pages it gives back in response to invalid requests are. Best Regards, Edward Zhang(张华)地址:北京市海淀区东北旺西路8号 中关村 Staff Software Engineer 软件园28号楼 环宇大厦3层 邮编:100193 TravelTransportation Standards Address: 3F Ring, Building 28 Emerging Technology Institute(ETI)Zhongguancun Software Park, 8 IBM China Software Development LabDongbeiwang West Road, Haidian e-mail: zhu...@cn.ibm.com District, Beijing, P.R.C.100193 Notes ID: Hua ZZ Zhang/China/IBM Tel: 86-10-82450483 Thierry Carrez thierry@openstac k.org To Sent by: openstack@lists.launchpad.net openstack-bounces cc +zhuadl=cn.ibm.co m@lists.launchpad Subject .net Re: [Openstack] I18n issue for OpenStack 2012-04-12 16:47 Sean Dague wrote: If we want to think about OpenStack as a basic building block like Apache, i18n is critical. Otherwise there are regions that won't adopt it solely because of a lack of i18n. Note that Apache HTTPd, for instance, does not seem to internationalize its error messages. Only the (enduser-facing) HTML pages it gives back in response to invalid requests are. Is there a metric on the completeness so far? Something automated that could be a jenkins coverage kind of test? Oddly enough, it's not a question of completeness of translations. Piggybacking on the awesome Launchpad Translations community always gave us great coverage. It's more a code support and CI integration issue. -- Thierry Carrez (ttx) Release Manager, OpenStack ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp inline: 36224036.gifinline: ecblank.gifinline: graycol.gifinline: pic09216.gif___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] I18n issue for OpenStack
Den 12. apr. 2012 13.27 skrev Hua ZZ Zhang zhu...@cn.ibm.com: These messages always need to be localized, returned and displayed on user interface, not just be logged in backend system. It is very common practice for a global software project. OpenStack isn't an interactive application. It's a piece of server software. I'm struggling to think of any server software that writes anything in its log files in anything other than English. I'm Danish and generally configure my servers to speak Danish, so I should have seen it at least occasionally. Do you have any examples of this alleged very common practice? -- Soren Hansen | http://linux2go.dk/ Senior Software Engineer | http://www.cisco.com/ Ubuntu Developer | http://www.ubuntu.com/ OpenStack Developer | http://www.openstack.org/ ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] I18n issue for OpenStack
Don't get me wrong.. I'd be happy to have the various openstack clients offer localised error messages. I'd also encourage a centralised effort to collect these translationns (so that all the various language bindings will use the same localised error messages). On the server, though, I believe we should stick to English and perhaps have every error message include a link (e.g. http://docs.openstack.doc/exception/NoNetworksDefinedException) to a localised docs site. I think losing the ability to search the web for error messages would be a major loss. -- Soren Hansen | http://linux2go.dk/ Senior Software Engineer | http://www.cisco.com/ Ubuntu Developer | http://www.ubuntu.com/ OpenStack Developer | http://www.openstack.org/ ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] nova nodes hosted in kvm virtual machines: no access to the outside world.
- any idea if my problem is in the nova configuration, or something to do with the hypervisor iptables rules ? - done something similar with good result ? - any idea on what to try next ? Actually adding an iptables entry on the hypervisor so packet coming from the floating ip network were masqueraded did the trick: -A POSTROUTING -s 192.168.123.0/24 ! -d 192.168.123.0/24 -j MASQUERADE ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Install instance failed on xenserver 6.0.2
1.3GB is more than enough. When you get that message, usually space has already dried up, or there is a problem authenticating with xenapi. Check that: xenapi_connection_url xenapi_connection_password are set correctly, and that you can reach dom0 from your devstack instance. Have a look at your localrc, xenrc, and nova.conf, see if you can find anything wrong with them. Hope this help! Armando On Thu, Apr 12, 2012 at 5:03 AM, Yi Sun beyo...@gmail.com wrote: Hi, I used devstack to install openstack on my xenserver 6.0.2. I followed the video found in this link http://wiki.openstack.org/XenServer/DevStack. After installation, I can access dashboard. But I failed to launch an instance. I tried to launch image tty, after launching, the instance status field shows Error and there has no new VM showing up in my xencenter. I did a ps ax on my domU VM, I see following nova processes: stack@ALLINONE:~/nova/bin$ ps ax | grep nova 5246 pts/6 S+ 0:02 python /opt/stack/nova/bin/nova-api 5325 pts/8 S+ 0:03 python /opt/stack/nova/bin/nova-cert 5346 pts/9 S+ 0:03 python /opt/stack/nova/bin/nova-volume 5371 pts/10 S+ 0:03 python /opt/stack/nova/bin/nova-network 5426 pts/11 S+ 0:03 python /opt/stack/nova/bin/nova-scheduler 5457 pts/12 S+ 0:00 python ./utils/nova-novncproxy --config-file /etc/nova/nova.conf --web . 5477 pts/13 S+ 0:00 python ./bin/nova-xvpvncproxy --config-file /etc/nova/nova.conf 5497 pts/14 S+ 0:03 python ./bin/nova-consoleauth 5537 pts/16 S+ 0:00 python /opt/stack/nova/bin/nova-objectstore I'm not seeing nova-compute running. So I tried to start it manually, Then I got errors attached in later section. Can someone help to take a look to see if I have missed anything during the installation? Also, is there a way to see find more debug information when failed to launch a instance? BTW-- I checked Dom0, I have 1.3G free space, is that enough to run nova-compute? Thanks Yi 012-04-12 03:42:33 CRITICAL nova [-] Unable to log in to XenAPI (is the Dom0 disk full?) 2012-04-12 03:42:33 TRACE nova Traceback (most recent call last): 2012-04-12 03:42:33 TRACE nova File ./nova-compute, line 47, in module 2012-04-12 03:42:33 TRACE nova server = service.Service.create(binary='nova-compute') 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/service.py, line 272, in create 2012-04-12 03:42:33 TRACE nova periodic_fuzzy_delay=periodic_fuzzy_delay) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/service.py, line 167, in __init__ 2012-04-12 03:42:33 TRACE nova self.manager = manager_class(host=self.host, *args, **kwargs) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/compute/manager.py, line 198, in __init__ 2012-04-12 03:42:33 TRACE nova utils.import_object(compute_driver), 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/utils.py, line 90, in import_object 2012-04-12 03:42:33 TRACE nova return cls() 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/connection.py, line 76, in get_connection 2012-04-12 03:42:33 TRACE nova conn = xenapi_conn.get_connection(read_only) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/xenapi_conn.py, line 144, in get_connection 2012-04-12 03:42:33 TRACE nova return XenAPIConnection(url, username, password) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/xenapi_conn.py, line 152, in __init__ 2012-04-12 03:42:33 TRACE nova self._session = XenAPISession(url, user, pw) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/xenapi_conn.py, line 491, in __init__ 2012-04-12 03:42:33 TRACE nova url = self._create_first_session(url, user, pw, exception) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/xenapi_conn.py, line 500, in _create_first_session 2012-04-12 03:42:33 TRACE nova session.login_with_password(user, pw) 2012-04-12 03:42:33 TRACE nova File /usr/local/lib/python2.7/dist-packages/XenAPI.py, line 182, in lambda 2012-04-12 03:42:33 TRACE nova return lambda *params: self._login(name, params) 2012-04-12 03:42:33 TRACE nova File /usr/local/lib/python2.7/dist-packages/XenAPI.py, line 148, in _login 2012-04-12 03:42:33 TRACE nova result = _parse_result(getattr(self, 'session.%s' % method)(*params)) 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/xmlrpclib.py, line 1224, in __call__ 2012-04-12 03:42:33 TRACE nova return self.__send(self.__name, args) 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/xmlrpclib.py, line 1575, in __request 2012-04-12 03:42:33 TRACE nova verbose=self.__verbose 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/xmlrpclib.py, line 1264, in request 2012-04-12 03:42:33 TRACE nova return self.single_request(host, handler, request_body, verbose) 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/xmlrpclib.py, line
[Openstack] Using Foreign Keys
Dear Developers, While testing our SUSE OpenStack packages we hit a nasty bug and reported it as: https://bugs.launchpad.net/keystone/+bug/972502 We found out that the underlying cause was a lack of referential integrity[1] using sqlite or mysql. When we tried to reproduce this issue on postgresql the usage of foreign keys greatly helped to find the cause. In order to prevent further inconsistencies we created a patch that added more foreign keys: https://review.openstack.org/6216 One reviewer commented: i don't approve of adding foreign keys, and we should probably remove the existing ones (in UserTenantMembership and in Endpoint) and on https://review.openstack.org/#patch,sidebyside,6216,3,keystone/identity/backends/sql.py we shouldn't be using foreign keys at all, they are a crutch that are not available everywhere This was a surprising answer to us as the usage of the foreign keys revealed the inconsistency in the first place. So removing them elsewhere does in no way improve the situation, it even does not help for mysql and sqlite, as SQLAlchemy abstracts them away. We also found similar bugs elsewhere: * https://bugs.launchpad.net/keystone/+bug/959294 * https://bugs.launchpad.net/keystone/+bug/973243 * https://bugs.launchpad.net/keystone/+bug/974199 In our point of view foreign keys should be used in all possible places. This would not harm any database that does not support them but helps all of us to find data inconsistencies and related bugs, which leads to faster development with fewer bugs. What is your take on these things? How would you take care of data consistency otherwise? Thank you for your feedback, Berhard M. Wiedemann J. Daniel Schmidt [1]: http://en.wikipedia.org/wiki/Referential_integrity -- J. Daniel Schmidt j...@suse.de SUSE LINUX Products GmbH Research Development Maxfeldstr. 5 HRB 16746 (AG Nürnberg) D-90409 Nürnberg GF: Jeff Hawn, Jennifer Guild, Felix Imendörffer ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] [openstack] Error Unable to list users: [Errno 110] ETIMEDOUT
Hi folks, I have a diablo installation with Dashboard and I'm having the following error when I try access Tenants or Users on Dashboard: Error Unable to get tenant info: [Errno 110] ETIMEDOUT Error Unable to list users: [Errno 110] ETIMEDOUT Has anyone had this problem? Lucian Thomaz ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [openstack] Error Unable to list users: [Errno 110] ETIMEDOUT
Sounds like you have access to keystone, but you don't have access to nova-api... -- Diego Parrilla http://www.stackops.com/*CEO* *www.stackops.com | * diego.parri...@stackops.com** | +34 649 94 43 29 | skype:diegoparrilla* * http://www.stackops.com/ * * On Thu, Apr 12, 2012 at 2:56 PM, Lucian Thomaz luciantho...@hotmail.comwrote: Hi folks, I have a diablo installation with Dashboard and I'm having the following error when I try access Tenants or Users on Dashboard: Error Unable to get tenant info: [Errno 110] ETIMEDOUT Error Unable to list users: [Errno 110] ETIMEDOUT Has anyone had this problem? *Lucian Thomaz* ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] I18n issue for OpenStack
Dear OpenStack friends, It will be happy and great for our OpenStack community to see this open project open to more market all over the world. In China, OpenStack community is very active. I heard many Chinese engineers talking about their wish to have a Chinese versioned openStack, including documentation's, manuals, user interfaces, error messages, etc in OpenStack meet-ups. I have many European friends and also Danish friends, since I used to do my university there. They all spoke perfect English, which made me admire, cos they were linguists in my point of view. Oriental languages are different. They are too far from the western lingual system. In China, there are many talented engineers, who are not that kind of linguists, but they are lover of open source. I think it is amazing to open the door to them. In China, it is very appreciated for software to be localized as much as possible. I used to google or baidu(a famous Chinese search engine) error messages and logs in Chinese for other software, though it is not Apache. I found a lot of useful references in Chinese, because it has been localized. If it is not localized well first, of course it does not have the google or yahoo ability to search.:-) So far I am rather grateful for all the messages following this i18 issue. Thank you so much. Best wishes. Vincent Hou (侯胜博) Software Engineer, Standards Growth Team, Emerging Technology Institute, IBM China Software Development Lab Tel: 86-10-82450778 Fax: 86-10-82453660 Notes ID: Sheng Bo Hou/China/IBM@IBMCNE-mail: sb...@cn.ibm.com Address:3F Ring, Building 28 Zhongguancun Software Park, 8 Dongbeiwang West Road, Haidian District, Beijing, P.R.C.100193 Soren Hansen so...@linux2go.dk Sent by: openstack-bounces+sbhou=cn.ibm@lists.launchpad.net 2012-04-12 19:50 To Hua ZZ Zhang/China/IBM@IBMCN cc openstack@lists.launchpad.net, Thierry Carrez thie...@openstack.org, openstack-bounces+zhuadl=cn.ibm@lists.launchpad.net Subject Re: [Openstack] I18n issue for OpenStack Don't get me wrong.. I'd be happy to have the various openstack clients offer localised error messages. I'd also encourage a centralised effort to collect these translationns (so that all the various language bindings will use the same localised error messages). On the server, though, I believe we should stick to English and perhaps have every error message include a link (e.g. http://docs.openstack.doc/exception/NoNetworksDefinedException) to a localised docs site. I think losing the ability to search the web for error messages would be a major loss. -- Soren Hansen | http://linux2go.dk/ Senior Software Engineer | http://www.cisco.com/ Ubuntu Developer | http://www.ubuntu.com/ OpenStack Developer | http://www.openstack.org/ ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Where does Keystone middleware for Swift belong?
On 04/11/2012 11:03 PM, John Dickinson wrote: I do not think that these pieces of middleware belong in the core swift repo. 1) Including them in swift would require swift to depend on keystone for full testing. 2) (When the middleware was created) Keystone's API was in a state of constant flux. Keystone has changed quite a bit since then, so this may not be the case anymore. 3) Swift does not require Keystone to run (and in fact many production environments don't use keystone at all). [1] 4) We have previously removed auth systems from swift's core code in order to simplify the codebase and allow separate dev cycles. All that is included now is the most basic auth system required for dev work, stand-alone tests, and POC deployments. Our thought thus far has been that auth systems providing auth for swift have the responsibility to maintain their integration code. It's not swift's responsibility to manage and maintain code for every auth system that wants to provide an auth mechanism for swift. That being said, there has been quite a bit of recent conversation about the concept of *-contrib areas for each project that include optional add-ons/extensions/plugins/etc or alternative APIs for each project. I expect these conversations to continue next week in person at the summit. One option is for the swift keystone middleware to be a part of such a contrib area. It sounds like there are good reasons for both projects to not want to include these pieces of middleware in their respective core repos. Perhaps a contrib area can be a compromise, but that does not answer who is responsible for it (ie who maintains the code?). I think that's a separate, but related, question. I think this is an excellent solution -- the contrib area/project. And as far as who should be responsible for it, I believe that the responsibilities should be shared across the relevant projects that may be integrated. For instance, recently Chmouel did a great job working with the Keystone contributors to hammer out the Swift keystone middleware and worked with the Glance contributors to make requisite changes in the Glance Swift storage driver... so a number of affected parties shared responsibility. Best, -jay ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] minimal IaaS openstack installation FROM SOURCE on CentOS
Hi, I need to install a minimal/simple Openstack IaaS Deployment framework on CentOS 6.x from Source. Is there anywhere a nice howto tutorial? And yes: I know there are packeges, but I need it from source. Cheers Viktor smime.p7s Description: S/MIME cryptographic signature ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] I18n issue for OpenStack
On 04/12/2012 04:52 AM, Thierry Carrez wrote: Joshua Harlow wrote: So there is a question here that I don’t understand. There a different levels of I18N, for say user facing error messages, or for other things I consider UI (horizon). Those need to be I18N and all that. I think the larger part that I don’t understand is why the things that are not the above (log messages) are being internationalized. So what level do we want to have ;) And what level is normal for people to expect (do systems like hadoop do I18N on there error messages, do other apache projects?) I agree with you. Documentation and user-facing interfaces should definitely support I18N. That means Horizon, and (maybe) the Python client bindings. Operators-facing log messages... not so much. By internationalizing them we lose the ability to google for them, and I'm not convinced the trade-off is favorable for that particular population. As long as user facing interfaces also means command line interface, I think we're on the same page. -Sean -- Sean Dague IBM Linux Technology Center email: slda...@us.ibm.com alt-email: sda...@linux.vnet.ibm.com ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] I18n issue for OpenStack
Both points of view being expressed about this with respect to log error messages are valid and need to be accommodated. An answer, as was suggested a while back, is for error messages to have two parts: 1. A locale-independent part that can be used for searches or understood by developers who get logs as parts of bug reports. 2. A localized part that lets operators determine if the problem is their issue or an OpenStack bug to be reported. The current English string would serve the first role, and the logging code could be changed to also emit the localized string if available. I would argue for this only in the case of ERROR messages and not DEBUG. While on the subject of logs, it would be good to agree on what actions should cause errors in logs to appear. Ideally, they would only occur if an OpenStack bug was detected (out-of-bounds array ref, etc.) or some operational problem occurred (disk ran out of space, etc.). Right now errors are sometimes output for other reasons such as bad arguments to api calls. This makes it difficult for an operator to know when a real problem with the system has occurred. David Kranz Quanta Research Cambridge On 4/12/2012 9:06 AM, Sheng Bo Hou wrote: Dear OpenStack friends, It will be happy and great for our OpenStack community to see this open project open to more market all over the world. In China, OpenStack community is very active. I heard many Chinese engineers talking about their wish to have a Chinese versioned openStack, including documentation's, manuals, user interfaces, error messages, etc in OpenStack meet-ups. I have many European friends and also Danish friends, since I used to do my university there. They all spoke perfect English, which made me admire, cos they were linguists in my point of view. Oriental languages are different. They are too far from the western lingual system. In China, there are many talented engineers, who are not that kind of linguists, but they are lover of open source. I think it is amazing to open the door to them. In China, it is very appreciated for software to be localized as much as possible. I used to google or baidu(a famous Chinese search engine) error messages and logs in Chinese for other software, though it is not Apache. I found a lot of useful references in Chinese, because it has been localized. If it is not localized well first, of course it does not have the google or yahoo ability to search.:-) So far I am rather grateful for all the messages following this i18 issue. Thank you so much. Best wishes. Vincent Hou (???) Software Engineer, Standards Growth Team, Emerging Technology Institute, IBM China Software Development Lab Tel: 86-10-82450778 Fax: 86-10-82453660 Notes ID: Sheng Bo Hou/China/IBM@IBMCNE-mail: sb...@cn.ibm.com Address:3F Ring, Building 28 Zhongguancun Software Park, 8 Dongbeiwang West Road, Haidian District, Beijing, P.R.C.100193 *Soren Hansen so...@linux2go.dk* Sent by: openstack-bounces+sbhou=cn.ibm@lists.launchpad.net 2012-04-12 19:50 To Hua ZZ Zhang/China/IBM@IBMCN cc openstack@lists.launchpad.net, Thierry Carrez thie...@openstack.org, openstack-bounces+zhuadl=cn.ibm@lists.launchpad.net Subject Re: [Openstack] I18n issue for OpenStack Don't get me wrong.. I'd be happy to have the various openstack clients offer localised error messages. I'd also encourage a centralised effort to collect these translationns (so that all the various language bindings will use the same localised error messages). On the server, though, I believe we should stick to English and perhaps have every error message include a link (e.g. http://docs.openstack.doc/exception/NoNetworksDefinedException) to a localised docs site. I think losing the ability to search the web for error messages would be a major loss. -- Soren Hansen | http://linux2go.dk/ Senior Software Engineer | http://www.cisco.com/ Ubuntu Developer | http://www.ubuntu.com/ OpenStack Developer | http://www.openstack.org/ ___ Mailing list: https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] profiling nova-api
Hi Yun! Thanks very much for sharing this information. Can I ask you to pull the code in this branch: https://review.openstack.org/#change,5762 And retry your test? On my test machines, the work that Huang Zhiteng has done to convert Nova's servers to use multiple operating system processes, each with its own greenthread service pool, resulted in a massive throughput improvement, turning a quickly-bottlenecked system into a server that could scale nearly linearly with the number of worker processes. Be sure to set osapi_workers to the number of cores your machine has... and also note that your code profiling technique is unlikely to be effective since cProfile wouldn't track the forked child worker processes' stacks, AFAIK. Still interested to see if the time to execute the 300 API calls is dramatically reduced, though. Looking forward to any results you might have. Best, -jay On 04/11/2012 04:48 PM, Yun Mao wrote: Hi Stackers, I spent some time looking at nova-api today. Setup: everything-on-one-node devstack, essex trunk. I setup 1 user with 10 tiny VMs. Client: 3 python threads each doing a loop of nova list equivalent for 100 times. So 300 API calls with concurrency=3. how to profile: python -m cProfile -s time /opt/stack/nova/bin/nova-api --flagfile=/etc/nova/nova.conf --logdir=/var/log/nova --nodebug The partial output is attached in the end. Observations: * It takes about 60 seconds to finish. CPU of nova-api is around 70% to 90% * Database access: Each nova list API call will issue 4 db APIs: 3 instance_get_all_by_filters(), 1 instance_fault_get_by_instance_uuids(), so 1200 db API calls total (note: not necessarily 1200 SQL statements, could be more). The 900 instance_get_all_by_filters() calls took 30.2 seconds (i.e. 0.03s each)! The 300 instance_fault_get_by_instance_uuids() calls only took 1.129 seconds (0.004 each). You might think: MySQL sucks. Not so fast. Remember this is a tiny database with only 10 VMs. Profile also shows that the actual _mysql.connection.query() method only took 1.883 seconds in total. So, we pretty much spend 29 seconds out of 60 seconds doing either sqlalchemy stuff or our own wrapper. You can also see from the sheer volume of sqlalchemy library calls involved. * the cfg.py library inefficiency. During 300 API calls, common.cfg.ConfigOpts._get() is called 135005 times! and we paid 2.470 sec for that. Hopefully this is useful for whoever wants to improve the performance of nova-api. Thanks, Yun === 23355694 function calls (22575841 primitive calls) in 77.874 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 812 25.7250.032 25.7250.032 {method 'poll' of 'select.epoll' objects} 24081.8830.0011.8830.001 {method 'query' of '_mysql.connection' objects} 703801.6670.0007.1870.000 expression.py:2263(corresponding_column) 1350051.2540.0002.4700.000 cfg.py:1058(_get) 410271.0430.0001.9070.000 schema.py:542(__init__) 388021.0080.0001.2190.000 __init__.py:451(format) 1622060.8210.0000.8210.000 util.py:883(values) 15306660.7730.0000.7740.000 {isinstance} 135046/1349600.7160.0001.9190.000 cfg.py:1107(_substitute) 12050.7130.0011.3690.001 base.py:2106(__init__) 1836000.6900.0000.7960.000 interfaces.py:954(_reduce_path) 810020.6870.0002.4920.000 compiler.py:312(visit_label) 388020.6500.0006.0870.000 log.py:227(format) 3192700.6220.0000.7480.000 attributes.py:164(__get__) 890242/8842290.6080.0001.8850.000 {getattr} 405000.6050.0003.1010.000 schema.py:955(_make_proxy) 120783/1207380.6030.0000.6050.000 {method 'sub' of '_sre.SRE_Pattern' objects} 810000.6010.0002.1560.000 interfaces.py:677(create_row_processor) 630000.5900.0000.7070.000 times.py:44(DateTime_or_None) 981020.5880.0000.8860.000 compiler.py:337(visit_column) 6580980.5800.0000.5810.000 {method 'intersection' of 'set' objects} 1098020.5620.0000.5620.000 expression.py:3625(_from_objects) 231610/12020.5510.0005.8130.005 visitors.py:58(_compiler_dispatch) 1440020.5100.0000.6930.000 compiler.py:622(_truncated_identifier) 135005/1349600.4850.0004.8720.000 cfg.py:860(__getattr__) 24080.4630.0001.9420.001 {built-in method fetch_row} 711000.4600.0000.5800.000 strategies.py:121(create_row_processor) 2990310.4370.0000.4370.000 {_codecs.utf_8_decode} 60000.4370.0001.7990.000 models.py:93(iteritems) 36000/90000.4090.0004.7910.001
Re: [Openstack] Where does Keystone middleware for Swift belong?
On Thu, Apr 12, 2012 at 5:03 AM, John Dickinson m...@not.mn wrote: 4) We have previously removed auth systems from swift's core code in order to simplify the codebase and allow separate dev cycles. All that is included now is the most basic auth system required for dev work, stand-alone tests, and POC deployments. If swift doesn't want to be opinionated about a auth server I think this is a good reason to have it outside Swift and probably like you suggest in the contrib area if that something we can make happen. I like the idea of having the middleware in the *client as effectively those middleware are clients but that may not what a end-user expect. It may be another discussion but it would be nice to abstract the auth code in Swift as currently this is not so easy to implement all Swift features in Auth middleware. The best way currently to do so is to follow the commits in tempauth/swauth and each middleware maintainers implement the features on his own. Maru has been thinking about it and started to do an implementation in the swift_auth middleware in this review : https://review.openstack.org/#patch,sidebyside,5661,4,keystone/middleware/swift_auth.py I can't remember what was the outcome of the initial work done by Greg on authz in Swift but is Maru review can be something we can look forward to have in Swift so all the other middleware would only have to do the strict minimal of authentication/validation ? Cheers, Chmouel. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] control user quota
Hello, I try to assign quota to individual users, to control how many instances each user can run concurrently. But I don't see a doc describing how to do that. I use diablo release. Any help or doc pointer will be greatly appreciated. Xin ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] profiling nova-api
Both the profiling the multi-process work are great - good stuff! Jay: Won't going multi-process just make it harder to profile? I think it's actually a good thing to profile without the multi-process patch, find fix and the bottlenecks in single-request performance, and then use multi-process for great concurrent-request performance? Justin On Thu, Apr 12, 2012 at 6:49 AM, Jay Pipes jaypi...@gmail.com wrote: Hi Yun! Thanks very much for sharing this information. Can I ask you to pull the code in this branch: https://review.openstack.org/#**change,5762https://review.openstack.org/#change,5762 And retry your test? On my test machines, the work that Huang Zhiteng has done to convert Nova's servers to use multiple operating system processes, each with its own greenthread service pool, resulted in a massive throughput improvement, turning a quickly-bottlenecked system into a server that could scale nearly linearly with the number of worker processes. Be sure to set osapi_workers to the number of cores your machine has... and also note that your code profiling technique is unlikely to be effective since cProfile wouldn't track the forked child worker processes' stacks, AFAIK. Still interested to see if the time to execute the 300 API calls is dramatically reduced, though. Looking forward to any results you might have. Best, -jay On 04/11/2012 04:48 PM, Yun Mao wrote: Hi Stackers, I spent some time looking at nova-api today. Setup: everything-on-one-node devstack, essex trunk. I setup 1 user with 10 tiny VMs. Client: 3 python threads each doing a loop of nova list equivalent for 100 times. So 300 API calls with concurrency=3. how to profile: python -m cProfile -s time /opt/stack/nova/bin/nova-api --flagfile=/etc/nova/nova.conf --logdir=/var/log/nova --nodebug The partial output is attached in the end. Observations: * It takes about 60 seconds to finish. CPU of nova-api is around 70% to 90% * Database access: Each nova list API call will issue 4 db APIs: 3 instance_get_all_by_filters(), 1 instance_fault_get_by_**instance_uuids(), so 1200 db API calls total (note: not necessarily 1200 SQL statements, could be more). The 900 instance_get_all_by_filters() calls took 30.2 seconds (i.e. 0.03s each)! The 300 instance_fault_get_by_**instance_uuids() calls only took 1.129 seconds (0.004 each). You might think: MySQL sucks. Not so fast. Remember this is a tiny database with only 10 VMs. Profile also shows that the actual _mysql.connection.query() method only took 1.883 seconds in total. So, we pretty much spend 29 seconds out of 60 seconds doing either sqlalchemy stuff or our own wrapper. You can also see from the sheer volume of sqlalchemy library calls involved. * the cfg.py library inefficiency. During 300 API calls, common.cfg.ConfigOpts._get() is called 135005 times! and we paid 2.470 sec for that. Hopefully this is useful for whoever wants to improve the performance of nova-api. Thanks, Yun === 23355694 function calls (22575841 primitive calls) in 77.874 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 812 25.7250.032 25.7250.032 {method 'poll' of 'select.epoll' objects} 24081.8830.0011.8830.001 {method 'query' of '_mysql.connection' objects} 703801.6670.0007.1870.000 expression.py:2263(**corresponding_column) 1350051.2540.0002.4700.000 cfg.py:1058(_get) 410271.0430.0001.9070.000 schema.py:542(__init__) 388021.0080.0001.2190.000 __init__.py:451(format) 1622060.8210.0000.8210.000 util.py:883(values) 15306660.7730.0000.7740.000 {isinstance} 135046/1349600.7160.0001.9190.000 cfg.py:1107(_substitute) 12050.7130.0011.3690.001 base.py:2106(__init__) 1836000.6900.0000.7960.000 interfaces.py:954(_reduce_* *path) 810020.6870.0002.4920.000 compiler.py:312(visit_label) 388020.6500.0006.0870.000 log.py:227(format) 3192700.6220.0000.7480.000 attributes.py:164(__get__) 890242/8842290.6080.0001.8850.000 {getattr} 405000.6050.0003.1010.000 schema.py:955(_make_proxy) 120783/1207380.6030.0000.6050.000 {method 'sub' of '_sre.SRE_Pattern' objects} 810000.6010.0002.1560.000 interfaces.py:677(create_row_**processor) 630000.5900.0000.7070.000 times.py:44(DateTime_or_None) 981020.5880.0000.8860.000 compiler.py:337(visit_column) 6580980.5800.0000.5810.000 {method 'intersection' of 'set' objects} 1098020.5620.0000.5620.000 expression.py:3625(_from_** objects) 231610/12020.5510.0005.8130.005
Re: [Openstack] profiling nova-api
On 04/12/2012 10:39 AM, Justin Santa Barbara wrote: Both the profiling the multi-process work are great - good stuff! Jay: Won't going multi-process just make it harder to profile? Yep, that's why I said also note that your code profiling technique is unlikely to be effective since cProfile wouldn't track the forked child worker processes' stacks ;) I think it's actually a good thing to profile without the multi-process patch, find fix and the bottlenecks in single-request performance, and then use multi-process for great concurrent-request performance? Agreed! -jay ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Netstack] Role of nova-manage network commands when using QuantumManager
nova-manage is an admin tool,just as you said,it opeates the DB directly,and can be executed both in nova-network node and nova-compute node,it is a simple way to work as an admin tool before keystone come out. in folsom,there will be and admin tool like novaclient to take the place of nova-manage. 2012/4/12 Vaze, Mandar mandar.v...@nttdata.com: It is my understanding that in multi-node setup : · nova-manage can be executed from any machine which may not be running nova-network process. (Or should nova-manage always be run on nova-network node ?) · nova-manage does DB operations and delegates the actual networking calls to nova-network process ? Is this understanding correct ? I traced “nova-manage network create” and nova-manage network delete” using FlatDHCPManager (default for devstack/stack.sh) Both these calls seem to be doing only DB operations. BTW, nova-network process was shutdown during both “network create” and “network delete” – Still both operations were successful. But when using QuantumManager as network manager – nova-manage seems to be doing networking operations like “iptables-save” (during network create) and “kill_dhcp” (during network delete) (via linux-net L3 driver) Since nova-manage command may be executed on a host which isn’t running nova-network – network commands like “iptables” and “kill -9 pid of dnsmasq” on host running nova-manage seems incorrect. For the first scenario (iptables-save during “network create” – there is already a defect in LP : https://bugs.launchpad.net/nova/+bug/977738 and review : https://review.openstack.org/6451 I would like your comments and opinions which would help me understand “What nova-manage should and should NOT do” Thanks, -Mandar __ Disclaimer:This email and any attachments are sent in strictest confidence for the sole use of the addressee and may contain legally privileged, confidential, and proprietary data. If you are not the intended recipient, please advise the sender by replying promptly to this email and then delete and destroy this email and any attachments without any further use, copying or forwarding -- Mailing list: https://launchpad.net/~netstack Post to : netst...@lists.launchpad.net Unsubscribe : https://launchpad.net/~netstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] control user quota
You can set quotas per tenant. If you have Horizon installed may be you can modify quotas in the System Panel. -- Diego Parrilla http://www.stackops.com/*CEO* *www.stackops.com | * diego.parri...@stackops.com** | +34 649 94 43 29 | skype:diegoparrilla* * http://www.stackops.com/ * * On Thu, Apr 12, 2012 at 4:27 PM, Xin Zhao xz...@bnl.gov wrote: Hello, I try to assign quota to individual users, to control how many instances each user can run concurrently. But I don't see a doc describing how to do that. I use diablo release. Any help or doc pointer will be greatly appreciated. Xin __**_ Mailing list: https://launchpad.net/~**openstackhttps://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~**openstackhttps://launchpad.net/~openstack More help : https://help.launchpad.net/**ListHelphttps://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] control user quota
nova does not support it ever,you can set the flag quota_instances to control the total num instances a tenant can create ,the num of instances concurrently created is surely to be less than this quota . 2012/4/12 Xin Zhao xz...@bnl.gov: Hello, I try to assign quota to individual users, to control how many instances each user can run concurrently. But I don't see a doc describing how to do that. I use diablo release. Any help or doc pointer will be greatly appreciated. Xin ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] control user quota
I try to assign quota to individual users, to control how many instances each user can run concurrently. But I don't see a doc describing how to do that. I use diablo release. Any help or doc pointer will be greatly appreciated. Quotas apply at the nova project/tenant granularity, as opposed to an individual user. Project-specific quotas may be set via the nova CLI, e.g. $ nova quota-update tenant_ID --instances=50 otherwise the configured default quota is inherited. Since you're still on diablo, the new quota classes mechanism would not be relevant. Cheers, Eoghan ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Using Foreign Keys
On Thu, Apr 12, 2012 at 7:35 AM, J. Daniel Schmidt j...@suse.de wrote: In our point of view foreign keys should be used in all possible places. This would not harm any database that does not support them but helps all of us to find data inconsistencies and related bugs, which leads to faster development with fewer bugs. FWIW, I recently learned that you can enforce foreign keys in sqlite 3.6.19 with a pragma by setting up and event/listener on session create. http://www.sqlite.org/foreignkeys.html We've had some good success with it. -clayg ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] profiling nova-api
Just a small warning: since cProfile has its own overhead on entering/exiting every method and uses deterministic rather than statistical profiling, it may misrepresent tiny functions. They will take much more wall-clock time simply due to the profiling overhead * number of executions. I'm not saying cfg is not slow, but in this case it may be worth confirming the actual time spend on each call by doing a minimalistic test with timeit, without any profiler (request the same variable 100 times and see how much it really takes per iteration). Regards, Stanisław Pitucha Cloud Services Hewlett Packard -Original Message- From: openstack-bounces+stanislaw.pitucha=hp@lists.launchpad.net [mailto:openstack-bounces+stanislaw.pitucha=hp@lists.launchpad.net] On Behalf Of Yun Mao Sent: Wednesday, April 11, 2012 9:48 PM To: openstack@lists.launchpad.net Subject: [Openstack] profiling nova-api Hi Stackers, I spent some time looking at nova-api today. Setup: everything-on-one-node devstack, essex trunk. I setup 1 user with 10 tiny VMs. Client: 3 python threads each doing a loop of nova list equivalent for 100 times. So 300 API calls with concurrency=3. how to profile: python -m cProfile -s time /opt/stack/nova/bin/nova-api --flagfile=/etc/nova/nova.conf --logdir=/var/log/nova --nodebug The partial output is attached in the end. Observations: * It takes about 60 seconds to finish. CPU of nova-api is around 70% to 90% * Database access: Each nova list API call will issue 4 db APIs: 3 instance_get_all_by_filters(), 1 instance_fault_get_by_instance_uuids(), so 1200 db API calls total (note: not necessarily 1200 SQL statements, could be more). The 900 instance_get_all_by_filters() calls took 30.2 seconds (i.e. 0.03s each)! The 300 instance_fault_get_by_instance_uuids() calls only took 1.129 seconds (0.004 each). You might think: MySQL sucks. Not so fast. Remember this is a tiny database with only 10 VMs. Profile also shows that the actual _mysql.connection.query() method only took 1.883 seconds in total. So, we pretty much spend 29 seconds out of 60 seconds doing either sqlalchemy stuff or our own wrapper. You can also see from the sheer volume of sqlalchemy library calls involved. * the cfg.py library inefficiency. During 300 API calls, common.cfg.ConfigOpts._get() is called 135005 times! and we paid 2.470 sec for that. Hopefully this is useful for whoever wants to improve the performance of nova-api. Thanks, Yun === 23355694 function calls (22575841 primitive calls) in 77.874 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 812 25.7250.032 25.7250.032 {method 'poll' of 'select.epoll' objects} 24081.8830.0011.8830.001 {method 'query' of '_mysql.connection' objects} 703801.6670.0007.1870.000 expression.py:2263(corresponding_column) 1350051.2540.0002.4700.000 cfg.py:1058(_get) 410271.0430.0001.9070.000 schema.py:542(__init__) 388021.0080.0001.2190.000 __init__.py:451(format) 1622060.8210.0000.8210.000 util.py:883(values) 15306660.7730.0000.7740.000 {isinstance} 135046/1349600.7160.0001.9190.000 cfg.py:1107(_substitute) 12050.7130.0011.3690.001 base.py:2106(__init__) 1836000.6900.0000.7960.000 interfaces.py:954(_reduce_path) 810020.6870.0002.4920.000 compiler.py:312(visit_label) 388020.6500.0006.0870.000 log.py:227(format) 3192700.6220.0000.7480.000 attributes.py:164(__get__) 890242/8842290.6080.0001.8850.000 {getattr} 405000.6050.0003.1010.000 schema.py:955(_make_proxy) 120783/1207380.6030.0000.6050.000 {method 'sub' of '_sre.SRE_Pattern' objects} 810000.6010.0002.1560.000 interfaces.py:677(create_row_processor) 630000.5900.0000.7070.000 times.py:44(DateTime_or_None) 981020.5880.0000.8860.000 compiler.py:337(visit_column) 6580980.5800.0000.5810.000 {method 'intersection' of 'set' objects} 1098020.5620.0000.5620.000 expression.py:3625(_from_objects) 231610/12020.5510.0005.8130.005 visitors.py:58(_compiler_dispatch) 1440020.5100.0000.6930.000 compiler.py:622(_truncated_identifier) 135005/1349600.4850.0004.8720.000 cfg.py:860(__getattr__) 24080.4630.0001.9420.001 {built-in method fetch_row} 711000.4600.0000.5800.000 strategies.py:121(create_row_processor) 2990310.4370.0000.4370.000 {_codecs.utf_8_decode} 60000.4370.0001.7990.000 models.py:93(iteritems) 36000/90000.4090.0004.7910.001 mapper.py:2146(populate_state) 810020.3930.0001.1040.000
[Openstack] Quantum and HTTPD
Over the past day or so, I've made an effort to get Quantum running in HTTPD. My rationale has been to provide: 1. Native SSL support 2. IPv6 3. Certificate based Authentication My goal has been to do this all on Essex without changing the projects' python code base. I'm attempting to do this for all of the Openstack components, and since Quantum has no dependencies, it seemed a good next step after Keystone. The obvious way to set it up should be to use a wsgi file with just from paste.deploy.loadwsgi import loadapp application = loadapp('config:/etc/quantum/quantum.conf', 'quantum') But it fails due to issues finding the plugins (error log at the end of the message). It deploys cleanly once I made the following changes to quantum. --- a/quantum/extensions/extensions.py +++ b/quantum/extensions/extensions.py @@ -538,8 +538,9 @@ class ResourceExtension(object): # Returns the extention paths from a config entry and the __path__ # of quantum.extensions def get_extensions_path(config=None): -paths = ':'.join(quantum.extensions.__path__) -if config: -paths = ':'.join([config.get('api_extensions_path', ''), paths]) +#paths = ':'.join(quantum.extensions.__path__) +paths = /etc/quantum/plugins/ +#if config: +#paths = ':'.join([config.get('api_extensions_path', ''), paths]) return paths Without this, there is a spurious error message due to the leading ':' which puts a blank first element to the path. It also fails to find the extensions path regardless of values put into config files etc. It is this last issue which leads me to highly suggest we push Quantum to get on the openstack-common bandwagon, as its Config file processing is confusing and, I think, broken for the general case. The other issue which leads me to suspect this approach won't work is the fact that the quantum command line client accepts a hostname and a port, but not an URL. So, while we could deploy quantum behind HTTPD and port 443, it would basically be the root of the HTTP directory, and we wouldn't be able to share the HTTPD instance. We couldn't do https://hostname/quantum and put it next to https://hostname/keystone Again, not without a code change. Finally, there seems to be some support for SSL in Quantum. I note that the quantum client has the option -s, --ssl use ssl which leads me to believe that it has been at least attempted. It may be that the quantum server would not be severely impacted by the overhead of SSL in Python. Here's the HTTP error log if I don't make the above change: [Thu Apr 12 11:21:13 2012] [info] Initial (No.1) HTTPS request received for chil d 7 (server ayoungstack.bos.redhat.com:443) [Thu Apr 12 11:21:13 2012] [info] [client 10.16.187.36] mod_wsgi (pid=8747, proc ess='', application='ayoungstack.bos.redhat.com|/quantum/api'): Loading WSGI scr ipt '/var/www/cgi-bin/quantum/api'. [Thu Apr 12 11:21:13 2012] [error] ERROR:quantum.extensions.extensions:Extension path /etc/quantum/extension doesn't exist! [Thu Apr 12 11:21:13 2012] [error] WARNING:quantum.extensions.extensions:extensi on file portstats.py wasnt loaded due to cannot import name extensions [Thu Apr 12 11:21:13 2012] [error] WARNING:quantum.extensions.extensions:extensi on Cisco Nova Tenant not supported by plugin quantum.plugins.openvswitch.ovs_qu antum_plugin.OVSQuantumPlugin object at 0x7f1fae80e450 [Thu Apr 12 11:21:13 2012] [error] WARNING:quantum.extensions.extensions:extensi on Cisco Port Profile not supported by plugin quantum.plugins.openvswitch.ovs_q uantum_plugin.OVSQuantumPlugin object at 0x7f1fae80e450 [Thu Apr 12 11:21:13 2012] [error] WARNING:quantum.extensions.extensions:extensi on Cisco Multiport not supported by plugin quantum.plugins.openvswitch.ovs_quan tum_plugin.OVSQuantumPlugin object at 0x7f1fae80e450 [Thu Apr 12 11:21:13 2012] [error] WARNING:quantum.extensions.extensions:Did not find expected name Extensions in /opt/stack/quantum/quantum/extensions/extens ions.py ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] [SWIFT] Looking for an approach to attach an account or a container in operating system . Like a NAS of SAN driver.
I'm keeping in search and think about the easiest way for users to leverage their swift account. There has several client applications for accessing swift around . Either Windows / Linux / Mac. But eventually , user still need to install a client for this purpose. What if user can attach their own account from swift-proxy (or something else) directly via NFS or CIFS or iscsi target will be much better. As I know , both linux and Windows has application to reach this target. Such as Gladinet Server / S3FS etc. How about provide such interfaces in Swift-proxy ? If there's an exist discussion ticket , please let me know it . Cheers -- +Hugo Kuo+ tonyt...@gmail.com + tonyt...@gmail.com886 935004793 ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] control user quota
I did a quick test in Essex . The process almost same as before(Cactus/Diablo) 1. Manage Quota for a specified Tenant from nova-manage . 2. Manage Default Quota parameters from nova.conf with several flags 3. Hacking Nova source code quota.py for default values. Hope it helps. Xin Zhao xz...@bnl.gov 於 2012年4月12日下午10:27 寫道: Hello, I try to assign quota to individual users, to control how many instances each user can run concurrently. But I don't see a doc describing how to do that. I use diablo release. Any help or doc pointer will be greatly appreciated. Xin __**_ Mailing list: https://launchpad.net/~**openstackhttps://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~**openstackhttps://launchpad.net/~openstack More help : https://help.launchpad.net/**ListHelphttps://help.launchpad.net/ListHelp -- +Hugo Kuo+ tonyt...@gmail.com + tonyt...@gmail.com886 935004793 ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Instance can't reach dhcp or metadata
Hi Mandar, The whole default stuff is a common point of confusion with QuantumManager, and something we're planning on getting rid of in Folsom. For Essex, I've explained the details below. On Wed, Apr 11, 2012 at 8:47 PM, Vaze, Mandar mandar.v...@nttdata.comwrote: Dan, Bug you referred to specifically says “default” tenant – which is not the case for me. I’m not using default tenant – I’m using uuid of “demo” tenant created by stack.sh I suspect you are spinning up VMs using the demo tenant, but unless you have modified your stack.sh, when you create a network using nova-manage, no --project_id flag is specified. Hence, from a Quantum perspective that network does not have a tenant, making this a global network, which is owned by a tenant named default (this string can be changed using the quantum_default_tenant_id flag in nova). For more details on creating quantum networks with nova-manage, see: http://docs.openstack.org/incubation/openstack-network/admin/content/Net-Create-dle455.html BTW, stack.sh creates incorrect entries in quantum/mélange DB, it has tenant ID = “default” – This should be uuid of some valid tenant, not string “default” This is not actually incorrect, given the logic above, though I admit it is confusing. This was really just to provide backward compatibility with old nova-manage calls that did not specify a project. In Folsom, we're planning on requiring a tenant for all Quantum network creation. ** ** FWIW, this setup (although seems incorrect) works with quantum+nova_ipam – not with quantum+mélange i.e. With quantum+nova_ipam I can just create a VM and ssh to it. Yes, quantum + nova-ipam is a much more tested path. I suspect you are just running into the bug I mention below and that your quantum + melange setup would work once you have that patch in, but I don't know of anyone using Melange + DHCP in a real deployment, so I wouldn't be surprised if there were more issues lurking. Dan ** ** -Mandar ** ** *From:* Dan Wendlandt [mailto:d...@nicira.com] *Sent:* Wednesday, April 11, 2012 11:07 PM *To:* Vaze, Mandar *Cc:* Nicolas de BONFILS; openstack@lists.launchpad.net *Subject:* Re: [Openstack] Instance can't reach dhcp or metadata ** ** ** ** On Wed, Apr 11, 2012 at 5:24 AM, Vaze, Mandar mandar.v...@nttdata.com wrote: I have *never* been able to get to ssh to an instance with Quantum+mélange https://lists.launchpad.net/openstack/msg09206.html ** ** Looking at that thread, I suspect you may be hitting the same issue I mentioned above: https://bugs.launchpad.net/quantum/+bug/949234 ** ** If you try that fix and either do or don't have luck with it, please add a comment to the issue. ** ** Dan ** ** -Mandar *From:* openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net[mailto: openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net] *On Behalf Of *Nicolas de BONFILS *Sent:* Wednesday, April 11, 2012 1:45 AM *To:* Dan Wendlandt *Cc:* openstack@lists.launchpad.net *Subject:* Re: [Openstack] Instance can't reach dhcp or metadata Hi, I can't get the ssh connection,VNC doesn't respond and 10.0.0.1 go to localhost (ssh to server itself) --- Nicolas ** ** On Tue, Apr 10, 2012 at 21:42, Dan Wendlandt d...@nicira.com wrote: On Tue, Apr 10, 2012 at 11:54 AM, Nicolas de BONFILS ndebonf...@gmail.com wrote: Things starting to work ! When I boot boot cirros image with ip 10.0.0.1, I can ssh (even if it doesn't accept my password), but when I lauch tty-uec image (or other) with ip starting at 10.0.0.2, ssh tell no route to host If it works on one image, but not another, this is probably an issue with the image itself. The no route to host error is likely because the gateway interface 10.0.0.1 is arping for 10.0.0.2 and not getting a response. Perhaps the image is not configured to use DCHP on the interface? Or is not correctly launching? I'd use VNC to login and check it out. Dan I sum up the actual conf - br-int as bridge in OVS, no other conf (nothing in interfaces file), ifconfig show a 10.0.0.1 ip - nova conf got public_interface=br-int / flat_network_bridge=br-int / flat_interface=eth0 - quantum manage the assignation successfully Thanks --- Nicolas ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- ~~~ Dan Wendlandt Nicira, Inc: www.nicira.com twitter: danwendlandt ~~~
[Openstack] Swift block-level deduplication
Folks, From previous posts on the ML, it seems there are a couple of efforts in train to add distributed content deduping to Swift. My question is whether either or both these approaches involve active client participation in enabling duplicate chunk detection? One could see a spectrum ranging between: 1. Client actively breaks the object into chunks, selects the hashing algorithm, calculates fingerprint and then only uploads if Swift reports that fingerprint is unknown. 2. Client determines which objects are worth deduping, maybe has some influence on chunk size and/or hashing, but fingerprint calculation is all handled internally by Swift. 3. Client is entirely uninvolved, deduplication is handled transparently in the object storage layer and enabled either globally or per-container. If anyone involved has insight into the above, I'd be interested in hearing your thoughts (the context is leveraging dedupe in glance). Cheers, Eoghan ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Netstack] Role of nova-manage network commands when using QuantumManager
Hi Mandar, Thanks for bringing this up. For Essex, nova-manage commands to create/delete Quantum networks must be run on the nova-network node. For Folsom this will all change, as all networks will be created directly against the Quantum API, rather than using nova-manage. I'll add a note to the administrator guide, as this is not called there. Thanks! Dan On Thu, Apr 12, 2012 at 1:38 AM, Vaze, Mandar mandar.v...@nttdata.comwrote: It is my understanding that in multi-node setup : **· **nova-manage can be executed from any machine which may not be running nova-network process. (Or should nova-manage always be run on nova-network node ?) **· **nova-manage does DB operations and delegates the actual networking calls to nova-network process ? ** ** Is this understanding correct ? ** ** I traced “nova-manage network create” and nova-manage network delete” using FlatDHCPManager (default for devstack/stack.sh) Both these calls seem to be doing only DB operations. BTW, nova-network process was shutdown during both “network create” and “network delete” – Still both operations were successful. ** ** But when using QuantumManager as network manager – nova-manage seems to be doing networking operations like “iptables-save” (during network create) and “kill_dhcp” (during network delete) (via linux-net L3 driver) ** ** Since nova-manage command may be executed on a host which isn’t running nova-network – network commands like “iptables” and “kill -9 pid of dnsmasq” on host running nova-manage seems incorrect. ** ** For the first scenario (iptables-save during “network create” – there is already a defect in LP : https://bugs.launchpad.net/nova/+bug/977738 and review : https://review.openstack.org/6451 ** ** I would like your comments and opinions which would help me understand “What nova-manage should and should NOT do” ** ** Thanks, -Mandar ** ** ** ** ** ** ** ** __ Disclaimer:This email and any attachments are sent in strictest confidence for the sole use of the addressee and may contain legally privileged, confidential, and proprietary data. If you are not the intended recipient, please advise the sender by replying promptly to this email and then delete and destroy this email and any attachments without any further use, copying or forwarding -- Mailing list: https://launchpad.net/~netstack Post to : netst...@lists.launchpad.net Unsubscribe : https://launchpad.net/~netstack More help : https://help.launchpad.net/ListHelp -- ~~~ Dan Wendlandt Nicira, Inc: www.nicira.com twitter: danwendlandt ~~~ ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] minimal IaaS openstack installation FROM SOURCE on CentOS
All the tarballs should be available on Launchpad, there are links from the main OpenStack.org page. Most instructions assume getting packages from yum, apt-get, etc but once you get the source installed there are plenty of CentOS specific config docs around. For Nova and Swift: http://wiki.openstack.org/InstallInstructions. For Keystone there's also this https://github.com/timeredbull/references/wiki/Installing-and-configuring-openstack-keystone-in-a-CentOS-6.2which may help. -Paul On Thu, Apr 12, 2012 at 8:31 AM, Mauch, Viktor (SCC) ma...@kit.edu wrote: Hi, ** ** I need to install a minimal/simple Openstack IaaS Deployment framework on CentOS 6.x from Source. ** ** Is there anywhere a nice howto tutorial? ** ** And yes: I know there are packeges, but I need it from source. ** ** Cheers Viktor ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] control user quota
On Thu, 2012-04-12 at 11:10 -0400, Eoghan Glynn wrote: Project-specific quotas may be set via the nova CLI, e.g. $ nova quota-update tenant_ID --instances=50 otherwise the configured default quota is inherited. Since you're still on diablo, the new quota classes mechanism would not be relevant. I should also point out that nova quota-update did not exist in the diablo release of python-novaclient… -- Kevin L. Mitchell kevin.mitch...@rackspace.com ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] control user quota
nova-manage http://nova.openstack.org/runnova/nova.manage.html nova-manage project quota projectname example : #list xin-project 's quota $nova-manage project quota xin-project Will return several key/value #modify a key with new value $nova-manage project quota xin-project --key=??? --value=??? https://github.com/openstack/nova/blob/master/nova/quota.py For configuration flags please refer to the above link of quota.py Xin Zhao xz...@bnl.gov 於 2012年4月13日上午12:15 寫道: Hi Kuo, Could you give more details, like the commands used, and settings in the config file ? I can't find a good example for them. Thanks, Xin On 4/12/2012 12:04 PM, Kuo Hugo wrote: I did a quick test in Essex . The process almost same as before(Cactus/Diablo) 1. Manage Quota for a specified Tenant from nova-manage . 2. Manage Default Quota parameters from nova.conf with several flags 3. Hacking Nova source code quota.py for default values. Hope it helps. Xin Zhao xz...@bnl.gov 於 2012年4月12日下午10:27 寫道: Hello, I try to assign quota to individual users, to control how many instances each user can run concurrently. But I don't see a doc describing how to do that. I use diablo release. Any help or doc pointer will be greatly appreciated. Xin ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- +Hugo Kuo+ tonyt...@gmail.com + tonyt...@gmail.com886 935004793 -- +Hugo Kuo+ tonyt...@gmail.com + tonyt...@gmail.com886 935004793 ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] The Scheduling feature when reboot the instance
No this does not exist. If you are going to overprovision ram, you should probably make sure that you have swap enabled on your host. Vish On Apr 12, 2012, at 4:10 AM, Văn Đình Phúc wrote: Hi. I'm using Openstack (2011.3 (2011.3-nova-milestone-tarball:tarmac-20110922115702-k9nkvxqzhj130av2) with 3 Compute nodes. My scheduling option is default. I have the problem as the following steps: Compute node 1 is installed the modules: nova-api, nova-compute and nova-network. The resource of node-1 max is fitfor 3 instances (m1.small): i-0001, i-0002, i-0003. I turn off i-0001. and then I request new ínstance by the euca-run-instance command , My new instance ( i-0004) is located on the node 1. The resources: RAM , CPU,.. of node-2 and node-3 is available. finally, I reboot the i-0001.What is happen? the i-0001 is rebooted on the node-1 , and It's shutdown off after reboot.I checked the libvirt's log : Failed to allocate 2147483648 B: Cannot allocate memory 2012-04-12 16:11:50.530: shutting down So , Do Openstack have the sheduling feature when rebooting the instance ? Example: As above , My instance (i-0001) will be migrated to node-2 or node-3 when the resource of node-1 is not available. phucvdbmail.gif Văn Đình Phúc Manager - Cloud Team Techno Department Bkav Specialization Division Office: Bkav Building - Yen Hoa New Town, Cau Giay Dist, Hanoi Tel: (84-4) 3763.2552 Mobile: 0169 4702 388 Do your best, the rest will come ! Hãy làm việc hết mình, những điều tốt đẹp sẽ đến với bạn ! Disclaimer: This e-mail and any files transmitted with it are confidential and may contain privileged information. It is intended solely for the use of the individual to whom it is addressed and others authorized to receive it. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. If you have received this message in error, please notify the sender immediately by reply e-mail and delete completely this e-mail from your system, without reproducing, distributing or retaining copies. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] minimal IaaS openstack installation FROM SOURCE on CentOS
Of course I found the tarballs with the source code. However all the centos specific docs I found couldn't really help. Most of them are too old, did not work (concerning several dependency errors) or provide only a single-node-installation What I really search is a detailed step-by-step description, how to install a simple/minimal IaaS Openstack cloud on 2 nodes on CentOS 6.x from source. But thanks for your answer! Cheer vic From: P. Stallworth [mailto:pstallwo...@gmail.com] Sent: Thursday, April 12, 2012 6:15 PM To: Mauch, Viktor (SCC) Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] minimal IaaS openstack installation FROM SOURCE on CentOS All the tarballs should be available on Launchpad, there are links from the main OpenStack.org page. Most instructions assume getting packages from yum, apt-get, etc but once you get the source installed there are plenty of CentOS specific config docs around. For Nova and Swift: http://wiki.openstack.org/InstallInstructions. For Keystone there's also this https://github.com/timeredbull/references/wiki/Installing-and-configuring-op enstack-keystone-in-a-CentOS-6.2 which may help. -Paul On Thu, Apr 12, 2012 at 8:31 AM, Mauch, Viktor (SCC) ma...@kit.edu wrote: Hi, I need to install a minimal/simple Openstack IaaS Deployment framework on CentOS 6.x from Source. Is there anywhere a nice howto tutorial? And yes: I know there are packeges, but I need it from source. Cheers Viktor ___ Mailing list: https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack https://launchpad.net/%7Eopenstack More help : https://help.launchpad.net/ListHelp smime.p7s Description: S/MIME cryptographic signature ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Swift] Does there any exist blueprint or sub-project of user's storage space quota or counting method for Swift ?
Hi Kuo, One option would be to keep the usage information (num files, num bytes, etc) per container / account in an sqlite DB, just like it is done for account and container info. To avoid having to loop through all data at regular intervals (to update the info), additional logic could be added to the api methods to update the sqlite DB's when new files are added, files are deleted, etc. Such approach will require more lines of code, but will be far less stressful on performance. (the brute-force approach to loop through it at regular intervals will be hell on performance on large deployments..) For data transfer billing based on download / upload amounts, a similar approach could be used. If no one else is looking into this, I would certainly be willing to help to help get this started. Kind regards, Frederik Van Hecke *T:* +32487733713 *E:* frede...@cluttr.be *W:* www.cluttr.be *This e-mail and any attachments thereto may contain information which is confidential and/or protected by intellectual property rights and are intended for the sole use of the recipient(s)named above. Any use of the information contained herein (including, but not limited to, total or partial reproduction, communication or distribution in any form) by persons other than the designated recipient(s) is prohibited. If you have received this e-mail in error, please notify the sender either by telephone or by e-mail and delete the material from any computer. Thank you for your cooperation.* On Thu, Apr 12, 2012 at 17:45, Kuo Hugo tonyt...@gmail.com wrote: Hi folks , I'm thinking about the better approach to manage an user or an account space usage quota in swift. Is there any related blueprint or sub-project even an idea around ? Any suggestion of benefits to be an external service or to be a middle-ware in swift-proxy ? I'm concerning about such feature will reduce the performance of entire Swift environment. Appreciate : -- +Hugo Kuo+ tonyt...@gmail.com + tonyt...@gmail.com886 935004793 ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Install instance failed on xenserver 6.0.2
Thanks, the xenapi_connection_url is the problem. Yi On 04/12/2012 05:12 AM, Armando Migliaccio wrote: 1.3GB is more than enough. When you get that message, usually space has already dried up, or there is a problem authenticating with xenapi. Check that: xenapi_connection_url xenapi_connection_password are set correctly, and that you can reach dom0 from your devstack instance. Have a look at your localrc, xenrc, and nova.conf, see if you can find anything wrong with them. Hope this help! Armando On Thu, Apr 12, 2012 at 5:03 AM, Yi Sunbeyo...@gmail.com wrote: Hi, I used devstack to install openstack on my xenserver 6.0.2. I followed the video found in this link http://wiki.openstack.org/XenServer/DevStack. After installation, I can access dashboard. But I failed to launch an instance. I tried to launch image tty, after launching, the instance status field shows Error and there has no new VM showing up in my xencenter. I did a ps ax on my domU VM, I see following nova processes: stack@ALLINONE:~/nova/bin$ ps ax | grep nova 5246 pts/6S+ 0:02 python /opt/stack/nova/bin/nova-api 5325 pts/8S+ 0:03 python /opt/stack/nova/bin/nova-cert 5346 pts/9S+ 0:03 python /opt/stack/nova/bin/nova-volume 5371 pts/10 S+ 0:03 python /opt/stack/nova/bin/nova-network 5426 pts/11 S+ 0:03 python /opt/stack/nova/bin/nova-scheduler 5457 pts/12 S+ 0:00 python ./utils/nova-novncproxy --config-file /etc/nova/nova.conf --web . 5477 pts/13 S+ 0:00 python ./bin/nova-xvpvncproxy --config-file /etc/nova/nova.conf 5497 pts/14 S+ 0:03 python ./bin/nova-consoleauth 5537 pts/16 S+ 0:00 python /opt/stack/nova/bin/nova-objectstore I'm not seeing nova-compute running. So I tried to start it manually, Then I got errors attached in later section. Can someone help to take a look to see if I have missed anything during the installation? Also, is there a way to see find more debug information when failed to launch a instance? BTW-- I checked Dom0, I have 1.3G free space, is that enough to run nova-compute? Thanks Yi 012-04-12 03:42:33 CRITICAL nova [-] Unable to log in to XenAPI (is the Dom0 disk full?) 2012-04-12 03:42:33 TRACE nova Traceback (most recent call last): 2012-04-12 03:42:33 TRACE nova File ./nova-compute, line 47, inmodule 2012-04-12 03:42:33 TRACE nova server = service.Service.create(binary='nova-compute') 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/service.py, line 272, in create 2012-04-12 03:42:33 TRACE nova periodic_fuzzy_delay=periodic_fuzzy_delay) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/service.py, line 167, in __init__ 2012-04-12 03:42:33 TRACE nova self.manager = manager_class(host=self.host, *args, **kwargs) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/compute/manager.py, line 198, in __init__ 2012-04-12 03:42:33 TRACE nova utils.import_object(compute_driver), 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/utils.py, line 90, in import_object 2012-04-12 03:42:33 TRACE nova return cls() 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/connection.py, line 76, in get_connection 2012-04-12 03:42:33 TRACE nova conn = xenapi_conn.get_connection(read_only) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/xenapi_conn.py, line 144, in get_connection 2012-04-12 03:42:33 TRACE nova return XenAPIConnection(url, username, password) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/xenapi_conn.py, line 152, in __init__ 2012-04-12 03:42:33 TRACE nova self._session = XenAPISession(url, user, pw) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/xenapi_conn.py, line 491, in __init__ 2012-04-12 03:42:33 TRACE nova url = self._create_first_session(url, user, pw, exception) 2012-04-12 03:42:33 TRACE nova File /opt/stack/nova/nova/virt/xenapi_conn.py, line 500, in _create_first_session 2012-04-12 03:42:33 TRACE nova session.login_with_password(user, pw) 2012-04-12 03:42:33 TRACE nova File /usr/local/lib/python2.7/dist-packages/XenAPI.py, line 182, inlambda 2012-04-12 03:42:33 TRACE nova return lambda *params: self._login(name, params) 2012-04-12 03:42:33 TRACE nova File /usr/local/lib/python2.7/dist-packages/XenAPI.py, line 148, in _login 2012-04-12 03:42:33 TRACE nova result = _parse_result(getattr(self, 'session.%s' % method)(*params)) 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/xmlrpclib.py, line 1224, in __call__ 2012-04-12 03:42:33 TRACE nova return self.__send(self.__name, args) 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/xmlrpclib.py, line 1575, in __request 2012-04-12 03:42:33 TRACE nova verbose=self.__verbose 2012-04-12 03:42:33 TRACE nova File /usr/lib/python2.7/xmlrpclib.py, line 1264, in request 2012-04-12 03:42:33 TRACE nova return self.single_request(host, handler, request_body, verbose) 2012-04-12 03:42:33 TRACE nova File
Re: [Openstack] [SWIFT] Looking for an approach to attach an account or a container in operating system . Like a NAS of SAN driver.
Hi Kuo, Here are some quick links: https://github.com/redbo/cloudfuse http://gladinet.blogspot.com/2010/10/openstack-windows-client.html I'm running cloudfuse on Ubuntu without much to complain about. Kind regards, Frederik Van Hecke *T:* +32487733713 *E:* frede...@cluttr.be *W:* www.cluttr.be *This e-mail and any attachments thereto may contain information which is confidential and/or protected by intellectual property rights and are intended for the sole use of the recipient(s)named above. Any use of the information contained herein (including, but not limited to, total or partial reproduction, communication or distribution in any form) by persons other than the designated recipient(s) is prohibited. If you have received this e-mail in error, please notify the sender either by telephone or by e-mail and delete the material from any computer. Thank you for your cooperation.* On Thu, Apr 12, 2012 at 17:57, Kuo Hugo tonyt...@gmail.com wrote: I'm keeping in search and think about the easiest way for users to leverage their swift account. There has several client applications for accessing swift around . Either Windows / Linux / Mac. But eventually , user still need to install a client for this purpose. What if user can attach their own account from swift-proxy (or something else) directly via NFS or CIFS or iscsi target will be much better. As I know , both linux and Windows has application to reach this target. Such as Gladinet Server / S3FS etc. How about provide such interfaces in Swift-proxy ? If there's an exist discussion ticket , please let me know it . Cheers -- +Hugo Kuo+ tonyt...@gmail.com + tonyt...@gmail.com886 935004793 ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] minimal IaaS openstack installation FROM SOURCE on CentOS
Devstack just gained support for Fedora, so you could try using it. You might have to make some modifications, but it is just a shell script so it should be easy to read. (From devstack.org) try: git clone git://github.com/openstack-dev/devstack.git cd devstack; ./stack.sh On Apr 12, 2012, at 6:31 AM, Mauch, Viktor (SCC) wrote: Hi, I need to install a minimal/simple Openstack IaaS Deployment framework on CentOS 6.x from Source. Is there anywhere a nice howto tutorial? And yes: I know there are packeges, but I need it from source. Cheers Viktor ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] Remote participation from Design Summit (and conference) was (Re: [Openstack-operators] Health Monitoring Blueprints)
On Wed, 2012-04-11 at 23:13 -0400, Duncan McGreggor wrote: The following channels have been created on Freenode and are registered. #osds-ballroom #osds-seacliff-a-b #osds-seacliff-c #osds-seacliff-d #osds-marina #osds-bayview-a #osds-bayview-b #osds-golden-gate Each channel is also getting logged, viewable via HTTP here: http://irclogs.osds.cogitat.io/ Awesome, thank you Duncan. We have also (thanks to Cisco) https://openstack.webex.com/ that we can use to stream audio from the rooms. Before we sing our happy song, though, we need to jump a few hoops: - test that Webex actually runs on the Ubuntu machines contributed by Zareason - configure the 8 machines - prepare all the Webex events/meetings - update the Summit sessions adding the link to the Webex meetings - install the machines at the conference venue (on Sunday afternoon) - hope things work well on Monday I need volunteers to make all these things happen. Sunday afternoon hand work especially. Contact me in private, please, if you have experience with Webex, have an Ubuntu 11.04 machine for testing purposes and will be in San Francisco on Sunday afternoon to help setup the rooms. thanks, stef ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Quantum and HTTPD
On 04/12/2012 01:05 PM, Dan Wendlandt wrote: Hi Adam, cool stuff! Thanks for reporting the issues. I'm in favor of both changes your suggest. Any interest on working on the openstack common stuff? More details inline. I'll probably help out with common stuff across the board, especially WRT to running in HTTPD and PKI/Cert issues come up. My sorter term goal is to harden an Essex deploy so that it can be used in places where the policies dictate SSL for all communications. Thanks for validating what I saw. Nice to know I don't have to beat my head against it for too long. Any idea how mature the SSL support is that Quantum is using right now? Dan On Thu, Apr 12, 2012 at 8:26 AM, Adam Young ayo...@redhat.com mailto:ayo...@redhat.com wrote: from paste.deploy.loadwsgi import loadapp application = loadapp('config:/etc/quantum/quantum.conf', 'quantum') But it fails due to issues finding the plugins (error log at the end of the message). It deploys cleanly once I made the following changes to quantum. --- a/quantum/extensions/extensions.py +++ b/quantum/extensions/extensions.py @@ -538,8 +538,9 @@ class ResourceExtension(object): # Returns the extention paths from a config entry and the __path__ # of quantum.extensions def get_extensions_path(config=None): -paths = ':'.join(quantum.extensions.__path__) -if config: -paths = ':'.join([config.get('api_extensions_path', ''), paths]) +#paths = ':'.join(quantum.extensions.__path__) +paths = //etc/quantum/plugins// +#if config: +#paths = ':'.join([config.get('api_extensions_path', ''), paths]) return paths Without this, there is a spurious error message due to the leading ':' which puts a blank first element to the path. It also fails to find the extensions path regardless of values put into config files etc. It is this last issue which leads me to highly suggest we push Quantum to get on the openstack-common bandwagon, as its Config file processing is confusing and, I think, broken for the general case. I'm a big proponent of using openstack common as much as possible in Quantum. Much of this existing code was ripped from nova/glance/etc. and is probably now out of date. I created a page in the wiki identifying areas in quantum that are ripe for using openstack-common: http://wiki.openstack.org/QuantumOpenstackCommon . Config if right at the top :) The other issue which leads me to suspect this approach won't work is the fact that the quantum command line client accepts a hostname and a port, but not an URL. So, while we could deploy quantum behind HTTPD and port 443, it would basically be the root of the HTTP directory, and we wouldn't be able to share the HTTPD instance. We couldn't do https://hostname/quantum and put it next to https://hostname/keystone Again, not without a code change. Finally, there seems to be some support for SSL in Quantum. I note that the quantum client has the option -s, --ssl use ssl which leads me to believe that it has been at least attempted. It may be that the quantum server would not be severely impacted by the overhead of SSL in Python. The quantum client is going to get a complete re-write in Folsom, as this is one of our key community projects listed on the wiki: http://wiki.openstack.org/QuantumStarterBugs This new client will match other openstack clients in terms of options, etc. This should mean that you can specify the endpoint as a URL, which should take care of both the SSL and the non-root issues, if I'm understanding you correctly. Jason Koelker will be leading a session in the Quantum track on redesigning the client, if folks are interested in helping out. Here's the HTTP error log if I don't make the above change: [Thu Apr 12 11:21:13 2012] [info] Initial (No.1) HTTPS request received for chil d 7 (server ayoungstack.bos.redhat.com:443 http://ayoungstack.bos.redhat.com:443) [Thu Apr 12 11:21:13 2012] [info] [client 10.16.187.36] mod_wsgi (pid=8747, proc ess='', application='ayoungstack.bos.redhat.com http://ayoungstack.bos.redhat.com|/quantum/api'): Loading WSGI scr ipt '/var/www/cgi-bin/quantum/api'. [Thu Apr 12 11:21:13 2012] [error] ERROR:quantum.extensions.extensions:Extension path /etc/quantum/extension doesn't exist! [Thu Apr 12 11:21:13 2012] [error] WARNING:quantum.extensions.extensions:extensi on file portstats.py wasnt loaded due to cannot import name extensions [Thu Apr 12 11:21:13 2012] [error] WARNING:quantum.extensions.extensions:extensi on Cisco Nova Tenant not supported by plugin quantum.plugins.openvswitch.ovs_qu antum_plugin.OVSQuantumPlugin object at 0x7f1fae80e450 [Thu Apr 12 11:21:13 2012]
Re: [Openstack] ERROR: string indices must be integers, not str
Thanks Mandar, that was my problem. From: mandar.v...@nttdata.com To: guib...@hotmail.com; openstack@lists.launchpad.net Subject: RE: [Openstack] ERROR: string indices must be integers, not str Date: Thu, 12 Apr 2012 11:02:44 + You may have his this bug : https://bugs.launchpad.net/nova/+bug/965826 Says : this occurs “When auth_host (in api-paste.ini) has the wrong IP address” Something to check … -Mandar From: openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net [mailto:openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net] On Behalf Of Guilherme Birk Sent: Wednesday, April 11, 2012 10:38 PM To: Openstack Mail List Subject: [Openstack] ERROR: string indices must be integers, not str I've got OpenStack working with this tutorial http://www.hastexo.com/resources/docs/installing-openstack-essex-20121-ubuntu-1204-precise-pangolin. Now I'm trying to deploy a new installation with the official manual, http://docs.openstack.org/trunk/openstack-compute/install/content/index.html. I can access dashboard, upload images and other things, but when I try to execute a nova list, or after connect to dashboard, I got this error: ERROR: string indices must be integers, not str. Anyone had this problem too? Maybe some wrong configuration? __ Disclaimer:This email and any attachments are sent in strictest confidence for the sole use of the addressee and may contain legally privileged, confidential, and proprietary data. If you are not the intended recipient, please advise the sender by replying promptly to this email and then delete and destroy this email and any attachments without any further use, copying or forwarding ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [openstack] Error Unable to list users: [Errno 110] ETIMEDOUT
All my services are running, including the nova-api. I can't see anything wrong on nova-api.log .. How can I fix or where can I find informations about that? Lucian Thomaz From: diego.parrilla.santama...@gmail.com Date: Thu, 12 Apr 2012 15:05:17 +0200 Subject: Re: [Openstack] [openstack] Error Unable to list users: [Errno 110] ETIMEDOUT To: luciantho...@hotmail.com CC: openstack@lists.launchpad.net Sounds like you have access to keystone, but you don't have access to nova-api...-- Diego Parrilla CEO www.stackops.com | diego.parri...@stackops.com | +34 649 94 43 29 | skype:diegoparrilla On Thu, Apr 12, 2012 at 2:56 PM, Lucian Thomaz luciantho...@hotmail.com wrote: Hi folks, I have a diablo installation with Dashboard and I'm having the following error when I try access Tenants or Users on Dashboard: Error Unable to get tenant info: [Errno 110] ETIMEDOUT Error Unable to list users: [Errno 110] ETIMEDOUT Has anyone had this problem? Lucian Thomaz ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Quantum and HTTPD
On Thu, Apr 12, 2012 at 10:16 AM, Adam Young ayo...@redhat.com wrote: On 04/12/2012 01:05 PM, Dan Wendlandt wrote: Hi Adam, cool stuff! Thanks for reporting the issues. I'm in favor of both changes your suggest. Any interest on working on the openstack common stuff? More details inline. I'll probably help out with common stuff across the board, especially WRT to running in HTTPD and PKI/Cert issues come up. My sorter term goal is to harden an Essex deploy so that it can be used in places where the policies dictate SSL for all communications. Thanks for validating what I saw. Nice to know I don't have to beat my head against it for too long. Any idea how mature the SSL support is that Quantum is using right now? I do not. I don't know of any deployments using it right now. Its likely that we just have whatever code came along for the ride when the web framework was borrowed from nova/glance. Salvatore might know, as he did a lot of the heavy lifting on the Quantum API side. Dan Dan On Thu, Apr 12, 2012 at 8:26 AM, Adam Young ayo...@redhat.com wrote: from paste.deploy.loadwsgi import loadapp application = loadapp('config:/etc/quantum/quantum.conf', 'quantum') But it fails due to issues finding the plugins (error log at the end of the message). It deploys cleanly once I made the following changes to quantum. --- a/quantum/extensions/extensions.py +++ b/quantum/extensions/extensions.py @@ -538,8 +538,9 @@ class ResourceExtension(object): # Returns the extention paths from a config entry and the __path__ # of quantum.extensions def get_extensions_path(config=None): -paths = ':'.join(quantum.extensions.__path__) -if config: -paths = ':'.join([config.get('api_extensions_path', ''), paths]) +#paths = ':'.join(quantum.extensions.__path__) +paths = */etc/quantum/plugins/* +#if config: +#paths = ':'.join([config.get('api_extensions_path', ''), paths]) return paths Without this, there is a spurious error message due to the leading ':' which puts a blank first element to the path. It also fails to find the extensions path regardless of values put into config files etc. It is this last issue which leads me to highly suggest we push Quantum to get on the openstack-common bandwagon, as its Config file processing is confusing and, I think, broken for the general case. I'm a big proponent of using openstack common as much as possible in Quantum. Much of this existing code was ripped from nova/glance/etc. and is probably now out of date. I created a page in the wiki identifying areas in quantum that are ripe for using openstack-common: http://wiki.openstack.org/QuantumOpenstackCommon . Config if right at the top :) The other issue which leads me to suspect this approach won't work is the fact that the quantum command line client accepts a hostname and a port, but not an URL. So, while we could deploy quantum behind HTTPD and port 443, it would basically be the root of the HTTP directory, and we wouldn't be able to share the HTTPD instance. We couldn't do https://hostname/quantum and put it next to https://hostname/keystone Again, not without a code change. Finally, there seems to be some support for SSL in Quantum. I note that the quantum client has the option -s, --ssl use ssl which leads me to believe that it has been at least attempted. It may be that the quantum server would not be severely impacted by the overhead of SSL in Python. The quantum client is going to get a complete re-write in Folsom, as this is one of our key community projects listed on the wiki: http://wiki.openstack.org/QuantumStarterBugs This new client will match other openstack clients in terms of options, etc. This should mean that you can specify the endpoint as a URL, which should take care of both the SSL and the non-root issues, if I'm understanding you correctly. Jason Koelker will be leading a session in the Quantum track on redesigning the client, if folks are interested in helping out. Here's the HTTP error log if I don't make the above change: [Thu Apr 12 11:21:13 2012] [info] Initial (No.1) HTTPS request received for chil d 7 (server ayoungstack.bos.redhat.com:443) [Thu Apr 12 11:21:13 2012] [info] [client 10.16.187.36] mod_wsgi (pid=8747, proc ess='', application='ayoungstack.bos.redhat.com|/quantum/api'): Loading WSGI scr ipt '/var/www/cgi-bin/quantum/api'. [Thu Apr 12 11:21:13 2012] [error] ERROR:quantum.extensions.extensions:Extension path /etc/quantum/extension doesn't exist! [Thu Apr 12 11:21:13 2012] [error] WARNING:quantum.extensions.extensions:extensi on file portstats.py wasnt loaded due to cannot import name extensions [Thu Apr 12 11:21:13 2012] [error] WARNING:quantum.extensions.extensions:extensi on Cisco Nova Tenant not supported by plugin quantum.plugins.openvswitch.ovs_qu
Re: [Openstack] I18n issue for OpenStack
So u have just touched on another issue, I would still say that exception messages should not be translated (+1), haha. If this is needed, then there is something wrong with the code and how exceptions are used instead (ie the bad code smell). Exceptions should be meant for error control flow, what they were designed for, not for user facing messages. I think it is more common to have a layer that translates exceptions into meaningful localized messages, but there needs to be a separation between exceptions and there localized messages (they should not be combined). This is a common thing afaik, its called separation of model and view, aka, mvc, (think of the exceptions as a model/controller(?), if the messages – the view are intertwined that seems broke). This is common with a lot of other parts of openstack as well, ec2 formatting/response creation should be separated from nova logic (ec2 should be a view, which it mostly is right now) and so on... On 4/12/12 4:27 AM, Hua ZZ Zhang zhu...@cn.ibm.com wrote: My cents: Apache HTTP is not so equivelant to OpenStack here. Generally it doesn't care about the application errors or exceptions thrown by web applications. In openstack, exceptions have been defined in nova, horizon, keystone etc. The messages of these exceptions are important for different users to understand what has happened. These messages always need to be localized, returned and displayed on user interface, not just be logged in backend system. It is very common practice for a global software project. Sean Dague wrote: If we want to think about OpenStack as a basic building block like Apache, i18n is critical. Otherwise there are regions that won't adopt it solely because of a lack of i18n. Note that Apache HTTPd, for instance, does not seem to internationalize its error messages. Only the (enduser-facing) HTML pages it gives back in response to invalid requests are. Best Regards, Edward Zhang(张华) Staff Software Engineer TravelTransportation Standards Emerging Technology Institute(ETI) IBM China Software Development Lab e-mail: zhu...@cn.ibm.com Notes ID: Hua ZZ Zhang/China/IBM Tel: 86-10-82450483地址:北京市海淀区东北旺西路8号 中关村软件园28号楼 环宇大厦3层 邮编:100193 Address: 3F Ring, Building 28 Zhongguancun Software Park, 8 Dongbeiwang West Road, Haidian District, Beijing, P.R.C.100193 [cid:3417071582_3128387][cid:3417071582_3146577] [cid:3417071582_3132379] [cid:3417071582_3124536]Thierry Carrez ---2012-04-12 16:51:59---Sean Dague wrote: Thierry Carrez thie...@openstack.org Sent by: openstack-bounces+zhuadl=cn.ibm@lists.launchpad.net 2012-04-12 16:47 [cid:3417071582_3170778] To [cid:3417071582_3169928] openstack@lists.launchpad.net [cid:3417071582_3171998] cc [cid:3417071582_3154088] [cid:3417071582_3146520] Subject [cid:3417071582_3157167] Re: [Openstack] I18n issue for OpenStack [cid:3417071582_3126377][cid:3417071582_3170799] Sean Dague wrote: If we want to think about OpenStack as a basic building block like Apache, i18n is critical. Otherwise there are regions that won't adopt it solely because of a lack of i18n. Note that Apache HTTPd, for instance, does not seem to internationalize its error messages. Only the (enduser-facing) HTML pages it gives back in response to invalid requests are. Is there a metric on the completeness so far? Something automated that could be a jenkins coverage kind of test? Oddly enough, it's not a question of completeness of translations. Piggybacking on the awesome Launchpad Translations community always gave us great coverage. It's more a code support and CI integration issue. inline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gif___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] profiling nova-api
Hi Jay, I will take a look later when I find a box with multiple cores to take advantage it.. Agreed - cprofiling is not so useful this case. This would be a purely performance benchmark. If implemented correctly, we should see a notable gain. However, It will probably not that linear because we might hit keystone's performance issue later. It looks like the second CPU hogger behind nova-api. Is there a multiprocess keystone too? Yun On Thu, Apr 12, 2012 at 9:49 AM, Jay Pipes jaypi...@gmail.com wrote: Hi Yun! Thanks very much for sharing this information. Can I ask you to pull the code in this branch: https://review.openstack.org/#change,5762 And retry your test? On my test machines, the work that Huang Zhiteng has done to convert Nova's servers to use multiple operating system processes, each with its own greenthread service pool, resulted in a massive throughput improvement, turning a quickly-bottlenecked system into a server that could scale nearly linearly with the number of worker processes. Be sure to set osapi_workers to the number of cores your machine has... and also note that your code profiling technique is unlikely to be effective since cProfile wouldn't track the forked child worker processes' stacks, AFAIK. Still interested to see if the time to execute the 300 API calls is dramatically reduced, though. Looking forward to any results you might have. Best, -jay On 04/11/2012 04:48 PM, Yun Mao wrote: Hi Stackers, I spent some time looking at nova-api today. Setup: everything-on-one-node devstack, essex trunk. I setup 1 user with 10 tiny VMs. Client: 3 python threads each doing a loop of nova list equivalent for 100 times. So 300 API calls with concurrency=3. how to profile: python -m cProfile -s time /opt/stack/nova/bin/nova-api --flagfile=/etc/nova/nova.conf --logdir=/var/log/nova --nodebug The partial output is attached in the end. Observations: * It takes about 60 seconds to finish. CPU of nova-api is around 70% to 90% * Database access: Each nova list API call will issue 4 db APIs: 3 instance_get_all_by_filters(), 1 instance_fault_get_by_instance_uuids(), so 1200 db API calls total (note: not necessarily 1200 SQL statements, could be more). The 900 instance_get_all_by_filters() calls took 30.2 seconds (i.e. 0.03s each)! The 300 instance_fault_get_by_instance_uuids() calls only took 1.129 seconds (0.004 each). You might think: MySQL sucks. Not so fast. Remember this is a tiny database with only 10 VMs. Profile also shows that the actual _mysql.connection.query() method only took 1.883 seconds in total. So, we pretty much spend 29 seconds out of 60 seconds doing either sqlalchemy stuff or our own wrapper. You can also see from the sheer volume of sqlalchemy library calls involved. * the cfg.py library inefficiency. During 300 API calls, common.cfg.ConfigOpts._get() is called 135005 times! and we paid 2.470 sec for that. Hopefully this is useful for whoever wants to improve the performance of nova-api. Thanks, Yun === 23355694 function calls (22575841 primitive calls) in 77.874 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 812 25.725 0.032 25.725 0.032 {method 'poll' of 'select.epoll' objects} 2408 1.883 0.001 1.883 0.001 {method 'query' of '_mysql.connection' objects} 70380 1.667 0.000 7.187 0.000 expression.py:2263(corresponding_column) 135005 1.254 0.000 2.470 0.000 cfg.py:1058(_get) 41027 1.043 0.000 1.907 0.000 schema.py:542(__init__) 38802 1.008 0.000 1.219 0.000 __init__.py:451(format) 162206 0.821 0.000 0.821 0.000 util.py:883(values) 1530666 0.773 0.000 0.774 0.000 {isinstance} 135046/134960 0.716 0.000 1.919 0.000 cfg.py:1107(_substitute) 1205 0.713 0.001 1.369 0.001 base.py:2106(__init__) 183600 0.690 0.000 0.796 0.000 interfaces.py:954(_reduce_path) 81002 0.687 0.000 2.492 0.000 compiler.py:312(visit_label) 38802 0.650 0.000 6.087 0.000 log.py:227(format) 319270 0.622 0.000 0.748 0.000 attributes.py:164(__get__) 890242/884229 0.608 0.000 1.885 0.000 {getattr} 40500 0.605 0.000 3.101 0.000 schema.py:955(_make_proxy) 120783/120738 0.603 0.000 0.605 0.000 {method 'sub' of '_sre.SRE_Pattern' objects} 81000 0.601 0.000 2.156 0.000 interfaces.py:677(create_row_processor) 63000 0.590 0.000 0.707 0.000 times.py:44(DateTime_or_None) 98102 0.588 0.000 0.886 0.000 compiler.py:337(visit_column) 658098 0.580 0.000 0.581 0.000 {method 'intersection' of 'set' objects} 109802 0.562 0.000 0.562 0.000 expression.py:3625(_from_objects) 231610/1202 0.551 0.000 5.813 0.005
Re: [Openstack] minimal IaaS openstack installation FROM SOURCE on CentOS
I have it running from source in a more-production-environment than devstack, though on Debian... https://github.com/justinsb/openstack-simple-config Would you like to collaborate on fixing this up for CentOS the Essex release? It was working a week or two before feature freeze, and post Keystone redux, so it should be good, so it should mostly be CentOS differences. More production-ready = won't wipe your data if you type the wrong thing into devstack :-) I'm hoping to establish a baseline of a recommended way to package OpenStack. I'm leading a Design Summit session about this, I believe! Justin On Thu, Apr 12, 2012 at 10:09 AM, Vishvananda Ishaya vishvana...@gmail.comwrote: Devstack just gained support for Fedora, so you could try using it. You might have to make some modifications, but it is just a shell script so it should be easy to read. (From devstack.org) try: git clone git://github.com/openstack-dev/devstack.git cd devstack; ./stack.sh On Apr 12, 2012, at 6:31 AM, Mauch, Viktor (SCC) wrote: Hi, ** ** I need to install a minimal/simple Openstack IaaS Deployment framework on CentOS 6.x from Source. ** ** Is there anywhere a nice howto tutorial? ** ** And yes: I know there are packeges, but I need it from source. ** ** Cheers Viktor ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Swift block-level deduplication
Thanks for the response Caitlin, The versioning/dedup ring we are working on at Nexenta will support both 1 and 3. I'll be presenting at the Summit on this. Great, I'll look forward to your presentation. The ultimate goal of distributed dedup is scenario #1. Only the client software can determine the optimum chunk boundaries, Agreed, this is where the maximum savings can be acheived, at the cost of imposing some complexity on the client layer. I'd be interested in using glance as a proof-point for this approach, its one of the topics I intended to discuss at the summit as part of this session: http://summit.openstack.org/sessions/view/78 Cheers, Eoghan ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Swift block-level deduplication
Eoghan Glynn wrote: The ultimate goal of distributed dedup is scenario #1. Only the client software can determine the optimum chunk boundaries, Agreed, this is where the maximum savings can be acheived, at the cost of imposing some complexity on the client layer. I'd be interested in using glance as a proof-point for this approach, its one of the topics I intended to discuss at the summit as part of this session: http://summit.openstack.org/sessions/view/78 A lot of the features you are referencing here are good ideas, but I think they belong as part of a Volume Service, rather than Glance. Glance deals with boot images and their metadata specifically. The optimizations you reference apply to Volume storage in general. From a distributed Deduplication perspective a Volume is just a collection of deduplicated Chunks, making it pretty much the same as an Object. But dedup is not the primary issue for volumes, but rather enabling efficient cloning so that then 100 VM's running a given OS can share the 95% of their boot drive that they have not modified. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Templates for slides?
Stefano Marfuli wrote: For the summit, I don't think the standard is: use what you're familiar with :) Speaking from experience here, don't forget to remove the XYZ Company Confidential from your template though. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Image API v2 Draft 4
A little fuel for the fire / entertainment before the summit: http://www.mnot.net/blog/2012/04/13/json_or_xml_just_decide Cheers, On 10/04/2012, at 3:56 PM, Vishvananda Ishaya wrote: On Apr 10, 2012, at 2:26 AM, Thierry Carrez wrote: Jay Pipes wrote: I take it you didn't attend the glorious JSON debate of a couple of summits ago :-) Glorious it was indeed. I think the key quote was something like: Please don't bastardize my JSON with your XML crap According to my twitter, the actual quote was: Don't bring your XML filth into my JSON Vish ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Mark Nottingham http://www.mnot.net/ ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [SWIFT] Looking for an approach to attach an account or a container in operating system . Like a NAS of SAN driver.
On Thu, 12 Apr 2012 23:57:59 +0800 Kuo Hugo tonyt...@gmail.com wrote: What if user can attach their own account from swift-proxy (or something else) directly via NFS or CIFS or iscsi target will be much better. Would it not be easier to use an actual filesystem for that, like GlusterFS? I don't quite see the point of layering a filesystem API adaptor on top of Swift. Since applications that import a filesystem API expect filesystem characteristics, performance is going to be fragile at best. -- Pete ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [SWIFT] Looking for an approach to attach an account or a container in operating system . Like a NAS of SAN driver.
I made some patches to cloudfuse to get it to support Keystone auth: http://blog.justinsb.com/blog/2012/03/29/openstack-storage-with-fuse/ I'd like to get this merged upstream, but haven't heard anything on my pull request... Redbo? Bueller? :-) I also saw an SFTP gateway floating about somewhere; that also seemed like a good approach. Should we make cloudfuse an openstack hosted project? Frederik: If you do have any issues that should be fixed, I'd love to know what they are! Justin On Thu, Apr 12, 2012 at 10:03 AM, Frederik Van Hecke frede...@cluttr.bewrote: Hi Kuo, Here are some quick links: https://github.com/redbo/cloudfuse http://gladinet.blogspot.com/2010/10/openstack-windows-client.html I'm running cloudfuse on Ubuntu without much to complain about. Kind regards, Frederik Van Hecke *T:* +32487733713 *E:* frede...@cluttr.be *W:* www.cluttr.be *This e-mail and any attachments thereto may contain information which is confidential and/or protected by intellectual property rights and are intended for the sole use of the recipient(s)named above. Any use of the information contained herein (including, but not limited to, total or partial reproduction, communication or distribution in any form) by persons other than the designated recipient(s) is prohibited. If you have received this e-mail in error, please notify the sender either by telephone or by e-mail and delete the material from any computer. Thank you for your cooperation.* On Thu, Apr 12, 2012 at 17:57, Kuo Hugo tonyt...@gmail.com wrote: I'm keeping in search and think about the easiest way for users to leverage their swift account. There has several client applications for accessing swift around . Either Windows / Linux / Mac. But eventually , user still need to install a client for this purpose. What if user can attach their own account from swift-proxy (or something else) directly via NFS or CIFS or iscsi target will be much better. As I know , both linux and Windows has application to reach this target. Such as Gladinet Server / S3FS etc. How about provide such interfaces in Swift-proxy ? If there's an exist discussion ticket , please let me know it . Cheers -- +Hugo Kuo+ tonyt...@gmail.com + tonyt...@gmail.com886 935004793 ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Image API v2 Draft 4
I may disagree with a couple of the points along the way; but I agree with the conclusion for OpenStack. Thanks for writing it! Justin PS vim or emacs? On Thu, Apr 12, 2012 at 12:58 PM, Mark Nottingham m...@mnot.net wrote: A little fuel for the fire / entertainment before the summit: http://www.mnot.net/blog/2012/04/13/json_or_xml_just_decide Cheers, On 10/04/2012, at 3:56 PM, Vishvananda Ishaya wrote: On Apr 10, 2012, at 2:26 AM, Thierry Carrez wrote: Jay Pipes wrote: I take it you didn't attend the glorious JSON debate of a couple of summits ago :-) Glorious it was indeed. I think the key quote was something like: Please don't bastardize my JSON with your XML crap According to my twitter, the actual quote was: Don't bring your XML filth into my JSON Vish ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Mark Nottingham http://www.mnot.net/ ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Laptop Demo Environment
I also recommend you use devstack to build an all-in-one Openstack environment. I have searched so many instructions in Google, but few of them can works fine. Sam On Tue, Apr 10, 2012 at 6:34 AM, Lance Haig lh...@haigmail.com wrote: On 10/04/12 14:09, Vaze, Mandar wrote: Would http://devstack.org/guides/**single-machine.htmlhttp://devstack.org/guides/single-machine.htmlwork for you ? (Or does it need to be installed from packages) -Mandar Hi Mandar, I used devstack before and I would prefer to build the environment manually to learn how each piece behaves and integrates Thanks Lance -- This message was scanned by Better Hosted and is believed to be clean. http://www.betterhosted.com __**_ Mailing list: https://launchpad.net/~**openstackhttps://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~**openstackhttps://launchpad.net/~openstack More help : https://help.launchpad.net/**ListHelphttps://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Where does Keystone middleware for Swift belong?
Hi John, On 2012-04-11, at 8:03 PM, John Dickinson wrote: I do not think that these pieces of middleware belong in the core swift repo. Understood. 1) Including them in swift would require swift to depend on keystone for full testing. As I mentioned in my initial email, the modules in question depend on Keystone only at the protocol level, and the unit tests run without any dependence on Keystone. I'm presuming that by 'full testing' you mean the currently non-existent functional tests? 2) (When the middleware was created) Keystone's API was in a state of constant flux. Keystone has changed quite a bit since then, so this may not be the case anymore. As of the essex release, the API and protocol used to communicate identity via the environment can be considered more or less stable. 3) Swift does not require Keystone to run (and in fact many production environments don't use keystone at all). [1] Definitely a good point. 4) We have previously removed auth systems from swift's core code in order to simplify the codebase and allow separate dev cycles. All that is included now is the most basic auth system required for dev work, stand-alone tests, and POC deployments. Our thought thus far has been that auth systems providing auth for swift have the responsibility to maintain their integration code. It's not swift's responsibility to manage and maintain code for every auth system that wants to provide an auth mechanism for swift. I understand - swift core doesn't want to take on responsibility for integrating with different auth systems. That being said, there has been quite a bit of recent conversation about the concept of *-contrib areas for each project that include optional add-ons/extensions/plugins/etc or alternative APIs for each project. I expect these conversations to continue next week in person at the summit. One option is for the swift keystone middleware to be a part of such a contrib area. It sounds like there are good reasons for both projects to not want to include these pieces of middleware in their respective core repos. Perhaps a contrib area can be a compromise, but that does not answer who is responsible for it (ie who maintains the code?). I think that's a separate, but related, question. +1 for allowing non-core functionality to be included via a 'contrib'-rooted package rather than having to reside outside the repo it targets. Regardless of whether it is included as 'contrib' or not, would would you have any interest in my factoring out common functionality from tempauth/swauth and making it available for reuse? From my understanding, a swift auth mechanism has 3 parts - authentication (authn), token authentication (token_authn), and authorization (authz). Both of the main implementations (tempauth and swauth) implement all 3 parts independently, though the only thing that differs between them is the authn backend. The swift_auth middleware from Keystone similarly duplicates the authz functionality of tempauth and swauth. If the common stuff could be extracted and made available as library modules or base classes, the cost of maintaining any given auth mechanism would be greatly reduced, and creating a new mechanism would be that much easier. Please let me know your thoughts. Cheers, Maru ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Endpoints problems
On Thu, 12 Apr 2012 15:28:21 -0500 Anne Gentle a...@openstack.org wrote: keystone --token 012345SECRET99TOKEN012345 --endpoint http://192.168.206.130:35357/v2.0 endpoint-create \ [] --internalurl http://192.168.206.130:8774/v2/$(tenant_id)s I haven't fixed this yet because I'm not sure if the $(tenant_id)s is literal or which tenant_id specifically to use (the Service tenant for the adminurl possibly)? The expression $(tenant_id)s is really contained inside the pattern in the database. It is substituded with a specific tennant ID when an application makes its request. The weird syntax is inherited from Python, where one can use constructs like %s or %(key)s. -- Pete ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] I18n issue for OpenStack
I agree that non-user visible protocol elements should not be translated. I think we need to dig more on the error messages. E.g., see: http://docs.openstack.org/api/openstack-compute/2/content/Asynchronous_Faults-d1e2009.html The example there contains: Could not find image 52415800-8b69-11e0-9b19-734f6f00 Which, as is, will need translation. Should it be redesigned? Probably. All of that aside, there are other potentially user-visible aspects of the Nova API (to pick on it for a moment), including machine names and metadata. E.g., http://docs.openstack.org/api/openstack-compute/2/content/Create_or_Replace_Metadata-d1e5358.html Now, both XML and JSON support Unicode, but: * We don't have language flagging here; is it needed? (My tentative answer: maybe, but hopefully not). * If we do, do we allow multiple values for the same key, to allow it to be multilingual? (same hope as above). etc. I think I brought this up a while back, and was told that it wasn't in-scope yet. Perhaps with our growing community, that needs another look? Cheers, On 12/04/2012, at 12:33 PM, Joshua Harlow wrote: So u have just touched on another issue, I would still say that exception messages should not be translated (+1), haha. If this is needed, then there is something wrong with the code and how exceptions are used instead (ie the bad code smell). Exceptions should be meant for error control flow, what they were designed for, not for user facing messages. I think it is more common to have a layer that translates exceptions into meaningful localized messages, but there needs to be a separation between exceptions and there localized messages (they should not be combined). This is a common thing afaik, its called separation of model and view, aka, mvc, (think of the exceptions as a model/controller(?), if the messages – the view are intertwined that seems broke). This is common with a lot of other parts of openstack as well, ec2 formatting/response creation should be separated from nova logic (ec2 should be a view, which it mostly is right now) and so on... On 4/12/12 4:27 AM, Hua ZZ Zhang zhu...@cn.ibm.com wrote: My cents: Apache HTTP is not so equivelant to OpenStack here. Generally it doesn't care about the application errors or exceptions thrown by web applications. In openstack, exceptions have been defined in nova, horizon, keystone etc. The messages of these exceptions are important for different users to understand what has happened. These messages always need to be localized, returned and displayed on user interface, not just be logged in backend system. It is very common practice for a global software project. Sean Dague wrote: If we want to think about OpenStack as a basic building block like Apache, i18n is critical. Otherwise there are regions that won't adopt it solely because of a lack of i18n. Note that Apache HTTPd, for instance, does not seem to internationalize its error messages. Only the (enduser-facing) HTML pages it gives back in response to invalid requests are. Best Regards, Edward Zhang(张华) Staff Software Engineer TravelTransportation Standards Emerging Technology Institute(ETI) IBM China Software Development Lab e-mail: zhu...@cn.ibm.com Notes ID: Hua ZZ Zhang/China/IBM Tel: 86-10-82450483地址:北京市海淀区东北旺西路8号 中关村软件园28号楼 环宇大厦3层 邮编:100193 Address: 3F Ring, Building 28 Zhongguancun Software Park, 8 Dongbeiwang West Road, Haidian District, Beijing, P.R.C.100193 image.gifimage.gif image.gif image.gifThierry Carrez ---2012-04-12 16:51:59---Sean Dague wrote: Thierry Carrez thie...@openstack.org Sent by: openstack-bounces+zhuadl=cn.ibm@lists.launchpad.net 2012-04-12 16:47 image.gif To image.gif openstack@lists.launchpad.net image.gif cc image.gif image.gif Subject image.gif Re: [Openstack] I18n issue for OpenStack image.gifimage.gif Sean Dague wrote: If we want to think about OpenStack as a basic building block like Apache, i18n is critical. Otherwise there are regions that won't adopt it solely because of a lack of i18n. Note that Apache HTTPd, for instance, does not seem to internationalize its error messages. Only the (enduser-facing) HTML pages it gives back in response to invalid requests are. Is there a metric on the completeness so far? Something automated that could be a jenkins coverage kind of test? Oddly enough, it's not a question of completeness of translations. Piggybacking on the awesome Launchpad Translations community always gave us great coverage. It's more a code support and CI integration issue. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Mark Nottingham http://www.mnot.net/
Re: [Openstack] Image API v2 Draft 4
On 04/12/2012 03:58 PM, Mark Nottingham wrote: A little fuel for the fire / entertainment before the summit: http://www.mnot.net/blog/2012/04/13/json_or_xml_just_decide I *have* to point out that your article is published on Friday the 13th. Just sayin' :) -jay ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] I18n issue for OpenStack
A good idea to separate into two parts, however I fear that the current English strings don't serve the first role as well as first appears. This has to do with the pre-processing we do on error strings to make more accurate searches and error report titles. A quick, very artificial example: Unable to get service info: Malformed request url As English speakers, we can look at this and see that Unable to get service info is what happened, and Malformed request url is why. So, knowing that there are probably many possible reasons for 'why' we were Unable to get service info, we might chop this part out of our search term, or when we ask for help - and indeed you can see an example of this in a title here: https://answers.launchpad.net/horizon/+question/190188 In other languages sometimes the sentence order is much different. For example, in Chinese, that error could be written something like: 因为错误格式的请求URL所以无法获得服务信息 As a Chinese speaker, you know what this says and you can work out the 'why' and the 'what' in your search term. As a non-Chinese speaker, you're stuck putting the whole thing into your search engine and hoping that no-one chopped off or changed the structural elements of the sentence such as 因为 and 所以. So, perhaps the part that can be used for searches and bug reports really does need to be 'locale-independent'. Complex system of impossible to understand error numbers, anyone? ;) Regards, Tom On 04/12/2012 11:46 PM, David Kranz wrote: Both points of view being expressed about this with respect to log error messages are valid and need to be accommodated. An answer, as was suggested a while back, is for error messages to have two parts: 1. A locale-independent part that can be used for searches or understood by developers who get logs as parts of bug reports. 2. A localized part that lets operators determine if the problem is their issue or an OpenStack bug to be reported. The current English string would serve the first role, and the logging code could be changed to also emit the localized string if available. I would argue for this only in the case of ERROR messages and not DEBUG. While on the subject of logs, it would be good to agree on what actions should cause errors in logs to appear. Ideally, they would only occur if an OpenStack bug was detected (out-of-bounds array ref, etc.) or some operational problem occurred (disk ran out of space, etc.). Right now errors are sometimes output for other reasons such as bad arguments to api calls. This makes it difficult for an operator to know when a real problem with the system has occurred. David Kranz Quanta Research Cambridge On 4/12/2012 9:06 AM, Sheng Bo Hou wrote: Dear OpenStack friends, It will be happy and great for our OpenStack community to see this open project open to more market all over the world. In China, OpenStack community is very active. I heard many Chinese engineers talking about their wish to have a Chinese versioned openStack, including documentation's, manuals, user interfaces, error messages, etc in OpenStack meet-ups. I have many European friends and also Danish friends, since I used to do my university there. They all spoke perfect English, which made me admire, cos they were linguists in my point of view. Oriental languages are different. They are too far from the western lingual system. In China, there are many talented engineers, who are not that kind of linguists, but they are lover of open source. I think it is amazing to open the door to them. In China, it is very appreciated for software to be localized as much as possible. I used to google or baidu(a famous Chinese search engine) error messages and logs in Chinese for other software, though it is not Apache. I found a lot of useful references in Chinese, because it has been localized. If it is not localized well first, of course it does not have the google or yahoo ability to search.:-) So far I am rather grateful for all the messages following this i18 issue. Thank you so much. Best wishes. Vincent Hou (侯胜博) Software Engineer, Standards Growth Team, Emerging Technology Institute, IBM China Software Development Lab Tel: 86-10-82450778 Fax: 86-10-82453660 Notes ID: Sheng Bo Hou/China/IBM@IBMCN E-mail: sb...@cn.ibm.com Address:3F Ring, Building 28 Zhongguancun Software Park, 8 Dongbeiwang West Road, Haidian District, Beijing, P.R.C.100193 *Soren Hansen so...@linux2go.dk* Sent by: openstack-bounces+sbhou=cn.ibm@lists.launchpad.net 2012-04-12 19:50 To Hua ZZ Zhang/China/IBM@IBMCN cc openstack@lists.launchpad.net, Thierry Carrez thie...@openstack.org, openstack-bounces+zhuadl=cn.ibm@lists.launchpad.net Subject Re: [Openstack] I18n issue for OpenStack Don't get me wrong.. I'd be happy to have the various openstack clients offer localised error messages. I'd also encourage a centralised effort to collect these translationns (so that all the various language
[Openstack] New Gerrit version (and server)
Hi, We've just upgraded Gerrit to version 2.3. There are a lot of changes behind the scenes that we've been looking forward to (like being able to store data in innodb rather than myisam tables for extra data longevity). And there are a few visible changes that may be of interest to OpenStack developers. One new addition in 2.3 is draft changes. The idea behind a draft change in Gerrit is that it is a change that is not ready for merging, or even general code review, but you would like to share it with some people to get early comments. If you upload a change as a draft, by default, no one else can see it. You must explicitly add each person you would like to share it with as a reviewer. Reviewers you add can leave comments, but can not vote at this stage. You can continue to upload new patchsets to the change as it evolves, and once it is ready for general review, you can click the Publish button. It will then become a normal change in Gerrit that everyone can see, including the earlier reviews from the draft stage. This is a one way transition; once a draft is published, it can't be made a draft again. If you're using git-review from source or the latest version from PyPI (version 1.16, released today), you can easily upload a draft change by adding the -D option (eg, git review -D). Earlier versions of git-review also have the -D option, but the git ref that Gerrit uses to indicate a change should be a draft was changed between the 2.3 release candidate and the final release; so if using -D results in an error, you may need to upgrade. You may notice some changes to the diff view. Notably, the header which contained all of the possible viewing options has been split up into several parts; you can switch between them by selecting options that show up under the menu at the top. I recommend setting Retain Header On File Switch under the Preferences section, as it is a nicer experience when changing files. Another notable new feature is the ability to add a group to the list of reviewers for a change. Just type in the name of the group and click Add Reviewer and all of the individuals in the group will be added to the list of reviewers (and will see the change on their review requests list. Finally, we've modified some of our local OpenStack style changes so that it is easier for us to track upstream changes in layout. It should mean a little more consistency throughout the interface, though we weren't able to keep the alternating row colors on the main table without a disproportionate amount of effort. Do note that you can click on a line in a table, and it will be highlighted to improve legibility. We've tried to give this as much testing as possible before moving it into production. If you encounter any issues, please let us know on IRC (mtaylor, jeblair, LinuxJedi), via email at openstack-ci-adm...@lists.launchpad.net, or you can file a bug at: https://bugs.launchpad.net/openstack-ci/ Thanks, Jim ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Endpoints problems
Maybe, here some codes are worth thouhands of words:keystone.catalog.backends.sql.Catalog: def get_catalog(self, user_id, tenant_id, metadata=None): d = dict(CONF.iteritems()) d.update({'tenant_id': tenant_id, 'user_id': user_id}) catalog = {} endpoints = [self.get_endpoint(e) for e in self.list_endpoints()] for ep in endpoints: service = self.get_service(ep['service_id']) srv_type = service['type'] srv_name = service['name'] region = ep['region'] if region not in catalog: catalog[region] = {} catalog[region][srv_type] = {} internal_url = ep['internalurl'].replace('$(', '%(') public_url = ep['publicurl'].replace('$(', '%(') admin_url = ep['adminurl'].replace('$(', '%(') catalog[region][srv_type]['name'] = srv_name catalog[region][srv_type]['publicURL'] = public_url % d catalog[region][srv_type]['adminURL'] = admin_url % d catalog[region][srv_type]['internalURL'] = internal_url % d return catalog-openstack-bounces+gongysh=cn.ibm@lists.launchpad.net wrote: -To: Anne Gentle a...@openstack.orgFrom: Pete Zaitcev zait...@redhat.comSent by: openstack-bounces+gongysh=cn.ibm@lists.launchpad.netDate: 04/13/2012 06:44AMCc: Openstack Mail List openstack@lists.launchpad.netSubject: Re: [Openstack] Endpoints problemsOn Thu, 12 Apr 2012 15:28:21 -0500Anne Gentle a...@openstack.org wrote: keystone --token 012345SECRET99TOKEN012345 --endpoint http://192.168.206.130:35357/v2.0endpoint-create \[]--internalurl http://192.168.206.130:8774/v2/$(tenant_id)s I haven't fixed this yet because I'm not sure if the $(tenant_id)s is literal or which tenant_id specifically to use (the Service tenant for the adminurl possibly)?The _expression_ "$(tenant_id)s" is really contained inside the patternin the database. It is substituded with a specific tennant ID whenan application makes its request. The weird syntax is inherited fromPython, where one can use constructs like %s or %(key)s.-- Pete___Mailing list: https://launchpad.net/~openstackPost to : openstack@lists.launchpad.netUnsubscribe : https://launchpad.net/~openstackMore help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Image API v2 Draft 4
Generally, I agree with a lot of what you're saying, but I want to point out a couple of things: 1. Static language folks gravitate to XML, not simply because they're invested in it, but because it solves a real problem: In a static language, I want to to say something like: myServer.name = hello; if I misspell name myServer.nam = hello; I should see an error...if I assign it to an integer... myServer.name=10; I should also see an error... and I should see those errors at compile time or while I'm authoring my code if a have a good editor or IDEI shouldn't have to wait until my program is run to catch those errors. Sure, I can parse some JSON turn the result into a hashtable and if I'm using something like Scala, I can do this myServer(name) = hello but at that point, there's very little benefit to having a static language, because I don't have the assurances and guarantees that the language provides. So I don't see a lot of Java folks dealing with JSON in that manner. Most devs will need to build a class before hand. So, you decrease barriers for static language clients because there's a set of tools that can extract the relevant info from XML schema languages and generate a set of class files at compile time. There's nothing saying you can't do something similar with JSON, but those sort of tools aren't there yet. 2. Then there's the issue of extensibilityespecially distributed extensibility. XML has that notion built in, JSON has no concept of it...and we are building extensible APIs. There are no standard way in JSON to introduce a new property without guaranteeing that there won't be clash. You've mention the need for namespaces in JSON precisely to deal with this sort of issue (http://www.mnot.net/blog/2011/10/12/thinking_about_namespaces_in_json). In the absence of a standard method, we're been using prefixes, which has worked out well, but most JSON tools don't know how to deal with them and they seem alien to folk that are used to using JSON day to day. This is a big deal because dynamic language folks are more likely to deal with the JSON directly...Static language folks are generally not dealing with XML in the same way. In XML, the notion of extensibility is build into parsers and data binding tools directly. Most folks don't have to worry too much about it. In fact extensible protocols like XMPP and Atom Pub generally benefit from the extensibility that's already built in: http://metajack.im/2010/02/01/json-versus-xml-not-as-simple-as-you-think/ Given that, if we're going to go the route of just picking one format, I think the fact that our API is extensible means that we might want to ask ourselves whether XML isn't a better fit :-) Having said all of that, I realize that our devs are working in a dynamic language, and don't see a lot of value in XML. It's important to take that into consideration, but we should also be asking whether there's value to our current clients and potential clients. Like it or not, there's a lot of folks out there using static languages. You're right in stating that if we had really good language bindings for Java and .Net, then issue #1 would essentially go away -- especially if we had language binding that was flexible enough to remove the need to go down to the HTTP level. Also, if the language binding itself was extensible we could also deal with issue 2. As things stand today though, I don't thing that we are even remotely there yet. -jOrGe W. On Apr 12, 2012, at 2:58 PM, Mark Nottingham wrote: A little fuel for the fire / entertainment before the summit: http://www.mnot.net/blog/2012/04/13/json_or_xml_just_decide Cheers, On 10/04/2012, at 3:56 PM, Vishvananda Ishaya wrote: On Apr 10, 2012, at 2:26 AM, Thierry Carrez wrote: Jay Pipes wrote: I take it you didn't attend the glorious JSON debate of a couple of summits ago :-) Glorious it was indeed. I think the key quote was something like: Please don't bastardize my JSON with your XML crap According to my twitter, the actual quote was: Don't bring your XML filth into my JSON Vish ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Mark Nottingham http://www.mnot.net/ ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] How to setup vncproxy with ubuntu precise package?
Hi folks I'm trying to setup vncproxy with ubuntu package on precise. But I could'nt find document how to setup them. If you there are information, could you share me? Thank you in advance Nachi ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] How to setup vncproxy with ubuntu precise package?
Hi, please see if following text can help. To enable vnc console access VMs started by OpenStack, we need many components to collaborate. Components on control node nova-api, which is API server of OpenStack nova-consoleauth, which is used to authorize vnc client noVNC, which is a VNC proxy for browser. An alternative proxy is nova-xvpvncproxy, which can accessed by a Java client at https://github.com/cloudbuilders/nova-xvpvncviewer. Components on compute node nova-compute, which is nova binary to instantiate VMs libvirt driver, which is used by nova-compute to interact with libvirt server VNC server, which is part of hypervisor? Steps for user to access VNC console 1. user gets the vnc console by command: [root@robinlinux utils]# nova get-vnc-console myserver20 novnc nova-api accepts this request, and then sends out "get_vnc_console" message to VM's related compute host 2. nova-compute, running on that compute host accepts that message, generate a token and call libvirt driver's get_vnc_console methods. 3. Libvirt driver will connect with libvirt server to get VM's vnc port, and look up the vnc host from FLAGS.vncserver_proxyclient_address. 4. nova-api will send out "authorize_console" message to nova-consoleauth, which then caches the connection information returned by compute-node with token as key 5. user browsers the URL returned the previous command, like below: [root@robinlinux utils]# nova get-vnc-console myserver20 novnc +---+--+ | Type | Url | +---+--+ | novnc | http://controlnode:6080/vnc_auto.html?token=34ce7a44-6186-43d8-be14-2ea9e028b8fa | +---+--+ 6. noVNC, which is listening on 6080 HTTP port, accepts the URL request, sends out "check_token" message to nova-consoleauth 7. nova-consoleauth checks the cached connections and returns one according to the requested token key 8. noVNC begins the proxy work, connecting the VNC server About configuration items in nova.conf #read by nova-compute to compose vnc-console URL # for novnc novncproxy_base_url=http://controlnode:6080/vnc_auto.html # for xvpvnc xvpvncproxy_base_url=http://controlnode:6081/console #read by nova-compute to instantiate VMs vncserver_listen=controlnode #read by libvirt driver to compute vnc-console URL vncserver_proxyclient_address=controlnode -openstack-bounces+gongysh=cn.ibm@lists.launchpad.net wrote: -To: openstack@lists.launchpad.netFrom: Nachi Ueno ueno.na...@nttdata-agilenet.comSent by: openstack-bounces+gongysh=cn.ibm@lists.launchpad.netDate: 04/13/2012 08:33AMSubject: [Openstack] How to setup vncproxy with ubuntu precise package?Hi folksI'm trying to setup vncproxy with ubuntu package on precise.But I could'nt find document how to setup them.If you there are information, could you share me?Thank you in advanceNachi___Mailing list: https://launchpad.net/~openstackPost to : openstack@lists.launchpad.netUnsubscribe : https://launchpad.net/~openstackMore help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Swift] Does there any exist blueprint or sub-project of user's storage space quota or counting method for Swift ?
Swift keeps total bytes, container, and object count (eventually) up-to-date in the account metadata. There are also log processing tools (like slogging - http://github.com/notmyname/slogging) that can provide usage information (including bandwidth) based on swift logs. While I think that it's appropriate for swift to generate the usage information (via internal processes or log processing), the appropriate place for quotas is in whatever system handles the concept of a user (normally the auth system). This way quotas are enforced by revoking or limiting access of the auth token. --John On Apr 12, 2012, at 11:53 AM, Frederik Van Hecke wrote: Hi Kuo, One option would be to keep the usage information (num files, num bytes, etc) per container / account in an sqlite DB, just like it is done for account and container info. To avoid having to loop through all data at regular intervals (to update the info), additional logic could be added to the api methods to update the sqlite DB's when new files are added, files are deleted, etc. Such approach will require more lines of code, but will be far less stressful on performance. (the brute-force approach to loop through it at regular intervals will be hell on performance on large deployments..) For data transfer billing based on download / upload amounts, a similar approach could be used. If no one else is looking into this, I would certainly be willing to help to help get this started. Kind regards, Frederik Van Hecke T: +32487733713 E: frede...@cluttr.be W: www.cluttr.be This e-mail and any attachments thereto may contain information which is confidential and/or protected by intellectual property rights and are intended for the sole use of the recipient(s)named above. Any use of the information contained herein (including, but not limited to, total or partial reproduction, communication or distribution in any form) by persons other than the designated recipient(s) is prohibited. If you have received this e-mail in error, please notify the sender either by telephone or by e-mail and delete the material from any computer. Thank you for your cooperation. On Thu, Apr 12, 2012 at 17:45, Kuo Hugo tonyt...@gmail.com wrote: Hi folks , I'm thinking about the better approach to manage an user or an account space usage quota in swift. Is there any related blueprint or sub-project even an idea around ? Any suggestion of benefits to be an external service or to be a middle-ware in swift-proxy ? I'm concerning about such feature will reduce the performance of entire Swift environment. Appreciate : -- +Hugo Kuo+ tonyt...@gmail.com +886 935004793 ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp smime.p7s Description: S/MIME cryptographic signature ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Swift] Does there any exist blueprint or sub-project of user's storage space quota or counting method for Swift ?
I should also mention the summit session talking about this very topic led by Everett Toews. It's (currently) scheduled for 9am on wednesday. http://summit.openstack.org/sessions/view/81 --John On Apr 12, 2012, at 8:51 PM, John Dickinson wrote: Swift keeps total bytes, container, and object count (eventually) up-to-date in the account metadata. There are also log processing tools (like slogging - http://github.com/notmyname/slogging) that can provide usage information (including bandwidth) based on swift logs. While I think that it's appropriate for swift to generate the usage information (via internal processes or log processing), the appropriate place for quotas is in whatever system handles the concept of a user (normally the auth system). This way quotas are enforced by revoking or limiting access of the auth token. --John On Apr 12, 2012, at 11:53 AM, Frederik Van Hecke wrote: Hi Kuo, One option would be to keep the usage information (num files, num bytes, etc) per container / account in an sqlite DB, just like it is done for account and container info. To avoid having to loop through all data at regular intervals (to update the info), additional logic could be added to the api methods to update the sqlite DB's when new files are added, files are deleted, etc. Such approach will require more lines of code, but will be far less stressful on performance. (the brute-force approach to loop through it at regular intervals will be hell on performance on large deployments..) For data transfer billing based on download / upload amounts, a similar approach could be used. If no one else is looking into this, I would certainly be willing to help to help get this started. Kind regards, Frederik Van Hecke T: +32487733713 E: frede...@cluttr.be W: www.cluttr.be This e-mail and any attachments thereto may contain information which is confidential and/or protected by intellectual property rights and are intended for the sole use of the recipient(s)named above. Any use of the information contained herein (including, but not limited to, total or partial reproduction, communication or distribution in any form) by persons other than the designated recipient(s) is prohibited. If you have received this e-mail in error, please notify the sender either by telephone or by e-mail and delete the material from any computer. Thank you for your cooperation. On Thu, Apr 12, 2012 at 17:45, Kuo Hugo tonyt...@gmail.com wrote: Hi folks , I'm thinking about the better approach to manage an user or an account space usage quota in swift. Is there any related blueprint or sub-project even an idea around ? Any suggestion of benefits to be an external service or to be a middle-ware in swift-proxy ? I'm concerning about such feature will reduce the performance of entire Swift environment. Appreciate : -- +Hugo Kuo+ tonyt...@gmail.com +886 935004793 ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp smime.p7s Description: S/MIME cryptographic signature ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Endpoints problems
On Apr 12, 2012, at 6:44 PM, Pete Zaitcev wrote: On Thu, 12 Apr 2012 15:28:21 -0500 Anne Gentle a...@openstack.org wrote: keystone --token 012345SECRET99TOKEN012345 --endpoint http://192.168.206.130:35357/v2.0 endpoint-create \ [] --internalurl http://192.168.206.130:8774/v2/$(tenant_id)s I haven't fixed this yet because I'm not sure if the $(tenant_id)s is literal or which tenant_id specifically to use (the Service tenant for the adminurl possibly)? The expression $(tenant_id)s is really contained inside the pattern in the database. It is substituded with a specific tennant ID when an application makes its request. The weird syntax is inherited from Python, where one can use constructs like %s or %(key)s. My understanding (based on somebody's previous answer in the mailing list, or possibly one of the IRC channels) was that you could only do this with the template backend, and when you were using the database backend you had to explicitly add endpoints for each tenant that needed to talk to the API. Can you confirm that you can use the $(tenant_id)s syntax when the backend is set using the following keystone.conf entry: [catalog] driver = keystone.catalog.backends.sql.Catalog Take care, Lorin -- Lorin Hochstein Lead Architect - Cloud Services Nimbis Services, Inc. www.nimbisservices.com ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [SWIFT] Looking for an approach to attach an account or a container in operating system . Like a NAS of SAN driver.
Thanks , will have a look at cloudfuse. I tried Gladinet solution already . But it do not support NFS protocol currently Frederik Van Hecke frede...@cluttr.be 於 2012年4月13日上午1:03 寫道: Hi Kuo, Here are some quick links: https://github.com/redbo/cloudfuse http://gladinet.blogspot.com/2010/10/openstack-windows-client.html I'm running cloudfuse on Ubuntu without much to complain about. Kind regards, Frederik Van Hecke *T:* +32487733713 *E:* frede...@cluttr.be *W:* www.cluttr.be *This e-mail and any attachments thereto may contain information which is confidential and/or protected by intellectual property rights and are intended for the sole use of the recipient(s)named above. Any use of the information contained herein (including, but not limited to, total or partial reproduction, communication or distribution in any form) by persons other than the designated recipient(s) is prohibited. If you have received this e-mail in error, please notify the sender either by telephone or by e-mail and delete the material from any computer. Thank you for your cooperation.* On Thu, Apr 12, 2012 at 17:57, Kuo Hugo tonyt...@gmail.com wrote: I'm keeping in search and think about the easiest way for users to leverage their swift account. There has several client applications for accessing swift around . Either Windows / Linux / Mac. But eventually , user still need to install a client for this purpose. What if user can attach their own account from swift-proxy (or something else) directly via NFS or CIFS or iscsi target will be much better. As I know , both linux and Windows has application to reach this target. Such as Gladinet Server / S3FS etc. How about provide such interfaces in Swift-proxy ? If there's an exist discussion ticket , please let me know it . Cheers -- +Hugo Kuo+ tonyt...@gmail.com + tonyt...@gmail.com886 935004793 ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- +Hugo Kuo+ tonyt...@gmail.com + tonyt...@gmail.com886 935004793 ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [SWIFT] Looking for an approach to attach an account or a container in operating system . Like a NAS of SAN driver.
SFTP looks interesting . I plan to have a try with your cloudfuse branch for later testing. Any Consideration will back to this ticket. Justin Santa Barbara jus...@fathomdb.com 於 2012年4月13日上午5:40 寫道: I made some patches to cloudfuse to get it to support Keystone auth: http://blog.justinsb.com/blog/2012/03/29/openstack-storage-with-fuse/ I'd like to get this merged upstream, but haven't heard anything on my pull request... Redbo? Bueller? :-) I also saw an SFTP gateway floating about somewhere; that also seemed like a good approach. Should we make cloudfuse an openstack hosted project? Frederik: If you do have any issues that should be fixed, I'd love to know what they are! Justin On Thu, Apr 12, 2012 at 10:03 AM, Frederik Van Hecke frede...@cluttr.bewrote: Hi Kuo, Here are some quick links: https://github.com/redbo/cloudfuse http://gladinet.blogspot.com/2010/10/openstack-windows-client.html I'm running cloudfuse on Ubuntu without much to complain about. Kind regards, Frederik Van Hecke *T:* +32487733713 *E:* frede...@cluttr.be *W:* www.cluttr.be *This e-mail and any attachments thereto may contain information which is confidential and/or protected by intellectual property rights and are intended for the sole use of the recipient(s)named above. Any use of the information contained herein (including, but not limited to, total or partial reproduction, communication or distribution in any form) by persons other than the designated recipient(s) is prohibited. If you have received this e-mail in error, please notify the sender either by telephone or by e-mail and delete the material from any computer. Thank you for your cooperation.* On Thu, Apr 12, 2012 at 17:57, Kuo Hugo tonyt...@gmail.com wrote: I'm keeping in search and think about the easiest way for users to leverage their swift account. There has several client applications for accessing swift around . Either Windows / Linux / Mac. But eventually , user still need to install a client for this purpose. What if user can attach their own account from swift-proxy (or something else) directly via NFS or CIFS or iscsi target will be much better. As I know , both linux and Windows has application to reach this target. Such as Gladinet Server / S3FS etc. How about provide such interfaces in Swift-proxy ? If there's an exist discussion ticket , please let me know it . Cheers -- +Hugo Kuo+ tonyt...@gmail.com + tonyt...@gmail.com886 935004793 ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- +Hugo Kuo+ tonyt...@gmail.com + tonyt...@gmail.com886 935004793 ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] [Swift] Does there any exist blueprint or sub-project of user's storage space quota or counting method for Swift ?
In my view, the biggest problem of swift is not the new features but the improvement of performance. At first, we knew that container-updater, *-auditor, *-replicator will loop all the files in the disk during the running interval. When the number of files is very large, the process of replicator, updater and auditor will spend much time. So, the time of eventual consistency is very long. Our practice of Sina Web Service Team https://launchpad.net/~sws: total accounts: 121,961; total containers:160,703; total objects: 14,291,519; total storage usage: 1.3T account replication time:10 hours; container replication time: 10 hours; object replication time: 48 hours; account audit time: 2 hours; container audit time: 9 hours; container update time:19 hours; This is terrible If we develop quota upon account db. There is long time for eventual consistency. Secondly, there is a vicious circle during replication. The replicator will query the account-server, container-server and object-server to compare the metadata, and determine whether to sync. When the number of files is very large, the frequent query make the account-server, container-server and object-server become a bottle neck. This will influence the process of proxy-server to work with back-end servers. There a lot of Timeout(10s) ERROR in proxy-server's log and the load-average is very high. So, some PUT, POST operations failed, and the replicator to sync, and fail more, and sync more... . In my opinion, we need to improve the process of replication and container update by using event drive framework or something else.. My leader may discuss this topic at Design Summit, http://openstackconferencespring2012.sched.org/speaker/huicheng 2012/4/13 John Dickinson m...@not.mn javascript:_e({}, 'cvml', 'm...@not.mn'); Swift keeps total bytes, container, and object count (eventually) up-to-date in the account metadata. There are also log processing tools (like slogging - http://github.com/notmyname/slogging) that can provide usage information (including bandwidth) based on swift logs. While I think that it's appropriate for swift to generate the usage information (via internal processes or log processing), the appropriate place for quotas is in whatever system handles the concept of a user (normally the auth system). This way quotas are enforced by revoking or limiting access of the auth token. --John On Apr 12, 2012, at 11:53 AM, Frederik Van Hecke wrote: Hi Kuo, One option would be to keep the usage information (num files, num bytes, etc) per container / account in an sqlite DB, just like it is done for account and container info. To avoid having to loop through all data at regular intervals (to update the info), additional logic could be added to the api methods to update the sqlite DB's when new files are added, files are deleted, etc. Such approach will require more lines of code, but will be far less stressful on performance. (the brute-force approach to loop through it at regular intervals will be hell on performance on large deployments..) For data transfer billing based on download / upload amounts, a similar approach could be used. If no one else is looking into this, I would certainly be willing to help to help get this started. Kind regards, Frederik Van Hecke T: +32487733713 E: frede...@cluttr.be javascript:_e({}, 'cvml', 'frede...@cluttr.be'); W: www.cluttr.be This e-mail and any attachments thereto may contain information which is confidential and/or protected by intellectual property rights and are intended for the sole use of the recipient(s)named above. Any use of the information contained herein (including, but not limited to, total or partial reproduction, communication or distribution in any form) by persons other than the designated recipient(s) is prohibited. If you have received this e-mail in error, please notify the sender either by telephone or by e-mail and delete the material from any computer. Thank you for your cooperation. On Thu, Apr 12, 2012 at 17:45, Kuo Hugo tonyt...@gmail.comjavascript:_e({}, 'cvml', 'tonyt...@gmail.com'); wrote: Hi folks , I'm thinking about the better approach to manage an user or an account space usage quota in swift. Is there any related blueprint or sub-project even an idea around ? Any suggestion of benefits to be an external service or to be a middle-ware in swift-proxy ? I'm concerning about such feature will reduce the performance of entire Swift environment. Appreciate : -- +Hugo Kuo+ tonyt...@gmail.com javascript:_e({}, 'cvml', 'tonyt...@gmail.com'); +886 935004793 ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net javascript:_e({}, 'cvml', 'openstack@lists.launchpad.net');
Re: [Openstack] Endpoints problems
On Thu, 12 Apr 2012 22:33:38 -0400 Lorin Hochstein lo...@nimbisservices.com wrote: My understanding (based on somebody's previous answer in the mailing list, or possibly one of the IRC channels) was that you could only do this with the template backend, and when you were using the database backend you had to explicitly add endpoints for each tenant that needed to talk to the API. Can you confirm that you can use the $(tenant_id)s syntax when the backend is set using the following keystone.conf entry: [catalog] driver = keystone.catalog.backends.sql.Catalog The thought that the substitution may not work never occured to me. I have the following in keystone.conf: [catalog] # dynamic, sql-based backend (supports API/CLI-based management commands) driver = keystone.catalog.backends.sql.Catalog template_file = /etc/keystone/default_catalog.templates # static, file-based backend (does *NOT* support any management commands) #driver = keystone.catalog.backends.templated.TemplatedCatalog #template_file = ./etc/default_catalog.templates And I run the following command as a part of re-population script: ## Without proxy: #$keystone endpoint-create --region RegionOne --service_id $SSID \ #--publicurl 'http://kvm-rei.zaitcev.lan/v1/AUTH_$(tenant_id)s' \ #--adminurl 'http://kvm-rei.zaitcev.lan/v1.0/' \ #--internalurl 'http://kvm-rei.zaitcev.lan/v1/AUTH_$(tenant_id)s' # With SSL proxy at kvm-san: $keystone endpoint-create --region RegionOne --service_id $SSID \ --adminurl 'http://kvm-rei.zaitcev.lan/v1.0/' \ --publicurl 'https://kvm-san.zaitcev.lan/v1/AUTH_$(tenant_id)s' \ --internalurl 'http://kvm-rei.zaitcev.lan/v1/AUTH_$(tenant_id)s' Everything seems to work. Also see Yong-Sheng's message about the source code. -- Pete ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Endpoints problems
On Fri, 13 Apr 2012 08:11:28 +0800 Yong Sheng Gong gong...@cn.ibm.com wrote: Maybe, here some codes are worth thouhands of words: I quite agree. On the other hand, does Anne care to read it? She needs a concise answer as to what command to document precisely, if I understad her query right. d = dict(CONF.iteritems()) d.update({'tenant_id': tenant_id, 'user_id': user_id}) catalog = {} It would be great if we kept track of available keys in a document somewhere. Of course, the source is open. That's how I found my forgotten 's'. But still, it's a hurdle to clear for some. -- Pete ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Endpoints problems
So looking at the code.. both templated and sql backends seem to support the variable substitution. And if i am reading the code correctly they support both of the following variable declarations: %(tennant_id)s $(tennant_id)s since it appears the code replaces $( with %( --shep On Apr 12, 2012, at 9:33 PM, Lorin Hochstein wrote: On Apr 12, 2012, at 6:44 PM, Pete Zaitcev wrote: On Thu, 12 Apr 2012 15:28:21 -0500 Anne Gentle a...@openstack.orgmailto:a...@openstack.org wrote: keystone --token 012345SECRET99TOKEN012345 --endpoint http://192.168.206.130:35357/v2.0 endpoint-create \ [] --internalurl http://192.168.206.130:8774/v2/$(tenant_id)s I haven't fixed this yet because I'm not sure if the $(tenant_id)s is literal or which tenant_id specifically to use (the Service tenant for the adminurl possibly)? The expression $(tenant_id)s is really contained inside the pattern in the database. It is substituded with a specific tennant ID when an application makes its request. The weird syntax is inherited from Python, where one can use constructs like %s or %(key)s. My understanding (based on somebody's previous answer in the mailing list, or possibly one of the IRC channels) was that you could only do this with the template backend, and when you were using the database backend you had to explicitly add endpoints for each tenant that needed to talk to the API. Can you confirm that you can use the $(tenant_id)s syntax when the backend is set using the following keystone.conf entry: [catalog] driver = keystone.catalog.backends.sql.Catalog Take care, Lorin -- Lorin Hochstein Lead Architect - Cloud Services Nimbis Services, Inc. www.nimbisservices.comhttps://www.nimbisservices.com/ ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.netmailto:openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] The Scheduling feature when reboot the instance
Ignoring issues of Ram . I have a number of questions as the following model: My node-1's resource as the following: CPU : 4 core RAM: 4 GB. Now , My Node-1 is hosting 4 instances: 3 instance: (each VM: 1 core CPU, 2 GB ram,..). 2 instance(i-0001, i-0002) is turn of and 1 instance(i-0003) is running. 1 instance : (1 core CPU, 1 GB ram). It is running.(i-0004) I request new ínstance by the euca-run-instance command. My new instance ( i-0005) is located on the node 1. This is the problem for the nova-scheduler. What is happen ? If I reboot 2 instances : i-0001,i-0002. How do we manage this problem in Openstack ? I think that: My 2 instances (i-0001 , i-0002) should be migrated to the rest available resources as node-2 and node-3. If not, it's actually very difficult to manage and reboot the instances which are turned off. And their resources-allocated will be reused for the new instances. - Thông điệp gốc : - Gửi từ : Vishvananda Ishaya [vishvana...@gmail.com] Gửi lúc : 12/04/2012 11:43 PM Gửi tới : openstack@lists.launchpad.net;vishvana...@gmail.com Chủ đ�� : Re: [Openstack] The Scheduling feature when reboot the instance No this does not exist. If you are going to overprovision ram, you should probably make sure that you have swap enabled on your host. Vish On Apr 12, 2012, at 4:10 AM, Văn �ình Phúc wrote: Hi. I'm using Openstack (2011.3 (2011.3-nova-milestone-tarball:tarmac-20110922115702-k9nkvxqzhj130av2) with 3 Compute nodes. My scheduling option is default. I have the problem as the following steps: Compute node 1 is installed the modules: nova-api, nova-compute and nova-network. The resource of node-1 max is fitfor 3 instances (m1.small): i-0001, i-0002, i-0003. I turn off i-0001. and then I request new ínstance by the euca-run-instance command , My new instance ( i-0004) is located on the node 1. The resources: RAM , CPU,.. of node-2 and node-3 is available. finally, I reboot the i-0001.What is happen? the i-0001 is rebooted on the node-1 , and It's shutdown off after reboot.I checked the libvirt's log : Failed to allocate 2147483648 B: Cannot allocate memory 2012-04-12 16:11:50.530: shutting down So , Do Openstack have the sheduling feature when rebooting the instance ? Example: As above , My instance (i-0001) will be migrated to node-2 or node-3 when the resource of node-1 is not available. phucvdbmail.gif Văn �ình Phúc Manager - Cloud Team Techno Department Bkav Specialization Division Office: Bkav Building - Yen Hoa New Town, Cau Giay Dist, Hanoi Tel: (84-4) 3763.2552 Mobile: 0169 4702 388 Do your best, the rest will come ! Hãy làm việc hết mình, những đi��u tốt đẹp sẽ đến với bạn ! Disclaimer: This e-mail and any files transmitted with it are confidential and may contain privileged information. It is intended solely for the use of the individual to whom it is addressed and others authorized to receive it. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. If you have received this message in error, please notify the sender immediately by reply e-mail and delete completely this e-mail from your system, without reproducing, distributing or retaining copies. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Endpoints problems
Here is one sample keystone default_catalog.templates which defines some services. In fact I think for SQL, we need use keystone client to add them into SQL DB.# config for TemplatedCatalog, using camelCase because I don't want to do# translations for keystone compatcatalog.RegionOne.identity.publicURL = http://controlnode:$(public_port)s/v2.0catalog.RegionOne.identity.adminURL = http://controlnode:$(admin_port)s/v2.0catalog.RegionOne.identity.internalURL = http://controlnode:$(public_port)s/v2.0catalog.RegionOne.identity.name = Identity Service# fake compute service for now to help novaclient tests workcatalog.RegionOne.compute.publicURL = http://controlnode:$(compute_port)s/v1.1/$(tenant_id)scatalog.RegionOne.compute.adminURL = http://controlnode:$(compute_port)s/v1.1/$(tenant_id)scatalog.RegionOne.compute.internalURL = http://controlnode:$(compute_port)s/v1.1/$(tenant_id)scatalog.RegionOne.compute.name = Compute Servicecatalog.RegionOne.volume.publicURL = http://controlnode:8776/v1/$(tenant_id)scatalog.RegionOne.volume.adminURL = http://controlnode:8776/v1/$(tenant_id)scatalog.RegionOne.volume.internalURL = http://controlnode:8776/v1/$(tenant_id)scatalog.RegionOne.volume.name = Volume Servicecatalog.RegionOne.ec2.publicURL = http://controlnode:8773/services/Cloudcatalog.RegionOne.ec2.adminURL = http://controlnode:8773/services/Admincatalog.RegionOne.ec2.internalURL = http://controlnode:8773/services/Cloudcatalog.RegionOne.ec2.name = EC2 Servicecatalog.RegionOne.image.publicURL = http://controlnode:9292/v1catalog.RegionOne.image.adminURL = http://controlnode:9292/v1catalog.RegionOne.image.internalURL = http://controlnode:9292/v1catalog.RegionOne.image.name = Image Service-openstack-bounces+gongysh=cn.ibm@lists.launchpad.net wrote: -To: Pete Zaitcev zait...@redhat.comFrom: Anne Gentle a...@openstack.orgSent by: openstack-bounces+gongysh=cn.ibm@lists.launchpad.netDate: 04/13/2012 12:33PMCc: Openstack Mail List openstack@lists.launchpad.netSubject: Re: [Openstack] Endpoints problemsThanks all! And thanks for not saying "It's a Python Thing You Wouldn't Understand." :)Yeah I do want a definitive answer but it's always good for me to learn to read code. Then again, things like replace('$(', '%(') make me go hmm... One last clarification, this $(tenant_id)s should be used for both nova and volume endpoints, right?Thanks,AnneOn Thu, Apr 12, 2012 at 5:44 PM, Pete Zaitcev zait...@redhat.com wrote: On Thu, 12 Apr 2012 15:28:21 -0500 Anne Gentle a...@openstack.org wrote: keystone --token 012345SECRET99TOKEN012345 --endpoint http://192.168.206.130:35357/v2.0 endpoint-create \ [] --internalurl http://192.168.206.130:8774/v2/$(tenant_id)s I haven't fixed this yet because I'm not sure if the $(tenant_id)s is literal or which tenant_id specifically to use (the Service tenant for the adminurl possibly)? The _expression_ "$(tenant_id)s" is really contained inside the pattern in the database. It is substituded with a specific tennant ID when an application makes its request. The weird syntax is inherited from Python, where one can use constructs like %s or %(key)s. -- Pete ___Mailing list: https://launchpad.net/~openstackPost to : openstack@lists.launchpad.netUnsubscribe : https://launchpad.net/~openstackMore help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Endpoints problems
Hi, From: openstack-bounces+atul.jha=csscorp@lists.launchpad.net [openstack-bounces+atul.jha=csscorp@lists.launchpad.net] on behalf of Anne Gentle [a...@openstack.org] Sent: Friday, April 13, 2012 10:03 AM To: Pete Zaitcev Cc: Openstack Mail List Subject: Re: [Openstack] Endpoints problems Thanks all! And thanks for not saying It's a Python Thing You Wouldn't Understand. :) Yeah I do want a definitive answer but it's always good for me to learn to read code. Then again, things like replace('$(', '%(') make me go hmm... One last clarification, this $(tenant_id)s should be used for both nova and volume endpoints, right? Yes. Nova-volume and Swift as well. Thanks, Anne On Thu, Apr 12, 2012 at 5:44 PM, Pete Zaitcev zait...@redhat.commailto:zait...@redhat.com wrote: On Thu, 12 Apr 2012 15:28:21 -0500 Anne Gentle a...@openstack.orgmailto:a...@openstack.org wrote: keystone --token 012345SECRET99TOKEN012345 --endpoint http://192.168.206.130:35357/v2.0 endpoint-create \ [] --internalurl http://192.168.206.130:8774/v2/$(tenant_id)shttp://192.168.206.130:8774/v2/$%28tenant_id%29s I haven't fixed this yet because I'm not sure if the $(tenant_id)s is literal or which tenant_id specifically to use (the Service tenant for the adminurl possibly)? The expression $(tenant_id)s is really contained inside the pattern in the database. It is substituded with a specific tennant ID when an application makes its request. The weird syntax is inherited from Python, where one can use constructs like %s or %(key)s. -- Pete http://www.csscorp.com/common/email-disclaimer.php ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] The Scheduling feature when reboot the instance
Nova has stayed out of doing this auto-migrations so far. You are requesting a very specific type of overallocation of resources, as in don't count machines that are shutoff when scheduling, but then automatically move them if they are turned back on. It is an interesting idea, but not something we have discussed implementing. You can generally over-allocate quite a bit, assuming you have swap enabled, and if some of your machines are not fully allocating their ram internally (which is usually the case) you should be fine. In deployments I have done when performance is really important, we simply do not over-allocate at all. Keep in mind that the main use case of OpenStack is to run a cloud system, not a virtualization system. In a cloud, you very rarely stop machines and start them later, you generally delete the machine completely when you are done and launch a new one when you need it. For this reason the particular use-case you are looking for hasn't really been considered. Vish On Apr 12, 2012, at 9:50 PM, Văn Đình Phúc wrote: Ignoring issues of Ram. I have a number of questions as the following model: My node-1's resource as the following: CPU : 4 core RAM: 4 GB. Now , My Node-1 is hosting 4 instances: 3 instance: (each VM: 1 core CPU, 2 GB ram,..). 2 instance(i-0001, i-0002) is turn of and 1 instance(i-0003) is running. 1 instance : (1 core CPU, 1 GB ram). It is running.(i-0004) I request new ínstance by the euca-run-instance command. My new instance ( i-0005) is located on the node 1. This is the problem for the nova-scheduler. What is happen ? If I reboot 2 instances : i-0001,i-0002. How do we manage this problem in Openstack ? I think that: My 2 instances (i-0001 , i-0002) should be migrated to the rest available resources as node-2 and node-3. If not, it's actually very difficult to manage and reboot the instances which are turned off. And their resources-allocated will be reused for the new instances. - Thông điệp gốc : - Gửi từ : Vishvananda Ishaya [vishvana...@gmail.com] Gửi lúc : 12/04/2012 11:43 PM Gửi tới : openstack@lists.launchpad.net;vishvana...@gmail.com Chủ đề : Re: [Openstack] The Scheduling feature when reboot the instance No this does not exist. If you are going to overprovision ram, you should probably make sure that you have swap enabled on your host. Vish On Apr 12, 2012, at 4:10 AM, Văn Đình Phúc wrote: Hi. I'm using Openstack (2011.3 (2011.3-nova-milestone-tarball:tarmac-20110922115702-k9nkvxqzhj130av2) with 3 Compute nodes. My scheduling option is default. I have the problem as the following steps: Compute node 1 is installed the modules: nova-api, nova-compute and nova-network. The resource of node-1 max is fitfor 3 instances (m1.small): i-0001, i-0002, i-0003. I turn off i-0001. and then I request new ínstance by the euca-run-instance command , My new instance ( i-0004) is located on the node 1. The resources: RAM , CPU,.. of node-2 and node-3 is available. finally, I reboot the i-0001.What is happen? the i-0001 is rebooted on the node-1 , and It's shutdown off after reboot.I checked the libvirt's log : Failed to allocate 2147483648 B: Cannot allocate memory 2012-04-12 16:11:50.530: shutting down So , Do Openstack have the sheduling feature when rebooting the instance ? Example: As above , My instance (i-0001) will be migrated to node-2 or node-3 when the resource of node-1 is not available. phucvdbmail.gif Văn Đình Phúc Manager - Cloud Team Techno Department Bkav Specialization Division Office: Bkav Building - Yen Hoa New Town, Cau Giay Dist, Hanoi Tel: (84-4) 3763.2552 Mobile: 0169 4702 388 Do your best, the rest will come ! Hãy làm việc hết mình, những điều tốt đẹp sẽ đến với bạn ! Disclaimer: This e-mail and any files transmitted with it are confidential and may contain privileged information. It is intended solely for the use of the individual to whom it is addressed and others authorized to receive it. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. If you have received this message in error, please notify the sender immediately by reply e-mail and delete completely this e-mail from your system, without reproducing, distributing or retaining copies. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe :
[Openstack-ubuntu-testing-notifications] Build Still Failing: precise-openstack-essex-nova-trunk #710
Title: precise-openstack-essex-nova-trunk General InformationBUILD FAILUREBuild URL:https://jenkins.qa.ubuntu.com/job/precise-openstack-essex-nova-trunk/710/Project:precise-openstack-essex-nova-trunkDate of build:Thu, 12 Apr 2012 06:06:07 -0400Build duration:5 min 17 secBuild cause:Started by user zulBuilt on:pkg-builderHealth ReportWDescriptionScoreBuild stability: All recent builds failed.0ChangesNo ChangesConsole Output[...truncated 3781 lines...]INFO:root:Executing ['bzr', 'builddeb', '-S', '--', '-sa', '-us', '-uc'] in schrootDEBUG:root:['schroot', '-r', '-c', 'precise-amd64-83bbecdb-9a4f-4290-aed9-8f03ff2451e4', '--', 'bzr', 'builddeb', '-S', '--', '-sa', '-us', '-uc']failed to open trace file: [Errno 2] No such file or directory: '/var/lib/jenkins/.bzr.log'Building using working treeBuilding package in merge modeLooking for a way to retrieve the upstream tarballUsing the upstream tarball that is present in /tmp/tmpP94tB8bzr: ERROR: An error (1) occurred running quilt: Applying patch nova-manage_flagfile_location.patchpatching file bin/nova-manageHunk #1 succeeded at 1659 (offset -648 lines).Applying patch kombu_tests_timeout.patchpatching file nova/tests/rpc/test_kombu.pyHunk #1 succeeded at 273 (offset 72 lines).Applying patch path-to-the-xenhost.conf-fixup.patchpatching file plugins/xenserver/xenapi/etc/xapi.d/plugins/xenhostApplying patch fix-ubuntu-tests.patchpatching file nova/tests/test_api.pyHunk #1 succeeded at 410 (offset 5 lines).Applying patch fix-docs-build-without-network.patchpatching file doc/source/conf.pyApplying patch 0001-fix-useexisting-deprecation-warnings.patchpatching file nova/db/sqlalchemy/migrate_repo/versions/075_convert_bw_usage_to_store_network_id.pypatching file nova/db/sqlalchemy/migrate_repo/versions/081_drop_instance_id_bw_cache.pyApplying patch fix_deprecated_auth_img_publish.patchpatching file nova/api/ec2/cloud.pyHunk #1 FAILED at 1398.1 out of 1 hunk FAILED -- rejects in file nova/api/ec2/cloud.pypatching file nova/image/s3.pyHunk #1 succeeded at 235 with fuzz 2 (offset 3 lines).Patch fix_deprecated_auth_img_publish.patch does not apply (enforce with -f)ERROR:root:Error occurred during package creation/buildERROR:root:Command '['schroot', '-r', '-c', 'precise-amd64-83bbecdb-9a4f-4290-aed9-8f03ff2451e4', '--', 'bzr', 'builddeb', '-S', '--', '-sa', '-us', '-uc']' returned non-zero exit status 3INFO:root:Destroying schroot session: precise-amd64-83bbecdb-9a4f-4290-aed9-8f03ff2451e4Traceback (most recent call last): File "/var/lib/jenkins/tools/openstack-ubuntu-testing/bin/build-package", line 72, in raise esubprocess.CalledProcessError: Command '['schroot', '-r', '-c', 'precise-amd64-83bbecdb-9a4f-4290-aed9-8f03ff2451e4', '--', 'bzr', 'builddeb', '-S', '--', '-sa', '-us', '-uc']' returned non-zero exit status 3Build step 'Execute shell' marked build as failureEmail was triggered for: FailureSending email for trigger: Failure-- Mailing list: https://launchpad.net/~openstack-ubuntu-testing-notifications Post to : openstack-ubuntu-testing-notifications@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack-ubuntu-testing-notifications More help : https://help.launchpad.net/ListHelp
[Openstack-ubuntu-testing-notifications] Build Failure: precise-openstack-essex-deploy #18312
Title: precise-openstack-essex-deploy General InformationBUILD FAILUREBuild URL:https://jenkins.qa.ubuntu.com/job/precise-openstack-essex-deploy/18312/Project:precise-openstack-essex-deployDate of build:Thu, 12 Apr 2012 09:46:41 -0400Build duration:46 minBuild cause:Started by command lineBuilt on:masterHealth ReportWDescriptionScoreBuild stability: 2 out of the last 5 builds failed.60ChangesNo ChangesBuild Artifactslogs/syslog.tar.gzlogs/test-03.os.magners.qa.lexington-log.tar.gzlogs/test-04.os.magners.qa.lexington-log.tar.gzlogs/test-05.os.magners.qa.lexington-log.tar.gzlogs/test-06.os.magners.qa.lexington-log.tar.gzlogs/test-07.os.magners.qa.lexington-log.tar.gzlogs/test-08.os.magners.qa.lexington-log.tar.gzlogs/test-09.os.magners.qa.lexington-log.tar.gzlogs/test-10.os.magners.qa.lexington-log.tar.gzlogs/test-11.os.magners.qa.lexington-log.tar.gzlogs/test-12.os.magners.qa.lexington-log.tar.gzConsole Output[...truncated 11142 lines...]INFO:paramiko.transport:Authentication (publickey) successful!INFO:paramiko.transport:Secsh channel 1 opened.INFO:paramiko.transport.sftp:[chan 1] Opened sftp connection (server version 3)INFO:root:Setting up connection to test-09.os.magners.qa.lexingtonINFO:paramiko.transport:Connected (version 2.0, client OpenSSH_5.9p1)INFO:paramiko.transport:Authentication (publickey) successful!INFO:paramiko.transport:Secsh channel 1 opened.INFO:paramiko.transport.sftp:[chan 1] Opened sftp connection (server version 3)INFO:root:Archiving logs on test-07.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-08.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-09.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-04.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-05.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-03.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-06.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-02.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Grabbing information from test-07.os.magners.qa.lexingtonINFO:root:Grabbing information from test-08.os.magners.qa.lexingtonINFO:root:Grabbing information from test-09.os.magners.qa.lexingtonINFO:root:Grabbing information from test-04.os.magners.qa.lexingtonINFO:root:Grabbing information from test-05.os.magners.qa.lexingtonERROR:root:Unable to get information from test-05.os.magners.qa.lexingtonINFO:root:Grabbing information from test-03.os.magners.qa.lexingtonINFO:root:Grabbing information from test-06.os.magners.qa.lexingtonERROR:root:Unable to get information from test-06.os.magners.qa.lexingtonINFO:root:Grabbing information from test-02.os.magners.qa.lexingtonERROR:root:Unable to get information from test-02.os.magners.qa.lexingtonINFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.tar: Removing leading `/' from member names+ exit 1Build step 'Execute shell' marked build as failureArchiving artifactsEmail was triggered for: FailureSending email for trigger: Failure-- Mailing list: https://launchpad.net/~openstack-ubuntu-testing-notifications Post to : openstack-ubuntu-testing-notifications@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack-ubuntu-testing-notifications More help : https://help.launchpad.net/ListHelp