Re: [Openstack] [Openstack-operators] Health Monitoring Blueprints

2012-04-12 Thread Zhongyue Luo
http://summit.openstack.org/sessions/view/68

I've submitted a proposal on a similar subject but got rejected :) Maybe
because of redundancy.

Looking forward to talking about this at the summit.

Cheers,
LZY

On Thu, Apr 12, 2012 at 11:13 AM, Duncan McGreggor dun...@dreamhost.comwrote:

 On Wed, Apr 11, 2012 at 5:52 PM, Stefano Maffulli stef...@openstack.org
 wrote:
  On Wed, 2012-04-11 at 14:03 -0700, Matt Joyce wrote:
  Problem of course is many operators aren't on the design summit
  contributor list ( ala don't have codes to get into it ) and if it's
  later it's 500 USD to attend.
 
  There will be over 400 people at the summit, not all of them are
  developers. I expect lots of operators/users have a representation
  there. Will there be enough to justify having this discussion there? I
  don't know but we can try.
 
  On Wed, 2012-04-11 at 17:16 -0400, Duncan McGreggor wrote:
  That's a really good point. In the post-conference conversations that
  deal with attendance policy, this should be kept in mind.
 
  We probably should set a date for a post-mortem discussion, after the
  conference. I'm quite sure I'll take a few days off after April 20,
  maybe have a couple of live feedback sessions in the first week of May
  would work?
 
  In lieu of not being able to attend in person, keep in mind the
  live-casting that will be done,
 
 
  We're not yet sure to be able to offer this. Wait for an official
  communication.
 
  in combination with IRC channels.
 
  This we can do: use IRC but there will be only one projector in the
  rooms, not two like at UDS. Each track leader can decide how to use it
  (for IRC or something else).
 
  Since you are already familiar with UDS setup, would you mind setting up
  the IRC channels for each of the rooms at the summit? This is the layout
  of the rooms and their expected usage:
 
 Ballroom: Intro Plenary, Breakout tables, Lightning Talks
 
 Seacliff A+B: Design summit sessions (fishbowl setup)*
 Seacliff C: Design summit sessions (fishbowl setup)*
 Seacliff D: Design summit sessions (fishbowl setup)*
 Marina: Design summit sessions (fishbowl setup)*
 Bayview B: Design summit sessions (fishbowl setup)*
 
 Golden Gate: Unconference room (theater setup)*
 Bayview A: Developer's lounge
 
  The association between rooms+track will be published soon, once the
  revisions on summit.openstack.org are completed.

 The following channels have been created on Freenode and are registered.

 #osds-ballroom
 #osds-seacliff-a-b
 #osds-seacliff-c
 #osds-seacliff-d
 #osds-marina
 #osds-bayview-a
 #osds-bayview-b
 #osds-golden-gate

 Each channel is also getting logged, viewable via HTTP here:
  http://irclogs.osds.cogitat.io/

 Feel free to put another logger in there ;-)

 At UDS, messages get sent to IRC channels at a countdown interval...
 not sure if we have anything that sophisticated for OSDS. At the very
 least, we can monitor the times ourselves and post messages to the
 channels.

 d
 ___
 Openstack-operators mailing list
 openstack-operat...@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] Role of nova-manage network commands when using QuantumManager

2012-04-12 Thread Vaze, Mandar
It is my understanding that in multi-node setup :

* nova-manage can be executed from any machine which may not be running 
nova-network process.  (Or should nova-manage always be run on nova-network 
node ?)

* nova-manage does DB operations and delegates the actual networking 
calls to nova-network process ?

Is this understanding correct ?

I traced nova-manage network create and nova-manage network delete using 
FlatDHCPManager (default for devstack/stack.sh)
Both these calls seem to be doing only DB operations.
BTW, nova-network process was shutdown during both network create and 
network delete - Still both operations were successful.

But when using QuantumManager as network manager - nova-manage seems to be 
doing networking operations like iptables-save (during network create) and 
kill_dhcp (during network delete)
(via linux-net L3 driver)

Since nova-manage command may be executed on a host which isn't running 
nova-network - network commands like iptables and kill -9 pid of dnsmasq 
on host running nova-manage seems incorrect.

For the first scenario (iptables-save during network create - there is 
already a defect in LP : https://bugs.launchpad.net/nova/+bug/977738
and review : https://review.openstack.org/6451

I would like your comments and opinions which would help me understand  What 
nova-manage should and should NOT do

Thanks,
-Mandar





__
Disclaimer:This email and any attachments are sent in strictest confidence for 
the sole use of the addressee and may contain legally privileged, confidential, 
and proprietary data.  If you are not the intended recipient, please advise the 
sender by replying promptly to this email and then delete and destroy this 
email and any attachments without any further use, copying or forwarding___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] I18n issue for OpenStack

2012-04-12 Thread Thierry Carrez
Sean Dague wrote:
 If we want to think about OpenStack as a basic building block like
 Apache, i18n is critical. Otherwise there are regions that won't adopt
 it solely because of a lack of i18n.

Note that Apache HTTPd, for instance, does not seem to internationalize
its error messages. Only the (enduser-facing) HTML pages it gives back
in response to invalid requests are.

 Is there a metric on the completeness so far? Something automated that
 could be a jenkins coverage kind of test?

Oddly enough, it's not a question of completeness of translations.
Piggybacking on the awesome Launchpad Translations community always gave
us great coverage. It's more a code support and CI integration issue.

-- 
Thierry Carrez (ttx)
Release Manager, OpenStack

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] I18n issue for OpenStack

2012-04-12 Thread Thierry Carrez
Joshua Harlow wrote:
 So there is a question here that I don’t understand.
 
 There a different levels of I18N, for say user facing error messages, or
 for other things I consider UI (horizon).
 
 Those need to be I18N and all that. I think the larger part that I don’t
 understand is why the things that are not the above (log messages) are
 being internationalized.
 
 So what level do we want to have ;) And what level is normal for people
 to expect (do systems like hadoop do I18N on there error messages, do
 other apache projects?)

I agree with you.

Documentation and user-facing interfaces should definitely support I18N.
That means Horizon, and (maybe) the Python client bindings.
Operators-facing log messages... not so much. By internationalizing them
we lose the ability to google for them, and I'm not convinced the
trade-off is favorable for that particular population.

If you come to the design summit and care about this, join us at the
I18N in OpenStack session.

Regards,

-- 
Thierry Carrez (ttx)
Release Manager, OpenStack

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] upgrade path from oneiric + managedit diablo to precise+essex?

2012-04-12 Thread ikke
Hi,

is there yet documented upgrade path from using managedit repo for
diablo on oneiric to use precise with essex?

I installed my cluster according to instructions from
docs.openstack.org for basic setup with dashboard. There are some
things that don't work still (errors) and I think it might be better
to upgrade it instead of start fixing old. But do you have experience
on what exactly goes broken, or is it straight forward as just
upgrading the packages and restarting ( it never is :) )?

 -i

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] Install instance failed on xenserver 6.0.2

2012-04-12 Thread Yi Sun
Hi,
I used devstack to install openstack on my xenserver 6.0.2. I followed the 
video found in this link http://wiki.openstack.org/XenServer/DevStack. After 
installation, I can access dashboard. But I failed to launch an instance.
I tried to launch image tty, after launching, the instance status field shows 
Error and there has no new VM  showing up in my xencenter.
I did a ps ax on my domU VM, I see following nova processes:
stack@ALLINONE:~/nova/bin$ ps ax | grep nova
 5246 pts/6S+ 0:02 python /opt/stack/nova/bin/nova-api
 5325 pts/8S+ 0:03 python /opt/stack/nova/bin/nova-cert
 5346 pts/9S+ 0:03 python /opt/stack/nova/bin/nova-volume
 5371 pts/10   S+ 0:03 python /opt/stack/nova/bin/nova-network
 5426 pts/11   S+ 0:03 python /opt/stack/nova/bin/nova-scheduler
 5457 pts/12   S+ 0:00 python ./utils/nova-novncproxy --config-file 
/etc/nova/nova.conf --web .
 5477 pts/13   S+ 0:00 python ./bin/nova-xvpvncproxy --config-file 
/etc/nova/nova.conf
 5497 pts/14   S+ 0:03 python ./bin/nova-consoleauth
 5537 pts/16   S+ 0:00 python /opt/stack/nova/bin/nova-objectstore

I'm not seeing nova-compute running. So I tried to start it manually, Then I 
got errors attached in later section.  Can someone help to take a look to see 
if I have missed anything during the installation?
Also, is there a way to see find more debug information when failed to launch a 
instance?

BTW-- I checked Dom0, I have 1.3G free space, is that enough to run 
nova-compute?
Thanks
Yi

012-04-12 03:42:33 CRITICAL nova [-] Unable to log in to XenAPI (is the Dom0 
disk full?)
2012-04-12 03:42:33 TRACE nova Traceback (most recent call last):
2012-04-12 03:42:33 TRACE nova   File ./nova-compute, line 47, in module
2012-04-12 03:42:33 TRACE nova server = 
service.Service.create(binary='nova-compute')
2012-04-12 03:42:33 TRACE nova   File /opt/stack/nova/nova/service.py, line 
272, in create
2012-04-12 03:42:33 TRACE nova periodic_fuzzy_delay=periodic_fuzzy_delay)
2012-04-12 03:42:33 TRACE nova   File /opt/stack/nova/nova/service.py, line 
167, in __init__
2012-04-12 03:42:33 TRACE nova self.manager = manager_class(host=self.host, 
*args, **kwargs)
2012-04-12 03:42:33 TRACE nova   File 
/opt/stack/nova/nova/compute/manager.py, line 198, in __init__
2012-04-12 03:42:33 TRACE nova utils.import_object(compute_driver),
2012-04-12 03:42:33 TRACE nova   File /opt/stack/nova/nova/utils.py, line 90, 
in import_object
2012-04-12 03:42:33 TRACE nova return cls()
2012-04-12 03:42:33 TRACE nova   File 
/opt/stack/nova/nova/virt/connection.py, line 76, in get_connection
2012-04-12 03:42:33 TRACE nova conn = xenapi_conn.get_connection(read_only)
2012-04-12 03:42:33 TRACE nova   File 
/opt/stack/nova/nova/virt/xenapi_conn.py, line 144, in get_connection
2012-04-12 03:42:33 TRACE nova return XenAPIConnection(url, username, 
password)
2012-04-12 03:42:33 TRACE nova   File 
/opt/stack/nova/nova/virt/xenapi_conn.py, line 152, in __init__
2012-04-12 03:42:33 TRACE nova self._session = XenAPISession(url, user, pw)
2012-04-12 03:42:33 TRACE nova   File 
/opt/stack/nova/nova/virt/xenapi_conn.py, line 491, in __init__
2012-04-12 03:42:33 TRACE nova url = self._create_first_session(url, user, 
pw, exception)
2012-04-12 03:42:33 TRACE nova   File 
/opt/stack/nova/nova/virt/xenapi_conn.py, line 500, in _create_first_session
2012-04-12 03:42:33 TRACE nova session.login_with_password(user, pw)
2012-04-12 03:42:33 TRACE nova   File 
/usr/local/lib/python2.7/dist-packages/XenAPI.py, line 182, in lambda
2012-04-12 03:42:33 TRACE nova return lambda *params: self._login(name, 
params)
2012-04-12 03:42:33 TRACE nova   File 
/usr/local/lib/python2.7/dist-packages/XenAPI.py, line 148, in _login
2012-04-12 03:42:33 TRACE nova result = _parse_result(getattr(self, 
'session.%s' % method)(*params))
2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/xmlrpclib.py, line 
1224, in __call__
2012-04-12 03:42:33 TRACE nova return self.__send(self.__name, args)
2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/xmlrpclib.py, line 
1575, in __request
2012-04-12 03:42:33 TRACE nova verbose=self.__verbose
2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/xmlrpclib.py, line 
1264, in request
2012-04-12 03:42:33 TRACE nova return self.single_request(host, handler, 
request_body, verbose)
2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/xmlrpclib.py, line 
1292, in single_request
2012-04-12 03:42:33 TRACE nova self.send_content(h, request_body)
2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/xmlrpclib.py, line 
1439, in send_content
2012-04-12 03:42:33 TRACE nova connection.endheaders(request_body)
2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/httplib.py, line 
951, in endheaders
2012-04-12 03:42:33 TRACE nova self._send_output(message_body)
2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/httplib.py, line 
811, in _send_output

[Openstack] nova nodes hosted in kvm virtual machines: no access to the outside world.

2012-04-12 Thread Pierre Amadio
Hi there !

My goal is to host an essex cloud on my laptop to study how it works,
play with it, demo it and so on.

I am experiencing a network problem with cloud instances: they are not
allowed to access the internet (wget on google.com by example).

Nodes runs as kvm virtual machines hosted in a laptop running Ubuntu
Oneiric.

So, in my laptop/hypervisor, i have created the following libvirt
network used for the openstack nodes:

network
  namedefault/name
  uuidd5d3dcc1-f863-9bbf-8d57-1149e361de6d/uuid
  forward mode='nat'/
  bridge name='virbr0' stp='on' delay='0' /
  mac address='52:54:00:5C:7B:5D'/
  ip address='192.168.122.1' netmask='255.255.255.0'
  /ip
/network

There is no libvirt dhcp, it is nated to the outside world, and the
network used is 192.168.122.0/24

I have installed several nodes (Ubuntu precise).

192.168.122.2   orchestra
This behave as a dhcp and cobbler server to install other nodes.

192.168.122.101 manager-node
Runs nova-api, nova-scheduler, nova-objectstore, nova-volume, nova-cert
and IScsi tgt.

192.168.122.102 messaging
Runs rabbitMQ, MySql, Glance and keystone.

192.168.122.103 compute-a
Runs nova-compute, nova-api and nova-network.

Excerpt from the nova.conf file:
--network_manager=nova.network.manager.FlatDHCPManager
--fixed_range=10.0.0.0/24
--floating_range=192.168.123.0/24
--auto_assign_floating_ip
--flat_network_dns=192.168.122.2

I can run some instances and log in to them from my hypervisor after
adding a route to the 192.168.123.0/24 network via the node running
nova-network (192.168.122.103) :

sudo route add -net 192.168.123.0 netmask 255.255.255.0 gw
192.168.122.103 dev virbr0

So, i have a vm running on 192.168.123.3 :

euca-describe-instances
RESERVATION r-xu7c0o8y  f45695cb80ca402a9a7f63852098b582default
INSTANCEi-0007  ami-0003192.168.123.3   server-7
running adminkey
(f45695cb80ca402a9a7f63852098b582, compute-a)   0   
m1.small2012-04-12T08:58:36.000Znovaaki-0001ari-0002

It s private ip is 10.0.0.2

From it, I cannot download page from the internet:

ubuntu@server-7:~$ wget http://www.yahoo.com/
--2012-04-12 09:36:55--  http://www.yahoo.com/
Resolving www.yahoo.com... 87.248.112.181
Connecting to www.yahoo.com|87.248.112.181|:80... failed: Connection
refused.

But, I can download page from http://192.168.122.1/ (hypervisor virbr0)
as well as http://192.168.0.9/ (hypervisor wifi interface used to get
access to the outside world).

From compute-a, the node running nova-network, i can download pages from
yahoo.com.

An iptables-save file from my hypervisor is attached to this mail.

I did try to remove all the REJECT line in the FORWARD table and reload
the rules without success.

I am afraid i m a bit lost in all those bridges.

Has anyone :

- any idea if my problem is in the nova configuration, or something to
do with the hypervisor iptables rules ?
- done something similar with good result ?
- any idea on what to try next ?

Have a nice day...

# Generated by iptables-save v1.4.10 on Thu Apr 12 11:41:24 2012
*nat
:PREROUTING ACCEPT [415:71017]
:INPUT ACCEPT [88:7343]
:OUTPUT ACCEPT [2282:152990]
:POSTROUTING ACCEPT [2346:157728]
-A POSTROUTING -s 192.168.122.0/24 ! -d 192.168.122.0/24 -p tcp -j MASQUERADE 
--to-ports 1024-65535 
-A POSTROUTING -s 192.168.122.0/24 ! -d 192.168.122.0/24 -p udp -j MASQUERADE 
--to-ports 1024-65535 
-A POSTROUTING -s 192.168.122.0/24 ! -d 192.168.122.0/24 -j MASQUERADE 
-A POSTROUTING -s 10.1.0.0/16 ! -d 10.1.0.0/16 -p tcp -j MASQUERADE --to-ports 
1024-65535 
-A POSTROUTING -s 10.1.0.0/16 ! -d 10.1.0.0/16 -p udp -j MASQUERADE --to-ports 
1024-65535 
-A POSTROUTING -s 10.1.0.0/16 ! -d 10.1.0.0/16 -j MASQUERADE 
COMMIT
# Completed on Thu Apr 12 11:41:24 2012
# Generated by iptables-save v1.4.10 on Thu Apr 12 11:41:24 2012
*mangle
:PREROUTING ACCEPT [159113:79914067]
:INPUT ACCEPT [69979:40278276]
:FORWARD ACCEPT [89107:39599033]
:OUTPUT ACCEPT [60378:10029197]
:POSTROUTING ACCEPT [150789:49724062]
-A POSTROUTING -o virbr2 -p udp -m udp --dport 68 -j CHECKSUM --checksum-fill 
COMMIT
# Completed on Thu Apr 12 11:41:24 2012
# Generated by iptables-save v1.4.10 on Thu Apr 12 11:41:24 2012
*filter
:INPUT ACCEPT [69896:40270442]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [60374:10028752]
-A INPUT -i virbr1 -p udp -m udp --dport 53 -j ACCEPT 
-A INPUT -i virbr1 -p tcp -m tcp --dport 53 -j ACCEPT 
-A INPUT -i virbr1 -p udp -m udp --dport 67 -j ACCEPT 
-A INPUT -i virbr1 -p tcp -m tcp --dport 67 -j ACCEPT 
-A INPUT -i virbr0 -p udp -m udp --dport 53 -j ACCEPT 
-A INPUT -i virbr0 -p tcp -m tcp --dport 53 -j ACCEPT 
-A INPUT -i virbr0 -p udp -m udp --dport 67 -j ACCEPT 
-A INPUT -i virbr0 -p tcp -m tcp --dport 67 -j ACCEPT 
-A INPUT -i virbr2 -p udp -m udp --dport 53 -j ACCEPT 
-A INPUT -i virbr2 -p tcp -m tcp --dport 53 -j ACCEPT 
-A INPUT -i virbr2 -p udp -m udp --dport 67 -j ACCEPT 
-A INPUT -i virbr2 -p tcp -m tcp --dport 67 -j ACCEPT 
-A FORWARD -i virbr1 -o 

Re: [Openstack] I18n issue for OpenStack

2012-04-12 Thread Christopher B Ferris
+1It is important that we distinguish between those who might contribute to the development of OpenStack, who often have advancedlanguage skills, as contrasted with those who might be asked to operate a cloud based on OpenStack. While it may be that the languageof open source development is English, it is not as likely that you'll findsomeone in IT operations at a company in a non-English language speakingcountry who has advanced (and in some cases, any) english language skills. For them, English language log messages might as well have beenwritten in Romulan.As a means of making this real, imagine trying to operate and debug OpenStack if all of the log messages were written in Simple Chinese.Who amongst us could do that, or would much less even attempt it? I rest my case.It is critically important that welocalize as much as possible, including log messages, install and operations manuals as wellas UI components for locales that we would like to see adopt OpenStack. Thorough globalization will be critical to broad adoption of OpenStack,especially in emerging geographies.Cheers,Christopher FerrisIBM Distinguished Engineer, CTO Industry and Cloud StandardsMember, IBM Academy of TechnologyIBM Software Group, Standards Strategyemail: chris...@us.ibm.comTwitter: christo4ferrisphone: +1 508 234 2986-openstack-bounces+chrisfer=us.ibm@lists.launchpad.net wrote: -To: openstack@lists.launchpad.netFrom: Sean Dague Sent by: openstack-bounces+chrisfer=us.ibm@lists.launchpad.netDate: 04/11/2012 03:01PMSubject: Re: [Openstack] I18n issue for OpenStackOn 04/11/2012 08:41 AM, Thierry Carrez wrote: Sheng Bo Hou wrote: After the research done by my colleage Edward Zhang and myself, we have found the following issues for openstack. We have already raised bug https://bugs.launchpad.net/nova/+bug/974810 https://bugs.launchpad.net/nova/+bug/974810 . [...] Thanks for your analysis. We plan to discuss how to fix and extend I18N at the summit. One question that was raised on the ML in February was whether internationalization was actually worth the effort for infrastructure software like OpenStack. I'll be the first to admit that there are other languages than English, but all our open development is based in English already (bugs, reviews, commit messages, mailing-lists, IRC...), so I don't think supporting more languages in the software itself will help growing our developer community.I would tend to disagree with that. People are more likely to invest their time in software if they'll be able to use it better in their locale. I think this is definitely even more true in places where English has less of a dominant presence. It may even bring people to the table solely interested in helping with translation. I've seen that happen elsewhere. On our users community, do operators of OpenStack need translated error messages ? Given that translations are often incomplete, is it worth it ? What do comparable infrastructure open source software projects provide ? The effort to provide them has proven non-trivial, I'd like to make sure it's time well spent.If we want to think about OpenStack as a basic building block like Apache, i18n is critical. Otherwise there are regions that won't adopt it solely because of a lack of i18n.Is there a metric on the completeness so far? Something automated that could be a jenkins coverage kind of test?	-Sean-- Sean DagueIBM Linux Technology Centeremail: slda...@us.ibm.comalt-email: sda...@linux.vnet.ibm.com___Mailing list: https://launchpad.net/~openstackPost to   : openstack@lists.launchpad.netUnsubscribe : https://launchpad.net/~openstackMore help  : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] ERROR: string indices must be integers, not str

2012-04-12 Thread Vaze, Mandar
You may have his this bug : https://bugs.launchpad.net/nova/+bug/965826

Says : this occurs When auth_host (in api-paste.ini) has the wrong IP address

Something to check ...
-Mandar

From: openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net 
[mailto:openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net] On 
Behalf Of Guilherme Birk
Sent: Wednesday, April 11, 2012 10:38 PM
To: Openstack Mail List
Subject: [Openstack] ERROR: string indices must be integers, not str

I've got OpenStack working with this tutorial 
http://www.hastexo.com/resources/docs/installing-openstack-essex-20121-ubuntu-1204-precise-pangolin.

Now I'm trying to deploy a new installation with the official manual, 
http://docs.openstack.org/trunk/openstack-compute/install/content/index.html. I 
can access dashboard, upload images and other things, but when I try to execute 
a nova list, or after connect to dashboard, I got this error: ERROR: string 
indices must be integers, not str.

Anyone had this problem too? Maybe some wrong configuration?

__
Disclaimer:This email and any attachments are sent in strictest confidence for 
the sole use of the addressee and may contain legally privileged, confidential, 
and proprietary data.  If you are not the intended recipient, please advise the 
sender by replying promptly to this email and then delete and destroy this 
email and any attachments without any further use, copying or forwarding___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] The Scheduling feature when reboot the instance

2012-04-12 Thread Văn Đình Phúc



Hi.

I'm using Openstack (2011.3
(2011.3-nova-milestone-tarball:tarmac-20110922115702-k9nkvxqzhj130av2) with 3
Compute nodes.

My scheduling option is default.

I have the problem as the following steps:

   Compute node 1 is installed the modules: nova-api, nova-compute and
   nova-network.
   The resource of node-1 max is fitfor 3 instances (m1.small): i-0001,
   i-0002, i-0003.
   I turn off i-0001.
   and then I request new ínstance by the euca-run-instance command , My new
   instance ( i-0004) is located on the node 1.
   The resources: RAM , CPU,.. of node-2 and node-3 is available.
   finally, I reboot the i-0001.What is happen? the i-0001 is rebooted
   on the node-1 , and It's shutdown off after reboot.I checked the libvirt's
   log :

   Failed to allocate 2147483648 B: Cannot allocate memory
   2012-04-12 16:11:50.530: shutting down

So , Do Openstack have the sheduling feature when rebooting the instance ?

Example: As above , My instance (i-0001) will be migrated to node-2 or
node-3 when the resource of node-1 is not available.





Văn �ình Phúc
Manager - Cloud Team

Techno Department

Bkav Specialization Division

Office: Bkav Building - Yen Hoa New Town, Cau Giay Dist, Hanoi

Tel: (84-4) 3763.2552

Mobile: 0169 4702 388



Do your best, the rest will come !

Hãy làm việc hết mình, những đi��u tốt
đẹp sẽ đến với bạn !

Disclaimer: This e-mail and any files transmitted with it are confidential and
may contain privileged information. It is intended solely for the use of the
individual to whom it is addressed and others authorized to receive it. If you
are not the intended recipient you are notified that disclosing, copying,
distributing or taking any action in reliance on the contents of this
information is strictly prohibited. If you have received this message in error,
please notify the sender immediately by reply e-mail and delete completely this
e-mail from your system, without reproducing, distributing or retaining copies.

inline: phucvdbmail.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] I18n issue for OpenStack

2012-04-12 Thread Hua ZZ Zhang
My cents:

Apache HTTP is not so equivelant to OpenStack here. Generally it doesn't
care about the application errors or exceptions thrown by web applications.
In openstack, exceptions have been defined in nova, horizon, keystone etc.
The messages of these exceptions are important for different users to
understand what has happened. These messages always need to be localized,
returned and displayed on user interface, not just be logged in backend
system. It is very common practice for a global software project.

Sean Dague wrote:
 If we want to think about OpenStack as a basic building block like
 Apache, i18n is critical. Otherwise there are regions that won't adopt
 it solely because of a lack of i18n.

Note that Apache HTTPd, for instance, does not seem to internationalize
its error messages. Only the (enduser-facing) HTML pages it gives back
in response to invalid requests are.



Best Regards,

 
 Edward Zhang(张华)地址:北京市海淀区东北旺西路8号 中关村 
 Staff Software Engineer   软件园28号楼 环宇大厦3层 邮编:100193 
 TravelTransportation Standards   Address: 3F Ring, Building 28 
 Emerging Technology Institute(ETI)Zhongguancun Software Park, 8 
 IBM China Software Development LabDongbeiwang West Road, Haidian
 e-mail: zhu...@cn.ibm.com District, Beijing, P.R.C.100193   
 Notes ID: Hua ZZ Zhang/China/IBM
 Tel: 86-10-82450483 
 
 
 
 
 
 
 





   
 Thierry Carrez
 thierry@openstac 
 k.org To 
 Sent by:  openstack@lists.launchpad.net   
 openstack-bounces  cc 
 +zhuadl=cn.ibm.co 
 m@lists.launchpad Subject 
 .net  Re: [Openstack] I18n issue for  
   OpenStack   
   
 2012-04-12 16:47  
   
   
   
   




Sean Dague wrote:
 If we want to think about OpenStack as a basic building block like
 Apache, i18n is critical. Otherwise there are regions that won't adopt
 it solely because of a lack of i18n.

Note that Apache HTTPd, for instance, does not seem to internationalize
its error messages. Only the (enduser-facing) HTML pages it gives back
in response to invalid requests are.

 Is there a metric on the completeness so far? Something automated that
 could be a jenkins coverage kind of test?

Oddly enough, it's not a question of completeness of translations.
Piggybacking on the awesome Launchpad Translations community always gave
us great coverage. It's more a code support and CI integration issue.

--
Thierry Carrez (ttx)
Release Manager, OpenStack

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

inline: 36224036.gifinline: ecblank.gifinline: graycol.gifinline: pic09216.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] I18n issue for OpenStack

2012-04-12 Thread Soren Hansen
Den 12. apr. 2012 13.27 skrev Hua ZZ Zhang zhu...@cn.ibm.com:
 These messages always need to be localized,
 returned and displayed on user interface, not just be logged in backend
 system. It is very common practice for a global software project.

OpenStack isn't an interactive application. It's a piece of server
software. I'm struggling to think of any server software that writes
anything in its log files in anything other than English. I'm Danish
and generally configure my servers to speak Danish, so I should have
seen it at least occasionally. Do you have any examples of this
alleged very common practice?

--
Soren Hansen             | http://linux2go.dk/
Senior Software Engineer | http://www.cisco.com/
Ubuntu Developer         | http://www.ubuntu.com/
OpenStack Developer      | http://www.openstack.org/

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] I18n issue for OpenStack

2012-04-12 Thread Soren Hansen
Don't get me wrong.. I'd be happy to have the various openstack
clients offer localised error messages. I'd also encourage a
centralised effort to collect these translationns (so that all the
various language bindings will use the same localised error messages).

On the server, though, I believe we should stick to English and
perhaps have every error message include a link (e.g.
http://docs.openstack.doc/exception/NoNetworksDefinedException) to a
localised docs site. I think losing the ability to search the web for
error messages would be a major loss.

-- 
Soren Hansen             | http://linux2go.dk/
Senior Software Engineer | http://www.cisco.com/
Ubuntu Developer         | http://www.ubuntu.com/
OpenStack Developer      | http://www.openstack.org/

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] nova nodes hosted in kvm virtual machines: no access to the outside world.

2012-04-12 Thread Pierre Amadio

 - any idea if my problem is in the nova configuration, or something to
 do with the hypervisor iptables rules ?
 - done something similar with good result ?
 - any idea on what to try next ?

Actually adding an iptables entry on the hypervisor so packet coming
from the floating ip network were masqueraded did the trick:

-A POSTROUTING -s 192.168.123.0/24 ! -d 192.168.123.0/24 -j MASQUERADE




___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Install instance failed on xenserver 6.0.2

2012-04-12 Thread Armando Migliaccio
1.3GB is more than enough. When you get that message, usually space
has already dried up, or there is a problem authenticating with
xenapi.

Check that:

xenapi_connection_url
xenapi_connection_password

are set correctly, and that you can reach dom0 from your devstack instance.

Have a look at your localrc, xenrc, and nova.conf, see if you can find
anything wrong with them.

Hope this help!
Armando

On Thu, Apr 12, 2012 at 5:03 AM, Yi Sun beyo...@gmail.com wrote:
 Hi,
 I used devstack to install openstack on my xenserver 6.0.2. I followed the
 video found in this link http://wiki.openstack.org/XenServer/DevStack. After
 installation, I can access dashboard. But I failed to launch an instance.
 I tried to launch image tty, after launching, the instance status field
 shows Error and there has no new VM  showing up in my xencenter.
 I did a ps ax on my domU VM, I see following nova processes:
 stack@ALLINONE:~/nova/bin$ ps ax | grep nova
  5246 pts/6    S+     0:02 python /opt/stack/nova/bin/nova-api
  5325 pts/8    S+     0:03 python /opt/stack/nova/bin/nova-cert
  5346 pts/9    S+     0:03 python /opt/stack/nova/bin/nova-volume
  5371 pts/10   S+     0:03 python /opt/stack/nova/bin/nova-network
  5426 pts/11   S+     0:03 python /opt/stack/nova/bin/nova-scheduler
  5457 pts/12   S+     0:00 python ./utils/nova-novncproxy --config-file
 /etc/nova/nova.conf --web .
  5477 pts/13   S+     0:00 python ./bin/nova-xvpvncproxy --config-file
 /etc/nova/nova.conf
  5497 pts/14   S+     0:03 python ./bin/nova-consoleauth
  5537 pts/16   S+     0:00 python /opt/stack/nova/bin/nova-objectstore

 I'm not seeing nova-compute running. So I tried to start it manually, Then I
 got errors attached in later section.  Can someone help to take a look to
 see if I have missed anything during the installation?
 Also, is there a way to see find more debug information when failed to
 launch a instance?

 BTW-- I checked Dom0, I have 1.3G free space, is that enough to run
 nova-compute?
 Thanks
 Yi

 012-04-12 03:42:33 CRITICAL nova [-] Unable to log in to XenAPI (is the Dom0
 disk full?)
 2012-04-12 03:42:33 TRACE nova Traceback (most recent call last):
 2012-04-12 03:42:33 TRACE nova   File ./nova-compute, line 47, in module
 2012-04-12 03:42:33 TRACE nova     server =
 service.Service.create(binary='nova-compute')
 2012-04-12 03:42:33 TRACE nova   File /opt/stack/nova/nova/service.py,
 line 272, in create
 2012-04-12 03:42:33 TRACE nova
 periodic_fuzzy_delay=periodic_fuzzy_delay)
 2012-04-12 03:42:33 TRACE nova   File /opt/stack/nova/nova/service.py,
 line 167, in __init__
 2012-04-12 03:42:33 TRACE nova     self.manager =
 manager_class(host=self.host, *args, **kwargs)
 2012-04-12 03:42:33 TRACE nova   File
 /opt/stack/nova/nova/compute/manager.py, line 198, in __init__
 2012-04-12 03:42:33 TRACE nova     utils.import_object(compute_driver),
 2012-04-12 03:42:33 TRACE nova   File /opt/stack/nova/nova/utils.py, line
 90, in import_object
 2012-04-12 03:42:33 TRACE nova     return cls()
 2012-04-12 03:42:33 TRACE nova   File
 /opt/stack/nova/nova/virt/connection.py, line 76, in get_connection
 2012-04-12 03:42:33 TRACE nova     conn =
 xenapi_conn.get_connection(read_only)
 2012-04-12 03:42:33 TRACE nova   File
 /opt/stack/nova/nova/virt/xenapi_conn.py, line 144, in get_connection
 2012-04-12 03:42:33 TRACE nova     return XenAPIConnection(url, username,
 password)
 2012-04-12 03:42:33 TRACE nova   File
 /opt/stack/nova/nova/virt/xenapi_conn.py, line 152, in __init__
 2012-04-12 03:42:33 TRACE nova     self._session = XenAPISession(url, user,
 pw)
 2012-04-12 03:42:33 TRACE nova   File
 /opt/stack/nova/nova/virt/xenapi_conn.py, line 491, in __init__
 2012-04-12 03:42:33 TRACE nova     url = self._create_first_session(url,
 user, pw, exception)
 2012-04-12 03:42:33 TRACE nova   File
 /opt/stack/nova/nova/virt/xenapi_conn.py, line 500, in
 _create_first_session
 2012-04-12 03:42:33 TRACE nova     session.login_with_password(user, pw)
 2012-04-12 03:42:33 TRACE nova   File
 /usr/local/lib/python2.7/dist-packages/XenAPI.py, line 182, in lambda
 2012-04-12 03:42:33 TRACE nova     return lambda *params: self._login(name,
 params)
 2012-04-12 03:42:33 TRACE nova   File
 /usr/local/lib/python2.7/dist-packages/XenAPI.py, line 148, in _login
 2012-04-12 03:42:33 TRACE nova     result = _parse_result(getattr(self,
 'session.%s' % method)(*params))
 2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/xmlrpclib.py,
 line 1224, in __call__
 2012-04-12 03:42:33 TRACE nova     return self.__send(self.__name, args)
 2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/xmlrpclib.py,
 line 1575, in __request
 2012-04-12 03:42:33 TRACE nova     verbose=self.__verbose
 2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/xmlrpclib.py,
 line 1264, in request
 2012-04-12 03:42:33 TRACE nova     return self.single_request(host, handler,
 request_body, verbose)
 2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/xmlrpclib.py,
 line 

[Openstack] Using Foreign Keys

2012-04-12 Thread J. Daniel Schmidt
Dear Developers,

While testing our SUSE OpenStack packages we hit a nasty bug and reported it 
as:  https://bugs.launchpad.net/keystone/+bug/972502

We found out that the underlying cause was a lack of referential integrity[1] 
using sqlite or mysql. When we tried to reproduce this issue on postgresql the 
usage of foreign keys greatly helped to find the cause.

In order to prevent further inconsistencies we created a patch that added more 
foreign keys: https://review.openstack.org/6216

One reviewer commented:
 i don't approve of adding foreign keys, and we should probably remove the
 existing ones (in UserTenantMembership and in Endpoint)

and on 
https://review.openstack.org/#patch,sidebyside,6216,3,keystone/identity/backends/sql.py
 we shouldn't be using foreign keys at all, they are a crutch that are not
 available everywhere

This was a surprising answer to us as the usage of the foreign keys revealed 
the inconsistency in the first place. So removing them elsewhere does in no 
way improve the situation, it even does not help for mysql and sqlite, as 
SQLAlchemy abstracts them away. We also found similar bugs elsewhere:

* https://bugs.launchpad.net/keystone/+bug/959294
* https://bugs.launchpad.net/keystone/+bug/973243
* https://bugs.launchpad.net/keystone/+bug/974199

In our point of view foreign keys should be used in all possible places. This 
would not harm any database that does not support them but helps all of us to 
find data inconsistencies and related bugs, which leads to faster development 
with fewer bugs.


What is your take on these things?
How would you take care of data consistency otherwise?


Thank you for your feedback,
  Berhard M. Wiedemann
  J. Daniel Schmidt

[1]: http://en.wikipedia.org/wiki/Referential_integrity

-- 
J. Daniel Schmidt j...@suse.de SUSE LINUX Products GmbH
Research  Development   Maxfeldstr. 5
HRB 16746 (AG Nürnberg)  D-90409 Nürnberg
GF:  Jeff Hawn, Jennifer Guild, Felix Imendörffer


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] [openstack] Error Unable to list users: [Errno 110] ETIMEDOUT

2012-04-12 Thread Lucian Thomaz

Hi folks,
I have a diablo installation with Dashboard and I'm having the following error 
when I try access Tenants or Users on Dashboard:

Error  Unable to get tenant info: [Errno 110] ETIMEDOUT

Error  Unable to list users: [Errno 110] ETIMEDOUT

Has anyone had this problem?


Lucian Thomaz ___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [openstack] Error Unable to list users: [Errno 110] ETIMEDOUT

2012-04-12 Thread Diego Parrilla Santamaría
Sounds like you have access to keystone, but you don't have access to
nova-api...

-- 
Diego Parrilla
http://www.stackops.com/*CEO*
*www.stackops.com | * diego.parri...@stackops.com** | +34 649 94 43 29 |
skype:diegoparrilla*
* http://www.stackops.com/
*

*




On Thu, Apr 12, 2012 at 2:56 PM, Lucian Thomaz luciantho...@hotmail.comwrote:

  Hi folks,
 I have a diablo installation with Dashboard and I'm having the following
 error when I try access Tenants or Users on Dashboard:

 Error  Unable to get tenant info: [Errno 110] ETIMEDOUT

 Error  Unable to list users: [Errno 110] ETIMEDOUT

 Has anyone had this problem?


 *Lucian Thomaz*

 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] I18n issue for OpenStack

2012-04-12 Thread Sheng Bo Hou
Dear OpenStack friends,

It will be happy and great for our OpenStack community to see this open 
project open to more market all over the world.
In China, OpenStack community is very active. I heard many Chinese 
engineers talking about their wish to have a Chinese versioned openStack, 
including documentation's, manuals, user interfaces, error messages, etc 
in OpenStack meet-ups. 
I have many European friends and also Danish friends, since I used to do 
my university there. They all spoke perfect English, which made me admire, 
cos they were linguists in my point of view. Oriental languages are 
different. They are too far from the western lingual system. In China, 
there are many talented engineers, who are not that kind of linguists, 
but they are lover of open source. I think it is amazing to open the 
door to them. In China, it is very appreciated for software to be 
localized as much as possible.
I used to google or baidu(a famous Chinese search engine) error messages 
and logs in Chinese for other software, though it is not Apache. I found a 
lot of useful references in Chinese, because it has been localized. If it 
is not localized well first, of course it does not have the google or 
yahoo ability to search.:-)
So far I am rather grateful for all the messages following this i18 issue. 
Thank you so much.

Best wishes.
Vincent Hou (侯胜博)

Software Engineer, Standards Growth Team, Emerging Technology Institute, 
IBM China Software Development Lab

Tel: 86-10-82450778 Fax: 86-10-82453660
Notes ID: Sheng Bo Hou/China/IBM@IBMCNE-mail: sb...@cn.ibm.com 
Address:3F Ring, Building 28 Zhongguancun Software Park, 8 Dongbeiwang 
West Road, Haidian District, Beijing, P.R.C.100193



Soren Hansen so...@linux2go.dk 
Sent by: openstack-bounces+sbhou=cn.ibm@lists.launchpad.net
2012-04-12 19:50

To
Hua ZZ Zhang/China/IBM@IBMCN
cc
openstack@lists.launchpad.net, Thierry Carrez thie...@openstack.org, 
openstack-bounces+zhuadl=cn.ibm@lists.launchpad.net
Subject
Re: [Openstack] I18n issue for OpenStack






Don't get me wrong.. I'd be happy to have the various openstack
clients offer localised error messages. I'd also encourage a
centralised effort to collect these translationns (so that all the
various language bindings will use the same localised error messages).

On the server, though, I believe we should stick to English and
perhaps have every error message include a link (e.g.
http://docs.openstack.doc/exception/NoNetworksDefinedException) to a
localised docs site. I think losing the ability to search the web for
error messages would be a major loss.

-- 
Soren Hansen | http://linux2go.dk/
Senior Software Engineer | http://www.cisco.com/
Ubuntu Developer | http://www.ubuntu.com/
OpenStack Developer  | http://www.openstack.org/

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Where does Keystone middleware for Swift belong?

2012-04-12 Thread Jay Pipes

On 04/11/2012 11:03 PM, John Dickinson wrote:

I do not think that these pieces of middleware belong in the core swift repo.

1) Including them in swift would require swift to depend on keystone for full 
testing.

2) (When the middleware was created) Keystone's API was in a state of constant 
flux. Keystone has changed quite a bit since then, so this may not be the case 
anymore.

3) Swift does not require Keystone to run (and in fact many production 
environments don't use keystone at all). [1]

4) We have previously removed auth systems from swift's core code in order to 
simplify the codebase and allow separate dev cycles. All that is included now 
is the most basic auth system required for dev work, stand-alone tests, and POC 
deployments.

Our thought thus far has been that auth systems providing auth for swift have 
the responsibility to maintain their integration code. It's not swift's 
responsibility to manage and maintain code for every auth system that wants to 
provide an auth mechanism for swift.

That being said, there has been quite a bit of recent conversation about the 
concept of *-contrib areas for each project that include optional 
add-ons/extensions/plugins/etc or alternative APIs for each project. I expect 
these conversations to continue next week in person at the summit. One option 
is for the swift keystone middleware to be a part of such a contrib area.

It sounds like there are good reasons for both projects to not want to include 
these pieces of middleware in their respective core repos. Perhaps a contrib 
area can be a compromise, but that does not answer who is responsible for it 
(ie who maintains the code?). I think that's a separate, but related, question.


I think this is an excellent solution -- the contrib area/project. And 
as far as who should be responsible for it, I believe that the 
responsibilities should be shared across the relevant projects that may 
be integrated. For instance, recently Chmouel did a great job working 
with the Keystone contributors to hammer out the Swift keystone 
middleware and worked with the Glance contributors to make requisite 
changes in the Glance Swift storage driver... so a number of affected 
parties shared responsibility.


Best,
-jay

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] minimal IaaS openstack installation FROM SOURCE on CentOS

2012-04-12 Thread Mauch, Viktor (SCC)
Hi,

 

I need to install a minimal/simple Openstack IaaS Deployment framework on
CentOS 6.x from Source.

 

Is there anywhere a nice howto tutorial?

 

And yes: I know there are packeges, but I need it from source.

 

Cheers Viktor



smime.p7s
Description: S/MIME cryptographic signature
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] I18n issue for OpenStack

2012-04-12 Thread Sean Dague

On 04/12/2012 04:52 AM, Thierry Carrez wrote:

Joshua Harlow wrote:

So there is a question here that I don’t understand.

There a different levels of I18N, for say user facing error messages, or
for other things I consider UI (horizon).

Those need to be I18N and all that. I think the larger part that I don’t
understand is why the things that are not the above (log messages) are
being internationalized.

So what level do we want to have ;) And what level is normal for people
to expect (do systems like hadoop do I18N on there error messages, do
other apache projects?)


I agree with you.

Documentation and user-facing interfaces should definitely support I18N.
That means Horizon, and (maybe) the Python client bindings.
Operators-facing log messages... not so much. By internationalizing them
we lose the ability to google for them, and I'm not convinced the
trade-off is favorable for that particular population.


As long as user facing interfaces also means command line interface, I 
think we're on the same page.


-Sean

--
Sean Dague
IBM Linux Technology Center
email: slda...@us.ibm.com
alt-email: sda...@linux.vnet.ibm.com


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] I18n issue for OpenStack

2012-04-12 Thread David Kranz
Both points of view being expressed about this with respect to log error 
messages are valid and need to be accommodated.
An answer, as was suggested a while back, is for error messages to have 
two parts:


1. A locale-independent part that can be used for searches or understood 
by developers who get logs as parts of bug reports.
2.  A localized part that lets operators determine if the problem is 
their issue or an OpenStack bug to be reported.


The current English string would serve the first role, and the logging 
code could be changed to also emit the localized string if available. I 
would argue

for this only in the case of ERROR messages and not DEBUG.

While on the subject of logs, it would be good to agree on what actions 
should cause errors in logs to appear. Ideally, they would only occur if 
an OpenStack bug
was detected (out-of-bounds array ref, etc.) or some operational problem 
occurred (disk ran out of space, etc.). Right now errors are sometimes 
output for other
reasons such as bad arguments to api calls. This makes it difficult for 
an operator to know when a real problem with the system has occurred.


David Kranz
Quanta Research Cambridge




On 4/12/2012 9:06 AM, Sheng Bo Hou wrote:

Dear OpenStack friends,

It will be happy and great for our OpenStack community to see this 
open project open to more market all over the world.
In China, OpenStack community is very active. I heard many Chinese 
engineers talking about their wish to have a Chinese versioned 
openStack, including documentation's, manuals, user interfaces, error 
messages, etc in OpenStack meet-ups.
I have many European friends and also Danish friends, since I used to 
do my university there. They all spoke perfect English, which made me 
admire, cos they were linguists in my point of view. Oriental 
languages are different. They are too far from the western lingual 
system. In China, there are many talented engineers, who are not that 
kind of linguists, but they are lover of open source. I think it is 
amazing to open the door to them. In China, it is very appreciated 
for software to be localized as much as possible.
I used to google or baidu(a famous Chinese search engine) error 
messages and logs in Chinese for other software, though it is not 
Apache. I found a lot of useful references in Chinese, because it has 
been localized. If it is not localized well first, of course it does 
not have the google or yahoo ability to search.:-)
So far I am rather grateful for all the messages following this i18 
issue. Thank you so much.


Best wishes.
Vincent Hou (???)

Software Engineer, Standards Growth Team, Emerging Technology 
Institute, IBM China Software Development Lab


Tel: 86-10-82450778 Fax: 86-10-82453660
Notes ID: Sheng Bo Hou/China/IBM@IBMCNE-mail: sb...@cn.ibm.com
Address:3F Ring, Building 28 Zhongguancun Software Park, 8 Dongbeiwang 
West Road, Haidian District, Beijing, P.R.C.100193



*Soren Hansen so...@linux2go.dk*
Sent by: openstack-bounces+sbhou=cn.ibm@lists.launchpad.net

2012-04-12 19:50


To
Hua ZZ Zhang/China/IBM@IBMCN
cc
	openstack@lists.launchpad.net, Thierry Carrez 
thie...@openstack.org, 
openstack-bounces+zhuadl=cn.ibm@lists.launchpad.net

Subject
Re: [Openstack] I18n issue for OpenStack









Don't get me wrong.. I'd be happy to have the various openstack
clients offer localised error messages. I'd also encourage a
centralised effort to collect these translationns (so that all the
various language bindings will use the same localised error messages).

On the server, though, I believe we should stick to English and
perhaps have every error message include a link (e.g.
http://docs.openstack.doc/exception/NoNetworksDefinedException) to a
localised docs site. I think losing the ability to search the web for
error messages would be a major loss.

--
Soren Hansen | http://linux2go.dk/
Senior Software Engineer | http://www.cisco.com/
Ubuntu Developer | http://www.ubuntu.com/
OpenStack Developer  | http://www.openstack.org/

___
Mailing list: https://launchpad.net/~openstack 
https://launchpad.net/%7Eopenstack

Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack 
https://launchpad.net/%7Eopenstack

More help   : https://help.launchpad.net/ListHelp



___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] profiling nova-api

2012-04-12 Thread Jay Pipes

Hi Yun!

Thanks very much for sharing this information. Can I ask you to pull the 
code in this branch:


https://review.openstack.org/#change,5762

And retry your test? On my test machines, the work that Huang Zhiteng 
has done to convert Nova's servers to use multiple operating system 
processes, each with its own greenthread service pool, resulted in a 
massive throughput improvement, turning a quickly-bottlenecked system 
into a server that could scale nearly linearly with the number of worker 
processes.


Be sure to set osapi_workers to the number of cores your machine has... 
and also note that your code profiling technique is unlikely to be 
effective since cProfile wouldn't track the forked child worker 
processes' stacks, AFAIK. Still interested to see if the time to execute 
the 300 API calls is dramatically reduced, though.


Looking forward to any results you might have.

Best,
-jay

On 04/11/2012 04:48 PM, Yun Mao wrote:

Hi Stackers, I spent some time looking at nova-api today.

Setup: everything-on-one-node devstack, essex trunk. I setup 1 user
with 10 tiny VMs.
Client: 3 python threads each doing a loop of nova list equivalent
for 100 times. So 300 API calls with concurrency=3.
how to profile: python -m cProfile -s time
/opt/stack/nova/bin/nova-api --flagfile=/etc/nova/nova.conf
--logdir=/var/log/nova --nodebug
The partial output is attached in the end.

Observations:
* It takes about 60 seconds to finish. CPU of nova-api is around 70% to 90%

* Database access: Each nova list API call will issue 4 db APIs: 3
instance_get_all_by_filters(), 1
instance_fault_get_by_instance_uuids(), so 1200 db API calls total
(note: not necessarily 1200 SQL statements, could be more). The 900
instance_get_all_by_filters() calls took 30.2 seconds (i.e. 0.03s
each)! The 300 instance_fault_get_by_instance_uuids() calls only took
1.129 seconds (0.004 each).

You might think: MySQL sucks. Not so fast. Remember this is a tiny
database with only 10 VMs. Profile also shows that the actual
_mysql.connection.query() method only took 1.883 seconds in total. So,
we pretty much spend 29 seconds out of 60 seconds doing either
sqlalchemy stuff or our own wrapper. You can also see from the sheer
volume of sqlalchemy library calls involved.

* the cfg.py library inefficiency. During 300 API calls,
common.cfg.ConfigOpts._get() is called 135005 times! and we paid 2.470
sec for that.

Hopefully this is useful for whoever wants to improve the performance
of nova-api.

Thanks,
Yun

===

  23355694 function calls (22575841 primitive calls) in 77.874 seconds

Ordered by: internal time

ncalls  tottime  percall  cumtime  percall filename:lineno(function)
   812   25.7250.032   25.7250.032 {method 'poll' of
'select.epoll' objects}
  24081.8830.0011.8830.001 {method 'query' of
'_mysql.connection' objects}
 703801.6670.0007.1870.000
expression.py:2263(corresponding_column)
1350051.2540.0002.4700.000 cfg.py:1058(_get)
 410271.0430.0001.9070.000 schema.py:542(__init__)
 388021.0080.0001.2190.000 __init__.py:451(format)
1622060.8210.0000.8210.000 util.py:883(values)
   15306660.7730.0000.7740.000 {isinstance}
135046/1349600.7160.0001.9190.000 cfg.py:1107(_substitute)
  12050.7130.0011.3690.001 base.py:2106(__init__)
1836000.6900.0000.7960.000 interfaces.py:954(_reduce_path)
 810020.6870.0002.4920.000 compiler.py:312(visit_label)
 388020.6500.0006.0870.000 log.py:227(format)
3192700.6220.0000.7480.000 attributes.py:164(__get__)
890242/8842290.6080.0001.8850.000 {getattr}
 405000.6050.0003.1010.000 schema.py:955(_make_proxy)
120783/1207380.6030.0000.6050.000 {method 'sub' of
'_sre.SRE_Pattern' objects}
 810000.6010.0002.1560.000
interfaces.py:677(create_row_processor)
 630000.5900.0000.7070.000 times.py:44(DateTime_or_None)
 981020.5880.0000.8860.000 compiler.py:337(visit_column)
6580980.5800.0000.5810.000 {method 'intersection'
of 'set' objects}
1098020.5620.0000.5620.000 expression.py:3625(_from_objects)
231610/12020.5510.0005.8130.005
visitors.py:58(_compiler_dispatch)
1440020.5100.0000.6930.000
compiler.py:622(_truncated_identifier)
135005/1349600.4850.0004.8720.000 cfg.py:860(__getattr__)
  24080.4630.0001.9420.001 {built-in method fetch_row}
 711000.4600.0000.5800.000
strategies.py:121(create_row_processor)
2990310.4370.0000.4370.000 {_codecs.utf_8_decode}
  60000.4370.0001.7990.000 models.py:93(iteritems)
36000/90000.4090.0004.7910.001 

Re: [Openstack] Where does Keystone middleware for Swift belong?

2012-04-12 Thread Chmouel Boudjnah
On Thu, Apr 12, 2012 at 5:03 AM, John Dickinson m...@not.mn wrote:
 4) We have previously removed auth systems from swift's core code in order to 
 simplify the codebase and allow separate dev cycles. All that is included now 
 is the most basic auth system required for dev work, stand-alone tests, and 
 POC deployments.

If swift doesn't want to be opinionated about a auth server I think
this is a good reason to have it outside Swift and probably like you
suggest in the contrib area if that something we can make happen.

I like the idea of having the middleware in the *client as effectively
those middleware are clients but that may not what a end-user expect.

It may be another discussion but it would be nice to abstract the auth
code in Swift as currently this is not so easy to implement all Swift
features in Auth middleware.

The best way currently to do so is to follow the commits in
tempauth/swauth and each middleware maintainers implement the features
on his own.

Maru has been thinking about it and started to do an implementation in
the swift_auth middleware in this review :

https://review.openstack.org/#patch,sidebyside,5661,4,keystone/middleware/swift_auth.py

I can't remember what was the outcome of the initial work done by Greg
on authz in Swift but is Maru review can be something we can look
forward to have in Swift so all the other middleware would only have
to do the strict minimal of authentication/validation ?

Cheers,
Chmouel.

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] control user quota

2012-04-12 Thread Xin Zhao

Hello,

I try to assign quota to individual users, to control how many instances 
each user can run concurrently. But I don't see a doc describing how to 
do that. I use diablo release.

Any help or doc pointer will be greatly appreciated.

Xin


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] profiling nova-api

2012-04-12 Thread Justin Santa Barbara
Both the profiling  the multi-process work are great - good stuff!

Jay: Won't going multi-process just make it harder to profile?  I think
it's actually a good thing to profile without the multi-process patch, find
 fix and the bottlenecks in single-request performance, and then use
multi-process for great concurrent-request performance?

Justin




On Thu, Apr 12, 2012 at 6:49 AM, Jay Pipes jaypi...@gmail.com wrote:

 Hi Yun!

 Thanks very much for sharing this information. Can I ask you to pull the
 code in this branch:

 https://review.openstack.org/#**change,5762https://review.openstack.org/#change,5762

 And retry your test? On my test machines, the work that Huang Zhiteng has
 done to convert Nova's servers to use multiple operating system processes,
 each with its own greenthread service pool, resulted in a massive
 throughput improvement, turning a quickly-bottlenecked system into a server
 that could scale nearly linearly with the number of worker processes.

 Be sure to set osapi_workers to the number of cores your machine has...
 and also note that your code profiling technique is unlikely to be
 effective since cProfile wouldn't track the forked child worker processes'
 stacks, AFAIK. Still interested to see if the time to execute the 300 API
 calls is dramatically reduced, though.

 Looking forward to any results you might have.

 Best,
 -jay


 On 04/11/2012 04:48 PM, Yun Mao wrote:

 Hi Stackers, I spent some time looking at nova-api today.

 Setup: everything-on-one-node devstack, essex trunk. I setup 1 user
 with 10 tiny VMs.
 Client: 3 python threads each doing a loop of nova list equivalent
 for 100 times. So 300 API calls with concurrency=3.
 how to profile: python -m cProfile -s time
 /opt/stack/nova/bin/nova-api --flagfile=/etc/nova/nova.conf
 --logdir=/var/log/nova --nodebug
 The partial output is attached in the end.

 Observations:
 * It takes about 60 seconds to finish. CPU of nova-api is around 70% to
 90%

 * Database access: Each nova list API call will issue 4 db APIs: 3
 instance_get_all_by_filters(), 1
 instance_fault_get_by_**instance_uuids(), so 1200 db API calls total
 (note: not necessarily 1200 SQL statements, could be more). The 900
 instance_get_all_by_filters() calls took 30.2 seconds (i.e. 0.03s
 each)! The 300 instance_fault_get_by_**instance_uuids() calls only took
 1.129 seconds (0.004 each).

 You might think: MySQL sucks. Not so fast. Remember this is a tiny
 database with only 10 VMs. Profile also shows that the actual
 _mysql.connection.query() method only took 1.883 seconds in total. So,
 we pretty much spend 29 seconds out of 60 seconds doing either
 sqlalchemy stuff or our own wrapper. You can also see from the sheer
 volume of sqlalchemy library calls involved.

 * the cfg.py library inefficiency. During 300 API calls,
 common.cfg.ConfigOpts._get() is called 135005 times! and we paid 2.470
 sec for that.

 Hopefully this is useful for whoever wants to improve the performance
 of nova-api.

 Thanks,
 Yun

 ===

  23355694 function calls (22575841 primitive calls) in 77.874
 seconds

Ordered by: internal time

ncalls  tottime  percall  cumtime  percall filename:lineno(function)
   812   25.7250.032   25.7250.032 {method 'poll' of
 'select.epoll' objects}
  24081.8830.0011.8830.001 {method 'query' of
 '_mysql.connection' objects}
 703801.6670.0007.1870.000
 expression.py:2263(**corresponding_column)
1350051.2540.0002.4700.000 cfg.py:1058(_get)
 410271.0430.0001.9070.000 schema.py:542(__init__)
 388021.0080.0001.2190.000 __init__.py:451(format)
1622060.8210.0000.8210.000 util.py:883(values)
   15306660.7730.0000.7740.000 {isinstance}
 135046/1349600.7160.0001.9190.000 cfg.py:1107(_substitute)
  12050.7130.0011.3690.001 base.py:2106(__init__)
1836000.6900.0000.7960.000 interfaces.py:954(_reduce_*
 *path)
 810020.6870.0002.4920.000 compiler.py:312(visit_label)
 388020.6500.0006.0870.000 log.py:227(format)
3192700.6220.0000.7480.000 attributes.py:164(__get__)
 890242/8842290.6080.0001.8850.000 {getattr}
 405000.6050.0003.1010.000 schema.py:955(_make_proxy)
 120783/1207380.6030.0000.6050.000 {method 'sub' of
 '_sre.SRE_Pattern' objects}
 810000.6010.0002.1560.000
 interfaces.py:677(create_row_**processor)
 630000.5900.0000.7070.000
 times.py:44(DateTime_or_None)
 981020.5880.0000.8860.000
 compiler.py:337(visit_column)
6580980.5800.0000.5810.000 {method 'intersection'
 of 'set' objects}
1098020.5620.0000.5620.000 expression.py:3625(_from_**
 objects)
 231610/12020.5510.0005.8130.005
 

Re: [Openstack] profiling nova-api

2012-04-12 Thread Jay Pipes

On 04/12/2012 10:39 AM, Justin Santa Barbara wrote:

Both the profiling  the multi-process work are great - good stuff!

Jay: Won't going multi-process just make it harder to profile?


Yep, that's why I said also note that your code profiling technique is 
unlikely to be effective since cProfile wouldn't track the forked child 
worker processes' stacks ;)


   I think

it's actually a good thing to profile without the multi-process patch,
find  fix and the bottlenecks in single-request performance, and then
use multi-process for great concurrent-request performance?


Agreed!

-jay

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [Netstack] Role of nova-manage network commands when using QuantumManager

2012-04-12 Thread heut2008
nova-manage is an admin tool,just as you said,it opeates the DB
directly,and can be executed both in nova-network node and
nova-compute node,it is a simple way to work as an admin tool before
keystone come out. in folsom,there will be and admin tool like
novaclient to take the place of nova-manage.

2012/4/12 Vaze, Mandar mandar.v...@nttdata.com:
 It is my understanding that in multi-node setup :

 · nova-manage can be executed from any machine which may not be
 running nova-network process.  (Or should nova-manage always be run on
 nova-network node ?)

 · nova-manage does DB operations and delegates the actual networking
 calls to nova-network process ?



 Is this understanding correct ?



 I traced “nova-manage network create” and nova-manage network delete” using
 FlatDHCPManager (default for devstack/stack.sh)

 Both these calls seem to be doing only DB operations.

 BTW, nova-network process was shutdown during both “network create” and
 “network delete” – Still both operations were successful.



 But when using QuantumManager as network manager – nova-manage seems to be
 doing networking operations like “iptables-save” (during network create) and
 “kill_dhcp” (during network delete)

 (via linux-net L3 driver)



 Since nova-manage command may be executed on a host which isn’t running
 nova-network – network commands like “iptables” and “kill -9 pid of
 dnsmasq” on host running nova-manage seems incorrect.



 For the first scenario (iptables-save during “network create” – there is
 already a defect in LP : https://bugs.launchpad.net/nova/+bug/977738

 and review : https://review.openstack.org/6451



 I would like your comments and opinions which would help me understand
  “What nova-manage should and should NOT do”



 Thanks,

 -Mandar










 __
 Disclaimer:This email and any attachments are sent in strictest confidence
 for the sole use of the addressee and may contain legally privileged,
 confidential, and proprietary data. If you are not the intended recipient,
 please advise the sender by replying promptly to this email and then delete
 and destroy this email and any attachments without any further use, copying
 or forwarding

 --
 Mailing list: https://launchpad.net/~netstack
 Post to     : netst...@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~netstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] control user quota

2012-04-12 Thread Diego Parrilla Santamaría
You can set quotas per tenant. If you have Horizon installed may be you can
modify quotas in the System Panel.

-- 
Diego Parrilla
http://www.stackops.com/*CEO*
*www.stackops.com | * diego.parri...@stackops.com** | +34 649 94 43 29 |
skype:diegoparrilla*
* http://www.stackops.com/
*

*



On Thu, Apr 12, 2012 at 4:27 PM, Xin Zhao xz...@bnl.gov wrote:

 Hello,

 I try to assign quota to individual users, to control how many instances
 each user can run concurrently. But I don't see a doc describing how to do
 that. I use diablo release.
 Any help or doc pointer will be greatly appreciated.

 Xin


 __**_
 Mailing list: 
 https://launchpad.net/~**openstackhttps://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : 
 https://launchpad.net/~**openstackhttps://launchpad.net/~openstack
 More help   : 
 https://help.launchpad.net/**ListHelphttps://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] control user quota

2012-04-12 Thread heut2008
nova does not support it ever,you can set the flag quota_instances
to control the total num instances a tenant can create ,the num of
instances concurrently created is surely to be less than this quota .

2012/4/12 Xin Zhao xz...@bnl.gov:
 Hello,

 I try to assign quota to individual users, to control how many instances
 each user can run concurrently. But I don't see a doc describing how to do
 that. I use diablo release.
 Any help or doc pointer will be greatly appreciated.

 Xin


 ___
 Mailing list: https://launchpad.net/~openstack
 Post to     : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] control user quota

2012-04-12 Thread Eoghan Glynn


 I try to assign quota to individual users, to control how many
 instances
 each user can run concurrently. But I don't see a doc describing how
 to
 do that. I use diablo release.
 Any help or doc pointer will be greatly appreciated.


Quotas apply at the nova project/tenant granularity, as opposed to an 
individual user.

Project-specific quotas may be set via the nova CLI, e.g.

  $ nova quota-update tenant_ID --instances=50

otherwise the configured default quota is inherited.

Since you're still on diablo, the new quota classes mechanism would not be 
relevant.

Cheers,
Eoghan 

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Using Foreign Keys

2012-04-12 Thread Clay Gerrard
On Thu, Apr 12, 2012 at 7:35 AM, J. Daniel Schmidt j...@suse.de wrote:

 In our point of view foreign keys should be used in all possible places. This
 would not harm any database that does not support them but helps all of us to
 find data inconsistencies and related bugs, which leads to faster development
 with fewer bugs.


FWIW, I recently learned that you can enforce foreign keys in sqlite 
3.6.19 with a pragma by setting up and event/listener on session
create.

http://www.sqlite.org/foreignkeys.html

We've had some good success with it.

-clayg

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] profiling nova-api

2012-04-12 Thread Pitucha, Stanislaw Izaak
Just a small warning: since cProfile has its own overhead on entering/exiting 
every method and uses deterministic rather than statistical profiling, it may 
misrepresent tiny functions. They will take much more wall-clock time simply 
due to the profiling overhead * number of executions.
I'm not saying cfg is not slow, but in this case it may be worth confirming the 
actual time spend on each call by doing a minimalistic test with timeit, 
without any profiler (request the same variable 100 times and see how much 
it really takes per iteration).

Regards,
Stanisław Pitucha
Cloud Services
Hewlett Packard


-Original Message-
From: openstack-bounces+stanislaw.pitucha=hp@lists.launchpad.net 
[mailto:openstack-bounces+stanislaw.pitucha=hp@lists.launchpad.net] On 
Behalf Of Yun Mao
Sent: Wednesday, April 11, 2012 9:48 PM
To: openstack@lists.launchpad.net
Subject: [Openstack] profiling nova-api

Hi Stackers, I spent some time looking at nova-api today.

Setup: everything-on-one-node devstack, essex trunk. I setup 1 user
with 10 tiny VMs.
Client: 3 python threads each doing a loop of nova list equivalent
for 100 times. So 300 API calls with concurrency=3.
how to profile: python -m cProfile -s time
/opt/stack/nova/bin/nova-api --flagfile=/etc/nova/nova.conf
--logdir=/var/log/nova --nodebug
The partial output is attached in the end.

Observations:
* It takes about 60 seconds to finish. CPU of nova-api is around 70% to 90%

* Database access: Each nova list API call will issue 4 db APIs: 3
instance_get_all_by_filters(), 1
instance_fault_get_by_instance_uuids(), so 1200 db API calls total
(note: not necessarily 1200 SQL statements, could be more). The 900
instance_get_all_by_filters() calls took 30.2 seconds (i.e. 0.03s
each)! The 300 instance_fault_get_by_instance_uuids() calls only took
1.129 seconds (0.004 each).

You might think: MySQL sucks. Not so fast. Remember this is a tiny
database with only 10 VMs. Profile also shows that the actual
_mysql.connection.query() method only took 1.883 seconds in total. So,
we pretty much spend 29 seconds out of 60 seconds doing either
sqlalchemy stuff or our own wrapper. You can also see from the sheer
volume of sqlalchemy library calls involved.

* the cfg.py library inefficiency. During 300 API calls,
common.cfg.ConfigOpts._get() is called 135005 times! and we paid 2.470
sec for that.

Hopefully this is useful for whoever wants to improve the performance
of nova-api.

Thanks,
Yun

===

 23355694 function calls (22575841 primitive calls) in 77.874 seconds

   Ordered by: internal time

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
  812   25.7250.032   25.7250.032 {method 'poll' of
'select.epoll' objects}
 24081.8830.0011.8830.001 {method 'query' of
'_mysql.connection' objects}
703801.6670.0007.1870.000
expression.py:2263(corresponding_column)
   1350051.2540.0002.4700.000 cfg.py:1058(_get)
410271.0430.0001.9070.000 schema.py:542(__init__)
388021.0080.0001.2190.000 __init__.py:451(format)
   1622060.8210.0000.8210.000 util.py:883(values)
  15306660.7730.0000.7740.000 {isinstance}
135046/1349600.7160.0001.9190.000 cfg.py:1107(_substitute)
 12050.7130.0011.3690.001 base.py:2106(__init__)
   1836000.6900.0000.7960.000 interfaces.py:954(_reduce_path)
810020.6870.0002.4920.000 compiler.py:312(visit_label)
388020.6500.0006.0870.000 log.py:227(format)
   3192700.6220.0000.7480.000 attributes.py:164(__get__)
890242/8842290.6080.0001.8850.000 {getattr}
405000.6050.0003.1010.000 schema.py:955(_make_proxy)
120783/1207380.6030.0000.6050.000 {method 'sub' of
'_sre.SRE_Pattern' objects}
810000.6010.0002.1560.000
interfaces.py:677(create_row_processor)
630000.5900.0000.7070.000 times.py:44(DateTime_or_None)
981020.5880.0000.8860.000 compiler.py:337(visit_column)
   6580980.5800.0000.5810.000 {method 'intersection'
of 'set' objects}
   1098020.5620.0000.5620.000 expression.py:3625(_from_objects)
231610/12020.5510.0005.8130.005
visitors.py:58(_compiler_dispatch)
   1440020.5100.0000.6930.000
compiler.py:622(_truncated_identifier)
135005/1349600.4850.0004.8720.000 cfg.py:860(__getattr__)
 24080.4630.0001.9420.001 {built-in method fetch_row}
711000.4600.0000.5800.000
strategies.py:121(create_row_processor)
   2990310.4370.0000.4370.000 {_codecs.utf_8_decode}
 60000.4370.0001.7990.000 models.py:93(iteritems)
36000/90000.4090.0004.7910.001 mapper.py:2146(populate_state)
810020.3930.0001.1040.000

[Openstack] Quantum and HTTPD

2012-04-12 Thread Adam Young
Over the past day or so, I've made an effort  to get Quantum running in 
HTTPD.


My rationale has been to provide:

1. Native SSL support
2. IPv6
3. Certificate based Authentication

My goal has been to do this all on Essex without changing the projects' 
python code base. I'm attempting to do this for all of the Openstack 
components,  and since Quantum has no dependencies,  it seemed a good 
next step after Keystone.



The obvious way to set it up should be to use a wsgi file with just


from paste.deploy.loadwsgi  import loadapp
application = loadapp('config:/etc/quantum/quantum.conf', 'quantum')

But it fails due to issues finding the plugins (error log at the end of 
the message). It deploys cleanly once I made the following changes to 
quantum.


--- a/quantum/extensions/extensions.py
+++ b/quantum/extensions/extensions.py
@@ -538,8 +538,9 @@ class ResourceExtension(object):
 # Returns the extention paths from a config entry and the __path__
 # of quantum.extensions
 def get_extensions_path(config=None):
-paths = ':'.join(quantum.extensions.__path__)
-if config:
-paths = ':'.join([config.get('api_extensions_path', ''), paths])
+#paths = ':'.join(quantum.extensions.__path__)
+paths = /etc/quantum/plugins/
+#if config:
+#paths = ':'.join([config.get('api_extensions_path', ''), paths])

 return paths

Without this, there is a spurious error message due to the leading ':'  
which puts a blank first element to the path.  It also fails to find the 
extensions path regardless of values put into config files etc.  It is 
this last issue which leads me to highly suggest we push Quantum to get 
on the openstack-common bandwagon,  as its Config file processing is 
confusing and,  I think, broken for the general case.



The other issue which leads me to suspect this approach won't work is 
the fact that the quantum command line client accepts a hostname and a 
port,  but not an URL.  So,  while we could deploy quantum behind HTTPD 
and port 443,  it would basically be the root of the HTTP directory,  
and we wouldn't be able to share the HTTPD instance.  We couldn't do


https://hostname/quantum

and put it next to

https://hostname/keystone


Again, not without a code change.

Finally,  there seems to be some support for SSL in Quantum.  I note 
that the quantum client has   the option


-s, --ssl use ssl

which leads me to believe that it has been at least attempted.  It may 
be that the quantum server would not be severely impacted by the 
overhead of SSL in Python.




Here's the HTTP error log if I don't make the above change:


[Thu Apr 12 11:21:13 2012] [info] Initial (No.1) HTTPS request received 
for chil

d 7 (server ayoungstack.bos.redhat.com:443)
[Thu Apr 12 11:21:13 2012] [info] [client 10.16.187.36] mod_wsgi 
(pid=8747, proc
ess='', application='ayoungstack.bos.redhat.com|/quantum/api'): Loading 
WSGI scr

ipt '/var/www/cgi-bin/quantum/api'.
[Thu Apr 12 11:21:13 2012] [error] 
ERROR:quantum.extensions.extensions:Extension

 path /etc/quantum/extension doesn't exist!
[Thu Apr 12 11:21:13 2012] [error] 
WARNING:quantum.extensions.extensions:extensi

on file portstats.py wasnt loaded due to cannot import name extensions
[Thu Apr 12 11:21:13 2012] [error] 
WARNING:quantum.extensions.extensions:extensi
on Cisco Nova Tenant not supported by plugin 
quantum.plugins.openvswitch.ovs_qu

antum_plugin.OVSQuantumPlugin object at 0x7f1fae80e450
[Thu Apr 12 11:21:13 2012] [error] 
WARNING:quantum.extensions.extensions:extensi
on Cisco Port Profile not supported by plugin 
quantum.plugins.openvswitch.ovs_q

uantum_plugin.OVSQuantumPlugin object at 0x7f1fae80e450
[Thu Apr 12 11:21:13 2012] [error] 
WARNING:quantum.extensions.extensions:extensi
on Cisco Multiport not supported by plugin 
quantum.plugins.openvswitch.ovs_quan

tum_plugin.OVSQuantumPlugin object at 0x7f1fae80e450
[Thu Apr 12 11:21:13 2012] [error] 
WARNING:quantum.extensions.extensions:Did not
 find expected name Extensions in 
/opt/stack/quantum/quantum/extensions/extens

ions.py

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] [SWIFT] Looking for an approach to attach an account or a container in operating system . Like a NAS of SAN driver.

2012-04-12 Thread Kuo Hugo
I'm keeping in search and think about  the easiest way for users to
leverage their swift account.

There has several client applications for accessing swift around . Either
Windows / Linux / Mac.

But eventually , user still need to install a client for this purpose.

What if user can attach their own account from swift-proxy (or something
else) directly via NFS or CIFS  or iscsi target will be much better.

As I know , both linux and Windows has application to reach  this target.
Such as Gladinet Server / S3FS etc.

How about provide such interfaces in Swift-proxy ?

If there's an exist discussion ticket , please let me know it .

Cheers


-- 
+Hugo Kuo+
tonyt...@gmail.com
+ tonyt...@gmail.com886 935004793
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] control user quota

2012-04-12 Thread Kuo Hugo
I did a quick test in Essex .
The process almost same as before(Cactus/Diablo)

1. Manage Quota for a specified Tenant from nova-manage .
2. Manage Default Quota parameters from nova.conf with several flags
3. Hacking Nova source code quota.py for default values.



Hope it helps.



Xin Zhao xz...@bnl.gov 於 2012年4月12日下午10:27 寫道:

 Hello,

 I try to assign quota to individual users, to control how many instances
 each user can run concurrently. But I don't see a doc describing how to do
 that. I use diablo release.
 Any help or doc pointer will be greatly appreciated.

 Xin


 __**_
 Mailing list: 
 https://launchpad.net/~**openstackhttps://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : 
 https://launchpad.net/~**openstackhttps://launchpad.net/~openstack
 More help   : 
 https://help.launchpad.net/**ListHelphttps://help.launchpad.net/ListHelp




-- 
+Hugo Kuo+
tonyt...@gmail.com
+ tonyt...@gmail.com886 935004793
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Instance can't reach dhcp or metadata

2012-04-12 Thread Dan Wendlandt
Hi Mandar,

The whole default stuff is a common point of confusion with
QuantumManager, and something we're planning on getting rid of in Folsom.
 For Essex, I've explained the details below.

On Wed, Apr 11, 2012 at 8:47 PM, Vaze, Mandar mandar.v...@nttdata.comwrote:

  Dan,

 Bug you referred to specifically says “default” tenant – which is not the
 case for me.

 I’m not using default tenant – I’m using  uuid of “demo” tenant created by
 stack.sh


I suspect you are spinning up VMs using the demo tenant, but unless you
have modified your stack.sh, when you create a network using nova-manage,
no --project_id flag is specified.  Hence, from a Quantum perspective
that network does not have a tenant, making this a global network, which
is owned by a tenant named default (this string can be changed using the
quantum_default_tenant_id flag in nova).  For more details on creating
quantum networks with nova-manage, see:
http://docs.openstack.org/incubation/openstack-network/admin/content/Net-Create-dle455.html


 

 BTW, stack.sh creates incorrect  entries in quantum/mélange DB,  it has
 tenant ID = “default” – This should be uuid of some valid tenant, not
 string “default”


This is not actually incorrect, given the logic above, though I admit it is
confusing.  This was really just to provide backward compatibility with old
nova-manage calls that did not specify a project.  In Folsom, we're
planning on requiring a tenant for all Quantum network creation.



 

 ** **

 FWIW, this setup (although seems incorrect) works with quantum+nova_ipam –
 not with quantum+mélange 

 i.e. With quantum+nova_ipam I can just create a VM and ssh to it.


Yes, quantum + nova-ipam is a much more tested path.  I suspect you are
just running into the bug I mention below and that your quantum + melange
setup would work once you have that patch in, but I don't know of anyone
using Melange + DHCP in a real deployment, so I wouldn't be surprised if
there were more issues lurking.

Dan



 

 ** **

 -Mandar

 ** **

 *From:* Dan Wendlandt [mailto:d...@nicira.com]
 *Sent:* Wednesday, April 11, 2012 11:07 PM
 *To:* Vaze, Mandar
 *Cc:* Nicolas de BONFILS; openstack@lists.launchpad.net

 *Subject:* Re: [Openstack] Instance can't reach dhcp or metadata

 ** **

 ** **

 On Wed, Apr 11, 2012 at 5:24 AM, Vaze, Mandar mandar.v...@nttdata.com
 wrote:

 I have *never* been able to get to ssh to an instance with Quantum+mélange
 

 https://lists.launchpad.net/openstack/msg09206.html

 ** **

 Looking at that thread, I suspect you may be hitting the same issue I
 mentioned above: https://bugs.launchpad.net/quantum/+bug/949234

 ** **

 If you try that fix and either do or don't have luck with it, please add a
 comment to the issue.

 ** **

 Dan

 ** **

  

   

 -Mandar

  

 *From:* openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net[mailto:
 openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net] *On Behalf
 Of *Nicolas de BONFILS
 *Sent:* Wednesday, April 11, 2012 1:45 AM
 *To:* Dan Wendlandt
 *Cc:* openstack@lists.launchpad.net
 *Subject:* Re: [Openstack] Instance can't reach dhcp or metadata

  

 Hi,

 I can't get the ssh connection,VNC doesn't respond and 10.0.0.1 go to
 localhost (ssh to server itself)
 

  

 ---

 Nicolas

 ** **

 On Tue, Apr 10, 2012 at 21:42, Dan Wendlandt d...@nicira.com wrote:

  

 On Tue, Apr 10, 2012 at 11:54 AM, Nicolas de BONFILS ndebonf...@gmail.com
 wrote:

 Things starting to work !

 When I boot boot cirros image with ip 10.0.0.1, I can ssh (even if it
 doesn't accept my password), but when I lauch tty-uec image (or other) with
 ip starting at 10.0.0.2, ssh tell no route to host

  

 If it works on one image, but not another, this is probably an issue with
 the image itself.  The no route to host error is likely because the
 gateway interface 10.0.0.1 is arping for 10.0.0.2 and not getting a
 response.  Perhaps the image is not configured to use DCHP on the
 interface?  Or is not correctly launching?  I'd use VNC to login and check
 it out.  

  

 Dan

  


 I sum up the actual conf

- br-int as bridge in OVS, no other conf (nothing in interfaces file),
ifconfig show a 10.0.0.1 ip
- nova conf got public_interface=br-int / flat_network_bridge=br-int /
flat_interface=eth0
- quantum manage the assignation successfully

  Thanks

 ---

 Nicolas

  

 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp



 

  

 -- 

 ~~~
 Dan Wendlandt 

 Nicira, Inc: www.nicira.com

 twitter: danwendlandt
 ~~~

  

  


 

[Openstack] Swift block-level deduplication

2012-04-12 Thread Eoghan Glynn


Folks,

From previous posts on the ML, it seems there are a couple of
efforts in train to add distributed content deduping to Swift.

My question is whether either or both these approaches involve
active client participation in enabling duplicate chunk
detection?

One could see a spectrum ranging between:

1. Client actively breaks the object into chunks, selects the
   hashing algorithm, calculates fingerprint and then only uploads
   if Swift reports that fingerprint is unknown.

2. Client determines which objects are worth deduping, maybe has
   some influence on chunk size and/or hashing, but fingerprint
   calculation is all handled internally by Swift.

3. Client is entirely uninvolved, deduplication is handled
   transparently in the object storage layer and enabled either
   globally or per-container.

If anyone involved has insight into the above, I'd be interested
in hearing your thoughts (the context is leveraging dedupe in glance).

Cheers,
Eoghan

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [Netstack] Role of nova-manage network commands when using QuantumManager

2012-04-12 Thread Dan Wendlandt
Hi Mandar,

Thanks for bringing this up.  For Essex, nova-manage commands to
create/delete Quantum networks must be run on the nova-network node.  For
Folsom this will all change, as all networks will be created directly
against the Quantum API, rather than using nova-manage.  I'll add a note to
the administrator guide, as this is not called there.  Thanks!

Dan


On Thu, Apr 12, 2012 at 1:38 AM, Vaze, Mandar mandar.v...@nttdata.comwrote:

  It is my understanding that in multi-node setup :

 **· **nova-manage can be executed from any machine which may not
 be running nova-network process.  (Or should nova-manage always be run on
 nova-network node ?)

 **· **nova-manage does DB operations and delegates the actual
 networking calls to nova-network process ?

 ** **

 Is this understanding correct ?

 ** **

 I traced “nova-manage network create” and nova-manage network delete”
 using FlatDHCPManager (default for devstack/stack.sh)

 Both these calls seem to be doing only DB operations.

 BTW, nova-network process was shutdown during both “network create” and
 “network delete” – Still both operations were successful.

 ** **

 But when using QuantumManager as network manager – nova-manage seems to be
 doing networking operations like “iptables-save” (during network create)
 and “kill_dhcp” (during network delete)

 (via linux-net L3 driver)

 ** **

 Since nova-manage command may be executed on a host which isn’t running
 nova-network – network commands like “iptables” and “kill -9 pid of
 dnsmasq” on host running nova-manage seems incorrect.

 ** **

 For the first scenario (iptables-save during “network create” – there is
 already a defect in LP : https://bugs.launchpad.net/nova/+bug/977738

 and review : https://review.openstack.org/6451

 ** **

 I would like your comments and opinions which would help me understand
  “What nova-manage should and should NOT do”

 ** **

 Thanks,

 -Mandar

 ** **

 ** **

 ** **

 ** **

 __
 Disclaimer:This email and any attachments are sent in strictest confidence
 for the sole use of the addressee and may contain legally privileged,
 confidential, and proprietary data. If you are not the intended recipient,
 please advise the sender by replying promptly to this email and then delete
 and destroy this email and any attachments without any further use, copying
 or forwarding

 --
 Mailing list: https://launchpad.net/~netstack
 Post to : netst...@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~netstack
 More help   : https://help.launchpad.net/ListHelp




-- 
~~~
Dan Wendlandt
Nicira, Inc: www.nicira.com
twitter: danwendlandt
~~~
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] minimal IaaS openstack installation FROM SOURCE on CentOS

2012-04-12 Thread P. Stallworth
All the tarballs should be available on Launchpad, there are links from the
main OpenStack.org page.  Most instructions assume getting packages from
yum, apt-get, etc but once you get the source installed there are plenty of
CentOS specific config docs around.  For Nova and Swift:
http://wiki.openstack.org/InstallInstructions.  For Keystone there's also
this
https://github.com/timeredbull/references/wiki/Installing-and-configuring-openstack-keystone-in-a-CentOS-6.2which
may help.

-Paul

On Thu, Apr 12, 2012 at 8:31 AM, Mauch, Viktor (SCC) ma...@kit.edu wrote:

 Hi,

 ** **

 I need to install a minimal/simple Openstack IaaS Deployment framework on
 CentOS 6.x from Source.

 ** **

 Is there anywhere a nice howto tutorial?

 ** **

 And yes: I know there are packeges, but I need it from source.

 ** **

 Cheers Viktor

 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] control user quota

2012-04-12 Thread Kevin L. Mitchell
On Thu, 2012-04-12 at 11:10 -0400, Eoghan Glynn wrote:
 Project-specific quotas may be set via the nova CLI, e.g.
 
   $ nova quota-update tenant_ID --instances=50
 
 otherwise the configured default quota is inherited.
 
 Since you're still on diablo, the new quota classes mechanism would
 not be relevant.

I should also point out that nova quota-update did not exist in the
diablo release of python-novaclient…
-- 
Kevin L. Mitchell kevin.mitch...@rackspace.com


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] control user quota

2012-04-12 Thread Kuo Hugo
nova-manage
http://nova.openstack.org/runnova/nova.manage.html

nova-manage project quota projectname

example :
#list xin-project 's quota
$nova-manage project quota xin-project
Will return several key/value

#modify a key with new value

$nova-manage project quota xin-project --key=???  --value=???

https://github.com/openstack/nova/blob/master/nova/quota.py

For configuration flags please refer to the above link of quota.py


Xin Zhao xz...@bnl.gov 於 2012年4月13日上午12:15 寫道:

  Hi Kuo,

 Could you give more details, like the commands used, and settings in the
 config file ? I can't find a good example for them.

 Thanks,
 Xin


 On 4/12/2012 12:04 PM, Kuo Hugo wrote:

 I did a quick test in Essex .
 The process almost same as before(Cactus/Diablo)

  1. Manage Quota for a specified Tenant from nova-manage .
 2. Manage Default Quota parameters from nova.conf with several flags
 3. Hacking Nova source code quota.py for default values.



  Hope it helps.



 Xin Zhao xz...@bnl.gov 於 2012年4月12日下午10:27 寫道:

 Hello,

 I try to assign quota to individual users, to control how many instances
 each user can run concurrently. But I don't see a doc describing how to do
 that. I use diablo release.
 Any help or doc pointer will be greatly appreciated.

 Xin


 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp




  --
 +Hugo Kuo+
 tonyt...@gmail.com
  + tonyt...@gmail.com886 935004793





-- 
+Hugo Kuo+
tonyt...@gmail.com
+ tonyt...@gmail.com886 935004793
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] The Scheduling feature when reboot the instance

2012-04-12 Thread Vishvananda Ishaya
No this does not exist.  If you are going to overprovision ram, you should 
probably make sure that you have swap enabled on your host.

Vish

On Apr 12, 2012, at 4:10 AM, Văn Đình Phúc wrote:

 Hi.
 I'm using Openstack (2011.3 
 (2011.3-nova-milestone-tarball:tarmac-20110922115702-k9nkvxqzhj130av2) with 3 
 Compute nodes.
 My scheduling option is default.
 I have the problem as the following steps:
 Compute node 1 is installed the modules: nova-api, nova-compute and 
 nova-network.
 The resource of node-1 max is fitfor 3 instances (m1.small): i-0001,   
 i-0002, i-0003.
 I turn off  i-0001.
 and then I request new ínstance by the euca-run-instance command , My new 
 instance ( i-0004) is located on the node 1.
 The resources: RAM , CPU,.. of node-2 and node-3 is available.
 finally, I reboot the i-0001.What is happen? the i-0001 is rebooted 
 on the node-1 , and It's shutdown off after reboot.I checked the libvirt's 
 log :
 
 Failed to allocate 2147483648 B: Cannot allocate memory
 2012-04-12 16:11:50.530: shutting down
 So , Do Openstack have the sheduling feature when rebooting the instance ?
 
 Example: As above , My instance (i-0001) will be migrated to node-2 or 
 node-3 when the resource of node-1 is not available.
 
 phucvdbmail.gif
  
 Văn Đình Phúc
 Manager - Cloud Team
 Techno Department
 Bkav Specialization Division
  
 Office:  Bkav Building - Yen Hoa New Town, Cau Giay Dist, Hanoi
 Tel:   (84-4) 3763.2552
 Mobile: 0169 4702 388 
 
 Do your best, the rest will come !  
 Hãy làm việc hết mình, những điều tốt đẹp sẽ đến với bạn !
  
 Disclaimer: This e-mail and any files transmitted with it are confidential 
 and may contain privileged information. It is intended solely for the use of 
 the individual to whom it is addressed and others authorized to receive it. 
 If you are not the intended recipient you are notified that disclosing, 
 copying, distributing or taking any action in reliance on the contents of 
 this information is strictly prohibited. If you have received this message in 
 error, please notify the sender immediately by reply e-mail and delete 
 completely this e-mail from your system, without reproducing, distributing or 
 retaining copies.
  
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] minimal IaaS openstack installation FROM SOURCE on CentOS

2012-04-12 Thread Mauch, Viktor (SCC)
Of course I found the tarballs with the source code.

 

However all the centos specific docs I found couldn't really help. Most of
them are too old, did not work (concerning several dependency errors) or
provide only a single-node-installation

 

What I really search is a detailed step-by-step description, how to install
a simple/minimal IaaS Openstack cloud on 2 nodes on CentOS 6.x from source.

 

But thanks for your answer!

 

Cheer vic

 

From: P. Stallworth [mailto:pstallwo...@gmail.com] 
Sent: Thursday, April 12, 2012 6:15 PM
To: Mauch, Viktor (SCC)
Cc: openstack@lists.launchpad.net
Subject: Re: [Openstack] minimal IaaS openstack installation FROM SOURCE on
CentOS

 

All the tarballs should be available on Launchpad, there are links from the
main OpenStack.org page.  Most instructions assume getting packages from
yum, apt-get, etc but once you get the source installed there are plenty of
CentOS specific config docs around.  For Nova and Swift:
http://wiki.openstack.org/InstallInstructions.  For Keystone there's also
this
https://github.com/timeredbull/references/wiki/Installing-and-configuring-op
enstack-keystone-in-a-CentOS-6.2 which may help.

-Paul

On Thu, Apr 12, 2012 at 8:31 AM, Mauch, Viktor (SCC) ma...@kit.edu wrote:

Hi,

 

I need to install a minimal/simple Openstack IaaS Deployment framework on
CentOS 6.x from Source.

 

Is there anywhere a nice howto tutorial?

 

And yes: I know there are packeges, but I need it from source.

 

Cheers Viktor


___
Mailing list: https://launchpad.net/~openstack
https://launchpad.net/%7Eopenstack 
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
https://launchpad.net/%7Eopenstack 
More help   : https://help.launchpad.net/ListHelp

 



smime.p7s
Description: S/MIME cryptographic signature
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [Swift] Does there any exist blueprint or sub-project of user's storage space quota or counting method for Swift ?

2012-04-12 Thread Frederik Van Hecke
Hi Kuo,

One option would be to keep the usage information (num files, num bytes,
etc) per container / account in an sqlite DB, just like it is done for
account and container info.

To avoid having to loop through all data at regular intervals (to update
the info), additional logic could be added to the api methods to update the
sqlite DB's when new files are added, files are deleted, etc. Such approach
will require more lines of code, but will be far less stressful on
performance.

(the brute-force approach to loop through it at regular intervals will be
hell on performance on large deployments..)


For data transfer billing based on download / upload amounts, a similar
approach could be used.

If no one else is looking into this, I would certainly be willing to help
to help get this started.


Kind regards,
Frederik Van Hecke

*T:*  +32487733713
*E:*  frede...@cluttr.be
*W:* www.cluttr.be



*This e-mail and any attachments thereto may contain information which
is confidential and/or protected by intellectual property rights and
are intended for the sole use of the recipient(s)named above. Any use
of the information contained herein (including, but not limited to,
total or partial reproduction, communication or distribution in any
form) by persons other than the designated recipient(s) is prohibited.
If you have received this e-mail in error, please notify the sender
either by telephone or by e-mail and delete the material from any
computer. Thank you for your cooperation.*




On Thu, Apr 12, 2012 at 17:45, Kuo Hugo tonyt...@gmail.com wrote:

 Hi folks ,

 I'm thinking about the better approach to manage an user or an account
 space usage quota in swift.
 Is  there any related blueprint or sub-project even an idea around ?
 Any suggestion of benefits to be an external service or to be a
 middle-ware in swift-proxy ?

 I'm concerning about such feature will reduce the performance of entire
 Swift environment.

 Appreciate :



 --
 +Hugo Kuo+
 tonyt...@gmail.com
 + tonyt...@gmail.com886 935004793


 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Install instance failed on xenserver 6.0.2

2012-04-12 Thread Yi Sun

Thanks, the xenapi_connection_url is the problem.
Yi

On 04/12/2012 05:12 AM, Armando Migliaccio wrote:

1.3GB is more than enough. When you get that message, usually space
has already dried up, or there is a problem authenticating with
xenapi.

Check that:

xenapi_connection_url
xenapi_connection_password

are set correctly, and that you can reach dom0 from your devstack instance.

Have a look at your localrc, xenrc, and nova.conf, see if you can find
anything wrong with them.

Hope this help!
Armando

On Thu, Apr 12, 2012 at 5:03 AM, Yi Sunbeyo...@gmail.com  wrote:

Hi,
I used devstack to install openstack on my xenserver 6.0.2. I followed the
video found in this link http://wiki.openstack.org/XenServer/DevStack. After
installation, I can access dashboard. But I failed to launch an instance.
I tried to launch image tty, after launching, the instance status field
shows Error and there has no new VM  showing up in my xencenter.
I did a ps ax on my domU VM, I see following nova processes:
stack@ALLINONE:~/nova/bin$ ps ax | grep nova
  5246 pts/6S+ 0:02 python /opt/stack/nova/bin/nova-api
  5325 pts/8S+ 0:03 python /opt/stack/nova/bin/nova-cert
  5346 pts/9S+ 0:03 python /opt/stack/nova/bin/nova-volume
  5371 pts/10   S+ 0:03 python /opt/stack/nova/bin/nova-network
  5426 pts/11   S+ 0:03 python /opt/stack/nova/bin/nova-scheduler
  5457 pts/12   S+ 0:00 python ./utils/nova-novncproxy --config-file
/etc/nova/nova.conf --web .
  5477 pts/13   S+ 0:00 python ./bin/nova-xvpvncproxy --config-file
/etc/nova/nova.conf
  5497 pts/14   S+ 0:03 python ./bin/nova-consoleauth
  5537 pts/16   S+ 0:00 python /opt/stack/nova/bin/nova-objectstore

I'm not seeing nova-compute running. So I tried to start it manually, Then I
got errors attached in later section.  Can someone help to take a look to
see if I have missed anything during the installation?
Also, is there a way to see find more debug information when failed to
launch a instance?

BTW-- I checked Dom0, I have 1.3G free space, is that enough to run
nova-compute?
Thanks
Yi

012-04-12 03:42:33 CRITICAL nova [-] Unable to log in to XenAPI (is the Dom0
disk full?)
2012-04-12 03:42:33 TRACE nova Traceback (most recent call last):
2012-04-12 03:42:33 TRACE nova   File ./nova-compute, line 47, inmodule
2012-04-12 03:42:33 TRACE nova server =
service.Service.create(binary='nova-compute')
2012-04-12 03:42:33 TRACE nova   File /opt/stack/nova/nova/service.py,
line 272, in create
2012-04-12 03:42:33 TRACE nova
periodic_fuzzy_delay=periodic_fuzzy_delay)
2012-04-12 03:42:33 TRACE nova   File /opt/stack/nova/nova/service.py,
line 167, in __init__
2012-04-12 03:42:33 TRACE nova self.manager =
manager_class(host=self.host, *args, **kwargs)
2012-04-12 03:42:33 TRACE nova   File
/opt/stack/nova/nova/compute/manager.py, line 198, in __init__
2012-04-12 03:42:33 TRACE nova utils.import_object(compute_driver),
2012-04-12 03:42:33 TRACE nova   File /opt/stack/nova/nova/utils.py, line
90, in import_object
2012-04-12 03:42:33 TRACE nova return cls()
2012-04-12 03:42:33 TRACE nova   File
/opt/stack/nova/nova/virt/connection.py, line 76, in get_connection
2012-04-12 03:42:33 TRACE nova conn =
xenapi_conn.get_connection(read_only)
2012-04-12 03:42:33 TRACE nova   File
/opt/stack/nova/nova/virt/xenapi_conn.py, line 144, in get_connection
2012-04-12 03:42:33 TRACE nova return XenAPIConnection(url, username,
password)
2012-04-12 03:42:33 TRACE nova   File
/opt/stack/nova/nova/virt/xenapi_conn.py, line 152, in __init__
2012-04-12 03:42:33 TRACE nova self._session = XenAPISession(url, user,
pw)
2012-04-12 03:42:33 TRACE nova   File
/opt/stack/nova/nova/virt/xenapi_conn.py, line 491, in __init__
2012-04-12 03:42:33 TRACE nova url = self._create_first_session(url,
user, pw, exception)
2012-04-12 03:42:33 TRACE nova   File
/opt/stack/nova/nova/virt/xenapi_conn.py, line 500, in
_create_first_session
2012-04-12 03:42:33 TRACE nova session.login_with_password(user, pw)
2012-04-12 03:42:33 TRACE nova   File
/usr/local/lib/python2.7/dist-packages/XenAPI.py, line 182, inlambda
2012-04-12 03:42:33 TRACE nova return lambda *params: self._login(name,
params)
2012-04-12 03:42:33 TRACE nova   File
/usr/local/lib/python2.7/dist-packages/XenAPI.py, line 148, in _login
2012-04-12 03:42:33 TRACE nova result = _parse_result(getattr(self,
'session.%s' % method)(*params))
2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/xmlrpclib.py,
line 1224, in __call__
2012-04-12 03:42:33 TRACE nova return self.__send(self.__name, args)
2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/xmlrpclib.py,
line 1575, in __request
2012-04-12 03:42:33 TRACE nova verbose=self.__verbose
2012-04-12 03:42:33 TRACE nova   File /usr/lib/python2.7/xmlrpclib.py,
line 1264, in request
2012-04-12 03:42:33 TRACE nova return self.single_request(host, handler,
request_body, verbose)
2012-04-12 03:42:33 TRACE nova   File 

Re: [Openstack] [SWIFT] Looking for an approach to attach an account or a container in operating system . Like a NAS of SAN driver.

2012-04-12 Thread Frederik Van Hecke
Hi Kuo,

Here are some quick links:

https://github.com/redbo/cloudfuse
http://gladinet.blogspot.com/2010/10/openstack-windows-client.html


I'm running cloudfuse on Ubuntu without much to complain about.



Kind regards,
Frederik Van Hecke

*T:*  +32487733713
*E:*  frede...@cluttr.be
*W:* www.cluttr.be



*This e-mail and any attachments thereto may contain information which
is confidential and/or protected by intellectual property rights and
are intended for the sole use of the recipient(s)named above. Any use
of the information contained herein (including, but not limited to,
total or partial reproduction, communication or distribution in any
form) by persons other than the designated recipient(s) is prohibited.
If you have received this e-mail in error, please notify the sender
either by telephone or by e-mail and delete the material from any
computer. Thank you for your cooperation.*




On Thu, Apr 12, 2012 at 17:57, Kuo Hugo tonyt...@gmail.com wrote:

 I'm keeping in search and think about  the easiest way for users to
 leverage their swift account.

 There has several client applications for accessing swift around . Either
 Windows / Linux / Mac.

 But eventually , user still need to install a client for this purpose.

 What if user can attach their own account from swift-proxy (or something
 else) directly via NFS or CIFS  or iscsi target will be much better.

 As I know , both linux and Windows has application to reach  this target.
 Such as Gladinet Server / S3FS etc.

 How about provide such interfaces in Swift-proxy ?

 If there's an exist discussion ticket , please let me know it .

 Cheers


 --
 +Hugo Kuo+
 tonyt...@gmail.com
 + tonyt...@gmail.com886 935004793


 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] minimal IaaS openstack installation FROM SOURCE on CentOS

2012-04-12 Thread Vishvananda Ishaya
Devstack just gained support for Fedora, so you could try using it. You might 
have to make some modifications, but it is just a shell script so it should be 
easy to read.

(From devstack.org) try:

git clone git://github.com/openstack-dev/devstack.git
cd devstack; ./stack.sh

On Apr 12, 2012, at 6:31 AM, Mauch, Viktor (SCC) wrote:

 Hi,
  
 I need to install a minimal/simple Openstack IaaS Deployment framework on 
 CentOS 6.x from Source.
  
 Is there anywhere a nice howto tutorial?
  
 And yes: I know there are packeges, but I need it from source.
  
 Cheers Viktor
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] Remote participation from Design Summit (and conference) was (Re: [Openstack-operators] Health Monitoring Blueprints)

2012-04-12 Thread Stefano Maffulli
On Wed, 2012-04-11 at 23:13 -0400, Duncan McGreggor wrote:
 The following channels have been created on Freenode and are
 registered.
 
 #osds-ballroom
 #osds-seacliff-a-b
 #osds-seacliff-c
 #osds-seacliff-d
 #osds-marina
 #osds-bayview-a
 #osds-bayview-b
 #osds-golden-gate
 
 Each channel is also getting logged, viewable via HTTP here:
   http://irclogs.osds.cogitat.io/
 
Awesome, thank you Duncan. 

We have also (thanks to Cisco) https://openstack.webex.com/ that we can
use to stream audio from the rooms. Before we sing our happy song,
though, we need to jump a few hoops:

- test that Webex actually runs on the Ubuntu machines contributed by
Zareason
- configure the 8 machines
- prepare all the Webex events/meetings
- update the Summit sessions adding the link to the Webex meetings
- install the machines at the conference venue (on Sunday afternoon)
- hope things work well on Monday

I need volunteers to make all these things happen. Sunday afternoon hand
work especially. Contact me in private, please, if you have experience
with Webex, have an Ubuntu 11.04 machine for testing purposes and will
be in San Francisco on Sunday afternoon to help setup the rooms.

thanks,
stef


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Quantum and HTTPD

2012-04-12 Thread Adam Young

On 04/12/2012 01:05 PM, Dan Wendlandt wrote:

Hi Adam, cool stuff!

Thanks for reporting the issues.  I'm in favor of both changes your 
suggest.  Any interest on working on the openstack common stuff?  More 
details inline.


I'll probably help out with common stuff across the board, especially 
WRT to running in HTTPD and PKI/Cert issues come up.  My sorter term 
goal is to harden an Essex deploy so that it can be used in places where 
the policies dictate SSL for all communications.


Thanks for validating what I saw.  Nice to know I don't have to beat my 
head against it for too long.


Any idea how mature the SSL support is that Quantum is using right now?



Dan

On Thu, Apr 12, 2012 at 8:26 AM, Adam Young ayo...@redhat.com 
mailto:ayo...@redhat.com wrote:



from paste.deploy.loadwsgi  import loadapp
application = loadapp('config:/etc/quantum/quantum.conf', 'quantum')

But it fails due to issues finding the plugins (error log at the
end of the message). It deploys cleanly once I made the following
changes to quantum.

--- a/quantum/extensions/extensions.py
+++ b/quantum/extensions/extensions.py
@@ -538,8 +538,9 @@ class ResourceExtension(object):
 # Returns the extention paths from a config entry and the __path__
 # of quantum.extensions
 def get_extensions_path(config=None):
-paths = ':'.join(quantum.extensions.__path__)
-if config:
-paths = ':'.join([config.get('api_extensions_path', ''),
paths])
+#paths = ':'.join(quantum.extensions.__path__)
+paths = //etc/quantum/plugins//
+#if config:
+#paths = ':'.join([config.get('api_extensions_path', ''),
paths])

 return paths

Without this, there is a spurious error message due to the leading
':'  which puts a blank first element to the path.  It also fails
to find the extensions path regardless of values put into config
files etc.  It is this last issue which leads me to highly suggest
we push Quantum to get on the openstack-common bandwagon,  as its
Config file processing is confusing and,  I think, broken for the
general case.


I'm a big proponent of using openstack common as much as possible in 
Quantum.  Much of this existing code was ripped from nova/glance/etc. 
and is probably now out of date.  I created a page in the wiki 
identifying areas in quantum that are ripe for using openstack-common: 
http://wiki.openstack.org/QuantumOpenstackCommon .  Config if right at 
the top :)



The other issue which leads me to suspect this approach won't work
is the fact that the quantum command line client accepts a
hostname and a port,  but not an URL.  So,  while we could deploy
quantum behind HTTPD and port 443,  it would basically be the root
of the HTTP directory,  and we wouldn't be able to share the HTTPD
instance.  We couldn't do

https://hostname/quantum

and put it next to

https://hostname/keystone


Again, not without a code change.

Finally,  there seems to be some support for SSL in Quantum.  I
note that the quantum client has   the option

-s, --ssl use ssl

which leads me to believe that it has been at least attempted.  It
may be that the quantum server would not be severely impacted by
the overhead of SSL in Python.


The quantum client is going to get a complete re-write in Folsom, as 
this is one of our key community projects listed on the wiki: 
http://wiki.openstack.org/QuantumStarterBugs


This new client will match other openstack clients in terms of 
options, etc.  This should mean that you can specify the endpoint as a 
URL, which should take care of both the SSL and the non-root issues, 
if I'm understanding you correctly.


Jason Koelker will be leading a session in the Quantum track on 
redesigning the client, if folks are interested in helping out.






Here's the HTTP error log if I don't make the above change:


[Thu Apr 12 11:21:13 2012] [info] Initial (No.1) HTTPS request
received for chil
d 7 (server ayoungstack.bos.redhat.com:443
http://ayoungstack.bos.redhat.com:443)
[Thu Apr 12 11:21:13 2012] [info] [client 10.16.187.36] mod_wsgi
(pid=8747, proc
ess='', application='ayoungstack.bos.redhat.com
http://ayoungstack.bos.redhat.com|/quantum/api'): Loading WSGI scr
ipt '/var/www/cgi-bin/quantum/api'.
[Thu Apr 12 11:21:13 2012] [error]
ERROR:quantum.extensions.extensions:Extension
 path /etc/quantum/extension doesn't exist!
[Thu Apr 12 11:21:13 2012] [error]
WARNING:quantum.extensions.extensions:extensi
on file portstats.py wasnt loaded due to cannot import name extensions
[Thu Apr 12 11:21:13 2012] [error]
WARNING:quantum.extensions.extensions:extensi
on Cisco Nova Tenant not supported by plugin
quantum.plugins.openvswitch.ovs_qu
antum_plugin.OVSQuantumPlugin object at 0x7f1fae80e450
[Thu Apr 12 11:21:13 2012] 

Re: [Openstack] ERROR: string indices must be integers, not str

2012-04-12 Thread Guilherme Birk

Thanks Mandar, that was my problem.

From: mandar.v...@nttdata.com
To: guib...@hotmail.com; openstack@lists.launchpad.net
Subject: RE: [Openstack] ERROR: string indices must be integers, not str
Date: Thu, 12 Apr 2012 11:02:44 +











You may have his this bug :
https://bugs.launchpad.net/nova/+bug/965826
 
Says : this occurs “When auth_host (in api-paste.ini) has the wrong IP address”
 
Something to check …
-Mandar
 


From: openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net 
[mailto:openstack-bounces+mandar.vaze=nttdata@lists.launchpad.net]
On Behalf Of Guilherme Birk

Sent: Wednesday, April 11, 2012 10:38 PM

To: Openstack Mail List

Subject: [Openstack] ERROR: string indices must be integers, not str


 

I've got OpenStack working with this tutorial

http://www.hastexo.com/resources/docs/installing-openstack-essex-20121-ubuntu-1204-precise-pangolin.



Now I'm trying to deploy a new installation with the official manual, 
http://docs.openstack.org/trunk/openstack-compute/install/content/index.html. I 
can access dashboard, upload images and other things, but when I try to execute 
a nova list, or after connect to dashboard, I got this error: ERROR: string 
indices must be
 integers, not str.



Anyone had this problem too? Maybe some wrong configuration?



__

Disclaimer:This email and any attachments are sent in strictest confidence for 
the sole use of the addressee and may contain legally privileged, confidential, 
and proprietary data.  If you are not the intended recipient, please advise the 
sender by replying promptly to this email and then delete and destroy this 
email and any attachments without any further use, copying or forwarding
  ___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [openstack] Error Unable to list users: [Errno 110] ETIMEDOUT

2012-04-12 Thread Lucian Thomaz






All my services are running, including the nova-api.
I can't see anything wrong on nova-api.log ..

How can I fix or where can I find informations about that?

Lucian Thomaz

From: diego.parrilla.santama...@gmail.com
Date: Thu, 12 Apr 2012 15:05:17 +0200
Subject: Re: [Openstack] [openstack] Error Unable to list users: [Errno 110] 
ETIMEDOUT
To: luciantho...@hotmail.com
CC: openstack@lists.launchpad.net

Sounds like you have access to keystone, but you don't have access to 
nova-api...-- 


Diego Parrilla
CEO


www.stackops.com |  diego.parri...@stackops.com | +34 649 94 43 29 | 
skype:diegoparrilla










On Thu, Apr 12, 2012 at 2:56 PM, Lucian Thomaz luciantho...@hotmail.com wrote:






Hi folks,
I have a diablo installation with Dashboard and I'm having the following error 
when I try access Tenants or Users on Dashboard:

Error  Unable to get tenant info: [Errno 110] ETIMEDOUT



Error  Unable to list users: [Errno 110] ETIMEDOUT

Has anyone had this problem?


Lucian Thomaz

  

___

Mailing list: https://launchpad.net/~openstack

Post to : openstack@lists.launchpad.net

Unsubscribe : https://launchpad.net/~openstack

More help   : https://help.launchpad.net/ListHelp




  ___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Quantum and HTTPD

2012-04-12 Thread Dan Wendlandt
On Thu, Apr 12, 2012 at 10:16 AM, Adam Young ayo...@redhat.com wrote:

  On 04/12/2012 01:05 PM, Dan Wendlandt wrote:

 Hi Adam, cool stuff!

  Thanks for reporting the issues.  I'm in favor of both changes your
 suggest.  Any interest on working on the openstack common stuff?  More
 details inline.


 I'll probably help out with common stuff across the board, especially WRT
 to running in HTTPD and PKI/Cert issues come up.  My sorter term goal is to
 harden an Essex deploy so that it can be used in places where the policies
 dictate SSL for all communications.

 Thanks for validating what I saw.  Nice to know I don't have to beat my
 head against it for too long.

 Any idea how mature the SSL support is that Quantum is using right now?


I do not.  I don't know of any deployments using it right now.  Its likely
that we just have whatever code came along for the ride when the web
framework was borrowed from nova/glance.  Salvatore might know, as he did a
lot of the heavy lifting on the Quantum API side.

Dan






  Dan

 On Thu, Apr 12, 2012 at 8:26 AM, Adam Young ayo...@redhat.com wrote:


 from paste.deploy.loadwsgi  import loadapp
 application = loadapp('config:/etc/quantum/quantum.conf', 'quantum')

 But it fails due to issues finding the plugins (error log at the end of
 the message). It deploys cleanly once I made the following changes to
 quantum.

 --- a/quantum/extensions/extensions.py
 +++ b/quantum/extensions/extensions.py
 @@ -538,8 +538,9 @@ class ResourceExtension(object):
  # Returns the extention paths from a config entry and the __path__
  # of quantum.extensions
  def get_extensions_path(config=None):
 -paths = ':'.join(quantum.extensions.__path__)
 -if config:
 -paths = ':'.join([config.get('api_extensions_path', ''), paths])
 +#paths = ':'.join(quantum.extensions.__path__)
 +paths = */etc/quantum/plugins/*
 +#if config:
 +#paths = ':'.join([config.get('api_extensions_path', ''),
 paths])

  return paths

 Without this, there is a spurious error message due to the leading ':'
 which puts a blank first element to the path.  It also fails to find the
 extensions path regardless of values put into config files etc.  It is this
 last issue which leads me to highly suggest we push Quantum to get on the
 openstack-common bandwagon,  as its Config file processing is confusing
 and,  I think, broken for the general case.


  I'm a big proponent of using openstack common as much as possible in
 Quantum.  Much of this existing code was ripped from nova/glance/etc. and
 is probably now out of date.  I created a page in the wiki identifying
 areas in quantum that are ripe for using openstack-common:
 http://wiki.openstack.org/QuantumOpenstackCommon .  Config if right at
 the top :)




 The other issue which leads me to suspect this approach won't work is the
 fact that the quantum command line client accepts a hostname and a port,
 but not an URL.  So,  while we could deploy quantum behind HTTPD and port
 443,  it would basically be the root of the HTTP directory,  and we
 wouldn't be able to share the HTTPD instance.  We couldn't do

 https://hostname/quantum

 and put it next to

 https://hostname/keystone


 Again, not without a code change.

 Finally,  there seems to be some support for SSL in Quantum.  I note that
 the quantum client has   the option

 -s, --ssl use ssl

 which leads me to believe that it has been at least attempted.  It may be
 that the quantum server would not be severely impacted by the overhead of
 SSL in Python.


  The quantum client is going to get a complete re-write in Folsom, as
 this is one of our key community projects listed on the wiki:
 http://wiki.openstack.org/QuantumStarterBugs

  This new client will match other openstack clients in terms of options,
 etc.  This should mean that you can specify the endpoint as a URL, which
 should take care of both the SSL and the non-root issues, if I'm
 understanding you correctly.

  Jason Koelker will be leading a session in the Quantum track on
 redesigning the client, if folks are interested in helping out.







 Here's the HTTP error log if I don't make the above change:


 [Thu Apr 12 11:21:13 2012] [info] Initial (No.1) HTTPS request received
 for chil
 d 7 (server ayoungstack.bos.redhat.com:443)
 [Thu Apr 12 11:21:13 2012] [info] [client 10.16.187.36] mod_wsgi
 (pid=8747, proc
 ess='', application='ayoungstack.bos.redhat.com|/quantum/api'): Loading
 WSGI scr
 ipt '/var/www/cgi-bin/quantum/api'.
 [Thu Apr 12 11:21:13 2012] [error]
 ERROR:quantum.extensions.extensions:Extension
  path /etc/quantum/extension doesn't exist!
 [Thu Apr 12 11:21:13 2012] [error]
 WARNING:quantum.extensions.extensions:extensi
 on file portstats.py wasnt loaded due to cannot import name extensions
 [Thu Apr 12 11:21:13 2012] [error]
 WARNING:quantum.extensions.extensions:extensi
 on Cisco Nova Tenant not supported by plugin
 quantum.plugins.openvswitch.ovs_qu
 

Re: [Openstack] I18n issue for OpenStack

2012-04-12 Thread Joshua Harlow
So u have just touched on another issue,

I would still say that exception messages should not be translated (+1), haha.

If this is needed, then there is something wrong with the code and how 
exceptions are used instead (ie the bad code smell). Exceptions should be meant 
for error control flow, what they were designed for, not for user facing 
messages. I think it is more common to have a layer that translates exceptions 
into meaningful localized messages, but there needs to be a separation between 
exceptions and there localized messages (they should not be combined). This is 
a common thing afaik, its called separation of model and view, aka, mvc, (think 
of the exceptions as a model/controller(?), if the messages – the view are 
intertwined that seems broke).

This is common with a lot of other parts of openstack as well, ec2 
formatting/response creation should be separated from nova logic (ec2 should be 
a view, which it mostly is right now) and so on...

On 4/12/12 4:27 AM, Hua ZZ Zhang zhu...@cn.ibm.com wrote:

My cents:

Apache HTTP is not so equivelant to OpenStack here. Generally it doesn't care 
about the application errors or exceptions thrown by web applications. In 
openstack, exceptions have been defined in nova, horizon, keystone etc. The 
messages of these exceptions are important for different users to understand 
what has happened. These messages always need to be localized, returned and 
displayed on user interface, not just be logged in backend system. It is very 
common practice for a global software project.

Sean Dague wrote:
 If we want to think about OpenStack as a basic building block like
 Apache, i18n is critical. Otherwise there are regions that won't adopt
 it solely because of a lack of i18n.

Note that Apache HTTPd, for instance, does not seem to internationalize
its error messages. Only the (enduser-facing) HTML pages it gives back
in response to invalid requests are.



Best Regards,


Edward Zhang(张华)
Staff Software Engineer
TravelTransportation Standards
Emerging Technology Institute(ETI)
IBM China Software Development Lab
e-mail: zhu...@cn.ibm.com
Notes ID: Hua ZZ Zhang/China/IBM
Tel: 86-10-82450483地址:北京市海淀区东北旺西路8号 中关村软件园28号楼 环宇大厦3层 邮编:100193
Address: 3F Ring, Building 28 Zhongguancun Software Park, 8 Dongbeiwang West 
Road, Haidian District, Beijing, P.R.C.100193
[cid:3417071582_3128387][cid:3417071582_3146577]

[cid:3417071582_3132379]
[cid:3417071582_3124536]Thierry Carrez ---2012-04-12 16:51:59---Sean Dague 
wrote:


Thierry Carrez thie...@openstack.org
Sent by: openstack-bounces+zhuadl=cn.ibm@lists.launchpad.net 2012-04-12 
16:47

[cid:3417071582_3170778]

To

[cid:3417071582_3169928]
openstack@lists.launchpad.net
[cid:3417071582_3171998]

cc

[cid:3417071582_3154088]
[cid:3417071582_3146520]

Subject

[cid:3417071582_3157167]
Re: [Openstack] I18n issue for OpenStack
[cid:3417071582_3126377][cid:3417071582_3170799]
Sean Dague wrote:
 If we want to think about OpenStack as a basic building block like
 Apache, i18n is critical. Otherwise there are regions that won't adopt
 it solely because of a lack of i18n.

Note that Apache HTTPd, for instance, does not seem to internationalize
its error messages. Only the (enduser-facing) HTML pages it gives back
in response to invalid requests are.

 Is there a metric on the completeness so far? Something automated that
 could be a jenkins coverage kind of test?

Oddly enough, it's not a question of completeness of translations.
Piggybacking on the awesome Launchpad Translations community always gave
us great coverage. It's more a code support and CI integration issue.
inline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gifinline: image.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] profiling nova-api

2012-04-12 Thread Yun Mao
Hi Jay,

I will take a look later when I find a box with multiple cores to take
advantage it..

Agreed - cprofiling is not so useful this case. This would be a purely
performance benchmark. If implemented correctly, we should see a
notable gain. However, It will probably not that linear because we
might hit keystone's performance issue later. It looks like the second
CPU hogger behind nova-api. Is there a multiprocess keystone too?

Yun

On Thu, Apr 12, 2012 at 9:49 AM, Jay Pipes jaypi...@gmail.com wrote:
 Hi Yun!

 Thanks very much for sharing this information. Can I ask you to pull the
 code in this branch:

 https://review.openstack.org/#change,5762

 And retry your test? On my test machines, the work that Huang Zhiteng has
 done to convert Nova's servers to use multiple operating system processes,
 each with its own greenthread service pool, resulted in a massive throughput
 improvement, turning a quickly-bottlenecked system into a server that could
 scale nearly linearly with the number of worker processes.

 Be sure to set osapi_workers to the number of cores your machine has... and
 also note that your code profiling technique is unlikely to be effective
 since cProfile wouldn't track the forked child worker processes' stacks,
 AFAIK. Still interested to see if the time to execute the 300 API calls is
 dramatically reduced, though.

 Looking forward to any results you might have.

 Best,
 -jay


 On 04/11/2012 04:48 PM, Yun Mao wrote:

 Hi Stackers, I spent some time looking at nova-api today.

 Setup: everything-on-one-node devstack, essex trunk. I setup 1 user
 with 10 tiny VMs.
 Client: 3 python threads each doing a loop of nova list equivalent
 for 100 times. So 300 API calls with concurrency=3.
 how to profile: python -m cProfile -s time
 /opt/stack/nova/bin/nova-api --flagfile=/etc/nova/nova.conf
 --logdir=/var/log/nova --nodebug
 The partial output is attached in the end.

 Observations:
 * It takes about 60 seconds to finish. CPU of nova-api is around 70% to
 90%

 * Database access: Each nova list API call will issue 4 db APIs: 3
 instance_get_all_by_filters(), 1
 instance_fault_get_by_instance_uuids(), so 1200 db API calls total
 (note: not necessarily 1200 SQL statements, could be more). The 900
 instance_get_all_by_filters() calls took 30.2 seconds (i.e. 0.03s
 each)! The 300 instance_fault_get_by_instance_uuids() calls only took
 1.129 seconds (0.004 each).

 You might think: MySQL sucks. Not so fast. Remember this is a tiny
 database with only 10 VMs. Profile also shows that the actual
 _mysql.connection.query() method only took 1.883 seconds in total. So,
 we pretty much spend 29 seconds out of 60 seconds doing either
 sqlalchemy stuff or our own wrapper. You can also see from the sheer
 volume of sqlalchemy library calls involved.

 * the cfg.py library inefficiency. During 300 API calls,
 common.cfg.ConfigOpts._get() is called 135005 times! and we paid 2.470
 sec for that.

 Hopefully this is useful for whoever wants to improve the performance
 of nova-api.

 Thanks,
 Yun

 ===

          23355694 function calls (22575841 primitive calls) in 77.874
 seconds

    Ordered by: internal time

    ncalls  tottime  percall  cumtime  percall filename:lineno(function)
       812   25.725    0.032   25.725    0.032 {method 'poll' of
 'select.epoll' objects}
      2408    1.883    0.001    1.883    0.001 {method 'query' of
 '_mysql.connection' objects}
     70380    1.667    0.000    7.187    0.000
 expression.py:2263(corresponding_column)
    135005    1.254    0.000    2.470    0.000 cfg.py:1058(_get)
     41027    1.043    0.000    1.907    0.000 schema.py:542(__init__)
     38802    1.008    0.000    1.219    0.000 __init__.py:451(format)
    162206    0.821    0.000    0.821    0.000 util.py:883(values)
   1530666    0.773    0.000    0.774    0.000 {isinstance}
 135046/134960    0.716    0.000    1.919    0.000 cfg.py:1107(_substitute)
      1205    0.713    0.001    1.369    0.001 base.py:2106(__init__)
    183600    0.690    0.000    0.796    0.000
 interfaces.py:954(_reduce_path)
     81002    0.687    0.000    2.492    0.000 compiler.py:312(visit_label)
     38802    0.650    0.000    6.087    0.000 log.py:227(format)
    319270    0.622    0.000    0.748    0.000 attributes.py:164(__get__)
 890242/884229    0.608    0.000    1.885    0.000 {getattr}
     40500    0.605    0.000    3.101    0.000 schema.py:955(_make_proxy)
 120783/120738    0.603    0.000    0.605    0.000 {method 'sub' of
 '_sre.SRE_Pattern' objects}
     81000    0.601    0.000    2.156    0.000
 interfaces.py:677(create_row_processor)
     63000    0.590    0.000    0.707    0.000
 times.py:44(DateTime_or_None)
     98102    0.588    0.000    0.886    0.000
 compiler.py:337(visit_column)
    658098    0.580    0.000    0.581    0.000 {method 'intersection'
 of 'set' objects}
    109802    0.562    0.000    0.562    0.000
 expression.py:3625(_from_objects)
 231610/1202    0.551    0.000    5.813    0.005
 

Re: [Openstack] minimal IaaS openstack installation FROM SOURCE on CentOS

2012-04-12 Thread Justin Santa Barbara
I have it running from source in a more-production-environment than
devstack, though on Debian...
https://github.com/justinsb/openstack-simple-config

Would you like to collaborate on fixing this up for CentOS  the Essex
release?  It was working a week or two before feature freeze, and post
Keystone redux, so it should be good, so it should mostly be CentOS
differences.

More production-ready = won't wipe your data if you type the wrong thing
into devstack :-)

I'm hoping to establish a baseline of a recommended way to package
OpenStack.  I'm leading a Design Summit session about this, I believe!

Justin





On Thu, Apr 12, 2012 at 10:09 AM, Vishvananda Ishaya
vishvana...@gmail.comwrote:

 Devstack just gained support for Fedora, so you could try using it. You
 might have to make some modifications, but it is just a shell script so it
 should be easy to read.

 (From devstack.org) try:

 git clone git://github.com/openstack-dev/devstack.git

 cd devstack; ./stack.sh


 On Apr 12, 2012, at 6:31 AM, Mauch, Viktor (SCC) wrote:

 Hi,
 ** **
 I need to install a minimal/simple Openstack IaaS Deployment framework on
 CentOS 6.x from Source.
 ** **
 Is there anywhere a nice howto tutorial?
 ** **
 And yes: I know there are packeges, but I need it from source.
 ** **
 Cheers Viktor
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp



 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Swift block-level deduplication

2012-04-12 Thread Eoghan Glynn

Thanks for the response Caitlin,
 
 The versioning/dedup ring we are working on at Nexenta will support
 both 1 and 3. I'll be presenting at the Summit on this.

Great, I'll look forward to your presentation.

 The ultimate goal of distributed dedup is scenario #1. Only the
 client software can determine the optimum chunk boundaries,

Agreed, this is where the maximum savings can be acheived, at the cost
of imposing some complexity on the client layer. I'd be interested in
using glance as a proof-point for this approach, its one of the topics
I intended to discuss at the summit as part of this session:

  http://summit.openstack.org/sessions/view/78

Cheers,
Eoghan




___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Swift block-level deduplication

2012-04-12 Thread Caitlin Bestler
Eoghan Glynn wrote:


 The ultimate goal of distributed dedup is scenario #1. Only the client 
 software can determine the optimum chunk boundaries,

 Agreed, this is where the maximum savings can be acheived, at the cost of 
 imposing some complexity on the client layer. I'd be interested in using 
 glance as a proof-point for this approach, its one of the topics I 
 intended to discuss at the summit as part of this session:

  http://summit.openstack.org/sessions/view/78


A lot of the features you are referencing here are good ideas, but I think they 
belong as part of a Volume Service, rather than Glance.
Glance deals with boot images and their metadata specifically. The 
optimizations you reference apply to Volume storage in general.

From a distributed Deduplication perspective a Volume is just a collection of 
deduplicated Chunks, making it pretty much the same as an Object.

But dedup is not the primary issue for volumes, but rather enabling efficient 
cloning so that then 100 VM's running a given OS can share the 95%
of their boot drive that they have not modified.



___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Templates for slides?

2012-04-12 Thread Caitlin Bestler
Stefano Marfuli wrote:


 For the summit, I don't think the standard is: use what you're familiar with 
 :)

Speaking from experience here, don't forget to remove the XYZ Company 
Confidential from your template though.


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Image API v2 Draft 4

2012-04-12 Thread Mark Nottingham
A little fuel for the fire / entertainment before the summit:
  http://www.mnot.net/blog/2012/04/13/json_or_xml_just_decide

Cheers,


On 10/04/2012, at 3:56 PM, Vishvananda Ishaya wrote:

 On Apr 10, 2012, at 2:26 AM, Thierry Carrez wrote:
 
 Jay Pipes wrote:
 I take it you didn't attend the glorious JSON debate of a couple of
 summits ago :-)
 
 Glorious it was indeed.
 
 I think the key quote was something like:
 Please don't bastardize my JSON with your XML crap
 
 According to my twitter, the actual quote was: Don't bring your XML filth 
 into my JSON
 
 Vish
 
 
 
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp

--
Mark Nottingham
http://www.mnot.net/





___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [SWIFT] Looking for an approach to attach an account or a container in operating system . Like a NAS of SAN driver.

2012-04-12 Thread Pete Zaitcev
On Thu, 12 Apr 2012 23:57:59 +0800
Kuo Hugo tonyt...@gmail.com wrote:

 What if user can attach their own account from swift-proxy (or something
 else) directly via NFS or CIFS  or iscsi target will be much better.

Would it not be easier to use an actual filesystem for that, like
GlusterFS? I don't quite see the point of layering a filesystem
API adaptor on top of Swift. Since applications that import a
filesystem API expect filesystem characteristics, performance is
going to be fragile at best.

-- Pete

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [SWIFT] Looking for an approach to attach an account or a container in operating system . Like a NAS of SAN driver.

2012-04-12 Thread Justin Santa Barbara
I made some patches to cloudfuse to get it to support Keystone auth:
http://blog.justinsb.com/blog/2012/03/29/openstack-storage-with-fuse/

I'd like to get this merged upstream, but haven't heard anything on my pull
request...  Redbo?  Bueller? :-)

I also saw an SFTP gateway floating about somewhere; that also seemed like
a good approach.

Should we make cloudfuse an openstack hosted project?

Frederik:  If you do have any issues that should be fixed, I'd love to know
what they are!

Justin



On Thu, Apr 12, 2012 at 10:03 AM, Frederik Van Hecke frede...@cluttr.bewrote:

 Hi Kuo,

 Here are some quick links:

 https://github.com/redbo/cloudfuse
 http://gladinet.blogspot.com/2010/10/openstack-windows-client.html


 I'm running cloudfuse on Ubuntu without much to complain about.



 Kind regards,
 Frederik Van Hecke

 *T:*  +32487733713
 *E:*  frede...@cluttr.be
 *W:* www.cluttr.be



 *This e-mail and any attachments thereto may contain information which is 
 confidential and/or protected by intellectual property rights and are 
 intended for the sole use of the recipient(s)named above. Any use of the 
 information contained herein (including, but not limited to, total or partial 
 reproduction, communication or distribution in any form) by persons other 
 than the designated recipient(s) is prohibited. If you have received this 
 e-mail in error, please notify the sender either by telephone or by e-mail 
 and delete the material from any computer. Thank you for your cooperation.*




 On Thu, Apr 12, 2012 at 17:57, Kuo Hugo tonyt...@gmail.com wrote:

 I'm keeping in search and think about  the easiest way for users to
 leverage their swift account.

 There has several client applications for accessing swift around . Either
 Windows / Linux / Mac.

 But eventually , user still need to install a client for this purpose.

 What if user can attach their own account from swift-proxy (or something
 else) directly via NFS or CIFS  or iscsi target will be much better.

 As I know , both linux and Windows has application to reach  this target.
 Such as Gladinet Server / S3FS etc.

 How about provide such interfaces in Swift-proxy ?

 If there's an exist discussion ticket , please let me know it .

 Cheers


 --
 +Hugo Kuo+
 tonyt...@gmail.com
 + tonyt...@gmail.com886 935004793


 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp



 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Image API v2 Draft 4

2012-04-12 Thread Justin Santa Barbara
I may disagree with a couple of the points along the way; but I agree with
the conclusion for OpenStack.

Thanks for writing it!

Justin

PS vim or emacs?



On Thu, Apr 12, 2012 at 12:58 PM, Mark Nottingham m...@mnot.net wrote:

 A little fuel for the fire / entertainment before the summit:
  http://www.mnot.net/blog/2012/04/13/json_or_xml_just_decide

 Cheers,


 On 10/04/2012, at 3:56 PM, Vishvananda Ishaya wrote:

  On Apr 10, 2012, at 2:26 AM, Thierry Carrez wrote:
 
  Jay Pipes wrote:
  I take it you didn't attend the glorious JSON debate of a couple of
  summits ago :-)
 
  Glorious it was indeed.
 
  I think the key quote was something like:
  Please don't bastardize my JSON with your XML crap
 
  According to my twitter, the actual quote was: Don't bring your XML
 filth into my JSON
 
  Vish
 
 
 
  ___
  Mailing list: https://launchpad.net/~openstack
  Post to : openstack@lists.launchpad.net
  Unsubscribe : https://launchpad.net/~openstack
  More help   : https://help.launchpad.net/ListHelp

 --
 Mark Nottingham
 http://www.mnot.net/





 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Laptop Demo Environment

2012-04-12 Thread Sam Su
I also recommend you use devstack to build an all-in-one Openstack
environment. I have searched so many instructions in Google, but few of
them can works fine.

Sam

On Tue, Apr 10, 2012 at 6:34 AM, Lance Haig lh...@haigmail.com wrote:

 On 10/04/12 14:09, Vaze, Mandar wrote:

 Would 
 http://devstack.org/guides/**single-machine.htmlhttp://devstack.org/guides/single-machine.htmlwork
  for you ? (Or does it need to be installed from packages)

 -Mandar

  Hi Mandar,

 I used devstack before and I would prefer to build the environment
 manually to learn how each piece behaves and integrates


 Thanks

 Lance

 --
 This message was scanned by Better Hosted and is believed to be clean.
 http://www.betterhosted.com


 __**_
 Mailing list: 
 https://launchpad.net/~**openstackhttps://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : 
 https://launchpad.net/~**openstackhttps://launchpad.net/~openstack
 More help   : 
 https://help.launchpad.net/**ListHelphttps://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Where does Keystone middleware for Swift belong?

2012-04-12 Thread Maru Newby
Hi John,

On 2012-04-11, at 8:03 PM, John Dickinson wrote:

 I do not think that these pieces of middleware belong in the core swift repo.

Understood.  

 1) Including them in swift would require swift to depend on keystone for full 
 testing.

As I mentioned in my initial email, the modules in question depend on Keystone 
only at the protocol level, and the unit tests run without any dependence on 
Keystone.  I'm presuming that by 'full testing' you mean the currently 
non-existent functional tests?

 2) (When the middleware was created) Keystone's API was in a state of 
 constant flux. Keystone has changed quite a bit since then, so this may not 
 be the case anymore.

As of the essex release, the API and protocol used to communicate identity via 
the environment can be considered more or less stable. 

 3) Swift does not require Keystone to run (and in fact many production 
 environments don't use keystone at all). [1]

Definitely a good point.

 4) We have previously removed auth systems from swift's core code in order to 
 simplify the codebase and allow separate dev cycles. All that is included now 
 is the most basic auth system required for dev work, stand-alone tests, and 
 POC deployments.
 Our thought thus far has been that auth systems providing auth for swift have 
 the responsibility to maintain their integration code. It's not swift's 
 responsibility to manage and maintain code for every auth system that wants 
 to provide an auth mechanism for swift.

I understand - swift core doesn't want to take on responsibility for 
integrating with different auth systems.

 That being said, there has been quite a bit of recent conversation about the 
 concept of *-contrib areas for each project that include optional 
 add-ons/extensions/plugins/etc or alternative APIs for each project. I expect 
 these conversations to continue next week in person at the summit. One option 
 is for the swift keystone middleware to be a part of such a contrib area.
 
 It sounds like there are good reasons for both projects to not want to 
 include these pieces of middleware in their respective core repos. Perhaps a 
 contrib area can be a compromise, but that does not answer who is responsible 
 for it (ie who maintains the code?). I think that's a separate, but related, 
 question.

+1 for allowing non-core functionality to be included via a 'contrib'-rooted 
package rather than having to reside outside the repo it targets.

Regardless of whether it is included as 'contrib' or not, would would you have 
any interest in my factoring out common functionality from tempauth/swauth and 
making it available for reuse?  

From my understanding, a swift auth mechanism has 3 parts - authentication 
(authn), token authentication (token_authn), and authorization (authz).  Both 
of the main implementations (tempauth and swauth) implement all 3 parts 
independently, though the only thing that differs between them is the authn 
backend.  The swift_auth middleware from Keystone similarly duplicates the 
authz functionality of tempauth and swauth.  If the common stuff could be 
extracted and made available as library modules or base classes, the cost of 
maintaining any given auth mechanism would be greatly reduced, and creating a 
new mechanism would be that much easier.

Please let me know your thoughts.

Cheers,


Maru
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Endpoints problems

2012-04-12 Thread Pete Zaitcev
On Thu, 12 Apr 2012 15:28:21 -0500
Anne Gentle a...@openstack.org wrote:

 keystone --token 012345SECRET99TOKEN012345 --endpoint
 http://192.168.206.130:35357/v2.0 endpoint-create \
[]
--internalurl
 http://192.168.206.130:8774/v2/$(tenant_id)s
 
 I haven't fixed this yet because I'm not sure if the $(tenant_id)s is
 literal or which tenant_id specifically to use (the Service tenant for the
 adminurl possibly)?

The expression $(tenant_id)s is really contained inside the pattern
in the database. It is substituded with a specific tennant ID when
an application makes its request. The weird syntax is inherited from
Python, where one can use constructs like %s or %(key)s.

-- Pete

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] I18n issue for OpenStack

2012-04-12 Thread Mark Nottingham
I agree that non-user visible protocol elements should not be translated.

I think we need to dig more on the error messages. E.g., see:
  
http://docs.openstack.org/api/openstack-compute/2/content/Asynchronous_Faults-d1e2009.html

The example there contains:
  Could not find image 52415800-8b69-11e0-9b19-734f6f00

Which, as is, will need translation. Should it be redesigned? Probably.

All of that aside, there are other potentially user-visible aspects of the Nova 
API (to pick on it for a moment), including machine names and metadata. 

E.g., 
  
http://docs.openstack.org/api/openstack-compute/2/content/Create_or_Replace_Metadata-d1e5358.html

Now, both XML and JSON support Unicode, but:

 * We don't have language flagging here; is it needed? (My tentative answer: 
maybe, but hopefully not).

 * If we do, do we allow multiple values for the same key, to allow it to be 
multilingual? (same hope as above).

etc. I think I brought this up a while back, and was told that it wasn't 
in-scope yet. Perhaps with our growing community, that needs another look?

Cheers,


On 12/04/2012, at 12:33 PM, Joshua Harlow wrote:

 So u have just touched on another issue,
 
 I would still say that exception messages should not be translated (+1), haha.
 
 If this is needed, then there is something wrong with the code and how 
 exceptions are used instead (ie the bad code smell). Exceptions should be 
 meant for error control flow, what they were designed for, not for user 
 facing messages. I think it is more common to have a layer that translates 
 exceptions into meaningful localized messages, but there needs to be a 
 separation between exceptions and there localized messages (they should not 
 be combined). This is a common thing afaik, its called separation of model 
 and view, aka, mvc, (think of the exceptions as a model/controller(?), if the 
 messages – the view are intertwined that seems broke). 
 
 This is common with a lot of other parts of openstack as well, ec2 
 formatting/response creation should be separated from nova logic (ec2 should 
 be a view, which it mostly is right now) and so on...
 
 On 4/12/12 4:27 AM, Hua ZZ Zhang zhu...@cn.ibm.com wrote:
 
 My cents:
 
 Apache HTTP is not so equivelant to OpenStack here. Generally it doesn't care 
 about the application errors or exceptions thrown by web applications. In 
 openstack, exceptions have been defined in nova, horizon, keystone etc. The 
 messages of these exceptions are important for different users to understand 
 what has happened. These messages always need to be localized, returned and 
 displayed on user interface, not just be logged in backend system. It is very 
 common practice for a global software project.
 
 Sean Dague wrote:
  If we want to think about OpenStack as a basic building block like
  Apache, i18n is critical. Otherwise there are regions that won't adopt
  it solely because of a lack of i18n.
 
 Note that Apache HTTPd, for instance, does not seem to internationalize
 its error messages. Only the (enduser-facing) HTML pages it gives back
 in response to invalid requests are.
 
 
 
 Best Regards, 
 
 Edward Zhang(张华)
 Staff Software Engineer
 TravelTransportation Standards
 Emerging Technology Institute(ETI)
 IBM China Software Development Lab
 e-mail: zhu...@cn.ibm.com
 Notes ID: Hua ZZ Zhang/China/IBM
 Tel: 86-10-82450483地址:北京市海淀区东北旺西路8号 中关村软件园28号楼 环宇大厦3层 邮编:100193
 Address: 3F Ring, Building 28 Zhongguancun Software Park, 8 Dongbeiwang West 
 Road, Haidian District, Beijing, P.R.C.100193 
 image.gifimage.gif
 
 image.gif
 image.gifThierry Carrez ---2012-04-12 16:51:59---Sean Dague wrote:
 
 Thierry Carrez thie...@openstack.org 
 Sent by: openstack-bounces+zhuadl=cn.ibm@lists.launchpad.net 2012-04-12 
 16:47
 image.gif
 To
 
 image.gif
 openstack@lists.launchpad.net 
 image.gif
 
 cc
 
 image.gif
 image.gif
 
 Subject
 
 image.gif
 Re: [Openstack] I18n issue for OpenStack 
 image.gifimage.gif
 Sean Dague wrote:
  If we want to think about OpenStack as a basic building block like
  Apache, i18n is critical. Otherwise there are regions that won't adopt
  it solely because of a lack of i18n.
 
 Note that Apache HTTPd, for instance, does not seem to internationalize
 its error messages. Only the (enduser-facing) HTML pages it gives back
 in response to invalid requests are.
 
  Is there a metric on the completeness so far? Something automated that
  could be a jenkins coverage kind of test?
 
 Oddly enough, it's not a question of completeness of translations.
 Piggybacking on the awesome Launchpad Translations community always gave
 us great coverage. It's more a code support and CI integration issue.
 
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp

--
Mark Nottingham
http://www.mnot.net/






Re: [Openstack] Image API v2 Draft 4

2012-04-12 Thread Jay Pipes

On 04/12/2012 03:58 PM, Mark Nottingham wrote:

A little fuel for the fire / entertainment before the summit:
   http://www.mnot.net/blog/2012/04/13/json_or_xml_just_decide


I *have* to point out that your article is published on Friday the 13th.

Just sayin' :)

-jay

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] I18n issue for OpenStack

2012-04-12 Thread Tom Fifield
A good idea to separate into two parts, however I fear that the current 
English strings don't serve the first role as well as first appears. 
This has to do with the pre-processing we do on error strings to make 
more accurate searches and error report titles.


A quick, very artificial example:

Unable to get service info: Malformed request url

As English speakers, we can look at this and see that Unable to get 
service info is what happened, and Malformed request url is why.


So, knowing that there are probably many possible reasons for 'why' we 
were Unable to get service info, we might chop this part out of our 
search term, or when we ask for help - and indeed you can see an example 
of this in a title here: 
https://answers.launchpad.net/horizon/+question/190188


In other languages sometimes the sentence order is much different. For 
example, in Chinese, that error could be written something like:


因为错误格式的请求URL所以无法获得服务信息

As a Chinese speaker, you know what this says and you can work out the 
'why' and the 'what' in your search term.


As a non-Chinese speaker, you're stuck putting the whole thing into your 
search engine and hoping that no-one chopped off or changed the 
structural elements of the sentence such as 因为 and 所以.


So, perhaps the part that can be used for searches and bug reports 
really does need to be 'locale-independent'. Complex system of 
impossible to understand error numbers, anyone? ;)



Regards,


Tom

On 04/12/2012 11:46 PM, David Kranz wrote:

Both points of view being expressed about this with respect to log error
messages are valid and need to be accommodated.
An answer, as was suggested a while back, is for error messages to have
two parts:

1. A locale-independent part that can be used for searches or understood
by developers who get logs as parts of bug reports.
2. A localized part that lets operators determine if the problem is
their issue or an OpenStack bug to be reported.

The current English string would serve the first role, and the logging
code could be changed to also emit the localized string if available. I
would argue
for this only in the case of ERROR messages and not DEBUG.

While on the subject of logs, it would be good to agree on what actions
should cause errors in logs to appear. Ideally, they would only occur if
an OpenStack bug
was detected (out-of-bounds array ref, etc.) or some operational problem
occurred (disk ran out of space, etc.). Right now errors are sometimes
output for other
reasons such as bad arguments to api calls. This makes it difficult for
an operator to know when a real problem with the system has occurred.

David Kranz
Quanta Research Cambridge




On 4/12/2012 9:06 AM, Sheng Bo Hou wrote:

Dear OpenStack friends,

It will be happy and great for our OpenStack community to see this
open project open to more market all over the world.
In China, OpenStack community is very active. I heard many Chinese
engineers talking about their wish to have a Chinese versioned
openStack, including documentation's, manuals, user interfaces, error
messages, etc in OpenStack meet-ups.
I have many European friends and also Danish friends, since I used to
do my university there. They all spoke perfect English, which made me
admire, cos they were linguists in my point of view. Oriental
languages are different. They are too far from the western lingual
system. In China, there are many talented engineers, who are not that
kind of linguists, but they are lover of open source. I think it is
amazing to open the door to them. In China, it is very appreciated
for software to be localized as much as possible.
I used to google or baidu(a famous Chinese search engine) error
messages and logs in Chinese for other software, though it is not
Apache. I found a lot of useful references in Chinese, because it has
been localized. If it is not localized well first, of course it does
not have the google or yahoo ability to search.:-)
So far I am rather grateful for all the messages following this i18
issue. Thank you so much.

Best wishes.
Vincent Hou (侯胜博)

Software Engineer, Standards Growth Team, Emerging Technology
Institute, IBM China Software Development Lab

Tel: 86-10-82450778 Fax: 86-10-82453660
Notes ID: Sheng Bo Hou/China/IBM@IBMCN E-mail: sb...@cn.ibm.com
Address:3F Ring, Building 28 Zhongguancun Software Park, 8 Dongbeiwang
West Road, Haidian District, Beijing, P.R.C.100193


*Soren Hansen so...@linux2go.dk*
Sent by: openstack-bounces+sbhou=cn.ibm@lists.launchpad.net

2012-04-12 19:50


To
Hua ZZ Zhang/China/IBM@IBMCN
cc
openstack@lists.launchpad.net, Thierry Carrez
thie...@openstack.org,
openstack-bounces+zhuadl=cn.ibm@lists.launchpad.net
Subject
Re: [Openstack] I18n issue for OpenStack









Don't get me wrong.. I'd be happy to have the various openstack
clients offer localised error messages. I'd also encourage a
centralised effort to collect these translationns (so that all the
various language 

[Openstack] New Gerrit version (and server)

2012-04-12 Thread James E. Blair
Hi,

We've just upgraded Gerrit to version 2.3.  There are a lot of changes
behind the scenes that we've been looking forward to (like being able to
store data in innodb rather than myisam tables for extra data
longevity).  And there are a few visible changes that may be of interest
to OpenStack developers.

One new addition in 2.3 is draft changes.  The idea behind a draft
change in Gerrit is that it is a change that is not ready for merging,
or even general code review, but you would like to share it with some
people to get early comments.  If you upload a change as a draft, by
default, no one else can see it.  You must explicitly add each person
you would like to share it with as a reviewer.  Reviewers you add can
leave comments, but can not vote at this stage.  You can continue to
upload new patchsets to the change as it evolves, and once it is ready
for general review, you can click the Publish button.  It will then
become a normal change in Gerrit that everyone can see, including the
earlier reviews from the draft stage.  This is a one way transition;
once a draft is published, it can't be made a draft again.

If you're using git-review from source or the latest version from PyPI
(version 1.16, released today), you can easily upload a draft change by
adding the -D option (eg, git review -D).  Earlier versions of
git-review also have the -D option, but the git ref that Gerrit uses
to indicate a change should be a draft was changed between the 2.3
release candidate and the final release; so if using -D results in an
error, you may need to upgrade.

You may notice some changes to the diff view.  Notably, the header which
contained all of the possible viewing options has been split up into
several parts; you can switch between them by selecting options that
show up under the menu at the top.  I recommend setting Retain Header
On File Switch under the Preferences section, as it is a nicer
experience when changing files.

Another notable new feature is the ability to add a group to the list of
reviewers for a change.  Just type in the name of the group and click
Add Reviewer and all of the individuals in the group will be added to
the list of reviewers (and will see the change on their review
requests list.

Finally, we've modified some of our local OpenStack style changes so
that it is easier for us to track upstream changes in layout.  It should
mean a little more consistency throughout the interface, though we
weren't able to keep the alternating row colors on the main table
without a disproportionate amount of effort.  Do note that you can click
on a line in a table, and it will be highlighted to improve legibility.

We've tried to give this as much testing as possible before moving it
into production.  If you encounter any issues, please let us know on IRC
(mtaylor, jeblair, LinuxJedi), via email at
openstack-ci-adm...@lists.launchpad.net, or you can file a bug at:

  https://bugs.launchpad.net/openstack-ci/

Thanks,

Jim

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Endpoints problems

2012-04-12 Thread Yong Sheng Gong
Maybe, here some codes are worth thouhands of words:keystone.catalog.backends.sql.Catalog:  def get_catalog(self, user_id, tenant_id, metadata=None): d = dict(CONF.iteritems()) d.update({'tenant_id': tenant_id, 'user_id': user_id}) catalog = {} endpoints = [self.get_endpoint(e) for e in self.list_endpoints()] for ep in endpoints: service = self.get_service(ep['service_id']) srv_type = service['type'] srv_name = service['name'] region = ep['region'] if region not in catalog: catalog[region] = {} catalog[region][srv_type] = {} internal_url = ep['internalurl'].replace('$(', '%(') public_url = ep['publicurl'].replace('$(', '%(') admin_url = ep['adminurl'].replace('$(', '%(') catalog[region][srv_type]['name'] = srv_name catalog[region][srv_type]['publicURL'] = public_url % d catalog[region][srv_type]['adminURL'] = admin_url % d catalog[region][srv_type]['internalURL'] = internal_url % d return catalog-openstack-bounces+gongysh=cn.ibm@lists.launchpad.net wrote: -To: Anne Gentle a...@openstack.orgFrom: Pete Zaitcev zait...@redhat.comSent by: openstack-bounces+gongysh=cn.ibm@lists.launchpad.netDate: 04/13/2012 06:44AMCc: Openstack Mail List openstack@lists.launchpad.netSubject: Re: [Openstack] Endpoints problemsOn Thu, 12 Apr 2012 15:28:21 -0500Anne Gentle a...@openstack.org wrote: keystone --token 012345SECRET99TOKEN012345 --endpoint http://192.168.206.130:35357/v2.0endpoint-create \[]--internalurl http://192.168.206.130:8774/v2/$(tenant_id)s  I haven't fixed this yet because I'm not sure if the $(tenant_id)s is literal or which tenant_id specifically to use (the Service tenant for the adminurl possibly)?The _expression_ "$(tenant_id)s" is really contained inside the patternin the database. It is substituded with a specific tennant ID whenan application makes its request. The weird syntax is inherited fromPython, where one can use constructs like %s or %(key)s.-- Pete___Mailing list: https://launchpad.net/~openstackPost to   : openstack@lists.launchpad.netUnsubscribe : https://launchpad.net/~openstackMore help  : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Image API v2 Draft 4

2012-04-12 Thread Jorge Williams
Generally, I agree with a lot of what you're saying, but I want to point out a 
couple of things:

1.  Static language folks gravitate to XML, not simply because they're invested 
in it, but because it solves a real problem:

In a static language, I want to to say something like:

myServer.name = hello;

if I misspell name

myServer.nam = hello;

I should see an error...if I assign it to an integer...

myServer.name=10;

I should also see an error...

and I should see those errors at compile time or while I'm authoring my code if 
a have a good editor or IDEI shouldn't have to wait until my program is run 
to catch those errors. 

Sure, I can parse some JSON turn the result into a hashtable and if I'm using 
something like Scala, I can do  this

myServer(name) = hello

but at that point, there's very little benefit to having a static language, 
because I don't have the assurances and guarantees that the language provides. 
So I don't see a lot of Java folks dealing with JSON in that manner.  Most devs 
will  need to build a class before hand.  So, you decrease barriers for static 
language clients because there's a set of tools that can extract the relevant 
info from XML schema languages and generate a set of class files at compile 
time.   There's nothing saying you can't do something similar with JSON, but 
those sort of tools aren't there  yet.

2.  Then there's the issue of extensibilityespecially distributed 
extensibility. XML has that notion built in, JSON has no concept of it...and we 
are building extensible APIs. There are no standard way in JSON to introduce a  
new property without guaranteeing that there won't be  clash.  You've mention 
the need for namespaces in JSON precisely to  deal with this sort of issue 
(http://www.mnot.net/blog/2011/10/12/thinking_about_namespaces_in_json). 
In the absence of a standard method, we're been using prefixes, which has 
worked out well, but most JSON tools don't know how to deal with them and they 
seem alien to folk that are used to using JSON day to day. This is a big deal 
because dynamic language folks are more likely to deal with the JSON 
directly...Static language folks are generally not dealing with XML in the same 
way.  In XML, the notion of extensibility is build into parsers  and data 
binding tools directly.  Most folks don't have to worry too much about it.  In 
fact extensible protocols like XMPP and Atom Pub generally benefit from the 
extensibility that's already  built in:  
http://metajack.im/2010/02/01/json-versus-xml-not-as-simple-as-you-think/ 

Given that, if we're going to go the route of just picking one format, I think 
the fact that our API is extensible means that we might want to ask ourselves 
whether XML isn't a better fit :-)

Having said all of that,  I realize that our devs are working in a dynamic 
language, and don't see a lot of value in XML.  It's important to take that 
into consideration, but we should also be asking whether there's value to our 
current clients and potential clients.  Like it or not, there's a lot of folks 
out there using static languages. 

You're right in stating that if we had really good language bindings for Java 
and .Net, then issue #1 would essentially go away -- especially if we had 
language binding that was flexible enough to  remove the need to go down to the 
HTTP level.  Also, if the language binding itself was extensible we could also 
deal with issue 2.  As things stand today though, I don't thing that we are 
even remotely there yet.

-jOrGe W.


On Apr 12, 2012, at 2:58 PM, Mark Nottingham wrote:

 A little fuel for the fire / entertainment before the summit:
  http://www.mnot.net/blog/2012/04/13/json_or_xml_just_decide
 
 Cheers,
 
 
 On 10/04/2012, at 3:56 PM, Vishvananda Ishaya wrote:
 
 On Apr 10, 2012, at 2:26 AM, Thierry Carrez wrote:
 
 Jay Pipes wrote:
 I take it you didn't attend the glorious JSON debate of a couple of
 summits ago :-)
 
 Glorious it was indeed.
 
 I think the key quote was something like:
 Please don't bastardize my JSON with your XML crap
 
 According to my twitter, the actual quote was: Don't bring your XML filth 
 into my JSON
 
 Vish
 
 
 
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp
 
 --
 Mark Nottingham
 http://www.mnot.net/
 
 
 
 
 
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] How to setup vncproxy with ubuntu precise package?

2012-04-12 Thread Nachi Ueno
Hi folks

I'm trying to setup vncproxy with ubuntu package on precise.
But I could'nt find document how to setup them.
If you there are information, could you share me?

Thank you in advance
Nachi

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] How to setup vncproxy with ubuntu precise package?

2012-04-12 Thread Yong Sheng Gong
Hi, please see if following text can help.
			To enable vnc console access VMs started by OpenStack, we need many components to collaborate.
		
Components on control node

		nova-api, which is API server of OpenStack
		nova-consoleauth, which is used to authorize vnc client
		noVNC, which is a VNC proxy for browser. An alternative proxy is 
nova-xvpvncproxy, which can accessed by a Java client at 
https://github.com/cloudbuilders/nova-xvpvncviewer.
			
Components on compute node

		nova-compute, which is nova binary to instantiate VMs
		libvirt driver, which is used by nova-compute to interact with libvirt server
		VNC server, which is part of hypervisor?
			
		
			Steps for user to access VNC console
		
			
			1. user gets the vnc console by command:
		
			

	
		[root@robinlinux utils]# nova get-vnc-console myserver20 novnc
		

			
		
	
	
		nova-api accepts this request, and then sends out "get_vnc_console" message to VM's related compute host
	
		2. nova-compute, running on that compute host accepts that message, 
generate a token and call libvirt driver's get_vnc_console methods.
	
		3. Libvirt driver will connect with libvirt server to get VM's vnc 
port, and look up the vnc host from FLAGS.vncserver_proxyclient_address.
	
		4. nova-api will send out "authorize_console" message to 
nova-consoleauth, which then caches the connection information returned 
by compute-node with token as key
	
		5. user browsers the URL returned the previous command, like below:
	
		
			

	[root@robinlinux utils]# nova get-vnc-console myserver20 novnc
	+---+--+
	| Type | Url |
	+---+--+
	| novnc | http://controlnode:6080/vnc_auto.html?token=34ce7a44-6186-43d8-be14-2ea9e028b8fa |
	+---+--+
	
			
		
	
	
		6. noVNC, which is listening on 6080 HTTP port, accepts the URL request, sends out "check_token" message to nova-consoleauth
	
		7. nova-consoleauth checks the cached connections and returns one according to the requested token key
	
		8. noVNC begins the proxy work, connecting the VNC server
	
		About configuration items in nova.conf
	
		
			

	#read by nova-compute to compose vnc-console URL
	# for novnc
	novncproxy_base_url=http://controlnode:6080/vnc_auto.html
	# for xvpvnc
	xvpvncproxy_base_url=http://controlnode:6081/console
	#read by nova-compute to instantiate VMs
	vncserver_listen=controlnode
	
	#read by libvirt driver to compute vnc-console URL
	vncserver_proxyclient_address=controlnode
	
			
		
	

-openstack-bounces+gongysh=cn.ibm@lists.launchpad.net wrote: -To: openstack@lists.launchpad.netFrom: Nachi Ueno ueno.na...@nttdata-agilenet.comSent by: openstack-bounces+gongysh=cn.ibm@lists.launchpad.netDate: 04/13/2012 08:33AMSubject: [Openstack] How to setup vncproxy with ubuntu precise package?Hi folksI'm trying to setup vncproxy with ubuntu package on precise.But I could'nt find document how to setup them.If you there are information, could you share me?Thank you in advanceNachi___Mailing list: https://launchpad.net/~openstackPost to   : openstack@lists.launchpad.netUnsubscribe : https://launchpad.net/~openstackMore help  : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [Swift] Does there any exist blueprint or sub-project of user's storage space quota or counting method for Swift ?

2012-04-12 Thread John Dickinson
Swift keeps total bytes, container, and object count (eventually) up-to-date in 
the account metadata. There are also log processing tools (like slogging - 
http://github.com/notmyname/slogging) that can provide usage information 
(including bandwidth) based on swift logs.

While I think that it's appropriate for swift to generate the usage information 
(via internal processes or log processing), the appropriate place for quotas is 
in whatever system handles the concept of a user (normally the auth system). 
This way quotas are enforced by revoking or limiting access of the auth token.

--John


On Apr 12, 2012, at 11:53 AM, Frederik Van Hecke wrote:

 Hi Kuo,
 
 One option would be to keep the usage information (num files, num bytes, etc) 
 per container / account in an sqlite DB, just like it is done for account and 
 container info.
 
 To avoid having to loop through all data at regular intervals (to update the 
 info), additional logic could be added to the api methods to update the 
 sqlite DB's when new files are added, files are deleted, etc. Such approach 
 will require more lines of code, but will be far less stressful on 
 performance.
 
 (the brute-force approach to loop through it at regular intervals will be 
 hell on performance on large deployments..)
 
 
 For data transfer billing based on download / upload amounts, a similar 
 approach could be used.
 
 If no one else is looking into this, I would certainly be willing to help to 
 help get this started.
 
 
 Kind regards,
 Frederik Van Hecke
 
 T:  +32487733713
 E:  frede...@cluttr.be
 W: www.cluttr.be
 
 
 
 
 
 This e-mail and any attachments thereto may contain information which is 
 confidential and/or protected by intellectual property rights and are 
 intended for the sole use of the recipient(s)named above. Any use of the 
 information contained herein (including, but not limited to, total or partial 
 reproduction, communication or distribution in any form) by persons other 
 than the designated recipient(s) is prohibited. If you have received this 
 e-mail in error, please notify the sender either by telephone or by e-mail 
 and delete the material from any computer. Thank you for your cooperation.
 
 
 
 On Thu, Apr 12, 2012 at 17:45, Kuo Hugo tonyt...@gmail.com wrote:
 Hi folks , 
 
 I'm thinking about the better approach to manage an user or an account 
 space usage quota in swift.
 Is  there any related blueprint or sub-project even an idea around ?
 Any suggestion of benefits to be an external service or to be a middle-ware 
 in swift-proxy ?
 
 I'm concerning about such feature will reduce the performance of entire Swift 
 environment. 
 
 Appreciate :
 
   
 
 -- 
 +Hugo Kuo+
 tonyt...@gmail.com
 +886 935004793
 
 
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp
 
 
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp



smime.p7s
Description: S/MIME cryptographic signature
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [Swift] Does there any exist blueprint or sub-project of user's storage space quota or counting method for Swift ?

2012-04-12 Thread John Dickinson
I should also mention the summit session talking about this very topic led by 
Everett Toews. It's (currently) scheduled for 9am on wednesday.

http://summit.openstack.org/sessions/view/81

--John



On Apr 12, 2012, at 8:51 PM, John Dickinson wrote:

 Swift keeps total bytes, container, and object count (eventually) up-to-date 
 in the account metadata. There are also log processing tools (like slogging - 
 http://github.com/notmyname/slogging) that can provide usage information 
 (including bandwidth) based on swift logs.
 
 While I think that it's appropriate for swift to generate the usage 
 information (via internal processes or log processing), the appropriate place 
 for quotas is in whatever system handles the concept of a user (normally the 
 auth system). This way quotas are enforced by revoking or limiting access of 
 the auth token.
 
 --John
 
 
 On Apr 12, 2012, at 11:53 AM, Frederik Van Hecke wrote:
 
 Hi Kuo,
 
 One option would be to keep the usage information (num files, num bytes, 
 etc) per container / account in an sqlite DB, just like it is done for 
 account and container info.
 
 To avoid having to loop through all data at regular intervals (to update the 
 info), additional logic could be added to the api methods to update the 
 sqlite DB's when new files are added, files are deleted, etc. Such approach 
 will require more lines of code, but will be far less stressful on 
 performance.
 
 (the brute-force approach to loop through it at regular intervals will be 
 hell on performance on large deployments..)
 
 
 For data transfer billing based on download / upload amounts, a similar 
 approach could be used.
 
 If no one else is looking into this, I would certainly be willing to help to 
 help get this started.
 
 
 Kind regards,
 Frederik Van Hecke
 
 T:  +32487733713
 E:  frede...@cluttr.be
 W: www.cluttr.be
 
 
 
 
 
 This e-mail and any attachments thereto may contain information which is 
 confidential and/or protected by intellectual property rights and are 
 intended for the sole use of the recipient(s)named above. Any use of the 
 information contained herein (including, but not limited to, total or 
 partial reproduction, communication or distribution in any form) by persons 
 other than the designated recipient(s) is prohibited. If you have received 
 this e-mail in error, please notify the sender either by telephone or by 
 e-mail and delete the material from any computer. Thank you for your 
 cooperation.
 
 
 
 On Thu, Apr 12, 2012 at 17:45, Kuo Hugo tonyt...@gmail.com wrote:
 Hi folks , 
 
 I'm thinking about the better approach to manage an user or an account 
 space usage quota in swift.
 Is  there any related blueprint or sub-project even an idea around ?
 Any suggestion of benefits to be an external service or to be a middle-ware 
 in swift-proxy ?
 
 I'm concerning about such feature will reduce the performance of entire 
 Swift environment. 
 
 Appreciate :
 
 
 
 -- 
 +Hugo Kuo+
 tonyt...@gmail.com
 +886 935004793
 
 
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp
 
 
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp
 



smime.p7s
Description: S/MIME cryptographic signature
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Endpoints problems

2012-04-12 Thread Lorin Hochstein

On Apr 12, 2012, at 6:44 PM, Pete Zaitcev wrote:

 On Thu, 12 Apr 2012 15:28:21 -0500
 Anne Gentle a...@openstack.org wrote:
 
 keystone --token 012345SECRET99TOKEN012345 --endpoint
 http://192.168.206.130:35357/v2.0 endpoint-create \
 []
   --internalurl
 http://192.168.206.130:8774/v2/$(tenant_id)s
 
 I haven't fixed this yet because I'm not sure if the $(tenant_id)s is
 literal or which tenant_id specifically to use (the Service tenant for the
 adminurl possibly)?
 
 The expression $(tenant_id)s is really contained inside the pattern
 in the database. It is substituded with a specific tennant ID when
 an application makes its request. The weird syntax is inherited from
 Python, where one can use constructs like %s or %(key)s.


My understanding (based on somebody's previous answer in the mailing list, or 
possibly one of the IRC channels) was that you could only do this with the 
template backend, and when you were using the database backend you had to 
explicitly add endpoints for each tenant that needed to talk to the API.

Can you confirm that you can use the $(tenant_id)s syntax when the backend is 
set using the following keystone.conf entry:

[catalog]
driver = keystone.catalog.backends.sql.Catalog


Take care,

Lorin
--
Lorin Hochstein
Lead Architect - Cloud Services
Nimbis Services, Inc.
www.nimbisservices.com




___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [SWIFT] Looking for an approach to attach an account or a container in operating system . Like a NAS of SAN driver.

2012-04-12 Thread Kuo Hugo
Thanks , will have a look at cloudfuse.

I tried Gladinet solution already . But it do not support NFS protocol
currently

Frederik Van Hecke frede...@cluttr.be 於 2012年4月13日上午1:03 寫道:

 Hi Kuo,

 Here are some quick links:

 https://github.com/redbo/cloudfuse
 http://gladinet.blogspot.com/2010/10/openstack-windows-client.html


 I'm running cloudfuse on Ubuntu without much to complain about.



 Kind regards,
 Frederik Van Hecke

 *T:*  +32487733713
 *E:*  frede...@cluttr.be
 *W:* www.cluttr.be



 *This e-mail and any attachments thereto may contain information which is 
 confidential and/or protected by intellectual property rights and are 
 intended for the sole use of the recipient(s)named above. Any use of the 
 information contained herein (including, but not limited to, total or partial 
 reproduction, communication or distribution in any form) by persons other 
 than the designated recipient(s) is prohibited. If you have received this 
 e-mail in error, please notify the sender either by telephone or by e-mail 
 and delete the material from any computer. Thank you for your cooperation.*




 On Thu, Apr 12, 2012 at 17:57, Kuo Hugo tonyt...@gmail.com wrote:

 I'm keeping in search and think about  the easiest way for users to
 leverage their swift account.

 There has several client applications for accessing swift around . Either
 Windows / Linux / Mac.

 But eventually , user still need to install a client for this purpose.

 What if user can attach their own account from swift-proxy (or something
 else) directly via NFS or CIFS  or iscsi target will be much better.

 As I know , both linux and Windows has application to reach  this target.
 Such as Gladinet Server / S3FS etc.

 How about provide such interfaces in Swift-proxy ?

 If there's an exist discussion ticket , please let me know it .

 Cheers


 --
 +Hugo Kuo+
 tonyt...@gmail.com
 + tonyt...@gmail.com886 935004793


 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp





-- 
+Hugo Kuo+
tonyt...@gmail.com
+ tonyt...@gmail.com886 935004793
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [SWIFT] Looking for an approach to attach an account or a container in operating system . Like a NAS of SAN driver.

2012-04-12 Thread Kuo Hugo
SFTP looks interesting .

I plan to have a try with your cloudfuse branch for later testing.

Any Consideration will back to this ticket.

Justin Santa Barbara jus...@fathomdb.com 於 2012年4月13日上午5:40 寫道:

 I made some patches to cloudfuse to get it to support Keystone auth:
 http://blog.justinsb.com/blog/2012/03/29/openstack-storage-with-fuse/

 I'd like to get this merged upstream, but haven't heard anything on my
 pull request...  Redbo?  Bueller? :-)

 I also saw an SFTP gateway floating about somewhere; that also seemed like
 a good approach.

 Should we make cloudfuse an openstack hosted project?

 Frederik:  If you do have any issues that should be fixed, I'd love to
 know what they are!

 Justin




 On Thu, Apr 12, 2012 at 10:03 AM, Frederik Van Hecke 
 frede...@cluttr.bewrote:

 Hi Kuo,

 Here are some quick links:

 https://github.com/redbo/cloudfuse
 http://gladinet.blogspot.com/2010/10/openstack-windows-client.html


 I'm running cloudfuse on Ubuntu without much to complain about.



 Kind regards,
 Frederik Van Hecke

 *T:*  +32487733713
 *E:*  frede...@cluttr.be
 *W:* www.cluttr.be



 *This e-mail and any attachments thereto may contain information which is 
 confidential and/or protected by intellectual property rights and are 
 intended for the sole use of the recipient(s)named above. Any use of the 
 information contained herein (including, but not limited to, total or 
 partial reproduction, communication or distribution in any form) by persons 
 other than the designated recipient(s) is prohibited. If you have received 
 this e-mail in error, please notify the sender either by telephone or by 
 e-mail and delete the material from any computer. Thank you for your 
 cooperation.*




 On Thu, Apr 12, 2012 at 17:57, Kuo Hugo tonyt...@gmail.com wrote:

 I'm keeping in search and think about  the easiest way for users to
 leverage their swift account.

 There has several client applications for accessing swift around .
 Either Windows / Linux / Mac.

 But eventually , user still need to install a client for this purpose.

 What if user can attach their own account from swift-proxy (or something
 else) directly via NFS or CIFS  or iscsi target will be much better.

 As I know , both linux and Windows has application to reach  this
 target.
 Such as Gladinet Server / S3FS etc.

 How about provide such interfaces in Swift-proxy ?

 If there's an exist discussion ticket , please let me know it .

 Cheers


 --
 +Hugo Kuo+
 tonyt...@gmail.com
 + tonyt...@gmail.com886 935004793


 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp



 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp





-- 
+Hugo Kuo+
tonyt...@gmail.com
+ tonyt...@gmail.com886 935004793
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] [Swift] Does there any exist blueprint or sub-project of user's storage space quota or counting method for Swift ?

2012-04-12 Thread Alex Yang
In my view, the biggest problem of swift is not the new features but the
improvement of performance.

At first, we knew that container-updater, *-auditor, *-replicator will loop
all the files in the disk during the running interval. When the number of
files is very large, the process of replicator, updater and auditor will
spend much time. So, the time of eventual consistency is very long.

Our practice of  Sina Web Service Team https://launchpad.net/~sws:

total accounts:  121,961;

total containers:160,703;

total objects: 14,291,519;

total storage usage:  1.3T

account replication time:10 hours;

container replication time:  10 hours;

object replication time:   48 hours;

account audit time:   2 hours;

container audit time: 9 hours;

container update time:19 hours;

This is terrible If we develop quota upon account db. There is long time
for eventual consistency.

Secondly,  there is a vicious circle during replication. The replicator
will query the account-server, container-server and object-server to
compare the metadata, and determine whether to sync. When the number of
files is very large, the frequent query make the account-server,
container-server and object-server become a bottle neck. This will
influence the process of proxy-server to work with back-end servers. There
a lot of Timeout(10s) ERROR in proxy-server's log and the load-average is
very high.
So, some PUT, POST operations failed, and the replicator to sync, and fail
more, and sync more...
.
In my opinion, we need to improve the process of replication and container
update by using event drive framework or something else..
My leader may discuss this topic at Design Summit,
http://openstackconferencespring2012.sched.org/speaker/huicheng

2012/4/13 John Dickinson m...@not.mn javascript:_e({}, 'cvml',
'm...@not.mn');

 Swift keeps total bytes, container, and object count (eventually)
 up-to-date in the account metadata. There are also log processing tools
 (like slogging - http://github.com/notmyname/slogging) that can provide
 usage information (including bandwidth) based on swift logs.

 While I think that it's appropriate for swift to generate the usage
 information (via internal processes or log processing), the appropriate
 place for quotas is in whatever system handles the concept of a user
 (normally the auth system). This way quotas are enforced by revoking or
 limiting access of the auth token.

 --John


 On Apr 12, 2012, at 11:53 AM, Frederik Van Hecke wrote:

  Hi Kuo,
 
  One option would be to keep the usage information (num files, num bytes,
 etc) per container / account in an sqlite DB, just like it is done for
 account and container info.
 
  To avoid having to loop through all data at regular intervals (to update
 the info), additional logic could be added to the api methods to update the
 sqlite DB's when new files are added, files are deleted, etc. Such approach
 will require more lines of code, but will be far less stressful on
 performance.
 
  (the brute-force approach to loop through it at regular intervals will
 be hell on performance on large deployments..)
 
 
  For data transfer billing based on download / upload amounts, a similar
 approach could be used.
 
  If no one else is looking into this, I would certainly be willing to
 help to help get this started.
 
 
  Kind regards,
  Frederik Van Hecke
 
  T:  +32487733713
  E:  frede...@cluttr.be javascript:_e({}, 'cvml',
 'frede...@cluttr.be');
  W: www.cluttr.be
 
 
 
 
 
  This e-mail and any attachments thereto may contain information which is
 confidential and/or protected by intellectual property rights and are
 intended for the sole use of the recipient(s)named above. Any use of the
 information contained herein (including, but not limited to, total or
 partial reproduction, communication or distribution in any form) by persons
 other than the designated recipient(s) is prohibited. If you have received
 this e-mail in error, please notify the sender either by telephone or by
 e-mail and delete the material from any computer. Thank you for your
 cooperation.
 
 
 
  On Thu, Apr 12, 2012 at 17:45, Kuo Hugo 
  tonyt...@gmail.comjavascript:_e({}, 'cvml', 'tonyt...@gmail.com');
 wrote:
  Hi folks ,
 
  I'm thinking about the better approach to manage an user or an
 account space usage quota in swift.
  Is  there any related blueprint or sub-project even an idea around ?
  Any suggestion of benefits to be an external service or to be a
 middle-ware in swift-proxy ?
 
  I'm concerning about such feature will reduce the performance of entire
 Swift environment.
 
  Appreciate :
 
 
 
  --
  +Hugo Kuo+
  tonyt...@gmail.com javascript:_e({}, 'cvml', 'tonyt...@gmail.com');
  +886 935004793
 
 
  ___
  Mailing list: https://launchpad.net/~openstack
  Post to : openstack@lists.launchpad.net javascript:_e({}, 'cvml',
 'openstack@lists.launchpad.net');
  

Re: [Openstack] Endpoints problems

2012-04-12 Thread Pete Zaitcev
On Thu, 12 Apr 2012 22:33:38 -0400
Lorin Hochstein lo...@nimbisservices.com wrote:

 My understanding (based on somebody's previous answer in the mailing list,
 or possibly one of the IRC channels) was that you could only do this with
 the template backend, and when you were using the database backend you had
 to explicitly add endpoints for each tenant that needed to talk to the API.
 
 Can you confirm that you can use the $(tenant_id)s syntax when the backend
 is set using the following keystone.conf entry:
 
 [catalog]
 driver = keystone.catalog.backends.sql.Catalog

The thought that the substitution may not work never occured to me.
I have the following in keystone.conf:

[catalog]
# dynamic, sql-based backend (supports API/CLI-based management commands)
driver = keystone.catalog.backends.sql.Catalog
template_file = /etc/keystone/default_catalog.templates

# static, file-based backend (does *NOT* support any management commands)
#driver = keystone.catalog.backends.templated.TemplatedCatalog
#template_file = ./etc/default_catalog.templates

And I run the following command as a part of re-population script:

## Without proxy:
#$keystone endpoint-create --region RegionOne --service_id $SSID \
#--publicurl 'http://kvm-rei.zaitcev.lan/v1/AUTH_$(tenant_id)s' \
#--adminurl 'http://kvm-rei.zaitcev.lan/v1.0/' \
#--internalurl 'http://kvm-rei.zaitcev.lan/v1/AUTH_$(tenant_id)s'
# With SSL proxy at kvm-san:
$keystone endpoint-create --region RegionOne --service_id $SSID \
--adminurl 'http://kvm-rei.zaitcev.lan/v1.0/' \
--publicurl 'https://kvm-san.zaitcev.lan/v1/AUTH_$(tenant_id)s' \
--internalurl 'http://kvm-rei.zaitcev.lan/v1/AUTH_$(tenant_id)s'

Everything seems to work. Also see Yong-Sheng's message about
the source code.

-- Pete

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Endpoints problems

2012-04-12 Thread Pete Zaitcev
On Fri, 13 Apr 2012 08:11:28 +0800
Yong Sheng Gong gong...@cn.ibm.com wrote:

 Maybe, here some codes are worth thouhands of words:

I quite agree. On the other hand, does Anne care to read it? She needs
a concise answer as to what command to document precisely, if I understad
her query right.

 d = dict(CONF.iteritems())
 d.update({'tenant_id': tenant_id,
   'user_id': user_id})
 catalog = {}

It would be great if we kept track of available keys in a document
somewhere. Of course, the source is open. That's how I found my
forgotten 's'. But still, it's a hurdle to clear for some.

-- Pete

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Endpoints problems

2012-04-12 Thread Justin Shepherd
So looking at the code.. both templated and sql backends seem to support the 
variable substitution.

And if i am reading the code correctly they support both of the following 
variable declarations:

%(tennant_id)s
$(tennant_id)s

since it appears the code replaces $( with %(

--shep
On Apr 12, 2012, at 9:33 PM, Lorin Hochstein wrote:


On Apr 12, 2012, at 6:44 PM, Pete Zaitcev wrote:

On Thu, 12 Apr 2012 15:28:21 -0500
Anne Gentle a...@openstack.orgmailto:a...@openstack.org wrote:

keystone --token 012345SECRET99TOKEN012345 --endpoint
http://192.168.206.130:35357/v2.0 endpoint-create \
[]
  --internalurl
http://192.168.206.130:8774/v2/$(tenant_id)s

I haven't fixed this yet because I'm not sure if the $(tenant_id)s is
literal or which tenant_id specifically to use (the Service tenant for the
adminurl possibly)?

The expression $(tenant_id)s is really contained inside the pattern
in the database. It is substituded with a specific tennant ID when
an application makes its request. The weird syntax is inherited from
Python, where one can use constructs like %s or %(key)s.

My understanding (based on somebody's previous answer in the mailing list, or 
possibly one of the IRC channels) was that you could only do this with the 
template backend, and when you were using the database backend you had to 
explicitly add endpoints for each tenant that needed to talk to the API.

Can you confirm that you can use the $(tenant_id)s syntax when the backend is 
set using the following keystone.conf entry:

[catalog]
driver = keystone.catalog.backends.sql.Catalog


Take care,

Lorin
--
Lorin Hochstein
Lead Architect - Cloud Services
Nimbis Services, Inc.
www.nimbisservices.comhttps://www.nimbisservices.com/




___
Mailing list: https://launchpad.net/~openstack
Post to : 
openstack@lists.launchpad.netmailto:openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] The Scheduling feature when reboot the instance

2012-04-12 Thread Văn Đình Phúc



Ignoring issues of Ram . I have a number of questions as the following model:

My node-1's resource as the following:

   CPU : 4 core
   RAM: 4 GB.

Now , My Node-1 is hosting 4 instances:

   3 instance: (each VM: 1 core CPU, 2 GB ram,..).
   2 instance(i-0001, i-0002) is turn of and 1 instance(i-0003) is
   running.
   1 instance : (1 core CPU, 1 GB ram).
   It is running.(i-0004)

I request new ínstance by the euca-run-instance command. My new instance (
i-0005) is located on the node 1. This is the problem for the
nova-scheduler.

What is happen ? If I reboot 2 instances : i-0001,i-0002.

How do we manage this problem in Openstack ?

I think that: My 2 instances (i-0001 , i-0002) should be migrated to the
rest available resources as node-2 and node-3.

If not, it's actually very difficult to manage and reboot the instances which
are turned off. And their resources-allocated will be reused for the new
instances.

- Thông điệp gốc : - 


Gửi từ : Vishvananda Ishaya [vishvana...@gmail.com]

Gửi lúc : 12/04/2012 11:43 PM

Gửi tới : openstack@lists.launchpad.net;vishvana...@gmail.com

Chủ đ�� : Re: [Openstack] The Scheduling feature when reboot the
instance



No this does not exist. If you are going to overprovision ram, you should
probably make sure that you have swap enabled on your host. 



Vish


On Apr 12, 2012, at 4:10 AM, Văn �ình Phúc wrote:




   Hi.

   I'm using Openstack (2011.3
   (2011.3-nova-milestone-tarball:tarmac-20110922115702-k9nkvxqzhj130av2) with
   3 Compute nodes.

   My scheduling option is default.

   I have the problem as the following steps:

   Compute node 1 is installed the modules: nova-api, nova-compute and
   nova-network.
   The resource of node-1 max is fitfor 3 instances (m1.small): i-0001,
   i-0002, i-0003.
   I turn off i-0001.
   and then I request new ínstance by the euca-run-instance command , My
   new instance ( i-0004) is located on the node 1.
   The resources: RAM , CPU,.. of node-2 and node-3 is available.
   finally, I reboot the i-0001.What is happen? the i-0001 is
   rebooted on the node-1 , and It's shutdown off after reboot.I checked
   the libvirt's log :

   Failed to allocate 2147483648 B: Cannot allocate memory
   2012-04-12 16:11:50.530: shutting down

   So , Do Openstack have the sheduling feature when rebooting the instance ?

   Example: As above , My instance (i-0001) will be migrated to node-2 or
   node-3 when the resource of node-1 is not available.

   phucvdbmail.gif



   




   Văn �ình Phúc
   Manager - Cloud Team

   Techno Department

   Bkav Specialization Division

   


   Office: Bkav Building - Yen Hoa New Town, Cau Giay Dist, Hanoi

   Tel: (84-4) 3763.2552

   Mobile: 0169 4702 388

   

   Do your best, the rest will come !

   Hãy làm việc hết mình, những đi��u tốt
   đẹp sẽ đến với bạn !

   


   Disclaimer: This e-mail and any files transmitted with it are confidential
   and may contain privileged information. It is intended solely for the use of
   the individual to whom it is addressed and others authorized to receive it.
   If you are not the intended recipient you are notified that disclosing,
   copying, distributing or taking any action in reliance on the contents of
   this information is strictly prohibited. If you have received this message
   in error, please notify the sender immediately by reply e-mail and delete
   completely this e-mail from your system, without reproducing, distributing
   or retaining copies.

   


   ___
   Mailing list: https://launchpad.net/~openstack
   Post to : openstack@lists.launchpad.net
   Unsubscribe : https://launchpad.net/~openstack
   More help : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Endpoints problems

2012-04-12 Thread Yong Sheng Gong
Here is one sample keystone default_catalog.templates which defines some services. In fact I think for SQL, we need use keystone client to add them into SQL DB.# config for TemplatedCatalog, using camelCase because I don't want to do# translations for keystone compatcatalog.RegionOne.identity.publicURL = http://controlnode:$(public_port)s/v2.0catalog.RegionOne.identity.adminURL = http://controlnode:$(admin_port)s/v2.0catalog.RegionOne.identity.internalURL = http://controlnode:$(public_port)s/v2.0catalog.RegionOne.identity.name = Identity Service# fake compute service for now to help novaclient tests workcatalog.RegionOne.compute.publicURL = http://controlnode:$(compute_port)s/v1.1/$(tenant_id)scatalog.RegionOne.compute.adminURL = http://controlnode:$(compute_port)s/v1.1/$(tenant_id)scatalog.RegionOne.compute.internalURL = http://controlnode:$(compute_port)s/v1.1/$(tenant_id)scatalog.RegionOne.compute.name = Compute Servicecatalog.RegionOne.volume.publicURL = http://controlnode:8776/v1/$(tenant_id)scatalog.RegionOne.volume.adminURL = http://controlnode:8776/v1/$(tenant_id)scatalog.RegionOne.volume.internalURL = http://controlnode:8776/v1/$(tenant_id)scatalog.RegionOne.volume.name = Volume Servicecatalog.RegionOne.ec2.publicURL = http://controlnode:8773/services/Cloudcatalog.RegionOne.ec2.adminURL = http://controlnode:8773/services/Admincatalog.RegionOne.ec2.internalURL = http://controlnode:8773/services/Cloudcatalog.RegionOne.ec2.name = EC2 Servicecatalog.RegionOne.image.publicURL = http://controlnode:9292/v1catalog.RegionOne.image.adminURL = http://controlnode:9292/v1catalog.RegionOne.image.internalURL = http://controlnode:9292/v1catalog.RegionOne.image.name = Image Service-openstack-bounces+gongysh=cn.ibm@lists.launchpad.net wrote: -To: Pete Zaitcev zait...@redhat.comFrom: Anne Gentle a...@openstack.orgSent by: openstack-bounces+gongysh=cn.ibm@lists.launchpad.netDate: 04/13/2012 12:33PMCc: Openstack Mail List openstack@lists.launchpad.netSubject: Re: [Openstack] Endpoints problemsThanks all! And thanks for not saying "It's a Python Thing You Wouldn't Understand." :)Yeah I do want a definitive answer but it's always good for me to learn to read code. Then again, things like replace('$(', '%(') make me go hmm...

One last clarification, this $(tenant_id)s should be used for both nova and volume endpoints, right?Thanks,AnneOn Thu, Apr 12, 2012 at 5:44 PM, Pete Zaitcev zait...@redhat.com wrote:

On Thu, 12 Apr 2012 15:28:21 -0500
Anne Gentle a...@openstack.org wrote:
 keystone --token 012345SECRET99TOKEN012345 --endpoint
 http://192.168.206.130:35357/v2.0 endpoint-create \
[]
--internalurl
 http://192.168.206.130:8774/v2/$(tenant_id)s

 I haven't fixed this yet because I'm not sure if the $(tenant_id)s is
 literal or which tenant_id specifically to use (the Service tenant for the
 adminurl possibly)?
The _expression_ "$(tenant_id)s" is really contained inside the pattern
in the database. It is substituded with a specific tennant ID when
an application makes its request. The weird syntax is inherited from
Python, where one can use constructs like %s or %(key)s.

-- Pete

___Mailing list: https://launchpad.net/~openstackPost to   : openstack@lists.launchpad.netUnsubscribe : https://launchpad.net/~openstackMore help  : https://help.launchpad.net/ListHelp


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Endpoints problems

2012-04-12 Thread Atul Jha
Hi,

From: openstack-bounces+atul.jha=csscorp@lists.launchpad.net 
[openstack-bounces+atul.jha=csscorp@lists.launchpad.net] on behalf of Anne 
Gentle [a...@openstack.org]
Sent: Friday, April 13, 2012 10:03 AM
To: Pete Zaitcev
Cc: Openstack Mail List
Subject: Re: [Openstack] Endpoints problems

Thanks all!

And thanks for not saying It's a Python Thing You Wouldn't Understand. :)

Yeah I do want a definitive answer but it's always good for me to learn to read 
code.

Then again, things like replace('$(', '%(') make me go hmm...

One last clarification, this $(tenant_id)s should be used for both nova and 
volume endpoints, right?

Yes.
Nova-volume and Swift as well.

Thanks,

Anne


On Thu, Apr 12, 2012 at 5:44 PM, Pete Zaitcev 
zait...@redhat.commailto:zait...@redhat.com wrote:
On Thu, 12 Apr 2012 15:28:21 -0500
Anne Gentle a...@openstack.orgmailto:a...@openstack.org wrote:

 keystone --token 012345SECRET99TOKEN012345 --endpoint
 http://192.168.206.130:35357/v2.0 endpoint-create \
[]
--internalurl
 http://192.168.206.130:8774/v2/$(tenant_id)shttp://192.168.206.130:8774/v2/$%28tenant_id%29s

 I haven't fixed this yet because I'm not sure if the $(tenant_id)s is
 literal or which tenant_id specifically to use (the Service tenant for the
 adminurl possibly)?

The expression $(tenant_id)s is really contained inside the pattern
in the database. It is substituded with a specific tennant ID when
an application makes its request. The weird syntax is inherited from
Python, where one can use constructs like %s or %(key)s.

-- Pete

http://www.csscorp.com/common/email-disclaimer.php

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] The Scheduling feature when reboot the instance

2012-04-12 Thread Vishvananda Ishaya
Nova has stayed out of doing this auto-migrations so far.  You are requesting a 
very specific type of overallocation of resources, as in don't count machines 
that are shutoff when scheduling, but then automatically move them if they are 
turned back on.  It is an interesting idea, but not something we have discussed 
implementing.

You can generally over-allocate quite a bit, assuming you have swap enabled, 
and if some of your machines are not fully allocating their ram internally 
(which is usually the case) you should be fine. In deployments I have done when 
performance is really important, we simply do not over-allocate at all.

Keep in mind that the main use case of OpenStack is to run a cloud system, not 
a virtualization system. In a cloud, you very rarely stop machines and start 
them later, you generally delete the machine completely when you are done and 
launch a new one when you need it.  For this reason the particular use-case you 
are looking for hasn't really been considered.

Vish

On Apr 12, 2012, at 9:50 PM, Văn Đình Phúc wrote:

 Ignoring issues of Ram. I have a number of questions as the following model:
  
 My node-1's resource as the following:
 CPU : 4 core
 RAM: 4 GB.
 Now , My Node-1 is hosting 4 instances:
 
 3 instance: (each VM: 1 core CPU, 2 GB ram,..). 
 2 instance(i-0001, i-0002) is turn of and 1 instance(i-0003) is 
 running.
 1 instance : (1 core CPU, 1 GB ram). 
 It is running.(i-0004)
 I request new ínstance by the euca-run-instance command. My new instance ( 
 i-0005) is located on the node 1. This is the problem for the 
 nova-scheduler.
 
 What is happen ? If I reboot 2 instances : i-0001,i-0002.
 
 How do we manage this problem in Openstack ?
 
 I think that: My 2 instances (i-0001 , i-0002) should be migrated to 
 the rest available resources as node-2 and node-3.
 
 If not, it's actually very difficult to manage and reboot  the instances 
 which are turned off. And their resources-allocated will be reused for the 
 new instances.
 
 - Thông điệp gốc : -
 Gửi từ   : Vishvananda Ishaya [vishvana...@gmail.com]
 Gửi lúc  : 12/04/2012 11:43 PM
 Gửi tới  : openstack@lists.launchpad.net;vishvana...@gmail.com
 Chủ đề : Re: [Openstack] The Scheduling feature when reboot the instance
  
 No this does not exist.  If you are going to overprovision ram, you should 
 probably make sure that you have swap enabled on your host.
 
 Vish
 
 On Apr 12, 2012, at 4:10 AM, Văn Đình Phúc wrote:
 
 Hi.
 I'm using Openstack (2011.3 
 (2011.3-nova-milestone-tarball:tarmac-20110922115702-k9nkvxqzhj130av2) with 
 3 Compute nodes.
 My scheduling option is default.
 I have the problem as the following steps:
 Compute node 1 is installed the modules: nova-api, nova-compute and 
 nova-network.
 The resource of node-1 max is fitfor 3 instances (m1.small): i-0001,   
 i-0002, i-0003.
 I turn off  i-0001.
 and then I request new ínstance by the euca-run-instance command , My new 
 instance ( i-0004) is located on the node 1.
 The resources: RAM , CPU,.. of node-2 and node-3 is available.
 finally, I reboot the i-0001.What is happen? the i-0001 is rebooted 
 on the node-1 , and It's shutdown off after reboot.I checked the libvirt's 
 log :
 
 Failed to allocate 2147483648 B: Cannot allocate memory
 2012-04-12 16:11:50.530: shutting down
 So , Do Openstack have the sheduling feature when rebooting the instance ?
 
 Example: As above , My instance (i-0001) will be migrated to node-2 or 
 node-3 when the resource of node-1 is not available.
 
 phucvdbmail.gif
  
 Văn Đình Phúc
 Manager - Cloud Team
 Techno Department
 Bkav Specialization Division
  
 Office:  Bkav Building - Yen Hoa New Town, Cau Giay Dist, Hanoi
 Tel:   (84-4) 3763.2552
 Mobile: 0169 4702 388 
 
 Do your best, the rest will come !  
 Hãy làm việc hết mình, những điều tốt đẹp sẽ đến với bạn !
  
 Disclaimer: This e-mail and any files transmitted with it are confidential 
 and may contain privileged information. It is intended solely for the use of 
 the individual to whom it is addressed and others authorized to receive it. 
 If you are not the intended recipient you are notified that disclosing, 
 copying, distributing or taking any action in reliance on the contents of 
 this information is strictly prohibited. If you have received this message 
 in error, please notify the sender immediately by reply e-mail and delete 
 completely this e-mail from your system, without reproducing, distributing 
 or retaining copies.
  
 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp
 

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : 

[Openstack-ubuntu-testing-notifications] Build Still Failing: precise-openstack-essex-nova-trunk #710

2012-04-12 Thread openstack-testing-bot
Title: precise-openstack-essex-nova-trunk
General InformationBUILD FAILUREBuild URL:https://jenkins.qa.ubuntu.com/job/precise-openstack-essex-nova-trunk/710/Project:precise-openstack-essex-nova-trunkDate of build:Thu, 12 Apr 2012 06:06:07 -0400Build duration:5 min 17 secBuild cause:Started by user zulBuilt on:pkg-builderHealth ReportWDescriptionScoreBuild stability: All recent builds failed.0ChangesNo ChangesConsole Output[...truncated 3781 lines...]INFO:root:Executing ['bzr', 'builddeb', '-S', '--', '-sa', '-us', '-uc'] in schrootDEBUG:root:['schroot', '-r', '-c', 'precise-amd64-83bbecdb-9a4f-4290-aed9-8f03ff2451e4', '--', 'bzr', 'builddeb', '-S', '--', '-sa', '-us', '-uc']failed to open trace file: [Errno 2] No such file or directory: '/var/lib/jenkins/.bzr.log'Building using working treeBuilding package in merge modeLooking for a way to retrieve the upstream tarballUsing the upstream tarball that is present in /tmp/tmpP94tB8bzr: ERROR: An error (1) occurred running quilt: Applying patch nova-manage_flagfile_location.patchpatching file bin/nova-manageHunk #1 succeeded at 1659 (offset -648 lines).Applying patch kombu_tests_timeout.patchpatching file nova/tests/rpc/test_kombu.pyHunk #1 succeeded at 273 (offset 72 lines).Applying patch path-to-the-xenhost.conf-fixup.patchpatching file plugins/xenserver/xenapi/etc/xapi.d/plugins/xenhostApplying patch fix-ubuntu-tests.patchpatching file nova/tests/test_api.pyHunk #1 succeeded at 410 (offset 5 lines).Applying patch fix-docs-build-without-network.patchpatching file doc/source/conf.pyApplying patch 0001-fix-useexisting-deprecation-warnings.patchpatching file nova/db/sqlalchemy/migrate_repo/versions/075_convert_bw_usage_to_store_network_id.pypatching file nova/db/sqlalchemy/migrate_repo/versions/081_drop_instance_id_bw_cache.pyApplying patch fix_deprecated_auth_img_publish.patchpatching file nova/api/ec2/cloud.pyHunk #1 FAILED at 1398.1 out of 1 hunk FAILED -- rejects in file nova/api/ec2/cloud.pypatching file nova/image/s3.pyHunk #1 succeeded at 235 with fuzz 2 (offset 3 lines).Patch fix_deprecated_auth_img_publish.patch does not apply (enforce with -f)ERROR:root:Error occurred during package creation/buildERROR:root:Command '['schroot', '-r', '-c', 'precise-amd64-83bbecdb-9a4f-4290-aed9-8f03ff2451e4', '--', 'bzr', 'builddeb', '-S', '--', '-sa', '-us', '-uc']' returned non-zero exit status 3INFO:root:Destroying schroot session: precise-amd64-83bbecdb-9a4f-4290-aed9-8f03ff2451e4Traceback (most recent call last):  File "/var/lib/jenkins/tools/openstack-ubuntu-testing/bin/build-package", line 72, in raise esubprocess.CalledProcessError: Command '['schroot', '-r', '-c', 'precise-amd64-83bbecdb-9a4f-4290-aed9-8f03ff2451e4', '--', 'bzr', 'builddeb', '-S', '--', '-sa', '-us', '-uc']' returned non-zero exit status 3Build step 'Execute shell' marked build as failureEmail was triggered for: FailureSending email for trigger: Failure-- 
Mailing list: https://launchpad.net/~openstack-ubuntu-testing-notifications
Post to : openstack-ubuntu-testing-notifications@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack-ubuntu-testing-notifications
More help   : https://help.launchpad.net/ListHelp


[Openstack-ubuntu-testing-notifications] Build Failure: precise-openstack-essex-deploy #18312

2012-04-12 Thread openstack-testing-bot
Title: precise-openstack-essex-deploy
General InformationBUILD FAILUREBuild URL:https://jenkins.qa.ubuntu.com/job/precise-openstack-essex-deploy/18312/Project:precise-openstack-essex-deployDate of build:Thu, 12 Apr 2012 09:46:41 -0400Build duration:46 minBuild cause:Started by command lineBuilt on:masterHealth ReportWDescriptionScoreBuild stability: 2 out of the last 5 builds failed.60ChangesNo ChangesBuild Artifactslogs/syslog.tar.gzlogs/test-03.os.magners.qa.lexington-log.tar.gzlogs/test-04.os.magners.qa.lexington-log.tar.gzlogs/test-05.os.magners.qa.lexington-log.tar.gzlogs/test-06.os.magners.qa.lexington-log.tar.gzlogs/test-07.os.magners.qa.lexington-log.tar.gzlogs/test-08.os.magners.qa.lexington-log.tar.gzlogs/test-09.os.magners.qa.lexington-log.tar.gzlogs/test-10.os.magners.qa.lexington-log.tar.gzlogs/test-11.os.magners.qa.lexington-log.tar.gzlogs/test-12.os.magners.qa.lexington-log.tar.gzConsole Output[...truncated 11142 lines...]INFO:paramiko.transport:Authentication (publickey) successful!INFO:paramiko.transport:Secsh channel 1 opened.INFO:paramiko.transport.sftp:[chan 1] Opened sftp connection (server version 3)INFO:root:Setting up connection to test-09.os.magners.qa.lexingtonINFO:paramiko.transport:Connected (version 2.0, client OpenSSH_5.9p1)INFO:paramiko.transport:Authentication (publickey) successful!INFO:paramiko.transport:Secsh channel 1 opened.INFO:paramiko.transport.sftp:[chan 1] Opened sftp connection (server version 3)INFO:root:Archiving logs on test-07.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-08.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-09.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-04.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-05.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-03.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-06.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Archiving logs on test-02.os.magners.qa.lexingtonINFO:paramiko.transport:Secsh channel 2 opened.INFO:root:Grabbing information from test-07.os.magners.qa.lexingtonINFO:root:Grabbing information from test-08.os.magners.qa.lexingtonINFO:root:Grabbing information from test-09.os.magners.qa.lexingtonINFO:root:Grabbing information from test-04.os.magners.qa.lexingtonINFO:root:Grabbing information from test-05.os.magners.qa.lexingtonERROR:root:Unable to get information from test-05.os.magners.qa.lexingtonINFO:root:Grabbing information from test-03.os.magners.qa.lexingtonINFO:root:Grabbing information from test-06.os.magners.qa.lexingtonERROR:root:Unable to get information from test-06.os.magners.qa.lexingtonINFO:root:Grabbing information from test-02.os.magners.qa.lexingtonERROR:root:Unable to get information from test-02.os.magners.qa.lexingtonINFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.INFO:paramiko.transport.sftp:[chan 1] sftp session closed.tar: Removing leading `/' from member names+ exit 1Build step 'Execute shell' marked build as failureArchiving artifactsEmail was triggered for: FailureSending email for trigger: Failure-- 
Mailing list: https://launchpad.net/~openstack-ubuntu-testing-notifications
Post to : openstack-ubuntu-testing-notifications@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack-ubuntu-testing-notifications
More help   : https://help.launchpad.net/ListHelp