Re: [Openstack] [OpenStack] [Metering] Options to obtain Notifications when ceilometer generates a meter entry in the DB

2013-06-25 Thread Tong Li

Doug, Deepak,
I am also in the process of implementing a blueprint which allows one
to easily add a dispatcher to do whatever you want to do for each meter
received by Ceilometer. Here is the link to blueprint and the
implementation.


https://blueprints.launchpad.net/openstack/?searchtext=multi-dispatcher-enablement

https://review.openstack.org/#/c/34301/

If this gets merged soon, you will only need to write something like
dispatcher_log.py, in method record_metering_data you may choose to do
whatever you like to do with the meter data.  For your question #1, you can
simple fire up a text message or send out an email if you prefer. Even
though you can do whatever you want to do there, but make sure the method
is extremely light weight and effecient.

Thanks.

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com



From:   Doug Hellmann doug.hellm...@dreamhost.com
To: Deepak Bangalore Hariyanna dbang...@usc.edu,
Cc: openstack@lists.launchpad.net openstack@lists.launchpad.net
Date:   06/25/2013 03:23 PM
Subject:Re: [Openstack] [OpenStack] [Metering] Options to obtain
Notifications when ceilometer generates a meter entry in the DB
Sent by:Openstack openstack-bounces
+litong01=us.ibm@lists.launchpad.net






On Fri, Jun 21, 2013 at 9:37 PM, Deepak Bangalore Hariyanna 
dbang...@usc.edu wrote:
  Hi All,

  I am currently working on an charging application to work with ceilometer
  (Grizzly release).
  Have been working on openstack for just couple weeks and hence have a
  couple of questions:
  1). I read in the documentation that the only way to access the data
  generated by collector is through the API(i.e either use the cURL option
  or the ceilometer pythonclient to query the required information). I am
  able to do this and fetch the required data.
  However, for an application to access these, is there a better way? Like,
  whenever the ceilometer generates an event entry in the db, does it
  provide any notification on any queues, or is there a way we can
  configure this to happen?

  If there is no such option, I plan to periodically poll the ceilometer
  through API for the usage data. (which I sincerely feel is a bad idea).

  2). From the Havana roadmap, I see an objective Publish meters to other
  systems
  Does this mean, other systems can configure to bind themselves on an AMQP
  queue and ceilometer would publish notifications on this exchange?
  If so, this would be a feature of Havana?
  Because I was confused with the publisher feature of Grizzzly, as below


  Would be great if someone can help me on this.

The architecture of ceilometer supports plugging in different publishers.
We have one that reproduces the grizzly/folsom feature of sending data on
the message bus so the collector can receive it. We also have one that
sends UDP messages that are consumed by the collector (useful for
monitoring, but not for metering). The API is designed to allow you to
write your own if you have a custom consumer, and we would welcome other
reusable publishers in the core code base.

Doug


  Thanks a lot,
  Deepak

  ___
  Mailing list: https://launchpad.net/~openstack
  Post to     : openstack@lists.launchpad.net
  Unsubscribe : https://launchpad.net/~openstack
  More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp
inline: graycol.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Swift proxy and swift-informant

2013-04-05 Thread Tong Li

Giovanni,
Have not tried various combinations. But latest swift code works fine
on Ubuntu 1210 and 1204. Probably try it on a spare machine and see if it
works.

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com



From:   Giovanni Colapinto giovanni.colapi...@gmail.com
To: Tong Li/Raleigh/IBM@IBMUS,
Cc: openstack@lists.launchpad.net, openstack-bounces
+litong01=us.ibm@lists.launchpad.net
Date:   04/05/2013 01:55 AM
Subject:Re: [Openstack] Swift proxy and swift-informant



Yes, I read that documentation on upgrade, but unfortunately in that
repository quantal distribution doesn't exists. Is it safe to use precise
packages even if I got quantal?

Thank you


On Thu, Apr 4, 2013 at 4:29 PM, Tong Li liton...@us.ibm.com wrote:
  on ubuntu, you can try the following.

  apt-get install python-software-properties
  add-apt-repository ppa:swift-core/release
  apt-get update
  apt-get install swift python-swiftclient

  Also look into the doc at this link.
  http://docs.openstack.org/developer/swift/howto_installmultinode.html

  If you want to use the latest swift code, you can get the code from
  github and build it yourself but I would not recommend to do it for the
  production system.

  Hope that helps.




  Tong Li
  Emerging Technologies  Standards
  Building 501/B205
  liton...@us.ibm.com

  Inactive hide details for Giovanni Colapinto ---04/04/2013 09:20:50
  AM---Thank you for the reply. How I can upgrade swift? On TGiovanni
  Colapinto ---04/04/2013 09:20:50 AM---Thank you for the reply. How I can
  upgrade swift? On Thu, Apr 4, 2013 at 3:12 PM, Tong Li litong01@

  From: Giovanni Colapinto giovanni.colapi...@gmail.com
  To: Tong Li/Raleigh/IBM@IBMUS,
  Cc: openstack@lists.launchpad.net, openstack-bounces+litong01=
  us.ibm@lists.launchpad.net
  Date: 04/04/2013 09:20 AM
  Subject: Re: [Openstack] Swift proxy and swift-informant




  Thank you for the reply. How I can upgrade swift?


  On Thu, Apr 4, 2013 at 3:12 PM, Tong Li liton...@us.ibm.com wrote:
swob is not a separate package, it is part of the swift core. You
may either get older version of informant which does not use swob
or upgrade swift.

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com

Inactive hide details for Giovanni Colapinto ---04/04/2013 04:26:57
AM---Hi to all. I try to configure swift proxy to work withGiovanni
Colapinto ---04/04/2013 04:26:57 AM---Hi to all. I try to configure
swift proxy to work with swift-informant.

From: Giovanni Colapinto giovanni.colapi...@gmail.com
To: openstack@lists.launchpad.net,
Date: 04/04/2013 04:26 AM
Subject: [Openstack] Swift proxy and swift-informant
Sent by: openstack-bounces+litong01=us.ibm@lists.launchpad.net




Hi to all.

I try to configure swift proxy to work with swift-informant.

I've installed swift-informant and add/modify the following section
to /etc/swift/proxy-server.conf:

[pipeline:main]
pipeline = informant healthcheck cache swift3 authtoken keystone
proxy-server

[filter:informant]
use = egg:informant#informant
statsd_host = 10.0.1.154
metric_name_prepend = inndig.

When I start proxy-server it returns the following error:

Traceback (most recent call last):
  File /usr/bin/swift-proxy-server, line 22, in module
    run_wsgi(conf_file, 'proxy-server', default_port=8080,
**options)
  File /usr/lib/python2.7/dist-packages/swift/common/wsgi.py,
line 138, in run_wsgi
    loadapp('config:%s' % conf_file, global_conf={'log_name':
log_name})
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py,
line 247, in loadapp
    return loadobj(APP, uri, name=name, **kw)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py,
line 271, in loadobj
    global_conf=global_conf)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py,
line 296, in loadcontext
    global_conf=global_conf)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py,
line 320, in _loadconfig
    return loader.get_context(object_type, name, global_conf)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py,
line 450, in get_context
    global_additions=global_additions)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py,
line 562, in _pipeline_app_context
    for name in pipeline[:-1]]
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py,
line 454, in get_context
    section)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py,
line 476, in _context_from_use

Re: [Openstack] Swift proxy and swift-informant

2013-04-04 Thread Tong Li

swob is not a separate package, it is part of the swift core. You may
either get older version of informant which does not use swob or upgrade
swift.

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com



From:   Giovanni Colapinto giovanni.colapi...@gmail.com
To: openstack@lists.launchpad.net,
Date:   04/04/2013 04:26 AM
Subject:[Openstack] Swift proxy and swift-informant
Sent by:openstack-bounces+litong01=us.ibm@lists.launchpad.net



Hi to all.

I try to configure swift proxy to work with swift-informant.

I've installed swift-informant and add/modify the following section
to /etc/swift/proxy-server.conf:

[pipeline:main]
pipeline = informant healthcheck cache swift3 authtoken keystone
proxy-server

[filter:informant]
use = egg:informant#informant
statsd_host = 10.0.1.154
metric_name_prepend = inndig.

When I start proxy-server it returns the following error:

Traceback (most recent call last):
  File /usr/bin/swift-proxy-server, line 22, in module
    run_wsgi(conf_file, 'proxy-server', default_port=8080, **options)
  File /usr/lib/python2.7/dist-packages/swift/common/wsgi.py, line 138,
in run_wsgi
    loadapp('config:%s' % conf_file, global_conf={'log_name': log_name})
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
247, in loadapp
    return loadobj(APP, uri, name=name, **kw)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
271, in loadobj
    global_conf=global_conf)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
296, in loadcontext
    global_conf=global_conf)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
320, in _loadconfig
    return loader.get_context(object_type, name, global_conf)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
450, in get_context
    global_additions=global_additions)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
562, in _pipeline_app_context
    for name in pipeline[:-1]]
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
454, in get_context
    section)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
476, in _context_from_use
    object_type, name=use, global_conf=global_conf)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
406, in get_context
    global_conf=global_conf)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
296, in loadcontext
    global_conf=global_conf)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
328, in _loadegg
    return loader.get_context(object_type, name, global_conf)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
620, in get_context
    object_type, name=name)
  File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
646, in find_egg_entry_point
    possible.append((entry.load(), protocol, entry.name))
  File /usr/lib/python2.7/dist-packages/pkg_resources.py, line 2017, in
load
    entry = __import__(self.module_name, globals(),globals(), ['__name__'])
  File
/usr/local/lib/python2.7/dist-packages/informant-0.0.10-py2.7.egg/informant/middleware.py,
 line 16, in module
    from swift.common.swob import Request
ImportError: No module named swob

Searching on google I understand that swob is a module of swift = 1.7.5,
but on my ubuntu 12.10 swift is 1.7.4

How can I resolv this situation? Is there a way to upgrade swift?

Thank you___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp
inline: graycol.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Swift proxy and swift-informant

2013-04-04 Thread Tong Li

on ubuntu, you can try the following.

apt-get install python-software-properties
add-apt-repository ppa:swift-core/release
apt-get update
apt-get install swift python-swiftclient

Also look into the doc at this link.
http://docs.openstack.org/developer/swift/howto_installmultinode.html

If you want to use the latest swift code, you can get the code from github
and build it yourself but I would not recommend to do it for the production
system.

Hope that helps.

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com



From:   Giovanni Colapinto giovanni.colapi...@gmail.com
To: Tong Li/Raleigh/IBM@IBMUS,
Cc: openstack@lists.launchpad.net, openstack-bounces
+litong01=us.ibm@lists.launchpad.net
Date:   04/04/2013 09:20 AM
Subject:Re: [Openstack] Swift proxy and swift-informant



Thank you for the reply. How I can upgrade swift?


On Thu, Apr 4, 2013 at 3:12 PM, Tong Li liton...@us.ibm.com wrote:
  swob is not a separate package, it is part of the swift core. You may
  either get older version of informant which does not use swob or upgrade
  swift.

  Tong Li
  Emerging Technologies  Standards
  Building 501/B205
  liton...@us.ibm.com

  Inactive hide details for Giovanni Colapinto ---04/04/2013 04:26:57
  AM---Hi to all. I try to configure swift proxy to work withGiovanni
  Colapinto ---04/04/2013 04:26:57 AM---Hi to all. I try to configure swift
  proxy to work with swift-informant.

  From: Giovanni Colapinto giovanni.colapi...@gmail.com
  To: openstack@lists.launchpad.net,
  Date: 04/04/2013 04:26 AM
  Subject: [Openstack] Swift proxy and swift-informant
  Sent by: openstack-bounces+litong01=us.ibm@lists.launchpad.net




  Hi to all.

  I try to configure swift proxy to work with swift-informant.

  I've installed swift-informant and add/modify the following section
  to /etc/swift/proxy-server.conf:

  [pipeline:main]
  pipeline = informant healthcheck cache swift3 authtoken keystone
  proxy-server

  [filter:informant]
  use = egg:informant#informant
  statsd_host = 10.0.1.154
  metric_name_prepend = inndig.

  When I start proxy-server it returns the following error:

  Traceback (most recent call last):
    File /usr/bin/swift-proxy-server, line 22, in module
      run_wsgi(conf_file, 'proxy-server', default_port=8080, **options)
    File /usr/lib/python2.7/dist-packages/swift/common/wsgi.py, line 138,
  in run_wsgi
      loadapp('config:%s' % conf_file, global_conf={'log_name': log_name})
    File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
  247, in loadapp
      return loadobj(APP, uri, name=name, **kw)
    File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
  271, in loadobj
      global_conf=global_conf)
    File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
  296, in loadcontext
      global_conf=global_conf)
    File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
  320, in _loadconfig
      return loader.get_context(object_type, name, global_conf)
    File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
  450, in get_context
      global_additions=global_additions)
    File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
  562, in _pipeline_app_context
      for name in pipeline[:-1]]
    File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
  454, in get_context
      section)
    File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
  476, in _context_from_use
      object_type, name=use, global_conf=global_conf)
    File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
  406, in get_context
      global_conf=global_conf)
    File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
  296, in loadcontext
      global_conf=global_conf)
    File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
  328, in _loadegg
      return loader.get_context(object_type, name, global_conf)
    File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
  620, in get_context
      object_type, name=name)
    File /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py, line
  646, in find_egg_entry_point
      possible.append((entry.load(), protocol, entry.name))
    File /usr/lib/python2.7/dist-packages/pkg_resources.py, line 2017, in
  load
      entry = __import__(self.module_name, globals(),globals(),
  ['__name__'])
    File
  
/usr/local/lib/python2.7/dist-packages/informant-0.0.10-py2.7.egg/informant/middleware.py,
 line 16, in module
      from swift.common.swob import Request
  ImportError: No module named swob

  Searching on google I understand that swob is a module of swift = 1.7.5,
  but on my ubuntu 12.10 swift is 1.7.4

  How can I resolv this situation? Is there a way to upgrade swift?

  Thank you___
  Mailing list: https://launchpad.net/~openstack
  Post to     : openstack@lists.launchpad.net

Re: [Openstack] keystone question

2013-02-08 Thread Tong Li

The X-Auth-Token header in your request to validate the user token are not
the same thing. You have to login as admin to get a token and hold on to
that token, when a user request comes in with his token, you can hand it
over to keystone for validation. Here I think will be how the request look
like.

 request: curl -s -X GET http://localhost:35357/tokens/tokenToBeValidated
-H X-Auth-Token: adminAccessToken

adminAccessToken should be a token you (as admin) to get using the same API
and admin userid and password or other means (certificates possibly if that
is how it was designed) to get access token just like any other user
against keystone.

Hope that helps.

Tong Li
Emerging Technologies  Standards



From:   pat p...@xvalheru.org
To: Tong Li/Raleigh/IBM@IBMUS,
Cc: openstack@lists.launchpad.net, openstack-bounces
+litong01=us.ibm@lists.launchpad.net
Date:   02/08/2013 07:31 AM
Subject:Re: [Openstack] keystone question



Hi,

Thanks for the reply.

I've been digging and I've found way how to get token using API:
curl -s -X POST http://localhost:35357/tokens -d '{auth:
{passwordCredentials: {username:XXX, password:XXX},
tenantName:XXX}}' -H Content-type: application/json

This request returns JSON response, that's fine for me.

But how to validate the token? I'm following the API:
http://docs.openstack.org/api/openstack-identity-service/2.0/content/GET_validateToken_v2.0_tokens__tokenId__Admin_API_Service_Developer_Operations-d1e1356.html


and request: curl -s -X GET http://localhost:35357/tokens/XXXYYYXXX -H
X-Auth-Token: XXXYYYXXX
return 401 (unauthorized).

What I'm doing wrong?

Thanks for help


On Wed, 6 Feb 2013 11:46:28 -0500, Tong Li wrote
 keystone provides APIs for authentication, I would think you only need to
develop some code in your app to call the API and parse the response, then
following request will have to be verified using the token. If you app is
already wsgi app, you will just need to use the keystone middleware in your
pipeline. If it is other type of the application, you will just need to
develop some code which deal with keystone authentication http
request/response and figure out a way to verify the token.

 Thanks.

 Tong Li
 Emerging Technologies  Standards



 Inactive hide details for pat ---02/06/2013 10:35:26 
AM---Hi all, I
have a question about keystone. I have an application (Jepat
---02/06/2013 10:35:26 AM---Hi all, I have a question about keystone. I
have an application (Jee web one) which I

 From: pat p...@xvalheru.org
 To: openstack@lists.launchpad.net,
 Date: 02/06/2013 10:35 AM
 Subject: [Openstack] keystone question
 Sent by: openstack-bounces+litong01=us.ibm@lists.launchpad.net


 Hi all,

 I have a question about keystone. I have an application (Jee web one)
which I
 want to authenticate against keystone. What I have to do?

 Thanks

 Pat

 
 Freehosting PIPNI - http://www.pipni.cz/

 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp




---
 Freehosting PIPNI - http://www.pipni.cz/





---

Freehosting PIPNI - http://www.pipni.cz/




inline: graycol.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] keystone question

2013-02-06 Thread Tong Li

keystone provides APIs for authentication, I would think you only need to
develop some code in your app to call the API and parse the response, then
following request will have to be verified using the token. If you app is
already wsgi app, you will just need to use the keystone middleware in your
pipeline. If it is other type of the application, you will just need to
develop some code which deal with keystone authentication http
request/response and figure out a way to verify the token.

Thanks.

Tong Li
Emerging Technologies  Standards





From:   pat p...@xvalheru.org
To: openstack@lists.launchpad.net,
Date:   02/06/2013 10:35 AM
Subject:[Openstack] keystone question
Sent by:openstack-bounces+litong01=us.ibm@lists.launchpad.net



Hi all,

I have a question about keystone. I have an application (Jee web one) which
I
want to authenticate against keystone. What I have to do?

Thanks

 Pat


Freehosting PIPNI - http://www.pipni.cz/


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

inline: graycol.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [SWIFT] Change the partition power to recreate the RING

2013-01-14 Thread Tong Li

John and swifters,
I see this problem as a big problem and I think that the scenario
described by Alejandro is a very common scenario. I am thinking if it is
possible to have like two rings (one with the newer extended power, one
with the existing ring power), when significant changes made to the
hardware, partition, a new ring get started with a command, and new data
into Swift will use the new ring, and existing data on the existing ring
still available and slowly (not impact the normal use) but automatically
moves to the new ring, once the existing ring shrinks to the size zero,
then that ring can be removed. The idea is to sort of having two virtual
Swift systems working side by side, the migration from existing ring to new
ring being done without interrupting the service. Can we put this
topic/feature as one to be discussed during the next summit and to be
considered as a high priority feature to work on for coming releases?

Thanks.

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com



From:   John Dickinson m...@not.mn
To: Alejandro Comisario alejandro.comisa...@mercadolibre.com,
Cc: openstack-operat...@lists.openstack.org
openstack-operat...@lists.openstack.org, openstack
openstack@lists.launchpad.net
Date:   01/11/2013 04:28 PM
Subject:Re: [Openstack] [SWIFT] Change the partition power to recreate
the RING
Sent by:openstack-bounces+litong01=us.ibm@lists.launchpad.net



If effect, this would be a complete replacement of your rings, and that is
essentially a whole new cluster. All of the existing data would need to be
rehashed into the new ring before it is available.

There is no process that rehashes the data to ensure that it is still in
the correct partition. Replication only ensures that the partitions are on
the right drives.

To change the number of partitions, you will need to GET all of the data
from the old ring and PUT it to the new ring. A more complicated, but
perhaps more efficient) solution may include something like walking each
drive and rehashing+moving the data to the right partition and then letting
replication settle it down.

Either way, 100% of your existing data will need to at least be rehashed
(and probably moved). Your CPU (hashing), disks (read+write), RAM
(directory walking), and network (replication) may all be limiting factors
in how long it will take to do this. Your per-disk free space may also
determine what method you choose.

I would not expect any data loss while doing this, but you will probably
have availability issues, depending on the data access patterns.

I'd like to eventually see something in swift that allows for changing the
partition power in existing rings, but that will be
hard/tricky/non-trivial.

Good luck.

--John


On Jan 11, 2013, at 1:17 PM, Alejandro Comisario
alejandro.comisa...@mercadolibre.com wrote:

 Hi guys.
 We've created a swift cluster several months ago, the things is that righ
now we cant add hardware and we configured lots of partitions thinking
about the final picture of the cluster.

 Today each datanodes is having 2500+ partitions per device, and even
tuning the background processes ( replicator, auditor  updater ) we really
want to try to lower the partition power.

 Since its not possible to do that without recreating the ring, we can
have the luxury of recreate it with a very lower partition power, and
rebalance / deploy the new ring.

 The question is, having a working cluster with *existing data* is it
possible to do this and wait for the data to move around *without data
loss* ???
 If so, it might be true to wait for an improvement in the overall cluster
performance ?

 We have no problem to have a non working cluster (while moving the data)
even for an entire weekend.

 Cheers.



[attachment smime.p7s deleted by Tong Li/Raleigh/IBM]
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp
inline: graycol.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] a filter to allow you access OpenStack without providing credentials or auth token in a development environment.

2012-11-21 Thread Tong Li

This filter was created to allow you to access OpenStack without the need
to provide either username/password or any token. Under the cover this
filter simply authenticate with keystone and get the auth token and stick
it back to the request.  If your work is mostly dealing with API (not using
Dashboard), you may find it useful. Get the filter and
installation/configuration instructions here.
https://github.com/osaddon/defaultauth

Thanks.

Tong Li
Emerging Technologies  Standards___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [devstack] How to purge, remove and wipe out devstack?

2012-11-19 Thread Tong Li

There are configuration files under /etc for components that you enabled
when you install devstack. such as /etc/nova, /etc/glance, etc.

Tong Li
Emerging Technologies  Standards




From:   Gui Maluf guimal...@gmail.com
To: openstack@lists.launchpad.net
openstack@lists.launchpad.net,
Date:   11/19/2012 05:10 AM
Subject:[Openstack] [devstack] How to purge, remove and wipe out
devstack?
Sent by:openstack-bounces+litong01=us.ibm@lists.launchpad.net



Hello,
if I would like to wipe, remove and purge everything devstack installed and
configured what should I do?

rm -rf /opt/stack
rm -rf /usr/local/bin/

what else?

thanks in advance!
:)

--
guilherme \n
\t maluf
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp
inline: graycol.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Could I restart devstack with old configuration?

2012-10-25 Thread Tong Li

Hao Wang,
you can run rejoin-stack.sh from devstack directory to restart the
whole thing. However, there are some problems dealing with volume. But
other services should be OK.

Thanks.

Tong Li
Emerging Technologies  Standards




From:   Hao Wang hao.1.w...@gmail.com
To: openstack@lists.launchpad.net,
Date:   10/25/2012 10:29 AM
Subject:[Openstack] Could I restart devstack with old configuration?
Sent by:openstack-bounces+litong01=us.ibm@lists.launchpad.net



Hi stackers,

I've got a quick question for you. Every time while I start devstack, the
script will initialize mysql database. That makes me have to import
customized images again. Do you know there is any way to avoid it?

Thanks,
Howard___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp
inline: graycol.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] Could I restart devstack with old configuration?

2012-10-25 Thread Tong Li

As I indicated, you can dress the volume stuff. Here is the rejoin-stack.sh
I have, I just added a few lines to deal with the volume problem, if you
use the script attached, everything will work fine. if you have swift
enabled, change the data file to fit your configuration

(See attached file: rejoin-stack.sh)

Tong Li
Emerging Technologies  Standards



From:   Dean Troyer dtro...@gmail.com
To: Tong Li/Raleigh/IBM@IBMUS,
Cc: Hao Wang hao.1.w...@gmail.com, openstack@lists.launchpad.net
Date:   10/25/2012 11:34 AM
Subject:Re: [Openstack] Could I restart devstack with old
configuration?



On Thu, Oct 25, 2012 at 10:03 AM, Tong Li liton...@us.ibm.com wrote:
  you can run rejoin-stack.sh from devstack directory to restart the whole
  thing. However, there are some problems dealing with volume. But other
  services should be OK.



rejoin-stack.sh only addresses restarting the processes running under
screen.  If you've used unstack.sh or rebooted it will probably not bring
everything back.  We do need restack.sh to undo unstack.sh.  ;)

As an alternative, if/when you do want to start with a fresh install but
have additional things to add you can create local.sh to do that work at
the end of stack.sh.  There is an example in samples/local.sh.

dt

--

Dean Troyer
dtro...@gmail.com
inline: graycol.gif

rejoin-stack.sh
Description: Binary data
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] does swift support resume upload?

2012-10-15 Thread Tong Li
I assume that you want to upload some pieces and later upload more, then
complete the object. If that is the case, you can use the large data object
upload which allows upload small pieces, after some time, upload more,
eventually upload a manifest file to complete the object. You can find more
information here.

http://docs.openstack.org/developer/swift/overview_large_objects.html

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com



From:   符永涛 yongta...@gmail.com
To: openstack@lists.launchpad.net,
Date:   10/13/2012 05:30 AM
Subject:[Openstack] does swift support resume upload?
Sent by:openstack-bounces+litong01=us.ibm@lists.launchpad.net



Dear swift experts,

We're planning to use swift to implement an upload service. And we want to
know if swift support resume upload feature? Thank you.

--
符永涛___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp
inline: graycol.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] [Swift] Blueprint - multi-range-support

2012-10-15 Thread Tong Li
Can you one please review this change for blueprint multi-range-support?
https://review.openstack.org/#/c/14180/

The blueprint is here.
https://blueprints.launchpad.net/swift/+spec/multi-range-support

Thanks.

Tong Li
Emerging Technologies  Standards
Building 501/B205___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] does swift support resume upload?

2012-10-15 Thread Tong Li

Tong Li
Emerging Technologies  Standards
Building 501/B205

openstack-bounces+litong01=us.ibm@lists.launchpad.net wrote on
10/15/2012 10:33:22 AM:

 From: 符永涛 yongta...@gmail.com
 To: Kuo Hugo tonyt...@gmail.com,
 Cc: openstack@lists.launchpad.net
 Date: 10/15/2012 10:35 AM
 Subject: Re: [Openstack] does swift support resume upload?
 Sent by: openstack-bounces+litong01=us.ibm@lists.launchpad.net

 Yes I mean resume broken transfer, or range post or multi thread upload.

As far as I know, swift currently does not support range post. it support
single range retrieval and we are in the process of support multi range
retrieval.

 2012/10/15 Kuo Hugo tonyt...@gmail.com
 Do you mean resume broken transfer ?


 2012/10/13 符永涛 yongta...@gmail.com
 Dear swift experts,

 We're planning to use swift to implement an upload service. And we
 want to know if swift support resume upload feature? Thank you.

 --
 符永涛

 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp




 --
 +Hugo Kuo+
 tonyt...@gmail.com
 +886 935004793




 --
 符永涛___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] HTTP_X_SERVICE_CATALOG endpoints_links

2012-10-01 Thread Tong Li

After a user gets authenticated, each following request will have a header
named HTTP_X_SERVICE_CATALOG which contains service end point links, can
any one tell me if it is safe to use the information contained in the
header to get the various end points from a filter in the pipeline? Notice
this header is set in the keystone, any other implementation of keystone
may choose not to include the information in the header, can anyone tell me
putting the endpoints in the headers is required by any implementation like
keystone for authentication?

Thanks.

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] HTTP_X_SERVICE_CATALOG endpoints_links

2012-10-01 Thread Tong Li

Great. thanks a lot.

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com



From:   Dolph Mathews dolph.math...@gmail.com
To: Tong Li/Raleigh/IBM@IBMUS,
Cc: openstack@lists.launchpad.net
Date:   10/01/2012 04:12 PM
Subject:Re: [Openstack] HTTP_X_SERVICE_CATALOG endpoints_links



The environment variables that auth_token sets are documented in the
module's docstring:
https://github.com/openstack/keystone/blob/master/keystone/middleware/auth_token.py

As these variables are the defined interface for any projects consuming
authentication services from middleware, it's safe to say they'll be
supported be supported by any variations of auth_token, and will either
continue to be supported or carefully deprecated.

Speaking of, there are currently three headers that were deprecated prior
to the release of essex (i.e. they were documented as deprecated in both
essex and folsom), and could be reviewed for removal in grizzly
(HTTP_X_USER, HTTP_X_ROLE, HTTP_X_TENANT).

-Dolph


On Mon, Oct 1, 2012 at 2:56 PM, Tong Li liton...@us.ibm.com wrote:
  After a user gets authenticated, each following request will have a
  header named HTTP_X_SERVICE_CATALOG which contains service end point
  links, can any one tell me if it is safe to use the information contained
  in the header to get the various end points from a filter in the
  pipeline? Notice this header is set in the keystone, any other
  implementation of keystone may choose not to include the information in
  the header, can anyone tell me putting the endpoints in the headers is
  required by any implementation like keystone for authentication?

  Thanks.

  Tong Li
  Emerging Technologies  Standards
  Building 501/B205
  liton...@us.ibm.com

  ___
  Mailing list: https://launchpad.net/~openstack
  Post to     : openstack@lists.launchpad.net
  Unsubscribe : https://launchpad.net/~openstack
  More help   : https://help.launchpad.net/ListHelp

inline: graycol.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [nova] Proposal for Sean Dague to join nova-core

2012-07-20 Thread Tong Li

+1,
Sean will be a great addition to the nova-core. He has always been willing
to lend a helping hand in the community.

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com



From:   Vishvananda Ishaya vishvana...@gmail.com
To: Openstack (openstack@lists.launchpad.net)
(openstack@lists.launchpad.net)
openstack@lists.launchpad.net
Date:   07/20/2012 01:53 PM
Subject:[Openstack] [nova] Proposal for Sean Dague to join nova-core
Sent by:openstack-bounces+litong01=us.ibm@lists.launchpad.net



Hello Everyone,

When I was going through the list of reviewers to see who would be good for
nova-core a few days ago, I left one out. Sean has been doing a lot of
reviews lately[1] and did the refactor and cleanup of the driver loading
code. I think he would also be a great addition to nova-core.

Vish

[1] https://review.openstack.org/#/dashboard/2750
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

inline: graycol.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] [nova] nova-manage is getting deprecated?

2012-07-20 Thread Tong Li
Awhile back, there was a comment on a nova-manage defect stated that
nova-manage is getting deprecated. Can any one tell what and when the
replacement will be? Thanks.

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [nova] Proposal to add Michael Still to nova-core

2012-07-19 Thread Tong Li
+1, Michael took time to review bug fixes and gave good suggestions and
comments. He will do great as a core.

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com

openstack-bounces+litong01=us.ibm@lists.launchpad.net wrote on
07/19/2012 10:48:30 AM:

 From: Johannes Erdfelt johan...@erdfelt.com
 To: openstack@lists.launchpad.net
 Date: 07/19/2012 11:58 AM
 Subject: Re: [Openstack] [nova] Proposal to add Michael Still to
nova-core
 Sent by: openstack-bounces+litong01=us.ibm@lists.launchpad.net

 On Wed, Jul 18, 2012, Vishvananda Ishaya vishvana...@gmail.com wrote:
  Michael wrote the image cache management code, did all of the remaining
  conversions of instance_id - instance_uuid, and has been contributing
  a lot to reviews[1]. I think he would make a great addition to
nova-core.

 +1!

 JE


 ___
 Mailing list: https://launchpad.net/~openstack
 Post to : openstack@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~openstack
 More help   : https://help.launchpad.net/ListHelp
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


Re: [Openstack] [nova] Proposal to add Yun Mao to nova-core

2012-07-19 Thread Tong Li

+1
Yun once took a lot of his time to help me with questions I had with nova.
With his help, I was able to resolve the issues and he is very
knowledgeable and did not hesitate to lend helping hands. will be a great
addition to the core team.

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com



From:   Johannes Erdfelt johan...@erdfelt.com
To: openstack@lists.launchpad.net
Date:   07/19/2012 11:48 AM
Subject:Re: [Openstack] [nova] Proposal to add Yun Mao to nova-core
Sent by:openstack-bounces+litong01=us.ibm@lists.launchpad.net



On Wed, Jul 18, 2012, Vishvananda Ishaya vishvana...@gmail.com wrote:
 Yun has been putting a lot of effort into cleaning up our state
 management, and has been contributing a lot to reviews[1]. I think he
 would make a great addition to nova-core.

+1!

JE


___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp

inline: graycol.gif___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp


[Openstack] [OpenStack] CDMI

2012-07-16 Thread Tong Li

An Storage Networking Industry Association (SNIA) for Cloud Data Management
Interface (CDMI) specification implementation based on OpenStack Swift has
been published at https://github.com/osaddon/cdmi
This implementation supports basic CDMI cloud data and container
manipulation and provides over 70 functional tests based on CDMI
specification. For detailed information please visit
https://github.com/osaddon/cdmi, your comments and questions will be
appreciated.

Tong Li
Emerging Technologies  Standards
Building 501/B205
liton...@us.ibm.com___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp