[openstack-dev] [Horizon][Trove] About Trove policies

2015-07-29 Thread Romain Hardouin
Hi all,

I'm currently working on two blueprints to improve the Trove support in Horizon:
1. blueprint trove-list-datastores-and-versions
2. blueprint datatable-column-level-policy-checks -- needed by the first

When requesting Trove API to get datastore versions, the response contains more 
data if it's called with an admin context. I want to process/display these 
additionnal data in a DataTable with admin only columns.

My first implementation was based on permission: process and show some columns 
only for an admin.
The feedbacks on gerrit suggest to use policies. So my current implementation 
is based on policies. As I said on gerrit, my concern is that there is no 
policy.json file in Trove.
Therefore I find a bit weird to have a trove_policy.json in Horizon.

I have several questions:
1. Is it planned to add policy file in Trove?
2. If not, should we keep trove_policy.json in Horizon?
3. If not, should we revert to permissions?

Links:
Patchsets for bp trove-list-datastores-and-versions: 
https://review.openstack.org/#/c/163196/
Patchsets for bp datatable-column-level-policy-checks: 
https://review.openstack.org/#/c/164010/

Thanks,

Romain

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all] [glance] do NOT ever sort requirements.txt

2014-09-03 Thread Romain Hardouin
On Wed, 2014-09-03 at 14:03 +0100, Daniel P. Berrange wrote:
 On Wed, Sep 03, 2014 at 08:37:17AM -0400, Sean Dague wrote:
  I'm not sure why people keep showing up with sort requirements patches
  like - https://review.openstack.org/#/c/76817/6, however, they do.
  
  All of these need to be -2ed with predjudice.
  
  requirements.txt is not a declarative interface. The order is important
  as pip processes it in the order it is. Changing the order has impacts
  on the overall integration which can cause wedges later.
 
 Can  requirements.txt contain comment lines ?  If so, it would be
 worth adding 
 
# The ordering of modules in this file is important
# Do not attempt to re-sort the lines
 
 Because 6 months hence people will have probably forgotten about
 this mail, or if they're new contributors, never know it existed.
 
 Regards,
 Daniel

Yes, requirements.txt can contain comment lines.
It's a good idea to keep this information in the file itself.

Best,
Romain



___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [magnetodb] Backup procedure for Cassandra backend

2014-09-02 Thread Romain Hardouin
On Tue, 2014-09-02 at 17:34 +0300, Dmitriy Ukhlov wrote:
 Hi Romain!
 
 
 Thank you for useful info about your Cassandra backuping.

It's always a pleasure to talk about Cassandra :)

 
 We have not tried to tune Cassandra compaction properties yet.
 
 MagnetoDB is DynamoDB-like REST API and it means that it is key-value
 storage itself and it should be able to work for different kind of
 load, because it depends on user application which use MagnetoDB.

The compaction strategy choice really matters when setting up a cluster.
In such a use case, I mean MagnetoDB, we can assume that the database
will be updated frequently. Thus LCS is more suitable than STCS.


 Do you have some recommendation or comments based on information about
 read/write ratio?

Yes, if read/write ratio = 2 then LCS is a must have.
Just be aware that LCS is more IO intensive during compaction than STCS,
but it's for a good cause.

You'll find information here:
http://www.datastax.com/dev/blog/when-to-use-leveled-compaction

Best,

Romain




___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [horizon] Support for Django 1.7: there's a bit of work, though it looks fixable to me...

2014-08-04 Thread Romain Hardouin
Hi,

Note that Django 1.7 requires Python 2.7 or above[1] while Juno still requires 
to be compatible with Python 2.6 (Suse ES 11 uses 2.6 if my memory serves me).

[1] https://docs.djangoproject.com/en/dev/releases/1.7/#python-compatibility

Best,

Romain


- Original Message -
From: Thomas Goirand z...@debian.org
To: OpenStack Development Mailing List openstack-dev@lists.openstack.org
Sent: Sunday, August 3, 2014 12:55:19 PM
Subject: [openstack-dev] [horizon] Support for Django 1.7: there's a bit of 
work, though it looks fixable to me...

Hi,

The Debian maintainer of Django would like to upload Django 1.7 before
Jessie is frozen on the 5th of November. As for OpenStack, I would like
Icehouse to be in Jessie, since it will be supported by major companies
(RedHat and Canonical both will use Icehouse as LTS, and will work on
security for a longer time than previously planned in the OpenStack
community).

Though Horizon Icehouse doesn't currently work with Django 1.7. The
first thing to fix would be the TEMPLATE_DIRS thing:

./run_tests.sh -N -P || true
Running Horizon application tests
Traceback (most recent call last):
  File
/home/zigo/sources/openstack/icehouse/horizon/build-area/horizon-2014.1.1/manage.py,
line 25, in module
execute_from_command_line(sys.argv)
  File
/usr/lib/python2.7/dist-packages/django/core/management/__init__.py,
line 385, in execute_from_command_line
utility.execute()
[... not useful stack dump ...]
  File /usr/lib/python2.7/dist-packages/django/conf/__init__.py, line
42, in _setup
self._wrapped = Settings(settings_module)
  File /usr/lib/python2.7/dist-packages/django/conf/__init__.py, line
110, in __init__
Please fix your settings. % setting)
django.core.exceptions.ImproperlyConfigured: The TEMPLATE_DIRS setting
must be a tuple. Please fix your settings.
Running openstack_dashboard tests
WARNING:root:No local_settings file found.

Then of course, the rest of the tests are completely broken because
there's no local_settings. Adding a comma at the end of:

TEMPLATE_DIRS = (os.path.join(ROOT_PATH, 'tests', 'templates'))

in horizon/test/settings.py fixes the issue. Note that this works in
both Django 1.6 and 1.7. Some other TEMPLATE_DIRS declaration already
have the comma, so I guess it's fine to add it. Which is why I did this:
https://review.openstack.org/111561

FYI, there's this document that talks about it:
https://docs.djangoproject.com/en/1.7/releases/1.7/#backwards-incompatible-changes-in-1-7

Then, after fixing this, I get this error:
==
ERROR: Failure: TypeError (Error when calling the metaclass bases
function() argument 1 must be code, not str)
--
Traceback (most recent call last):
  File /usr/lib/python2.7/dist-packages/nose/loader.py, line 414, in
loadTestsFromName
addr.filename, addr.module)
  File /usr/lib/python2.7/dist-packages/nose/importer.py, line 47, in
importFromPath
return self.importFromDir(dir_path, fqname)
  File /usr/lib/python2.7/dist-packages/nose/importer.py, line 94, in
importFromDir
mod = load_module(part_fqname, fh, filename, desc)
  File
/home/zigo/sources/openstack/icehouse/horizon/build-area/horizon-2014.1.1/horizon/test/tests/tables.py,
line 28, in module
from horizon.test import helpers as test
  File
/home/zigo/sources/openstack/icehouse/horizon/build-area/horizon-2014.1.1/horizon/test/helpers.py,
line 184, in module
class JasmineTests(SeleniumTestCase):
TypeError: Error when calling the metaclass bases
function() argument 1 must be code, not str

There's the same issue in the definition of SeleniumTestCase() in
openstack_dashboard/test/helpers.py (line 365 in Icehouse).

Since I don't really care about selenium (it can't be tested in Debian
because it's non-free), I commented out the class
JasmineTests(SeleniumTestCase), then I get more errors. A few instances
of this one:

  File
/home/zigo/sources/openstack/icehouse/horizon/build-area/horizon-2014.1.1/horizon/tables/base.py,
line 206, in lambda
average: lambda data: sum(data, 0.0) / len(data)
TypeError: unsupported operand type(s) for +: 'float' and 'str'

I'm not a Django expert, so I it'd be awesome to get help on this. Best
would be that:
1/ Support for Django 1.7 is added to Juno
2/ The changes are backported to Icehouse (even if this doesn't make it
into the stable branch because of let's stay safe, I can add the
patches as Debian specific).

Thoughts from the Horizon team would be welcome.

Cheers,

Thomas Goirand (zigo)

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [MagnetoDB] Best practices for uploading large amounts of data

2014-03-28 Thread Romain Hardouin
Bulk loading with sstableloader is blazingly fast (the price to pay is that's 
not portable of course). 
Also it's network efficient thanks to SSTable compression. If the network is 
not a limiting factor then LZ4 will be great.




Le Vendredi 28 mars 2014 13h46, Aleksandr Chudnovets achudnov...@mirantis.com 
a écrit :
 
Dmitriy Ukhlov wrote:

 I guess if we a talking about cassandra batch loading the fastest way is to 
 generate sstables locally and load it into Cassandra via JMX or sstableloader
http://www.datastax.com/dev/blog/bulk-loading



 Good idea, Dmitriy. IMHO bulk load is back-end specific task. So using 
specialized tools seems good idea for me.

Regards,
Alexander Chudnovets

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Split of the openstack-dev list

2013-11-14 Thread Romain Hardouin
Good idea.

-romain

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] Re : Re: Manual to build an application on open stack

2013-11-02 Thread Romain Hardouin
  I am trying to build an app that resides on the cloud and would want to 
  perform some basic storage management operations. br/br/So, you want to 
  build an app atop Swift ?br/br/-Romainbr/___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Re : welcoming new committers

2013-11-01 Thread Romain Hardouin
 Indeed :) Can you share with us briefly what you found interesting in
 the sessions of Upstream University? Which ones did you go to?

Upsteam University acted like a starter to me. I attended the september session 
in Paris.

I'm interested in OpenStack since Essex but I did not dare submit my first 
patch.
Folks at UU make this happen.
During the two days group session we have learned the basics of Open Source and 
how to interact with such a community.
Then, weekly assessments and phone calls allow us to stay motivated and thus 
not to give up. We are given valuable advices to get our fixes accepted.

Guys at Upstream University are really cool and proficient.


 Well, I think that anybody's opinion matters and you're not a new
 OpenStack developer anymore. You have your own experience and your
 reviews may definitely help somebody even newer than you to get his/her
 patch refined before the more experienced developers get to it. I'm sure
 your comments, even without a vote, would help. Chime in then :)

Thanks for your kind words. 
I'm going to start reviewing. I take note of what Jeremy Stanley said:
OpenStack does not lack developers... it lacks reviewers.

-Romain ___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] Re : welcoming new committers (was Re: When is it okay for submitters to say 'I don't want to add tests' ?)

2013-10-31 Thread Romain Hardouin
Hi all, br/br/Adding a message for new comers is a good idea. br/I am a 
new Horizon contributor, some of my fixes have been merged (thanks to Upstream 
University :-) and reviewers of course) but I still hesitate to do code review. 
To my mind, it is reserved to known developpers whose opinion matters... 
br/br/- Romain___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev