Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-27 Thread Octave J. Orgeron
, Octave J. Orgeron wrote: Hi Jay, Comments below.. On 7/26/2017 5:43 PM, Jay Pipes wrote: On 07/26/2017 07:06 PM, Octave J. Orgeron wrote: Hi Michael, On 7/26/2017 4:28 PM, Michael Bayer wrote: it at all. thinking out loud oslo_db.sqlalchemy.types.String(255, mysql_small_rowsize=64

Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-27 Thread Octave J. Orgeron
Hi Jay, Comments below.. On 7/26/2017 5:43 PM, Jay Pipes wrote: On 07/26/2017 07:06 PM, Octave J. Orgeron wrote: Hi Michael, On 7/26/2017 4:28 PM, Michael Bayer wrote: it at all. thinking out loud oslo_db.sqlalchemy.types.String(255, mysql_small_rowsize=64

Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-27 Thread Octave J. Orgeron
, Octave J. Orgeron wrote: Either way though, we'll have to ... still have to deal with any migrations that don't make proper use of oslo.db. Could you elaborate on the above? What about the Nova migrations aren't making proper use of oslo.db? Could you provide an example for us? Best, -jay

Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-26 Thread Octave J. Orgeron
Hi Michael, That is something we are working towards having our own CI where we could catch these things. I do think that having a function in the utils module of oslo.db to test the length of a table row would be handy though for projects to leverage as part of their unit tests. Octave On

Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-26 Thread Octave J. Orgeron
Hi Michael, On 7/26/2017 4:28 PM, Michael Bayer wrote: it at all. thinking out loud oslo_db.sqlalchemy.types.String(255, mysql_small_rowsize=64) oslo_db.sqlalchemy.types.String(255, mysql_small_rowsize=sa.TINYTEXT) oslo_db.sqlalchemy.types.String(255, mysql_small_rowsize=sa.TEXT) so if you

Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-26 Thread Octave J. Orgeron
over a 14K row size remains, and I still think that checks need to be put in place in oslo.db that would sum the total row size of any given table and raise an error if the limit is surpassed. On Wed, Jul 26, 2017 at 5:40 PM, Octave J. Orgeron <octave.orge...@oracle.com> wrote: Hi Michae

Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-26 Thread Octave J. Orgeron
Hi Michael, Comments below.. On 7/26/2017 1:08 PM, Michael Bayer wrote: On Jul 25, 2017 3:38 PM, "Octave J. Orgeron" <octave.orge...@oracle.com <mailto:octave.orge...@oracle.com>> wrote: Hi Michael, I understand that you want to abstract this completely away

Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-25 Thread Octave J. Orgeron
Hi Michael, I understand that you want to abstract this completely away inside of oslo.db. However, the reality is that making column changes based purely on the size and type of that column, without understanding what that column is being used for is extremely dangerous. You could end up

Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-25 Thread Octave J. Orgeron
Hi Graham, Comments below.. On 7/25/2017 5:04 AM, Graham Hayes wrote: On 24/07/17 20:37, Octave J. Orgeron wrote: Rather than having all the projects make use of oslo_db.sqlalchemy.ndb.AutoStringTinyText / AutoStringSize, we add new generic types to oslo.db

Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-24 Thread Octave J. Orgeron
Hi Michael, Comments below.. On 7/24/2017 2:49 PM, Michael Bayer wrote: On Mon, Jul 24, 2017 at 3:37 PM, Octave J. Orgeron <octave.orge...@oracle.com> wrote: For these, here is a brief synopsis: AutoStringTinyText, will convert a column to the TinyText type. This is used for cases

Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-24 Thread Octave J. Orgeron
Hi Michael, Comments below.. On 7/24/2017 9:13 AM, Michael Bayer wrote: On Mon, Jul 24, 2017 at 10:01 AM, Jay Pipes wrote: I would much prefer to *add* a brand new schema migration that handles conversion of the entire InnoDB schema at a certain point to an

Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-24 Thread Octave J. Orgeron
penstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Oracle <http://www.oracle.com/> Octave J. Orgeron | Sr. Principal Architect Certified Enterprise Architect Oracle Linux OpenStack Mobile: +1-720-616-1550 <tel:+17206161550> 500 Eldorado B

Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-24 Thread Octave J. Orgeron
Hi Jay, Comments below.. Thanks, Octave On 7/23/2017 4:10 PM, Jay Pipes wrote: Glad you brought this up, Mike. I was going to start a thread about this. Comments inline. On 07/23/2017 05:02 PM, Michael Bayer wrote: I've been working with Octave Oregon in assisting with new rules and

Re: [openstack-dev] [oslo.db] [ndb] ndb namespace throughout openstack projects

2017-07-24 Thread Octave J. Orgeron
Hi Mike, Thanks for putting this together. Comments below.. Thanks, Octave On 7/23/2017 3:02 PM, Michael Bayer wrote: I've been working with Octave Oregon in assisting with new rules and datatypes that would allow projects to support the NDB storage engine with MySQL. To that end, we've made

Re: [openstack-dev] [tc] Active or passive role with our database layer

2017-05-23 Thread Octave J. Orgeron
Comments below.. On 5/21/2017 1:38 PM, Monty Taylor wrote: Hi all! As the discussion around PostgreSQL has progressed, it has come clear to me that there is a decently deep philosophical question on which we do not currently share either definition or agreement. I believe that the lack of

Re: [openstack-dev] [tc] revised Postgresql deprecation patch for governance

2017-05-23 Thread Octave J. Orgeron
As OpenStack has evolved and grown, we are ending up with more and more MySQL-isms in the code. I'd love to see OpenStack support every database out there, but that is becoming more and more difficult. I've tried to get OpenStack to work with other databases like Oracle DB, MongoDB, TimesTen,

Re: [openstack-dev] [tc] [all] OpenStack moving both too fast and too slow at the same time

2017-05-08 Thread Octave J. Orgeron
:26 AM, Jeremy Stanley wrote: On 2017-05-05 15:35:16 -0600 (-0600), Octave J. Orgeron wrote: [...] If it's in support of Oracle specific technologies such as Solaris, [...] we are often shunned away because it's not Linux or "mainstream" enough. A great example is how our Nova drivers f

Re: [openstack-dev] [tc] [all] OpenStack moving both too fast and too slow at the same time

2017-05-08 Thread Octave J. Orgeron
vely young project and doesn't support some of things that you yourself said you need. As it grows, as options becomes available, it too will become more and more complex. On 5 May 2017 at 14:52, Octave J. Orgeron <octave.orge...@oracle.com> wrote: +1 On 5/5/2017 3:46 PM, Alex Schultz wro

Re: [openstack-dev] [tc] [all] OpenStack moving both too fast and too slow at the same time

2017-05-05 Thread Octave J. Orgeron
+1 On 5/5/2017 3:46 PM, Alex Schultz wrote: Sooo... I always get a little triggered when I hear that OpenStack is hard to deploy. We've spent last few years fixing it and I think it's pretty well fixed now. Even as we speak I'm deploying 500+ vms on OpenStack cluster I deployed last week

Re: [openstack-dev] [tc] [all] OpenStack moving both too fast and too slow at the same time

2017-05-05 Thread Octave J. Orgeron
Hi Matt, And this is actually part of the problem for vendors. Many Oracle engineers, including myself, have tried to get features and fixes pushed upstream. While that may sound easy, the reality is that it isn't! In many cases, it takes months for us to get something in or we get shot down

Re: [openstack-dev] [tc] [all] OpenStack moving both too fast and too slow at the same time

2017-05-05 Thread Octave J. Orgeron
Thank you Alex for the points you made below. These are some of the big issues that I see all OpenStack customers and operators struggling with. Regardless of the tools that the community or vendors put on the table, OpenStack is still a very complicated piece of technology to deploy and

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-06 Thread Octave J. Orgeron
Hi Morgan, Comments below.. Thanks, Octave On 2/6/2017 1:04 PM, Morgan Fainberg wrote: On Thu, Feb 2, 2017 at 2:28 PM, Octave J. Orgeron <octave.orge...@oracle.com <mailto:octave.orge...@oracle.com>> wrote: That refers to the total length of the row. InnoDB has a limi

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-06 Thread Octave J. Orgeron
figure out if we want to change the approach. I'm also going to create a spec and blueprint to cover the changes across the services. I'll post links once all of that is up for review. Thanks, Octave On 2/6/2017 7:53 AM, Mike Bayer wrote: On 02/03/2017 11:59 AM, Octave J. Orgeron wrote: Hi

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-03 Thread Octave J. Orgeron
Comments below.. On 2/3/2017 8:34 AM, Mike Bayer wrote: On 02/03/2017 10:21 AM, Doug Hellmann wrote: Excerpts from Mike Bayer's message of 2017-02-03 09:41:11 -0500: On 02/02/2017 05:28 PM, Octave J. Orgeron wrote: That refers to the total length of the row. InnoDB has a limit of 65k

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-03 Thread Octave J. Orgeron
Hi Doug, Comments below.. On 2/3/2017 8:21 AM, Doug Hellmann wrote: Excerpts from Mike Bayer's message of 2017-02-03 09:41:11 -0500: On 02/02/2017 05:28 PM, Octave J. Orgeron wrote: That refers to the total length of the row. InnoDB has a limit of 65k and NDB is limited to 14k. A simple

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-03 Thread Octave J. Orgeron
tack.org/cgi-bin/mailman/listinfo/openstack-dev -- Oracle <http://www.oracle.com/> Octave J. Orgeron | Sr. Principal Architect and Software Engineer Oracle Linux OpenStack Mobile: +1-720-616-1550 <tel:+17206161550> 500 Eldorado Blvd. | Broomfield, CO 80021 Certified Oracle Enterprise Archi

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-03 Thread Octave J. Orgeron
Hi Mike, Comments below.. Thanks, Octave On 2/3/2017 7:41 AM, Mike Bayer wrote: On 02/02/2017 05:28 PM, Octave J. Orgeron wrote: That refers to the total length of the row. InnoDB has a limit of 65k and NDB is limited to 14k. A simple example would be the volumes table in Cinder where

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-03 Thread Octave J. Orgeron
ttp://www.oracle.com/> Octave J. Orgeron | Sr. Principal Architect and Software Engineer Oracle Linux OpenStack Mobile: +1-720-616-1550 <tel:+17206161550> 500 Eldorado Blvd. | Broomfield, CO 80021 Certified Oracle Enterprise Architect: Systems Infrastructure <http://www.oracle.com/us/solut

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-02 Thread Octave J. Orgeron
//www.oracle.com/> Octave J. Orgeron | Sr. Principal Architect and Software Engineer Oracle Linux OpenStack Mobile: +1-720-616-1550 <tel:+17206161550> 500 Eldorado Blvd. | Broomfield, CO 80021 Certified Oracle Enterprise Architect: Systems Infrastructure <http://www.oracle.com/us/solut

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-02 Thread Octave J. Orgeron
openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Oracle <http://www.oracle.com/> Octave J. Orgeron | Sr. Principal Architect and Software Engineer Oracle Linux OpenStack Mobile: +1-720-616-1550 <tel:+17206161550> 500 Eldorado Blv

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-02 Thread Octave J. Orgeron
Hi Doug, Comments below.. Thanks, Octave On 2/2/2017 12:52 PM, Mike Bayer wrote: On 02/02/2017 02:16 PM, Octave J. Orgeron wrote: Hi Doug, Comments below.. Thanks, Octave On 2/2/2017 11:27 AM, Doug Hellmann wrote: It sounds like part of the plan is to use the configuration setting

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-02 Thread Octave J. Orgeron
Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Oracle <http://www.oracle.com/> Octave J. Orgeron | Sr. Principal Architect and Software Engineer Oracle Lin

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-02 Thread Octave J. Orgeron
: On 02/02/2017 10:25 AM, Monty Taylor wrote: On 02/01/2017 09:33 PM, Octave J. Orgeron wrote: Hi Folks, I'm working on adding support for MySQL Cluster to the core OpenStack services. This will enable the community to benefit from an active/active, auto-sharding, and scale-out MySQL database. My

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-02 Thread Octave J. Orgeron
Hi Monty, Thank you for the feedback. I'm excited about getting these patches upstream as everyone will be able to benefit from them. Thanks, Octave On 2/2/2017 8:25 AM, Monty Taylor wrote: On 02/01/2017 09:33 PM, Octave J. Orgeron wrote: Hi Folks, I'm working on adding support for MySQL

Re: [openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-02 Thread Octave J. Orgeron
man/listinfo/openstack-dev -- Oracle <http://www.oracle.com/> Octave J. Orgeron | Sr. Principal Architect and Software Engineer Oracle Linux OpenStack Mobile: +1-720-616-1550 <tel:+17206161550> 500 Eldorado Blvd. | Broomfield, CO 80021 Certified Oracle Enterprise Architect: Systems Infras

[openstack-dev] [oslo][oslo.db] MySQL Cluster support

2017-02-01 Thread Octave J. Orgeron
.db and can be reviewed at: https://review.openstack.org/427970 Thanks, Octave -- Oracle <http://www.oracle.com/> Octave J. Orgeron | Sr. Principal Architect and Software Engineer Oracle Linux OpenStack Certified Oracle Enterprise Architect: Systems Infrastructure <http://www.oracle.com/