Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-15 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 12/09/14 18:00, Mike Bayer wrote: > > On Sep 12, 2014, at 11:56 AM, Johannes Erdfelt > wrote: > >> On Fri, Sep 12, 2014, Doug Hellmann >> wrote: >>> I don’t think we will want to retroactively change the >>> migration scripts (that’s not somet

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-15 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 12/09/14 19:08, Doug Hellmann wrote: > > On Sep 12, 2014, at 1:03 PM, Ihar Hrachyshka > wrote: > >> Signed PGP part On 12/09/14 17:30, Mike Bayer wrote: >>> >>> On Sep 12, 2014, at 10:40 AM, Ihar Hrachyshka >>> wrote: >>> Signed PGP par

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Angus Lees
On Fri, 12 Sep 2014 01:08:04 PM Doug Hellmann wrote: > On Sep 12, 2014, at 1:03 PM, Ihar Hrachyshka wrote: > > Signed PGP part > > > > On 12/09/14 17:30, Mike Bayer wrote: > > > On Sep 12, 2014, at 10:40 AM, Ihar Hrachyshka > > > > > > wrote: > > >> Signed PGP part On 12/09/14 16:33, Mike Bayer

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Doug Hellmann
On Sep 12, 2014, at 1:03 PM, Ihar Hrachyshka wrote: > Signed PGP part > On 12/09/14 17:30, Mike Bayer wrote: > > > > On Sep 12, 2014, at 10:40 AM, Ihar Hrachyshka > > wrote: > > > >> Signed PGP part On 12/09/14 16:33, Mike Bayer wrote: > >>> I agree with this, changing the MySQL driver now is n

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 12/09/14 17:30, Mike Bayer wrote: > > On Sep 12, 2014, at 10:40 AM, Ihar Hrachyshka > wrote: > >> Signed PGP part On 12/09/14 16:33, Mike Bayer wrote: >>> I agree with this, changing the MySQL driver now is not an >>> option. >> >> That was no

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Mike Bayer
On Sep 12, 2014, at 11:56 AM, Johannes Erdfelt wrote: > On Fri, Sep 12, 2014, Doug Hellmann wrote: >> I don’t think we will want to retroactively change the migration scripts >> (that’s not something we generally like to do), > > We don't allow semantic changes to migration scripts since peopl

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Johannes Erdfelt
On Fri, Sep 12, 2014, Doug Hellmann wrote: > I don’t think we will want to retroactively change the migration scripts > (that’s not something we generally like to do), We don't allow semantic changes to migration scripts since people who have already run it won't get those changes. However, we ha

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Mike Bayer
On Sep 12, 2014, at 10:40 AM, Ihar Hrachyshka wrote: > Signed PGP part > On 12/09/14 16:33, Mike Bayer wrote: >> I agree with this, changing the MySQL driver now is not an option. > > That was not the proposal. The proposal was to introduce support to > run against something different from MySQ

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Sean Dague
On 09/12/2014 11:19 AM, Doug Hellmann wrote: > > On Sep 12, 2014, at 9:23 AM, Ihar Hrachyshka wrote: > >> Signed PGP part >> On 12/09/14 13:20, Sean Dague wrote: >>> On 09/12/2014 06:41 AM, Ihar Hrachyshka wrote: Some updates/concerns/questions. The status of introducing a new dri

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Doug Hellmann
On Sep 12, 2014, at 9:23 AM, Ihar Hrachyshka wrote: > Signed PGP part > On 12/09/14 13:20, Sean Dague wrote: > > On 09/12/2014 06:41 AM, Ihar Hrachyshka wrote: > >> Some updates/concerns/questions. > >> > >> The status of introducing a new driver to gate is: > >> > >> - all the patches for mysql

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 12/09/14 16:33, Mike Bayer wrote: > I agree with this, changing the MySQL driver now is not an option. That was not the proposal. The proposal was to introduce support to run against something different from MySQLdb + a gate job for that alternat

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Mike Bayer
On Sep 12, 2014, at 7:20 AM, Sean Dague wrote: > > Because we are in Feature Freeze. Now is the time for critical bug fixes > only, as we start to stabalize the tree. Releasing dependent libraries > that can cause breaks, for whatever reason, should be soundly avoided. > > If this was August,

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Jeremy Stanley
On 2014-09-12 12:41:42 +0200 (+0200), Ihar Hrachyshka wrote: [...] > That said, those failures were solved by pinning the version of the > library in openstack/requirements and those projects. This is in major > contrast to how we handled the new testtools release just several > weeks ago, when the

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 12/09/14 13:20, Sean Dague wrote: > On 09/12/2014 06:41 AM, Ihar Hrachyshka wrote: >> Some updates/concerns/questions. >> >> The status of introducing a new driver to gate is: >> >> - all the patches for mysql-connector are merged in all >> proj

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Sean Dague
On 09/12/2014 06:41 AM, Ihar Hrachyshka wrote: > Some updates/concerns/questions. > > The status of introducing a new driver to gate is: > > - all the patches for mysql-connector are merged in all projects; > - all devstack patches to support switching the driver are merged; > - new sqlalchemy-mi

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-09-12 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Some updates/concerns/questions. The status of introducing a new driver to gate is: - - all the patches for mysql-connector are merged in all projects; - - all devstack patches to support switching the driver are merged; - - new sqlalchemy-migrate

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-08-21 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 21/08/14 09:42, Endre Karlson wrote: > Why pymysql over mysql-python? > http://specs.openstack.org/openstack/oslo-specs/specs/juno/enable-mysql-connector.html#problem-description -BEGIN PGP SIGNATURE- Version: GnuPG/MacGPG2 v2.0.22 (Darw

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-08-21 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 21/08/14 02:03, Clark Boylan wrote: > On Mon, Aug 18, 2014, at 01:59 AM, Ihar Hrachyshka wrote: On > 17/08/14 02:09, Angus Lees wrote: On 16 Aug 2014 06:09, "Doug Hellmann" >>> > wrote: > > >

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-08-21 Thread Endre Karlson
Why pymysql over mysql-python? Endre Karlson 21. Aug. 2014 09:05 skrev "Angus Lees" følgende: > On Wed, 20 Aug 2014 05:03:51 PM Clark Boylan wrote: > > On Mon, Aug 18, 2014, at 01:59 AM, Ihar Hrachyshka wrote: > > > -BEGIN PGP SIGNED MESSAGE- > > > Hash: SHA512 > > > > > > On 17/08/14 02

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-08-21 Thread Angus Lees
On Wed, 20 Aug 2014 05:03:51 PM Clark Boylan wrote: > On Mon, Aug 18, 2014, at 01:59 AM, Ihar Hrachyshka wrote: > > -BEGIN PGP SIGNED MESSAGE- > > Hash: SHA512 > > > > On 17/08/14 02:09, Angus Lees wrote: > > > On 16 Aug 2014 06:09, "Doug Hellmann" > > > > >

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-08-20 Thread Clark Boylan
On Mon, Aug 18, 2014, at 01:59 AM, Ihar Hrachyshka wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA512 > > On 17/08/14 02:09, Angus Lees wrote: > > > > On 16 Aug 2014 06:09, "Doug Hellmann" > > wrote: > >> > >> > >> On Aug 15, 2014, at 9:29 AM, Ihar Hrachys

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-08-18 Thread Victor Sergeyev
Hello Doug, All. >> This release is currently blocked on landing some changes in projects using the library so they don’t break when the new version starts using different exception classes. We’re tracking that work in https://etherpad.openstack.org/p/sqla_exceptions_caught >> It looks like we’re

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-08-18 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 17/08/14 02:09, Angus Lees wrote: > > On 16 Aug 2014 06:09, "Doug Hellmann" > wrote: >> >> >> On Aug 15, 2014, at 9:29 AM, Ihar Hrachyshka >> > wrote: >> >>> Signed PGP part Some upda

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-08-16 Thread Angus Lees
On 16 Aug 2014 06:09, "Doug Hellmann" wrote: > > > On Aug 15, 2014, at 9:29 AM, Ihar Hrachyshka wrote: > > > Signed PGP part > > Some updates on the matter: > > > > - oslo-spec was approved with narrowed scope which is now 'enabled > > mysqlconnector as an alternative in gate' instead of 'switch

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-08-15 Thread Doug Hellmann
On Aug 15, 2014, at 9:29 AM, Ihar Hrachyshka wrote: > Signed PGP part > Some updates on the matter: > > - oslo-spec was approved with narrowed scope which is now 'enabled > mysqlconnector as an alternative in gate' instead of 'switch the > default db driver to mysqlconnector'. We'll revisit the

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-08-15 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Some updates on the matter: - - oslo-spec was approved with narrowed scope which is now 'enabled mysqlconnector as an alternative in gate' instead of 'switch the default db driver to mysqlconnector'. We'll revisit the switch part the next cycle once

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-22 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 FYI: I've moved the spec to oslo space since the switch is not really limited to neutron, and most of coding is to be done in oslo.db (though not much anyway). New spec: https://review.openstack.org/#/c/108355/ On 09/07/14 13:17, Ihar Hrachyshka wr

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-21 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 21/07/14 04:53, Angus Lees wrote: > Status, as I understand it: > > * oslo.db changes to support other mysql drivers: > > https://review.openstack.org/#/c/104425/ (merged) > https://review.openstack.org/#/c/106928/ (awaiting oslo.db > revie

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-20 Thread Angus Lees
Status, as I understand it: * oslo.db changes to support other mysql drivers: https://review.openstack.org/#/c/104425/ (merged) https://review.openstack.org/#/c/106928/ (awaiting oslo.db review) https://review.openstack.org/#/c/107221/ (awaiting oslo.db review) (These are sufficient to allow

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-18 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 14/07/14 17:03, Ihar Hrachyshka wrote: > On 14/07/14 15:54, Clark Boylan wrote: >> On Sun, Jul 13, 2014 at 9:20 AM, Ihar Hrachyshka >> wrote: On 11/07/14 19:20, Clark Boylan >> wrote: > Before we get too far ahead of ourselves mysql-connect

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-16 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 16/07/14 01:50, Vishvananda Ishaya wrote: > > On Jul 15, 2014, at 3:30 PM, Ihar Hrachyshka > wrote: > >> Signed PGP part On 14/07/14 22:48, Vishvananda Ishaya wrote: >>> >>> On Jul 13, 2014, at 9:29 AM, Ihar Hrachyshka >>> wrote: >>> Si

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-15 Thread Vishvananda Ishaya
On Jul 15, 2014, at 3:30 PM, Ihar Hrachyshka wrote: > Signed PGP part > On 14/07/14 22:48, Vishvananda Ishaya wrote: > > > > On Jul 13, 2014, at 9:29 AM, Ihar Hrachyshka > > wrote: > > > >> Signed PGP part On 12/07/14 03:17, Mike Bayer wrote: > >>> > >>> On 7/11/14, 7:26 PM, Carl Baldwin wrote:

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-15 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 14/07/14 22:48, Vishvananda Ishaya wrote: > > On Jul 13, 2014, at 9:29 AM, Ihar Hrachyshka > wrote: > >> Signed PGP part On 12/07/14 03:17, Mike Bayer wrote: >>> >>> On 7/11/14, 7:26 PM, Carl Baldwin wrote: On Jul 11, 2014 5:3

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-14 Thread Vishvananda Ishaya
On Jul 13, 2014, at 9:29 AM, Ihar Hrachyshka wrote: > Signed PGP part > On 12/07/14 03:17, Mike Bayer wrote: > > > > On 7/11/14, 7:26 PM, Carl Baldwin wrote: > >> > >> > >> On Jul 11, 2014 5:32 PM, "Vishvananda Ishaya" > >> > > wrote: > >>> > >>> I have tried using

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-14 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 14/07/14 15:54, Clark Boylan wrote: > On Sun, Jul 13, 2014 at 9:20 AM, Ihar Hrachyshka > wrote: On 11/07/14 19:20, Clark Boylan > wrote: Before we get too far ahead of ourselves mysql-connector is not hosted on pypi. Instead it is an ex

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-14 Thread Clark Boylan
On Sun, Jul 13, 2014 at 9:20 AM, Ihar Hrachyshka wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA512 > > On 11/07/14 19:20, Clark Boylan wrote: >> Before we get too far ahead of ourselves mysql-connector is not >> hosted on pypi. Instead it is an external package link. We recently >> manage

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-14 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 14/07/14 07:45, Thomas Goirand wrote: > On 07/14/2014 12:20 AM, Ihar Hrachyshka wrote: >> On 11/07/14 19:20, Clark Boylan wrote: >>> That said there is at least one other pure python alternative, >>> PyMySQL. PyMySQL supports py3k and pypy. We sh

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-13 Thread Thomas Goirand
On 07/14/2014 12:20 AM, Ihar Hrachyshka wrote: > On 11/07/14 19:20, Clark Boylan wrote: >> That said there is at least one other pure python alternative, >> PyMySQL. PyMySQL supports py3k and pypy. We should look at using >> PyMySQL instead if we want to start with a reasonable path to >> getting

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-13 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 12/07/14 02:49, Jay Pipes wrote: > On 07/11/2014 08:04 AM, Ihar Hrachyshka wrote: On 09/07/14 13:17, > Ihar Hrachyshka wrote: Hi all, Multiple projects are suffering from db lock timeouts due to deadlocks deep in mysqldb libr

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-13 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 12/07/14 00:30, Vishvananda Ishaya wrote: > I have tried using pymysql in place of mysqldb and in real world > concurrency tests against cinder and nova it performs slower. I was > inspired by the mention of mysql-connector so I just tried that >

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-13 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 12/07/14 03:17, Mike Bayer wrote: > > On 7/11/14, 7:26 PM, Carl Baldwin wrote: >> >> >> On Jul 11, 2014 5:32 PM, "Vishvananda Ishaya" >> > wrote: >>> >>> I have tried using pymysql in place of mysqldb and in real

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-13 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 11/07/14 19:20, Clark Boylan wrote: > Before we get too far ahead of ourselves mysql-connector is not > hosted on pypi. Instead it is an external package link. We recently > managed to remove all packages that are hosted as external package > link

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-12 Thread Carl Baldwin
+1. Well put. No one is arguing against this other approach. The two efforts can be taken independently. Carl On Jul 11, 2014 10:48 PM, "Mike Bayer" wrote: > > On 7/11/14, 11:26 PM, Jay Pipes wrote: > > Yep, couldn't agree more. > > > > Frankly, the steps you outline in the wiki above are exce

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-11 Thread Mike Bayer
On 7/11/14, 11:26 PM, Jay Pipes wrote: > Yep, couldn't agree more. > > Frankly, the steps you outline in the wiki above are excellent > examples of where we can make significant gains in both performance > and scalability. In addition to those you listed, the underlying > database schemas themselv

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-11 Thread Jay Pipes
On 07/11/2014 09:17 PM, Mike Bayer wrote: ... To identify performance that's alleviated by async you have to establish up front that IO blocking is the issue, which would entail having code that's blazing fast until you start running it against concurrent connections, at which point you can ident

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-11 Thread Mike Bayer
On 7/11/14, 7:26 PM, Carl Baldwin wrote: > > > On Jul 11, 2014 5:32 PM, "Vishvananda Ishaya" mailto:vishvana...@gmail.com>> wrote: > > > > I have tried using pymysql in place of mysqldb and in real world concurrency > > tests against cinder and nova it performs slower. I was inspired by the mentio

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-11 Thread Jay Pipes
On 07/11/2014 08:04 AM, Ihar Hrachyshka wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 09/07/14 13:17, Ihar Hrachyshka wrote: Hi all, Multiple projects are suffering from db lock timeouts due to deadlocks deep in mysqldb library that we use to interact with mysql servers. In essence

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-11 Thread Carl Baldwin
Clark, You make a good point. It's there some resistance to this or is it just a matter of asking? Carl On Jul 11, 2014 12:23 PM, "Clark Boylan" wrote: > Before we get too far ahead of ourselves mysql-connector is not hosted > on pypi. Instead it is an external package link. We recently manage

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-11 Thread Carl Baldwin
On Jul 11, 2014 5:32 PM, "Vishvananda Ishaya" wrote: > > I have tried using pymysql in place of mysqldb and in real world concurrency > tests against cinder and nova it performs slower. I was inspired by the mention > of mysql-connector so I just tried that option instead. Mysql-connector seems >

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-11 Thread Vishvananda Ishaya
I have tried using pymysql in place of mysqldb and in real world concurrency tests against cinder and nova it performs slower. I was inspired by the mention of mysql-connector so I just tried that option instead. Mysql-connector seems to be slightly slower as well, which leads me to believe that th

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-11 Thread Clark Boylan
Before we get too far ahead of ourselves mysql-connector is not hosted on pypi. Instead it is an external package link. We recently managed to remove all packages that are hosted as external package links from openstack and will not add new ones in. Before we can use mysql-connector in the gate ora

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-11 Thread Miguel Angel Ajo Pelayo
+1 here too, Amazed with the performance gains, x2.4 seems a lot, and we'd get rid of deadlocks. - Original Message - > +1 > > I'm pretty excited about the possibilities here. I've had this > mysqldb/eventlet contention in the back of my mind for some time now. > I'm glad to see some

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-11 Thread Carl Baldwin
+1 I'm pretty excited about the possibilities here. I've had this mysqldb/eventlet contention in the back of my mind for some time now. I'm glad to see some work being done in this area. Carl On Fri, Jul 11, 2014 at 7:04 AM, Ihar Hrachyshka wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: S

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-11 Thread Mike Bayer
On 7/9/14, 10:59 AM, Roman Podoliaka wrote: > Hi all, > > Not sure what issues you are talking about, but I just replaced > "mysql" with "mysql+mysqlconnector" in my db connection string in > neutron.conf and "neutron-db-manage upgrade head" worked like a charm > for an empty schema. > > Ihar, co

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-11 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 09/07/14 13:17, Ihar Hrachyshka wrote: > Hi all, > > Multiple projects are suffering from db lock timeouts due to > deadlocks deep in mysqldb library that we use to interact with > mysql servers. In essence, the problem is due to missing eventlet

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-10 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 10/07/14 08:09, Angus Lees wrote: > On 10 July 2014 00:59, Roman Podoliaka > wrote: > >> Not sure what issues you are talking about, but I just replaced >> "mysql" with "mysql+mysqlconnector" in my db connection string >> in neutron.conf and "n

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-09 Thread Angus Lees
On 10 July 2014 00:59, Roman Podoliaka wrote: > Not sure what issues you are talking about, but I just replaced > "mysql" with "mysql+mysqlconnector" in my db connection string in > neutron.conf and "neutron-db-manage upgrade head" worked like a charm > for an empty schema. > Yep, I don't think

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-09 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 09/07/14 16:59, Roman Podoliaka wrote: > Hi all, > > Not sure what issues you are talking about, but I just replaced > "mysql" with "mysql+mysqlconnector" in my db connection string in > neutron.conf and "neutron-db-manage upgrade head" worked

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-09 Thread Roman Podoliaka
Hi all, Not sure what issues you are talking about, but I just replaced "mysql" with "mysql+mysqlconnector" in my db connection string in neutron.conf and "neutron-db-manage upgrade head" worked like a charm for an empty schema. Ihar, could please elaborate on what changes to oslo.db are needed?

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-09 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 09/07/14 15:40, Sean Dague wrote: > On 07/09/2014 09:00 AM, Roman Podoliaka wrote: >> Hi Ihar, >> >> AFAIU, the switch is a matter of pip install + specifying the >> correct db URI in the config files. I'm not sure why you are >> filing a spec in

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-09 Thread Sean Dague
On 07/09/2014 09:00 AM, Roman Podoliaka wrote: > Hi Ihar, > > AFAIU, the switch is a matter of pip install + specifying the correct > db URI in the config files. I'm not sure why you are filing a spec in > Neutron project. IMHO, this has nothing to do with projects, but > rather a purely deploymen

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-09 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 On 09/07/14 15:00, Roman Podoliaka wrote: > Hi Ihar, > > AFAIU, the switch is a matter of pip install + specifying the > correct db URI in the config files. I'm not sure why you are filing > a spec in Neutron project. IMHO, this has nothing to do wi

Re: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-09 Thread Roman Podoliaka
Hi Ihar, AFAIU, the switch is a matter of pip install + specifying the correct db URI in the config files. I'm not sure why you are filing a spec in Neutron project. IMHO, this has nothing to do with projects, but rather a purely deployment question. E.g. don't we have PostgreSQL+psycopg2 or MySQL

[openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client

2014-07-09 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Hi all, Multiple projects are suffering from db lock timeouts due to deadlocks deep in mysqldb library that we use to interact with mysql servers. In essence, the problem is due to missing eventlet support in mysqldb module, meaning when a db lock i