Re: [libdbi-users] libdbi+mysql speed issues

2013-01-09 Thread Olivier Doucet
libdbi-drivers uses the mysql_config script shipped with MySQL to obtain the list of required libraries to link against, *unless* you use the --with-mysql-libdir configure switch. Yes I was using this configure switch. I copied configure line from Red Hat SRPM. Do you have any numbers? Would

Re: [libdbi-users] libdbi+mysql speed issues

2013-01-09 Thread Markus Hoenicka
Olivier Doucet webmas...@ajeux.com was heard to say: Do you have any numbers? Would be nice to know what speed gain this (almost) one-line optimization effected. I've done a benchmark with rrdtool that uses libdbi. http://tof.canardpc.com/view/31953cab-4329-45e9-9e30-eed2d9148ee1.jpg max

Re: [libdbi-users] libdbi+mysql speed issues

2013-01-08 Thread Markus Hoenicka
Olivier Doucet webmas...@ajeux.com was heard to say: Hello everyone, I'm following a quite old topic about libdbi speed issues. I was able to track the cause of these issues : The major problem is how libdbi goes from one row to another. RRDTool (the tool that used libdbi and that I was

Re: [libdbi-users] libdbi+mysql speed issues

2013-01-08 Thread Olivier Doucet
Hi Markus, 2013/1/8 Markus Hoenicka markus.hoeni...@mhoenicka.de: We could modify the driver function dbd_goto_row() by passing both the wanted row index rowidx and the current row index currowidx(which libdbi keeps track of anyway). This is one way to fix the problem, I agree. Unfortunately

Re: [libdbi-users] libdbi+mysql speed issues

2013-01-08 Thread Markus Hoenicka
Olivier Doucet webmas...@ajeux.com was heard to say: Hi Markus, 2013/1/8 Markus Hoenicka markus.hoeni...@mhoenicka.de: We could modify the driver function dbd_goto_row() by passing both the wanted row index rowidx and the current row index currowidx(which libdbi keeps track of anyway).

Re: [libdbi-users] libdbi+mysql speed issues

2013-01-08 Thread Mike Rylander
Markus, Would it be worth the ugliness of a module-global variable to bury the value of the row index used in the previous call to dbd_mysql.c::dbd_goto_row() inside the MySQL driver itself, side-stepping the function signature change for other drivers? The benefit of avoiding the API change may

Re: [libdbi-users] libdbi+mysql speed issues

2013-01-08 Thread Markus Hoenicka
Mike Rylander mrylan...@gmail.com was heard to say: Markus, Would it be worth the ugliness of a module-global variable to bury the value of the row index used in the previous call to dbd_mysql.c::dbd_goto_row() inside the MySQL driver itself, side-stepping the function signature change

Re: [libdbi-users] libdbi+mysql speed issues

2013-01-08 Thread markus . hoenicka
Markus Hoenicka writes: Hi, I'll have to read the code again a little more thoroughly, but to the best of my knowledge libdbi emulates MySQL's approach to retrieving rows from result sets. In order to walk through the rows of e.g. a PostgreSQL result set you have to retrieve the

[libdbi-users] libdbi+mysql speed issues

2011-07-09 Thread markus . hoenicka
Adam Jacob Muller writes: Hi, I'm developing an application that utilizes rrdtool (and the lidbdi interface into rrdtool) heavily and having some performance issues that seem to center around libdbi, Hi Adam, I can't see any obvious issues with your C code, so I assume the speed

Re: [libdbi-users] libdbi+mysql speed issues

2011-07-09 Thread Adam Jacob Muller
Hi Markus, I definitely can, anecdotal evidence suggests to me that this issue does not occur on postgres (I use rrdtool+postgres similarly and havne't seen the issue), but I'll make some actual tests and report back. -Adam On Jul 9, 2011, at 8:39 AM, markus.hoeni...@mhoenicka.de wrote:

[libdbi-users] libdbi+mysql speed issues

2011-07-05 Thread Adam Jacob Muller
Hi, I'm developing an application that utilizes rrdtool (and the lidbdi interface into rrdtool) heavily and having some performance issues that seem to center around libdbi, # ./dbi dbi_conn_queryf took 0.5866 dbi_result_next_row took 15.4186 looped through 71891 rows # ./mysql MySQL client