[libdbi-users] libdbi+mysql speed issues

2011-07-09 Thread markus . hoenicka
Adam Jacob Muller writes:
  Hi,
  I'm developing an application that utilizes rrdtool (and the lidbdi 
  interface into rrdtool) heavily and having some performance issues that seem 
  to center around libdbi,
  

Hi Adam,

I can't see any obvious issues with your C code, so I assume the speed
differences really stem from libdbi, one way or another. Unfortunately
I currently lack the time for any deeper analysis, but I'm somewhat
surprised about your results. libdbi has originally been developed as
a wrapper for MySQL and PostgreSQL and should work fairly well with
these database engines (other engines are a *lot* harder to fit). The
only overhead that the mysql driver contains is the column type
analysis and data conversion stuff. Some other engines have to buffer
the data and thus create way more overhead.

Did you have a chance to verify your results with any of the other
database drivers?

regards,
Markus

-- 
Markus Hoenicka
http://www.mhoenicka.de
AQ score 38

--
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security 
threats, fraudulent activity, and more. Splunk takes this data and makes 
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2d-c2
___
libdbi-users mailing list
libdbi-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/libdbi-users


Re: [libdbi-users] libdbi+mysql speed issues

2011-07-09 Thread Adam Jacob Muller
Hi Markus,

I definitely can, anecdotal evidence suggests to me that this issue does not 
occur on postgres (I use rrdtool+postgres similarly and havne't seen the 
issue), but I'll make some actual tests and report back.

-Adam


On Jul 9, 2011, at 8:39 AM, markus.hoeni...@mhoenicka.de wrote:

 Adam Jacob Muller writes:
 Hi,
 I'm developing an application that utilizes rrdtool (and the lidbdi 
 interface into rrdtool) heavily and having some performance issues that seem 
 to center around libdbi,
 
 
 Hi Adam,
 
 I can't see any obvious issues with your C code, so I assume the speed
 differences really stem from libdbi, one way or another. Unfortunately
 I currently lack the time for any deeper analysis, but I'm somewhat
 surprised about your results. libdbi has originally been developed as
 a wrapper for MySQL and PostgreSQL and should work fairly well with
 these database engines (other engines are a *lot* harder to fit). The
 only overhead that the mysql driver contains is the column type
 analysis and data conversion stuff. Some other engines have to buffer
 the data and thus create way more overhead.
 
 Did you have a chance to verify your results with any of the other
 database drivers?
 
 regards,
 Markus
 
 -- 
 Markus Hoenicka
 http://www.mhoenicka.de
 AQ score 38
 
 --
 All of the data generated in your IT infrastructure is seriously valuable.
 Why? It contains a definitive record of application performance, security 
 threats, fraudulent activity, and more. Splunk takes this data and makes 
 sense of it. IT sense. And common sense.
 http://p.sf.net/sfu/splunk-d2d-c2
 ___
 libdbi-users mailing list
 libdbi-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/libdbi-users


--
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security 
threats, fraudulent activity, and more. Splunk takes this data and makes 
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2d-c2
___
libdbi-users mailing list
libdbi-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/libdbi-users