Re: [libdbi-users] libdbi+mysql speed issues

2011-07-09 Thread Adam Jacob Muller
Hi Markus,

I definitely can, anecdotal evidence suggests to me that this issue does not 
occur on postgres (I use rrdtool+postgres similarly and havne't seen the 
issue), but I'll make some actual tests and report back.

-Adam


On Jul 9, 2011, at 8:39 AM, markus.hoeni...@mhoenicka.de wrote:

> Adam Jacob Muller writes:
>> Hi,
>> I'm developing an application that utilizes rrdtool (and the lidbdi 
>> interface into rrdtool) heavily and having some performance issues that seem 
>> to center around libdbi,
>> 
> 
> Hi Adam,
> 
> I can't see any obvious issues with your C code, so I assume the speed
> differences really stem from libdbi, one way or another. Unfortunately
> I currently lack the time for any deeper analysis, but I'm somewhat
> surprised about your results. libdbi has originally been developed as
> a wrapper for MySQL and PostgreSQL and should work fairly well with
> these database engines (other engines are a *lot* harder to fit). The
> only overhead that the mysql driver contains is the column type
> analysis and data conversion stuff. Some other engines have to buffer
> the data and thus create way more overhead.
> 
> Did you have a chance to verify your results with any of the other
> database drivers?
> 
> regards,
> Markus
> 
> -- 
> Markus Hoenicka
> http://www.mhoenicka.de
> AQ score 38
> 
> --
> All of the data generated in your IT infrastructure is seriously valuable.
> Why? It contains a definitive record of application performance, security 
> threats, fraudulent activity, and more. Splunk takes this data and makes 
> sense of it. IT sense. And common sense.
> http://p.sf.net/sfu/splunk-d2d-c2
> ___
> libdbi-users mailing list
> libdbi-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/libdbi-users


--
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security 
threats, fraudulent activity, and more. Splunk takes this data and makes 
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2d-c2
___
libdbi-users mailing list
libdbi-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/libdbi-users


[libdbi-users] libdbi+mysql speed issues

2011-07-09 Thread markus . hoenicka
Adam Jacob Muller writes:
 > Hi,
 > I'm developing an application that utilizes rrdtool (and the lidbdi 
 > interface into rrdtool) heavily and having some performance issues that seem 
 > to center around libdbi,
 > 

Hi Adam,

I can't see any obvious issues with your C code, so I assume the speed
differences really stem from libdbi, one way or another. Unfortunately
I currently lack the time for any deeper analysis, but I'm somewhat
surprised about your results. libdbi has originally been developed as
a wrapper for MySQL and PostgreSQL and should work fairly well with
these database engines (other engines are a *lot* harder to fit). The
only overhead that the mysql driver contains is the column type
analysis and data conversion stuff. Some other engines have to buffer
the data and thus create way more overhead.

Did you have a chance to verify your results with any of the other
database drivers?

regards,
Markus

-- 
Markus Hoenicka
http://www.mhoenicka.de
AQ score 38

--
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record of application performance, security 
threats, fraudulent activity, and more. Splunk takes this data and makes 
sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-d2d-c2
___
libdbi-users mailing list
libdbi-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/libdbi-users