Re: Tail Module + DBI Module, can't keep up!

2011-09-15 Thread Clive Eisen
On 15/09/2011 14:43, Brandon Phelps wrote: Has anyone ever dealt with an issue like this and have any idea how I might rework the script and/or application to avoid this delay, which will obviously get worse and worse as time goes on? IMHO it's much more likely to be mysqld itself get

Re: Tail Module + DBI Module, can't keep up!

2011-09-15 Thread ericbambach1
Brandon, This is probably more of a DB issue than DBI. I would google for general DB tuning strategies for mysql and high insert scenarios. I bet your unit of work is too small and you DB can't keep up with the inserts. Can you switch to using transactions an only commit every N lines

RE: Tail Module + DBI Module, can't keep up!

2011-09-15 Thread Roode, Eric
On September 15, 2011 9:44 AM, Brandon Phelps wrote: Hello! [...] My problem here is that the logs are coming in extremely fast and while the script does work, it progressively gets further and further behind. It's currently Sep 15, 10AM yet the script is still dealing with lines from Sep