Re: [pmacct-discussion] Pmacct data inconsistencies between tables.

2010-02-19 Thread Paolo Lucente
Hi Daniel, I see the 1 minute table contains duplicates - it would be better to say that _everything_ extracted is repeated twice. It could be handy to add tags to the aggregation method and assign a different 'post_tag' to each plugin so to identify who is generating them. I also wonder: how

Re: [pmacct-discussion] Pmacct data inconsistencies between tables.

2010-02-19 Thread Chris Wilson
Hi Paolo and Daniel, (please allow me to jump in as I may be able to help here, despite currently being in country working on a project.) On Fri, 19 Feb 2010, Paolo Lucente wrote: I also wonder: how does the primary key of the 1 min table look like? Is it any different from the 1 hour

Re: [pmacct-discussion] Pmacct data inconsistencies between tables.

2010-02-19 Thread Karl O. Pinc
On 02/19/2010 07:42:08 AM, Chris Wilson wrote: Hi Paolo and Daniel, I deleted the primary key from that table because it should not be necessary (there should not be any duplicates if everything is configured correctly) and it makes inserts extremely slow (by a factor of 10-100) when

Re: [pmacct-discussion] Pmacct data inconsistencies between tables.

2010-02-19 Thread Chris Wilson
Hi Karl, On Fri, 19 Feb 2010, Karl O. Pinc wrote: On 02/19/2010 07:42:08 AM, Chris Wilson wrote: I deleted the primary key from that table because it should not be necessary (there should not be any duplicates if everything is configured correctly) and it makes inserts extremely slow

Re: [pmacct-discussion] Pmacct data inconsistencies between tables.

2010-02-19 Thread Daniel Levy
Thanks, Paolo, for your help. Sorry about the attachments. I have updated the pmacctd.conf file and removed a couple of the plugins to prevent data replication. Regards -- Daniel Levy Aptivate | http://www.aptivate.org/ | +44 (0)1223 760887 The Humanitarian Centre, Fenner's, Gresham Road,

Re: [pmacct-discussion] Pmacct data inconsistencies between tables.

2010-02-19 Thread Karl O. Pinc
On 02/19/2010 10:24:57 AM, Chris Wilson wrote: Hi Karl, On Fri, 19 Feb 2010, Karl O. Pinc wrote: FWIW, the automatic sequential key generation speed is unrelated to table size when using postgresql. There is no sequence to generate as far as I know. The problem is the size of the

Re: [pmacct-discussion] aggregate-filter min packet count and bgp sql table questions

2010-02-19 Thread Paolo Lucente
Hi Brent, On Fri, Feb 19, 2010 at 10:51:21AM -0800, Brent Van Dussen wrote: I was curious if there was a way to have sfacctd only insert into the database if a certain number of packets and/or bytes threshold is reached. It seems you are looking for the sql_preprocess directive - and