Re: [pmacct-discussion] Flexible aggregation

2009-06-14 Thread Paolo Lucente
Hi Karl, On Sat, Jun 13, 2009 at 04:30:07PM -0500, Karl O. Pinc wrote: A good database should not have problems with simultaneous updates, or is there another reason why synchronization is an issue? No, not really - expecially when it's down to an INSERTs-only scenario. Just an effort to help

Re: [pmacct-discussion] Flexible aggregation

2009-06-14 Thread Chris Wilson
Hi Paolo and Karl, On Sat, 13 Jun 2009, Paolo Lucente wrote: On Sat, Jun 13, 2009 at 03:07:01PM -0500, Karl O. Pinc wrote: We are only interested in a single table. Why can't two separate sql plugins write to the same table? What Karl is proposing here might really result in a

Re: [pmacct-discussion] Flexible aggregation

2009-06-14 Thread Paolo Lucente
Hi Chris, On Sun, Jun 14, 2009 at 02:25:10PM +0300, Chris Wilson wrote: I don't think it can. For example, how would we write the configuration? Let's say we just want to zero (not aggregate on) the destination IP for flows less than 1000 bytes. We could try: plugins: mysql[with_dst],

Re: [pmacct-discussion] Flexible aggregation

2009-06-13 Thread Chris Wilson
Hi Paolo, On Sat, 13 Jun 2009, Paolo Lucente wrote: Good pointer. From a brief scan of the Aguri homepage, please feel free to correct whether i'm wrong, i see many similarities between pmacct and Aguri. I guess so; I was thinking that Aguri seems to store its output in text files rather

Re: [pmacct-discussion] Flexible aggregation

2009-06-13 Thread Chris Wilson
Hi Paolo, On Sat, 13 Jun 2009, Paolo Lucente wrote: minb = 1, zero_dstip, minb = 1, zero_dstport, minb = 1, zero_srcport, minb = 1, zero_srcip Then any flows which together do not add up to enough bytes to pass the minb filters, even after aggregation, end up in a

Re: [pmacct-discussion] Flexible aggregation

2009-06-13 Thread Karl O. Pinc
On 06/13/2009 05:11:40 AM, Paolo Lucente wrote: Hi Chris, Aguri is slightly more limited in the fact it has only a set of (4?) traffic aggregation profiles whereas pmacct offers a wider range of primitives. But I guess the point you wanted to make was the dynamic variation of the sampling

Re: [pmacct-discussion] Flexible aggregation

2009-06-13 Thread Paolo Lucente
Hi Karl, On Sat, Jun 13, 2009 at 03:03:04PM -0500, Karl O. Pinc wrote: What really is the constrained resource here? Is it the number of transactions the database supports or is it something more fundamental to the pmacct performance like cpu or memory constraints? What I'm thinking is

Re: [pmacct-discussion] Flexible aggregation

2009-06-13 Thread Karl O. Pinc
On 06/13/2009 03:49:07 PM, Paolo Lucente wrote: Hi Chris, On Sat, Jun 13, 2009 at 03:07:01PM -0500, Karl O. Pinc wrote: We are only interested in a single table. Why can't two separate sql plugins write to the same table? What Karl is proposing here might really result in a simpler

[pmacct-discussion] Flexible aggregation

2009-06-12 Thread Chris Wilson
Hi all, Has anyone heard of Aguri? Aguri is an aggregation-based traffic profiler targeted for near real-time, long-term, and wide-area traffic monitoring. Aguri adapts itself to spatial traffic distribution by aggregating small volume flows into aggregates, and achieves temporal aggregation