Re: [pmacct-discussion] Centralizing data from multiple nfacct collectors

[Alex]

I have a running setup with remote sites having pmacct + mysql which aggregates 
the data nightly and pushes them to a central hub as json files.

Alex

On January 5, 2017 5:42:45 PM GMT+02:00, Yann Belin  
wrote:
>Thanks all! I spent a couple of hours trough RabbitMQ docs/specs and it
>seems to be exactly what I need.
>
>On Thu, Jan 5, 2017 at 3:15 PM Karl O. Pinc  wrote:
>
>On Thu, 5 Jan 2017 10:57:01 +0100
>Yann Belin  wrote:
>
>> Not strictly a pmacct/nfacct question, but I was wondering if anyone
>> ever built a similar setup.
>
>Not strictly a pmacct/nfacct response, but thought I'd comment
>anyway.  ;-)
>
>> A central side would then gather
>> data from the different locations, and store the that data in a DBMS
>> (currently thinking of MySQL, but I'm not married to it).
>
>If you're already using MySQL it probably makes sense to continue
>to use it.  Otherwise my preference for a db is PostgreSQL.
>
>Regards,
>
>Karl 
>Free Software:  "You don't pay back, you pay forward."
> -- Robert A. Heinlein

-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity.___
pmacct-discussion mailing list
http://www.pmacct.net/#mailinglists

Re: [pmacct-discussion] Centralizing data from multiple nfacct collectors

[Karl O. Pinc]

On Thu, 5 Jan 2017 10:57:01 +0100
Yann Belin  wrote:

> Not strictly a pmacct/nfacct question, but I was wondering if anyone
> ever built a similar setup.

Not strictly a pmacct/nfacct response, but thought I'd comment
anyway.  ;-)

> A central side would then gather
> data from the different locations, and store the that data in a DBMS
> (currently thinking of MySQL, but I'm not married to it).

If you're already using MySQL it probably makes sense to continue
to use it.  Otherwise my preference for a db is PostgreSQL.

Regards,

Karl 
Free Software:  "You don't pay back, you pay forward."
 -- Robert A. Heinlein

___
pmacct-discussion mailing list
http://www.pmacct.net/#mailinglists

Re: [pmacct-discussion] Centralizing data from multiple nfacct collectors

[Paolo Lucente]

+1 on this.

On Thu, Jan 05, 2017 at 10:10:40AM +, Charlie Smurthwaite wrote:
> On 05/01/17 09:57, Yann Belin wrote:
> >the collectors have to store
> >(temporarily) their data locally. A central side would then gather
> >data from the different locations, and store the that data in a DBMS
> >(currently thinking of MySQL, but I'm not married to it).
> 
> Have you considered using a message queue. pmacct supports RabbitMQ, and
> I find this to be an extremely effective way to queue up data to be
> processed later.
> 
> Charlie
> 
> 
> 
> 
> Charlie Smurthwaite
> Technical Director
> 
> tel.  email. charlie@atech.media web. 
> https://atech.media
> 
> This e-mail has been sent by aTech Media Limited (or one of its assoicated 
> group companys, Dial 9 Communications Limited or Viaduct Hosting Limited). 
> Its contents are confidential therefore if you have received this message in 
> error, we would appreciate it if you could let us know and delete the 
> message. aTech Media Limited is a UK limited company, registration number 
> 5523199. Dial 9 Communications Limited is a UK limited company, registration 
> number 7740921. Viaduct Hosting Limited is a UK limited company, registration 
> number 8514362. All companies are registered at Unit 9 Winchester Place, 
> North Street, Poole, Dorset, BH15 1NX.
> 
> ___
> pmacct-discussion mailing list
> http://www.pmacct.net/#mailinglists

___
pmacct-discussion mailing list
http://www.pmacct.net/#mailinglists

Re: [pmacct-discussion] Centralizing data from multiple nfacct collectors

[Charlie Smurthwaite]

On 05/01/17 09:57, Yann Belin wrote:

the collectors have to store
(temporarily) their data locally. A central side would then gather
data from the different locations, and store the that data in a DBMS
(currently thinking of MySQL, but I'm not married to it).


Have you considered using a message queue. pmacct supports RabbitMQ, and
I find this to be an extremely effective way to queue up data to be
processed later.

Charlie




Charlie Smurthwaite
Technical Director

tel.  email. charlie@atech.media web. 
https://atech.media

This e-mail has been sent by aTech Media Limited (or one of its assoicated 
group companys, Dial 9 Communications Limited or Viaduct Hosting Limited). Its 
contents are confidential therefore if you have received this message in error, 
we would appreciate it if you could let us know and delete the message. aTech 
Media Limited is a UK limited company, registration number 5523199. Dial 9 
Communications Limited is a UK limited company, registration number 7740921. 
Viaduct Hosting Limited is a UK limited company, registration number 8514362. 
All companies are registered at Unit 9 Winchester Place, North Street, Poole, 
Dorset, BH15 1NX.

___
pmacct-discussion mailing list
http://www.pmacct.net/#mailinglists