For that sort of volume I’d investigate using and ELK stack on the backend and de-coupling pmacct from storage and analysis with a message queue like Rabbit. I’ve used this approach (not to that scale though) and it works well.
ELK == ElasticSearch Logstash Kibana > > > On 08/04/2016 11:48 AM, David McKen wrote: >> For that type of scale maybe a SQL like NoSQL db like cassandra may work >> better for you. >> >> On Thu, Aug 4, 2016 at 11:01 AM, Stephen Clark <sclar...@earthlink.net >> <mailto:sclar...@earthlink.net>> wrote: >> Hi List, >> >> I am looking to collect a large number of netflow records, on the order of a >> 100 million a day, >> and store them in a postgres DB. Has anyone done this or something similar >> using pmacct? >> >> Thanks, >> Steve >> >> >> _______________________________________________ >> pmacct-discussion mailing list >> http://www.pmacct.net/#mailinglists <http://www.pmacct.net/#mailinglists> >> >
Description: Message signed with OpenPGP using GPGMail
_______________________________________________ pmacct-discussion mailing list http://www.pmacct.net/#mailinglists