Depending on what you are tapping and your architecture, you may be able to accomplish this upstream. Do you have a network packet broker?
Jon On Wed, Mar 7, 2018, 11:34 Vladimir Shlyakhtin < vladimir.shlyakh...@sstech.us> wrote: > Hello, > > > What is good practice to capture data from multiple sources to avoid > duplication of packets. > I mean if we have multiple network points (e.g. routers) and capture data > from every of these points how to avoid duplication of packets. > According to Metron' PCAP docs PCAP topology just stores data from Kafka > topic to HDFS. > Is it possible to detects and skip duplicates, stitch packets and do other > processing? > Or the best way to do it in the beginning (send only unique packets) to > Kafka or in post-processing. > > Thank you > > Regards, > - Vladimir > -- Jon
