Depending on what you are tapping and your architecture, you may be able to
accomplish this upstream. Do you have a network packet broker?
On Wed, Mar 7, 2018, 11:34 Vladimir Shlyakhtin <
> What is good practice to capture data from multiple sources to avoid
> duplication of packets.
> I mean if we have multiple network points (e.g. routers) and capture data
> from every of these points how to avoid duplication of packets.
> According to Metron' PCAP docs PCAP topology just stores data from Kafka
> topic to HDFS.
> Is it possible to detects and skip duplicates, stitch packets and do other
> Or the best way to do it in the beginning (send only unique packets) to
> Kafka or in post-processing.
> Thank you
> - Vladimir