GitHub user hpvd edited a discussion: Monitor/Analyse Pulsar without external instrumentation (eBPF)
For Kafka there are some tools which make monitoring and analyzing without external instrumentation and without code modification possible. They all leverage the possibilities of the extended Berkley Paket Filter (eBPF) which collects data directly in the kernel. Some tools and demonstrations what's possible: - https://docs.px.dev/tutorials/pixie-101/kafka-monitoring/ - https://www.groundcover.com/blog/monitoring-kafka-metrics - https://pt.slideshare.net/HostedbyConfluent/monitoring-kafka-without-instrumentation-using-ebpf-with-antn-rodrguez-kafka-summit-london-2022 It's the same technology uses by Cilium to secure e.g. Kafka see: https://github.com/apache/pulsar/discussions/20650 It would be fantastic to make these things possible for Pulsar too (from dev ad operation perspective) and it would rise Pulsar to a new dimension of enterprise grade. The question is: how could we make it possible to access these world of eBPF? Are there already any efforts? GitHub link: https://github.com/apache/pulsar/discussions/20653 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
