I see in the Samza metrics documentation that there are two basic ways to get metrics from Samza to a metrics repository: 1) write a custom MetricsReporter to push the metrics directly, perhaps using an ExecutorService or similar to perform batching, or 2) consume the metrics Kafka queue and push them from there, letting the built-in MetricsSnapshotReporter do the batching.
Can anyone running Samza in production provide any insight into which of these to prefer? I'm looking to get my metrics out to Prometheus, probably via a Pushgateway endpoint. I see the pending SAMZA-340 patch to add Graphite support using approach #1. I like going directly from the monitored container to the monitoring system (fewer moving parts than going via Kafka in method #2), but I'd rather not re-implement the batching and other logic in the existing SnapshotMetricsReporter. Thanks.
