Avi, You can make samza publish metrics to a kafka topic using your own serdes -> https://samza.apache.org/learn/documentation/0.9/container/metrics.html From there it should be rather straightforward to consume and put stuff in NR.
Kind regards, Radek Gruchalski ra...@gruchalski.com (mailto:ra...@gruchalski.com) (mailto:ra...@gruchalski.com) de.linkedin.com/in/radgruchalski/ (http://de.linkedin.com/in/radgruchalski/) Confidentiality: This communication is intended for the above-named person and may be confidential and/or legally privileged. If it has come to you in error you must take no action based on it, nor must you copy or show it to anyone; please delete/destroy and inform the sender immediately. On Thursday, 21 January 2016 at 23:02, Avi Flax wrote: > Hello all, > > I’m new to Samza and I’m going to be implementing some stream > processing jobs for a client who is also new to Samza. My client uses > New Relic (NR) for metrics and I’d like to get Samza’s metrics > forwarding over to their NR account if possible. I’m just posting here > to get a quick sanity check from someone on what I have in mind. I > don’t really get YARN yet so I could be just completely off in my > thinking. > > It’s my understanding that YARN will start a JVM for each > SamzaContainer, which is essentially the application which actually > does most of the processing work. I’m thinking therefore that maybe > each SamzaContainer JVM could load the NR Java Agent[1] via the > `-javaagent` argument, then each job/task (not sure) would publish > metrics via JMX which will then be forwarded to NR as specified in a > local YAML file [2]. > > Does that make any sense? Does it seems reasonable? Is there a better way? > > I’d really appreciate any help with this! > > Thanks, > Avi > > [1] > https://docs.newrelic.com/docs/agents/java-agent/getting-started/new-relic-java > > [2] > https://docs.newrelic.com/docs/agents/java-agent/custom-instrumentation/custom-jmx-instrumentation-yaml >
