Ok. I will try that. Thanks, Vaibhav Garg +91-9505020924 vaibhavgar...@gmail.com LinkedIn <https://www.linkedin.com/in/vaibhavgarg90/>
On Sun, Mar 1, 2020 at 12:31 PM Jagadish Venkatraman <jagadish1...@gmail.com> wrote: > Hi Vaibhav, > > Can you try ./__package/newrelic/newrelic.jar? > > If that doesn't work, I'd recommend doing the following: > 1. Print the current working directory of your Samza container JVM > 2. Use (1) to determine a relative reference to the directory path within > your package > > Cheers > Jagadish > > On Saturday, February 29, 2020, Vaibhav Garg <vaibhavgar...@gmail.com> > wrote: > > > I would be really grateful if someone could help me with this. > > > > Thanks, > > Vaibhav Garg > > +91-9505020924 > > vaibhavgar...@gmail.com > > LinkedIn <https://www.linkedin.com/in/vaibhavgarg90/> > > > > > > On Sat, Feb 29, 2020 at 9:02 PM Vaibhav Garg <vaibhavgar...@gmail.com> > > wrote: > > > > > Please do let me know if some other clarification is needed. > > > > > > Thanks, > > > Vaibhav Garg > > > +91-9505020924 > > > vaibhavgar...@gmail.com > > > LinkedIn <https://www.linkedin.com/in/vaibhavgarg90/> > > > > > > > > > On Sat, Feb 29, 2020 at 10:31 AM Vaibhav Garg <vaibhavgar...@gmail.com > > > > > wrote: > > > > > >> OK. Here is what I have inside my configuration in order to start > > >> NewRelic at the time of the container start: > > >> > > >> task.opts=-Xmx2048m -XX:+UseConcMarkSweepGC > > >> *-javaagent:/usr/home/vaibhav/newrelic/newrelic.jar* > > >> > > >> Now, I have specified the absolute path of the NewRelic jar. There > are 2 > > >> challenges that I see with this approach: > > >> > > >> 1. The NewRelic jar and config would have to be present on all the > Yarn > > >> slave nodes since that container can start at any of the Yarn nodes. > > >> 2. A single Yarn cluster can be used to run multiple Samza > applications, > > >> so I would have to keep configuration for each application at each of > > the > > >> Yarn slave nodes. > > >> > > >> In order to fix this, I am bundling NewRelic inside my tar file: > > >> > > >> // download new relic dependencies > > >> task downloadNewrelic(type: Download) { > > >> mkdir "newrelic" > > >> src " > > >> https://download.newrelic.com/newrelic/java-agent/newrelic- > > agent/current/newrelic-java.zip > > >> " > > >> dest file("newrelic") > > >> } > > >> > > >> task buildTar(dependsOn: [build, downloadNewrelic], type: Tar) { > > >> // unzip new relic dependencies and add to the archive > > >> into(".") { > > >> from zipTree(file("newrelic/newrelic-java.zip")) > > >> } > > >> } > > >> > > >> With this build configuration, I have an additional *newrelic* > directory > > >> inside my archive. Here is the directory structure: > > >> my-job-name.tar.gz > > >> bin > > >> config > > >> lib > > >> newrelic > > >> newrelic.jar > > >> newrelic.yml > > >> ... > > >> > > >> What I would like to achieve is to: > > >> - Remove hardcoding the *javaagent* inside *task.opts* in the > container > > >> config. > > >> - Specify the path of NewRelic agent in *task.opts* relative to where > > >> the container files are present on the Yarn slave node. > > >> > > >> I hope I was clearer this time. Please let me know if any other > > >> clarification is needed. > > >> > > >> Thanks, > > >> Vaibhav Garg > > >> +91-9505020924 > > >> vaibhavgar...@gmail.com > > >> LinkedIn <https://www.linkedin.com/in/vaibhavgarg90/> > > >> > > >> > > >> On Sat, Feb 29, 2020 at 5:22 AM Yi Pan <nickpa...@gmail.com> wrote: > > >> > > >>> Hi, Vaibhav, > > >>> > > >>> Not quite sure whether I understand your ask. How do you package and > > >>> distribute NewRelic jar in the YARN cluster? It would be much helpful > > if > > >>> you can share your job configure that worked and the places that you > > >>> would > > >>> like to change. > > >>> > > >>> Best, > > >>> > > >>> -Yi > > >>> > > >>> On Fri, Feb 28, 2020 at 11:55 AM Vaibhav Garg < > vaibhavgar...@gmail.com > > > > > >>> wrote: > > >>> > > >>> > OK. I have been able to use NewRelic by specifying -javaagent > option > > in > > >>> > task.opts. > > >>> > > > >>> > However, I had to give the absolute path to the NewRelic jar file > in > > >>> order > > >>> > to make it work. > > >>> > > > >>> > How can I give a path that is relative to the container since I > would > > >>> like > > >>> > to integrate NewRelic dependencies along with other container > files? > > >>> > > > >>> > Thanks, > > >>> > Vaibhav Garg > > >>> > +91-9505020924 > > >>> > vaibhavgar...@gmail.com > > >>> > LinkedIn <https://www.linkedin.com/in/vaibhavgarg90/> > > >>> > > > >>> > > > >>> > On Sat, Feb 29, 2020 at 12:41 AM Vaibhav Garg < > > vaibhavgar...@gmail.com > > >>> > > > >>> > wrote: > > >>> > > > >>> > > Yes. That's exactly what I am looking for. > > >>> > > > > >>> > > Let me try it out and I will get back to you if I face any > issues. > > >>> > > > > >>> > > Thanks again > > >>> > > > > >>> > > Vaibhav Garg > > >>> > > +91-9505020924 > > >>> > > vaibhavgar...@gmail.com > > >>> > > LinkedIn <https://www.linkedin.com/in/vaibhavgarg90/> > > >>> > > > > >>> > > > > >>> > > On Fri, Feb 28, 2020 at 1:23 PM Yi Pan <nickpa...@gmail.com> > > wrote: > > >>> > > > > >>> > >> Hi, Vaibhav, > > >>> > >> > > >>> > >> Check the description of task.opts in the configuration doc > here: > > >>> > >> > > >>> > >> > > >>> > > > >>> http://samza.apache.org/learn/documentation/latest/jobs/ > > samza-configurations.html > > >>> > >> > > >>> > >> Is this what you are looking for? > > >>> > >> > > >>> > >> On Thu, Feb 27, 2020 at 9:54 PM Vaibhav Garg < > > >>> vaibhavgar...@gmail.com> > > >>> > >> wrote: > > >>> > >> > > >>> > >> > Hi, > > >>> > >> > > > >>> > >> > Any help here would be great. > > >>> > >> > > > >>> > >> > Thanks, > > >>> > >> > Vaibhav Garg > > >>> > >> > +91-9505020924 > > >>> > >> > vaibhavgar...@gmail.com > > >>> > >> > LinkedIn <https://www.linkedin.com/in/vaibhavgarg90/> > > >>> > >> > > > >>> > >> > > > >>> > >> > On Thu, Feb 27, 2020 at 10:20 AM Vaibhav Garg < > > >>> > vaibhavgar...@gmail.com> > > >>> > >> > wrote: > > >>> > >> > > > >>> > >> > > Dear Bharath, > > >>> > >> > > > > >>> > >> > > Thanks for your reply. I now realize that I put a very > > ambiguous > > >>> > >> question > > >>> > >> > > to the community. Here is another attempt: > > >>> > >> > > > > >>> > >> > > I have set up a Yarn cluster that is configured to run > > >>> containers of > > >>> > >> > > multiple Samza jobs. > > >>> > >> > > > > >>> > >> > > I would like to treat all the containers of the job as a > > single > > >>> > >> > > application in New Relic (as expected). > > >>> > >> > > > > >>> > >> > > Since the containers of the application can be killed on one > > >>> Yarn > > >>> > node > > >>> > >> > and > > >>> > >> > > can start on another Yarn node, I would have to specify New > > >>> Relic > > >>> > >> > > environment settings at the container start. > > >>> > >> > > > > >>> > >> > > Now, I am not sure how to specify java agent (to include New > > >>> Relic > > >>> > >> java > > >>> > >> > > agent) and pass additional arguments such as New Relic > > >>> environment > > >>> > >> every > > >>> > >> > > time the container starts. > > >>> > >> > > > > >>> > >> > > Please let me know if my understanding is wrong or some > other > > >>> > >> > > clarification is needed. > > >>> > >> > > > > >>> > >> > > Thanks in advance, > > >>> > >> > > Vaibhav Garg > > >>> > >> > > +91-9505020924 > > >>> > >> > > vaibhavgar...@gmail.com > > >>> > >> > > LinkedIn <https://www.linkedin.com/in/vaibhavgarg90/> > > >>> > >> > > > > >>> > >> > > > > >>> > >> > > On Thu, Feb 27, 2020 at 8:25 AM Bharath Kumara Subramanian < > > >>> > >> > > codin.mart...@gmail.com> wrote: > > >>> > >> > > > > >>> > >> > >> Hi, > > >>> > >> > >> > > >>> > >> > >> I am not sure I fully understand the ask. > > >>> > >> > >> > > >>> > >> > >> IIUC, Samza doesn't have native integration with New relic. > > >>> > However, > > >>> > >> you > > >>> > >> > >> should still be able to integrate your application with New > > >>> relic > > >>> > on > > >>> > >> > your > > >>> > >> > >> end without native support. > > >>> > >> > >> If you are particularly looking to integrate native Samza > > >>> metrics > > >>> > w/ > > >>> > >> New > > >>> > >> > >> relic, you might need to implement your own custom metrics > > >>> > reporter. > > >>> > >> You > > >>> > >> > >> can find more details here > > >>> > >> > >> < > > >>> > >> > >> > > >>> > >> > > > >>> > >> > > >>> > > > >>> https://samza.apache.org/learn/documentation/latest/ > > operations/monitoring.html#customreporter > > >>> > >> > >> > > > >>> > >> > >> > > >>> > >> > >> Thanks, > > >>> > >> > >> Bharath > > >>> > >> > >> > > >>> > >> > >> On Wed, Feb 26, 2020 at 3:15 AM Vaibhav Garg < > > >>> > >> vaibhavgar...@gmail.com> > > >>> > >> > >> wrote: > > >>> > >> > >> > > >>> > >> > >> > Hi, > > >>> > >> > >> > > > >>> > >> > >> > I want to integrate New Relic in my Samza jobs. Can > anyone > > >>> help > > >>> > >> with > > >>> > >> > >> this, > > >>> > >> > >> > please? > > >>> > >> > >> > > > >>> > >> > >> > Thanks, > > >>> > >> > >> > Vaibhav Garg > > >>> > >> > >> > +91-9505020924 > > >>> > >> > >> > vaibhavgar...@gmail.com > > >>> > >> > >> > LinkedIn <https://www.linkedin.com/in/vaibhavgarg90/> > > >>> > >> > >> > > > >>> > >> > >> > > >>> > >> > > > > >>> > >> > > > >>> > >> > > >>> > > > > >>> > > > >>> > > >> > > > > > -- > Jagadish >
