Thanks Bikas. I tried the following command but I get this exception... I am
sure the zip file is there..
xiaoyzhu@headnode0:~/tez$ hadoop jar
tez-dist/target/tez-0.8.1-SNAPSHOT/tez-job-analyzer-0.8.1-SNAPSHOT.jar
CriticalPath --dagId=dag_1441104825528_0013_1
--atsFileName=./dag_1441104825528_0013_1/dag_1441104825528_0013_1.zip
--outputDir=/tmp
java.lang.NoClassDefFoundError: org/apache/tez/history/parser/datamodel/DagInfo
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2615)
at java.lang.Class.getMethod0(Class.java:2856)
at java.lang.Class.getMethod(Class.java:1668)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.<init>(ProgramDriver.java:59)
at org.apache.hadoop.util.ProgramDriver.addClass(ProgramDriver.java:103)
at
org.apache.tez.analyzer.plugins.AnalyzerDriver.main(AnalyzerDriver.java:29)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.ClassNotFoundException:
org.apache.tez.history.parser.datamodel.DagInfo
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 13 more
Xiaoyong
From: Bikas Saha [mailto:[email protected]]
Sent: Thursday, September 3, 2015 7:28 AM
To: [email protected]
Subject: RE: how to run tez-tools?
Thanks for trying. The only tool that can currently be run from the cmd line is
the CriticalPath tool. Example command line is
hadoop jar
tez/tez-dist/target/tez-0.8.1-SNAPSHOT/tez-job-analyzer-0.8.1-SNAPSHOT.jar
CriticalPath --dagId=dag_1439860407967_0080_1
--atsFileName=tmp/test/dag_1439860407967_0080_1.zip --outputDir=tmp/
The ATS zip directory can be obtained by running the following example
hadoop jar ./tez/dist/tez/tez-history-parser-0.8.1-SNAPSHOT.jar
org.apache.tez.history.ATSImportTool -dagId dag_1439860407967_0080_1
--downloadDir tmp/
As more tools get added to the command line, they would replace CriticalPath in
the first command line with their own tool name.
These tools are still work in progress. So we appreciate your feedback as you
try them out. Patches for fixes (in usability/bugs/features) are welcome :)
Bikas
From: Xiaoyong Zhu [mailto:[email protected]]
Sent: Wednesday, September 02, 2015 6:27 AM
To: [email protected]<mailto:[email protected]>
Subject: how to run tez-tools?
I found the job analyzer in tez-tools is quite interesting and want to give it
a try. What's the correct way to use them?
I tried
java -cp
./tez-tools/analyzers/job-analyzer/target/tez-job-analyzer-0.8.1-SNAPSHOT.jar
org.apache.tez.analyzer.plugins.AnalyzerDriver
but it throws the exception
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/hadoop/util/ProgramDriver
at
org.apache.tez.analyzer.plugins.AnalyzerDriver.main(AnalyzerDriver.java:27)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.util.ProgramDriver
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 1 more
I guess I missed something but not sure where to find the correct ways.... Will
appreciate if someone could offer help, thanks!
Xiaoyong
