I don't think storm-benchmark can be run against storm 1.0.1 without code changes. Yes, both computation and communication parts are included. The metrics are collected by storm nimbus including end-to-end throughput and latency. I know nothing more than you on that micro-benchmark. Maybe + <goog_360245919>[email protected] <[email protected]> can help here.
On Mon, Jul 18, 2016 at 9:10 PM Walid Aljoby <[email protected]> wrote: > Hi Manu Zhang, > > Thank you for your prompt replies. > > I am using Apache storm 1.0.1. So I don't whether it is feasible to > change the version of storm inside pom.xml file of storm-benchmark to > 1.0.1. ? > Do the metrics you use include both computation and communication parts? > Do you have an idea about the implementation of the Benchmarks shown here: > Microbenchmarking > Apache Storm 1.0 Performance - Hortonworks > <http://hortonworks.com/blog/microbenchmarking-storm-1-0-performance/> ? > and How is it relative to your own metrics? > > Sorry for all these questions, > > Thank you > -- > Regards > Walid > ------------------------------ > *From:* Manu Zhang <[email protected]> > *To:* Walid Aljoby <[email protected]>; "[email protected]" < > [email protected]>; "[email protected]" <[email protected]> > *Sent:* Monday, July 18, 2016 8:09 PM > *Subject:* Re: Storm Benchmarks > > Hey Walid, > > storm-benchmark only supports storm 0.9.x for now. Which storm version do > you want to run against ? > > Regards, > Manu Zhang > > > On Mon, Jul 18, 2016 at 7:37 PM Walid Aljoby < > [email protected]> > wrote: > > > Thank you. > > You mean that it could not be run with new version of Apache storm? > > Regards > > Walid > > > > From: darion.yaphet <[email protected]> > > To: [email protected]; Walid Aljoby <[email protected]> > > Cc: User <[email protected]> > > Sent: Monday, July 18, 2016 6:35 PM > > Subject: Re:Storm Benchmarks > > > > It seems not found backtype.storm.generated.AlreadyAliveException > > .<br/>Because AlreadyAliveException have move to > org.apache.storm.generated > > At 2016-07-18 18:06:36, "Walid Aljoby" <[email protected]> > > wrote: > > >Hi Everyone, > > >Anyone used to run Storm Benchmarks in this site: > > https://github.com/roshannaik/storm-benchmark-sol ?The compilation was > > successful, but I got into error through run time? > > > > > >.0.1/bin/storm -jar > > ./target/storm-benchmark-0.1.0-jar-with-dependencies.jar -conf > > ./conf/sol.yaml -c topology.workers=2 storm.benchmark.tools.Runner > > storm.benchmark.benchmarks.SOL Running: > > /usr/lib/jvm/java-7-openjdk-amd64/bin/java -client -Ddaemon.name= > > -Dstorm.options=topology.workers%3D2 > > -Dstorm.home=/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1 > > > -Dstorm.log.dir=/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/logs > > -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib > > -Dstorm.conf.file=sol.yaml -cp > > > /home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/log4j-slf4j-impl-2.1.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/log4j-api-2.1.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/kryo-3.0.3.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/reflectasm-1.10.1.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/clojure-1.7.0.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/log4j-over-slf4j-1.6.6.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/log4j-core-2.1.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/disruptor-3.3.2.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/objenesis-2.1.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/servlet-api-2.5.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/storm-core-1.0.1.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/minlog-1.3.0.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/storm-rename-hack-1.0.1.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/slf4j-api-1.7.7.jar:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/lib/asm-5.0.3.jar:./target/storm-benchmark-0.1.0-jar-with-dependencies.jar:/home/jiachen/Desktop/Storm-Performance/storm-benchmark/conf:/home/jiachen/Desktop/Single-Storm/apache-storm-1.0.1/bin > > -Dstorm.jar=./target/storm-benchmark-0.1.0-jar-with-dependencies.jar > > storm.benchmark.tools.Runner storm.benchmark.benchmarks.SOLException in > > thread "main" java.lang.NoClassDefFoundError: > > backtype/storm/generated/AlreadyAliveException at > > java.lang.Class.getDeclaredMethods0(Native Method) at > > java.lang.Class.privateGetDeclaredMethods(Class.java:2625) at > > java.lang.Class.getMethod0(Class.java:2866) at > > java.lang.Class.getMethod(Class.java:1676) at > > sun.launcher.LauncherHelper.getMainMethod(LauncherHelper.java:494) at > > > sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:486)Caused > > by: java.lang.ClassNotFoundException: > > backtype.storm.generated.AlreadyAliveException at > > java.net.URLClassLoader$1.run(URLClassLoader.java:366) at > > java.net.URLClassLoader$1.run(URLClassLoader.java:355) at > > java.security.AccessController.doPrivileged(Native Method) at > > java.net.URLClassLoader.findClass(URLClassLoader.java:354) at > > java.lang.ClassLoader.loadClass(ClassLoader.java:425) at > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at > > java.lang.ClassLoader.loadClass(ClassLoader.java:358) ... 6 more > > > > > >Thank You > > >-- > > >Regards, > > >Walid > > > > > > > > > > > >
