To use pherf-cluster.py script make sure $HBASE_DIR/bin/hbase file is available which is used to construct classpath. Also add the following line to script before java_cmd is executed to make sure *hbasecp* variable contains phoenix jar: print "Classpath used to launch pherf: " + hbasecp
Also try running pherf-standalone.py which does not need any variable to be set and uses fat phoenix-client.jar with all dependencies bundled. - mujtaba On Thu, Jul 28, 2016 at 10:14 AM, Nathan Davis <[email protected]> wrote: > Hi All, > I'm trying to run pherf-cluster.py against an EMR cluster (on the master > server). The command I'm using is `HBASE_DIR=/usr/lib/hbase > ./pherf-cluster.py -drop all -l -q -z localhost -schemaFile > ./config/datamodel/user_defined_schema.sql -scenarioFile > ./config/scenario/user_defined_scenario.xml`. I get error > "java.lang.NoClassDefFoundError: > org/apache/phoenix/schema/TableNotFoundException". Below is part of my > terminal session that shows the applicable directories and the failed pherf > command. > > [ec2-user@ip-10-2-* bin]$ pwd >> /usr/lib/phoenix/bin >> > > >> [ec2-user@ip-10-2-* bin]$ ls -l /usr/lib/phoenix/ >> total 221104 >> drwxr-xr-x 3 root root 4096 Jul 28 16:54 bin >> -rw-r--r-- 1 root root 98170649 Jul 8 03:18 >> phoenix-4.7.0-HBase-1.2-client.jar >> -rw-r--r-- 1 root root 4898513 Jul 8 03:18 >> phoenix-4.7.0-HBase-1.2-client-minimal.jar >> -rw-r--r-- 1 root root 46138953 Jul 8 03:18 >> phoenix-4.7.0-HBase-1.2-client-spark.jar >> -rw-r--r-- 1 root root 31312803 Jul 8 03:18 >> phoenix-4.7.0-HBase-1.2-client-without-hbase.jar >> -rw-r--r-- 1 root root 25644258 Jul 8 03:18 >> phoenix-4.7.0-HBase-1.2-server.jar >> -rw-r--r-- 1 root root 6044 Jul 8 03:18 >> phoenix-4.7.0-HBase-1.2-tests.jar >> -rw-r--r-- 1 root root 4152940 Jul 8 03:18 >> phoenix-4.7.0-HBase-1.2-thin-client.jar >> -rw-r--r-- 1 root root 2884 Jul 8 03:18 >> phoenix-assembly-4.7.0-HBase-1.2-tests.jar >> lrwxrwxrwx 1 root root 34 Jul 22 17:32 phoenix-client.jar -> >> phoenix-4.7.0-HBase-1.2-client.jar >> -rw-r--r-- 1 root root 3631295 Jul 8 03:18 >> phoenix-core-4.7.0-HBase-1.2.jar >> -rw-r--r-- 1 root root 1674792 Jul 8 03:18 >> phoenix-core-4.7.0-HBase-1.2-tests.jar >> -rw-r--r-- 1 root root 35501 Jul 8 03:18 >> phoenix-flume-4.7.0-HBase-1.2.jar >> -rw-r--r-- 1 root root 23736 Jul 8 03:18 >> phoenix-flume-4.7.0-HBase-1.2-tests.jar >> -rw-r--r-- 1 root root 159771 Jul 8 03:18 >> phoenix-pherf-4.7.0-HBase-1.2.jar >> -rw-r--r-- 1 root root 4479303 Jul 8 03:18 >> phoenix-pherf-4.7.0-HBase-1.2-minimal.jar >> -rw-r--r-- 1 root root 58160 Jul 8 03:18 >> phoenix-pherf-4.7.0-HBase-1.2-tests.jar >> -rw-r--r-- 1 root root 42216 Jul 8 03:18 >> phoenix-pig-4.7.0-HBase-1.2.jar >> -rw-r--r-- 1 root root 43578 Jul 8 03:18 >> phoenix-pig-4.7.0-HBase-1.2-tests.jar >> -rw-r--r-- 1 root root 18810 Jul 8 03:18 >> phoenix-server-4.7.0-HBase-1.2.jar >> -rw-r--r-- 1 root root 3357692 Jul 8 03:18 >> phoenix-server-4.7.0-HBase-1.2-runnable.jar >> -rw-r--r-- 1 root root 20170 Jul 8 03:18 >> phoenix-server-4.7.0-HBase-1.2-tests.jar >> -rw-r--r-- 1 root root 10451 Jul 8 03:18 >> phoenix-server-client-4.7.0-HBase-1.2.jar >> -rw-r--r-- 1 root root 7139 Jul 8 03:18 >> phoenix-server-client-4.7.0-HBase-1.2-tests.jar >> lrwxrwxrwx 1 root root 34 Jul 22 17:32 phoenix-server.jar -> >> phoenix-4.7.0-HBase-1.2-server.jar >> -rw-r--r-- 1 root root 77327 Jul 8 03:18 >> phoenix-spark-4.7.0-HBase-1.2.jar >> -rw-r--r-- 1 root root 91730 Jul 8 03:18 >> phoenix-spark-4.7.0-HBase-1.2-tests.jar >> lrwxrwxrwx 1 root root 39 Jul 22 17:32 phoenix-thin-client.jar -> >> phoenix-4.7.0-HBase-1.2-thin-client.jar >> -rw-r--r-- 1 root root 16329 Jul 8 03:18 >> phoenix-tracing-webapp-4.7.0-HBase-1.2.jar >> -rw-r--r-- 1 root root 2284964 Jul 8 03:18 >> phoenix-tracing-webapp-4.7.0-HBase-1.2-runnable.jar >> -rw-r--r-- 1 root root 8065 Jul 8 03:18 >> phoenix-tracing-webapp-4.7.0-HBase-1.2-tests.jar >> > > >> [ec2-user@ip-10-2-1-118 bin]$ ls -l /usr/lib/hbase/ >> total 152732 >> drwxr-xr-x 4 root root 4096 Jul 22 17:32 bin >> lrwxrwxrwx 1 root root 15 Jul 22 17:32 conf -> /etc/hbase/conf >> -rw-r--r-- 1 root root 20861 Jul 8 02:17 hbase-annotations-1.2.1.jar >> -rw-r--r-- 1 root root 14224 Jul 8 02:17 >> hbase-annotations-1.2.1-tests.jar >> lrwxrwxrwx 1 root root 27 Jul 22 17:32 hbase-annotations.jar -> >> hbase-annotations-1.2.1.jar >> -rw-r--r-- 1 root root 1297581 Jul 8 02:17 hbase-client-1.2.1.jar >> lrwxrwxrwx 1 root root 22 Jul 22 17:32 hbase-client.jar -> >> hbase-client-1.2.1.jar >> -rw-r--r-- 1 root root 576307 Jul 8 02:17 hbase-common-1.2.1.jar >> -rw-r--r-- 1 root root 228279 Jul 8 02:17 hbase-common-1.2.1-tests.jar >> lrwxrwxrwx 1 root root 22 Jul 22 17:32 hbase-common.jar -> >> hbase-common-1.2.1.jar >> -rw-r--r-- 1 root root 131596 Jul 8 02:17 hbase-examples-1.2.1.jar >> lrwxrwxrwx 1 root root 24 Jul 22 17:32 hbase-examples.jar -> >> hbase-examples-1.2.1.jar >> -rw-r--r-- 1 root root 19531 Jul 8 02:17 >> hbase-external-blockcache-1.2.1.jar >> lrwxrwxrwx 1 root root 35 Jul 22 17:32 >> hbase-external-blockcache.jar -> hbase-external-blockcache-1.2.1.jar >> -rw-r--r-- 1 root root 95415 Jul 8 02:17 >> hbase-hadoop2-compat-1.2.1.jar >> lrwxrwxrwx 1 root root 30 Jul 22 17:32 hbase-hadoop2-compat.jar -> >> hbase-hadoop2-compat-1.2.1.jar >> -rw-r--r-- 1 root root 36616 Jul 8 02:17 hbase-hadoop-compat-1.2.1.jar >> lrwxrwxrwx 1 root root 29 Jul 22 17:32 hbase-hadoop-compat.jar -> >> hbase-hadoop-compat-1.2.1.jar >> -rw-r--r-- 1 root root 13194 Jul 8 02:17 hbase-it-1.2.1.jar >> -rw-r--r-- 1 root root 2837755 Jul 8 02:17 hbase-it-1.2.1-tests.jar >> lrwxrwxrwx 1 root root 18 Jul 22 17:32 hbase-it.jar -> >> hbase-it-1.2.1.jar >> -rw-r--r-- 1 root root 102090 Jul 8 02:17 hbase-prefix-tree-1.2.1.jar >> lrwxrwxrwx 1 root root 27 Jul 22 17:32 hbase-prefix-tree.jar -> >> hbase-prefix-tree-1.2.1.jar >> -rw-r--r-- 1 root root 116740 Jul 8 02:17 hbase-procedure-1.2.1.jar >> lrwxrwxrwx 1 root root 25 Jul 22 17:32 hbase-procedure.jar -> >> hbase-procedure-1.2.1.jar >> -rw-r--r-- 1 root root 4365816 Jul 8 02:17 hbase-protocol-1.2.1.jar >> lrwxrwxrwx 1 root root 24 Jul 22 17:32 hbase-protocol.jar -> >> hbase-protocol-1.2.1.jar >> -rw-r--r-- 1 root root 67347 Jul 8 02:17 >> hbase-resource-bundle-1.2.1.jar >> lrwxrwxrwx 1 root root 31 Jul 22 17:32 hbase-resource-bundle.jar -> >> hbase-resource-bundle-1.2.1.jar >> -rw-r--r-- 1 root root 431393 Jul 8 02:17 hbase-rest-1.2.1.jar >> lrwxrwxrwx 1 root root 20 Jul 22 17:32 hbase-rest.jar -> >> hbase-rest-1.2.1.jar >> -rw-r--r-- 1 root root 4139927 Jul 8 02:17 hbase-server-1.2.1.jar >> -rw-r--r-- 1 root root 7459050 Jul 8 02:17 hbase-server-1.2.1-tests.jar >> lrwxrwxrwx 1 root root 22 Jul 22 17:32 hbase-server.jar -> >> hbase-server-1.2.1.jar >> -rw-r--r-- 1 root root 13051 Jul 8 02:17 hbase-shell-1.2.1.jar >> lrwxrwxrwx 1 root root 21 Jul 22 17:32 hbase-shell.jar -> >> hbase-shell-1.2.1.jar >> -rw-r--r-- 1 root root 2760746 Jul 8 02:17 hbase-thrift-1.2.1.jar >> lrwxrwxrwx 1 root root 22 Jul 22 17:32 hbase-thrift.jar -> >> hbase-thrift-1.2.1.jar >> drwxr-xr-x 7 root root 4096 Jul 22 17:32 hbase-webapps >> drwxr-xr-x 3 root root 4096 Jul 22 17:32 include >> drwxr-xr-x 3 root root 12288 Jul 22 17:32 lib >> lrwxrwxrwx 1 root root 14 Jul 22 17:32 logs -> /var/log/hbase >> -rw-r--r-- 1 root root 98170649 Jul 28 16:04 phoenix-client.jar >> -rw-r--r-- 1 root root 3631295 Jul 28 16:07 >> phoenix-core-4.7.0-HBase-1.2.jar >> -rw-r--r-- 1 root root 25644258 Jul 28 16:04 phoenix-server.jar >> -rw-r--r-- 1 root root 4152940 Jul 28 16:04 phoenix-thin-client.jar >> lrwxrwxrwx 1 root root 14 Jul 22 17:32 pids -> /var/run/hbase >> > > >> [ec2-user@ip-10-2-* bin]$ HBASE_DIR=/usr/lib/hbase ./pherf-cluster.py >> -drop all -l -q -z localhost -schemaFile >> ./config/datamodel/user_defined_schema.sql -scenarioFile >> ./config/scenario/user_defined_scenario.xml >> HBASE_DIR environment variable is currently set to: /usr/lib/hbase >> Exception in thread "main" java.lang.NoClassDefFoundError: >> org/apache/phoenix/schema/TableNotFoundException >> at org.apache.phoenix.pherf.Pherf.<init>(Pherf.java:52) >> at org.apache.phoenix.pherf.Pherf.main(Pherf.java:188) >> Caused by: java.lang.ClassNotFoundException: >> org.apache.phoenix.schema.TableNotFoundException >> at java.net.URLClassLoader$1.run(URLClassLoader.java:366) >> at java.net.URLClassLoader$1.run(URLClassLoader.java:355) >> at java.security.AccessController.doPrivileged(Native Method) >> at java.net.URLClassLoader.findClass(URLClassLoader.java:354) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:425) >> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:358) >> ... 2 more > > > It seems like some jar is missing or another path is needed in the -cp > list. > > Thanks ahead of time for your help! > > -nathan >
