Re: Using Apache perf with Hbase 1.1

2016-10-18 Thread Pradheep Shanmugam
Hi,

All the regions are online acoording to 16010/master-status web UI.
Phoenix is not able connect properly due to error "Caused by: 
java.io.IOException: hconnection-0xa59a583 closed"

Thanks,
Pradheep

From: Mujtaba Chohan <mujt...@apache.org<mailto:mujt...@apache.org>>
Reply-To: "user@phoenix.apache.org<mailto:user@phoenix.apache.org>" 
<user@phoenix.apache.org<mailto:user@phoenix.apache.org>>
Date: Tuesday, October 18, 2016 at 5:36 PM
To: "user@phoenix.apache.org<mailto:user@phoenix.apache.org>" 
<user@phoenix.apache.org<mailto:user@phoenix.apache.org>>
Subject: Re: Using Apache perf with Hbase 1.1

Cannot get all table regions

Check that there are no offline regions. See related thread 
here<http://apache-phoenix-user-list.1124778.n5.nabble.com/Help-w-table-that-suddenly-keeps-timing-out-tt2393.html#a2404>.

On Tue, Oct 18, 2016 at 2:11 PM, Pradheep Shanmugam 
<pradheep.shanmu...@infor.com<mailto:pradheep.shanmu...@infor.com>> wrote:
Hi,

I am trying to connect pherf to hbase cluster running hbase 1.1 using below. 
Could you please help me connect pherf to hbase cluster running v 1.1

java -Xms512m -Xmx3072m  -cp 
"/home/ambari/pherf/phoenix/bin/../phoenix-pherf/config:/etc/hbase/conf:/home/ambari/pherf/phoenix/bin/../phoenix-client/target/phoenix-server-client-4.7.0-HBase-1.1.jar:/home/ambari/pherf/phoenix/bin/../phoenix-pherf/target/phoenix-pherf-4.8.1-HBase-1.1.jar"
 -Dlog4j.configuration=file:/home/ambari/pherf/phoenix/bin/log4j.properties 
org.apache.phoenix.pherf.Pherf -drop all -l -q -z hbase-perf-rs1 -schemaFile 
'.*user_defined_schema.sql' -scenarioFile '.*user_defined_scenario.xml’
And I get below exception

Exception in thread "main" java.lang.NoClassDefFoundError: 
org/apache/commons/cli/ParseException
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2615)
at java.lang.Class.getMethod0(Class.java:2856)
at java.lang.Class.getMethod(Class.java:1668)
at sun.launcher.LauncherHelper.getMainMethod(LauncherHelper.java:494)
at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:486)
Caused by: java.lang.ClassNotFoundException: 
org.apache.commons.cli.ParseException
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 6 more

When I tried to connect using below,
java -Xms512m -Xmx3072m  -cp 
"/home/ambari/pherf/phoenix/bin/../phoenix-pherf/config:/etc/hbase/conf:/home/ambari/pherf/phoenix/bin/../phoenix-client/target/phoenix-4.9.0-HBase-1.2-SNAPSHOT-client.jar:/home/ambari/pherf/phoenix/bin/../phoenix-pherf/target/phoenix-pherf-4.9.0-HBase-1.2-SNAPSHOT-minimal.jar"
 -Dlog4j.configuration=file:/home/ambari/pherf/phoenix/bin/log4j.properties 
org.apache.phoenix.pherf.Pherf -drop all -l -q -z hbase-perf-rs1 -schemaFile 
'.*user_defined_schema.sql' -scenarioFile '.*user_defined_scenario.xml’

I got below error. I thought it could be because of connecting to hbase 1.1 
with 1.2 client?

java.sql.SQLException: ERROR 1102 (XCL02): Cannot get all table regions.
at 
org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:457)
at 
org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:145)
at 
org.apache.phoenix.query.ConnectionQueryServicesImpl.getAllTableRegions(ConnectionQueryServicesImpl.java:549)
at 
org.apache.phoenix.iterate.BaseResultIterators.getParallelScans(BaseResultIterators.java:542)
at 
org.apache.phoenix.iterate.BaseResultIterators.getParallelScans(BaseResultIterators.java:477)
at 
org.apache.phoenix.iterate.BaseResultIterators.(BaseResultIterators.java:370)
at 
org.apache.phoenix.iterate.ParallelIterators.(ParallelIterators.java:60)
at org.apache.phoenix.execute.ScanPlan.newIterator(ScanPlan.java:218)
at org.apache.phoenix.execute.BaseQueryPlan.iterator(BaseQueryPlan.java:341)
at org.apache.phoenix.execute.BaseQueryPlan.iterator(BaseQueryPlan.java:206)
at org.apache.phoenix.jdbc.PhoenixStatement$1.call(PhoenixStatement.java:290)
at org.apache.phoenix.jdbc.PhoenixStatement$1.call(PhoenixStatement.java:270)
at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
at 
org.apache.phoenix.jdbc.PhoenixStatement.executeQuery(PhoenixStatement.java:269)
at 
org.apache.phoenix.jdbc.PhoenixStatement.executeQuery(PhoenixStatement.java:1476)
at 
org.apache.phoenix.jdbc.PhoenixDatabaseMetaData.getTables(PhoenixDatabaseMetaData.java:1149)
at 
org.apache.phoenix.pherf.util.PhoenixUtil.getTableMetaData(PhoenixUtil.java:220)
at org.apache.phoenix.pherf.util.PhoenixUtil.d

Re: Using Apache perf with Hbase 1.1

2016-10-18 Thread Mujtaba Chohan
>
> Cannot get all table regions
>

Check that there are no offline regions. See related thread here

.

On Tue, Oct 18, 2016 at 2:11 PM, Pradheep Shanmugam <
pradheep.shanmu...@infor.com> wrote:

> Hi,
>
> I am trying to connect pherf to hbase cluster running hbase 1.1 using
> below. Could you please help me connect pherf to hbase cluster running v 1.1
>
> java -Xms512m -Xmx3072m  -cp "/home/ambari/pherf/phoenix/
> bin/../phoenix-pherf/config:/etc/hbase/conf:/home/ambari/
> pherf/phoenix/bin/../phoenix-client/target/phoenix-server-
> client-4.7.0-HBase-1.1.jar:/home/ambari/pherf/phoenix/bin/
> ../phoenix-pherf/target/phoenix-pherf-4.8.1-HBase-1.1.jar"
> -Dlog4j.configuration=file:/home/ambari/pherf/phoenix/bin/log4j.properties
> org.apache.phoenix.pherf.Pherf -drop all -l -q -z hbase-perf-rs1
> -schemaFile '.*user_defined_schema.sql' -scenarioFile
> '.*user_defined_scenario.xml’
> And I get below exception
>
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/commons/cli/ParseException
> at java.lang.Class.getDeclaredMethods0(Native Method)
> at java.lang.Class.privateGetDeclaredMethods(Class.java:2615)
> at java.lang.Class.getMethod0(Class.java:2856)
> at java.lang.Class.getMethod(Class.java:1668)
> at sun.launcher.LauncherHelper.getMainMethod(LauncherHelper.java:494)
> at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:486)
> Caused by: java.lang.ClassNotFoundException: org.apache.commons.cli.
> ParseException
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> ... 6 more
>
> When I tried to connect using below,
> java -Xms512m -Xmx3072m  -cp "/home/ambari/pherf/phoenix/
> bin/../phoenix-pherf/config:/etc/hbase/conf:/home/ambari/
> pherf/phoenix/bin/../phoenix-client/target/phoenix-4.9.0-
> HBase-1.2-SNAPSHOT-client.jar:/home/ambari/pherf/phoenix/
> bin/../phoenix-pherf/target/phoenix-pherf-4.9.0-HBase-1.2-SNAPSHOT-minimal.jar"
> -Dlog4j.configuration=file:/home/ambari/pherf/phoenix/bin/log4j.properties
> org.apache.phoenix.pherf.Pherf -drop all -l -q -z hbase-perf-rs1
> -schemaFile '.*user_defined_schema.sql' -scenarioFile
> '.*user_defined_scenario.xml’
>
> I got below error. I thought it could be because of connecting to hbase
> 1.1 with 1.2 client?
>
> java.sql.SQLException: ERROR 1102 (XCL02): Cannot get all table regions.
> at org.apache.phoenix.exception.SQLExceptionCode$Factory$1.
> newException(SQLExceptionCode.java:457)
> at org.apache.phoenix.exception.SQLExceptionInfo.buildException(
> SQLExceptionInfo.java:145)
> at org.apache.phoenix.query.ConnectionQueryServicesImpl.
> getAllTableRegions(ConnectionQueryServicesImpl.java:549)
> at org.apache.phoenix.iterate.BaseResultIterators.getParallelScans(
> BaseResultIterators.java:542)
> at org.apache.phoenix.iterate.BaseResultIterators.getParallelScans(
> BaseResultIterators.java:477)
> at org.apache.phoenix.iterate.BaseResultIterators.(
> BaseResultIterators.java:370)
> at org.apache.phoenix.iterate.ParallelIterators.(
> ParallelIterators.java:60)
> at org.apache.phoenix.execute.ScanPlan.newIterator(ScanPlan.java:218)
> at org.apache.phoenix.execute.BaseQueryPlan.iterator(
> BaseQueryPlan.java:341)
> at org.apache.phoenix.execute.BaseQueryPlan.iterator(
> BaseQueryPlan.java:206)
> at org.apache.phoenix.jdbc.PhoenixStatement$1.call(
> PhoenixStatement.java:290)
> at org.apache.phoenix.jdbc.PhoenixStatement$1.call(
> PhoenixStatement.java:270)
> at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
> at org.apache.phoenix.jdbc.PhoenixStatement.executeQuery(
> PhoenixStatement.java:269)
> at org.apache.phoenix.jdbc.PhoenixStatement.executeQuery(
> PhoenixStatement.java:1476)
> at org.apache.phoenix.jdbc.PhoenixDatabaseMetaData.getTables(
> PhoenixDatabaseMetaData.java:1149)
> at org.apache.phoenix.pherf.util.PhoenixUtil.getTableMetaData(
> PhoenixUtil.java:220)
> at org.apache.phoenix.pherf.util.PhoenixUtil.deleteTables(
> PhoenixUtil.java:192)
> at org.apache.phoenix.pherf.Pherf.run(Pherf.java:234)
> at org.apache.phoenix.pherf.Pherf.main(Pherf.java:188)
> Caused by: java.io.IOException: hconnection-0xa59a583 closed
> at org.apache.hadoop.hbase.client.ConnectionManager$
> HConnectionImplementation.getKeepAliveZooKeeperWatcher(
> ConnectionManager.java:1685)
> at org.apache.hadoop.hbase.client.ZooKeeperRegistry.isTableOnlineState(
> ZooKeeperRegistry.java:122)
> at org.apache.hadoop.hbase.client.ConnectionManager$
> HConnectionImplementation.isTableDisabled(ConnectionManager.java:979)
> at 

Using Apache perf with Hbase 1.1

2016-10-18 Thread Pradheep Shanmugam
Hi,

I am trying to connect pherf to hbase cluster running hbase 1.1 using below. 
Could you please help me connect pherf to hbase cluster running v 1.1

java -Xms512m -Xmx3072m  -cp 
"/home/ambari/pherf/phoenix/bin/../phoenix-pherf/config:/etc/hbase/conf:/home/ambari/pherf/phoenix/bin/../phoenix-client/target/phoenix-server-client-4.7.0-HBase-1.1.jar:/home/ambari/pherf/phoenix/bin/../phoenix-pherf/target/phoenix-pherf-4.8.1-HBase-1.1.jar"
 -Dlog4j.configuration=file:/home/ambari/pherf/phoenix/bin/log4j.properties 
org.apache.phoenix.pherf.Pherf -drop all -l -q -z hbase-perf-rs1 -schemaFile 
'.*user_defined_schema.sql' -scenarioFile '.*user_defined_scenario.xml’
And I get below exception

Exception in thread "main" java.lang.NoClassDefFoundError: 
org/apache/commons/cli/ParseException
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2615)
at java.lang.Class.getMethod0(Class.java:2856)
at java.lang.Class.getMethod(Class.java:1668)
at sun.launcher.LauncherHelper.getMainMethod(LauncherHelper.java:494)
at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:486)
Caused by: java.lang.ClassNotFoundException: 
org.apache.commons.cli.ParseException
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 6 more

When I tried to connect using below,
java -Xms512m -Xmx3072m  -cp 
"/home/ambari/pherf/phoenix/bin/../phoenix-pherf/config:/etc/hbase/conf:/home/ambari/pherf/phoenix/bin/../phoenix-client/target/phoenix-4.9.0-HBase-1.2-SNAPSHOT-client.jar:/home/ambari/pherf/phoenix/bin/../phoenix-pherf/target/phoenix-pherf-4.9.0-HBase-1.2-SNAPSHOT-minimal.jar"
 -Dlog4j.configuration=file:/home/ambari/pherf/phoenix/bin/log4j.properties 
org.apache.phoenix.pherf.Pherf -drop all -l -q -z hbase-perf-rs1 -schemaFile 
'.*user_defined_schema.sql' -scenarioFile '.*user_defined_scenario.xml’

I got below error. I thought it could be because of connecting to hbase 1.1 
with 1.2 client?

java.sql.SQLException: ERROR 1102 (XCL02): Cannot get all table regions.
at 
org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:457)
at 
org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:145)
at 
org.apache.phoenix.query.ConnectionQueryServicesImpl.getAllTableRegions(ConnectionQueryServicesImpl.java:549)
at 
org.apache.phoenix.iterate.BaseResultIterators.getParallelScans(BaseResultIterators.java:542)
at 
org.apache.phoenix.iterate.BaseResultIterators.getParallelScans(BaseResultIterators.java:477)
at 
org.apache.phoenix.iterate.BaseResultIterators.(BaseResultIterators.java:370)
at 
org.apache.phoenix.iterate.ParallelIterators.(ParallelIterators.java:60)
at org.apache.phoenix.execute.ScanPlan.newIterator(ScanPlan.java:218)
at org.apache.phoenix.execute.BaseQueryPlan.iterator(BaseQueryPlan.java:341)
at org.apache.phoenix.execute.BaseQueryPlan.iterator(BaseQueryPlan.java:206)
at org.apache.phoenix.jdbc.PhoenixStatement$1.call(PhoenixStatement.java:290)
at org.apache.phoenix.jdbc.PhoenixStatement$1.call(PhoenixStatement.java:270)
at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
at 
org.apache.phoenix.jdbc.PhoenixStatement.executeQuery(PhoenixStatement.java:269)
at 
org.apache.phoenix.jdbc.PhoenixStatement.executeQuery(PhoenixStatement.java:1476)
at 
org.apache.phoenix.jdbc.PhoenixDatabaseMetaData.getTables(PhoenixDatabaseMetaData.java:1149)
at 
org.apache.phoenix.pherf.util.PhoenixUtil.getTableMetaData(PhoenixUtil.java:220)
at org.apache.phoenix.pherf.util.PhoenixUtil.deleteTables(PhoenixUtil.java:192)
at org.apache.phoenix.pherf.Pherf.run(Pherf.java:234)
at org.apache.phoenix.pherf.Pherf.main(Pherf.java:188)
Caused by: java.io.IOException: hconnection-0xa59a583 closed
at 
org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getKeepAliveZooKeeperWatcher(ConnectionManager.java:1685)
at 
org.apache.hadoop.hbase.client.ZooKeeperRegistry.isTableOnlineState(ZooKeeperRegistry.java:122)
at 
org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.isTableDisabled(ConnectionManager.java:979)
at 
org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1148)
at 
org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.relocateRegion(ConnectionManager.java:1136)
at 
org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getRegionLocation(ConnectionManager.java:957)
at 
org.apache.phoenix.query.ConnectionQueryServicesImpl.getAllTableRegions(ConnectionQueryServicesImpl.java:535)