?????? Can query server run with hadoop ha mode??
hi F21 , I am sure hbase-site.xml was configured properly , here is my hbase-site.xml (hbase side) : hbase.rootdir hdfs://stage-cluster/hbase hbase.cluster.distributed true hbase.zookeeper.quorum tnode01,tnode02,tnode03 zookeeper.znode.parent /hbase dfs.support.append true zookeeper.session.timeout 18 hbase.rpc.timeout 12 hbase.hregion.memstore.flush.size 67108864 hfile.block.cache.size 0.1 phoenix.schema.isNamespaceMappingEnabled true hbase.regionserver.wal.codec org.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec hbase.region.server.rpc.scheduler.factory.class org.apache.hadoop.hbase.ipc.PhoenixRpcSchedulerFactory Factory to create the Phoenix RPC Scheduler that uses separate queues for index and metadata updates hbase.rpc.controllerfactory.class org.apache.hadoop.hbase.ipc.controller.ServerRpcControllerFactory Factory to create the Phoenix RPC Scheduler that uses separate queues for index and metadata updates and the following is phoenix side hbase-site.xml hbase.regionserver.wal.codec org.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec phoenix.schema.isNamespaceMappingEnabled true and the following is query server log 2016-09-08 13:33:03,218 INFO org.apache.phoenix.queryserver.server.Main: env:PATH=/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hadoop/bin:/usr/local/hadoop-2.7.1/bin:/usr/local/hbase-1.1.2/bin:/usr/local/apache-hive-1.2.1-bin/bin:/usr/local/sqoop-1.4.6.bin__hadoop-2.0.4-alpha/bin 2016-09-08 13:33:03,219 INFO org.apache.phoenix.queryserver.server.Main: env:HISTCONTROL=ignoredups 2016-09-08 13:33:03,219 INFO org.apache.phoenix.queryserver.server.Main: env:HCAT_HOME=/usr/local/apache-hive-1.2.1-bin/hcatalog 2016-09-08 13:33:03,220 INFO org.apache.phoenix.queryserver.server.Main: env:HISTSIZE=1000 2016-09-08 13:33:03,220 INFO org.apache.phoenix.queryserver.server.Main: env:JAVA_HOME=/usr/local/java/latest 2016-09-08 13:33:03,220 INFO org.apache.phoenix.queryserver.server.Main: env:TERM=xterm 2016-09-08 13:33:03,220 INFO org.apache.phoenix.queryserver.server.Main: env:XFILESEARCHPATH=/usr/dt/app-defaults/%L/Dt 2016-09-08 13:33:03,220 INFO org.apache.phoenix.queryserver.server.Main: env:LANG=en_US.UTF-8 2016-09-08 13:33:03,220 INFO org.apache.phoenix.queryserver.server.Main: env:G_BROKEN_FILENAMES=1 2016-09-08 13:33:03,220 INFO org.apache.phoenix.queryserver.server.Main: env:SELINUX_LEVEL_REQUESTED= 2016-09-08 13:33:03,221 INFO org.apache.phoenix.queryserver.server.Main: env:SELINUX_ROLE_REQUESTED= 2016-09-08 13:33:03,221 INFO org.apache.phoenix.queryserver.server.Main: env:MAIL=/var/spool/mail/hadoop 2016-09-08 13:33:03,221 INFO org.apache.phoenix.queryserver.server.Main: env:LOGNAME=hadoop 2016-09-08 13:33:03,221 INFO org.apache.phoenix.queryserver.server.Main: env:PWD=/usr/local/apache-phoenix-4.8.0-HBase-1.1-bin/bin 2016-09-08 13:33:03,221 INFO org.apache.phoenix.queryserver.server.Main: env:KYLIN_HOME=/usr/local/apache-kylin-1.5.1-bin 2016-09-08 13:33:03,221 INFO org.apache.phoenix.queryserver.server.Main: env:_=./queryserver.py 2016-09-08 13:33:03,221 INFO org.apache.phoenix.queryserver.server.Main: env:LESSOPEN=|/usr/bin/lesspipe.sh %s 2016-09-08 13:33:03,222 INFO org.apache.phoenix.queryserver.server.Main: env:SHELL=/bin/bash 2016-09-08 13:33:03,222 INFO org.apache.phoenix.queryserver.server.Main: env:SELINUX_USE_CURRENT_RANGE= 2016-09-08 13:33:03,222 INFO org.apache.phoenix.queryserver.server.Main: env:QTINC=/usr/lib64/qt-3.3/include 2016-09-08 13:33:03,222 INFO org.apache.phoenix.queryserver.server.Main: env:CVS_RSH=ssh 2016-09-08 13:33:03,222 INFO org.apache.phoenix.queryserver.server.Main: env:SSH_TTY=/dev/pts/0 2016-09-08 13:33:03,222 INFO org.apache.phoenix.queryserver.server.Main: env:SSH_CLIENT=172.18.100.27 51441 22 2016-09-08 13:33:03,223 INFO org.apache.phoenix.queryserver.server.Main: env:HIVE_HOME=/usr/local/apache-hive-1.2.1-bin 2016-09-08 13:33:03,223 INFO org.apache.phoenix.queryserver.server.Main: env:OLDPWD=/usr/local/hadoop-2.7.1/etc/hadoop 2016-09-08 13:33:03,223 INFO org.apache.phoenix.queryserver.server.Main: env:USER=hadoop 2016-09-08 13:33:03,223 INFO org.apache.phoenix.queryserver.server.Main: env:SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass 2016-09-08 13:33:03,223 INFO org.apache.phoenix.queryserver.server.Main: env:SSH_CONNECTION=172.18.100.27 51441 172.23.201.49 22 2016-09-08 13:33:03,223 INFO org.apache.phoenix.queryserver.server.Main: env:HOSTNAME=tnode02 2016-09-08 13:33:03,223 INFO org.apache.phoenix.queryserver.server.Main:
Re: Can query server run with hadoop ha mode？
I have a test cluster running HDFS in HA mode with HBase + Phoenix on docker running successfully. Can you check if you have a properly configured hbase-site.xml that is available to your phoenix query server? Make sure hbase.zookeeper.quorum and zookeeper.znode.parent is present. If zookeeper does not run on 2181, you will also need hbase.zookeeper.property.clientPort. As a quick test, can you wget or curl http://your-phoenix-server:8765 to see if it has any response? Finally, if you could post the logs from the query server, that would be great too. Cheers, Francis On 8/09/2016 12:55 PM, zengbaitang wrote: I have a hadoop ha cluster and hbase, and have installed phoenix. I try to use query server today , I start the queryserver and then I exec the following command ./sqlline-thin.py http://tnode02:8765 sel.sql the terminal responds the following error , and the *stage-cluster* is the value of hadoop dfs.nameservices , how to solve this error? AvaticaClientRuntimeException: Remote driver error: RuntimeException: java.sql.SQLException: ERROR 103 (08004): Unable to establish connection. -> SQLException: ERROR 103 (08004): Unable to establish connection. -> IOException: java.lang.reflect.InvocationTargetException -> InvocationTargetException: (null exception message) -> ExceptionInInitializerError: (null exception message) -> IllegalArgumentException: java.net.UnknownHostException: stage-cluster -> UnknownHostException: stage-cluster. Error -1 (0) null java.lang.RuntimeException: java.sql.SQLException: ERROR 103 (08004): Unable to establish connection. at org.apache.calcite.avatica.jdbc.JdbcMeta.openConnection(JdbcMeta.java:619) at org.apache.calcite.avatica.remote.LocalService.apply(LocalService.java:299) at org.apache.calcite.avatica.remote.Service$OpenConnectionRequest.accept(Service.java:1748) at org.apache.calcite.avatica.remote.Service$OpenConnectionRequest.accept(Service.java:1728) at org.apache.calcite.avatica.remote.AbstractHandler.apply(AbstractHandler.java:95) at org.apache.calcite.avatica.remote.ProtobufHandler.apply(ProtobufHandler.java:46) at org.apache.calcite.avatica.server.AvaticaProtobufHandler.handle(AvaticaProtobufHandler.java:124) at org.apache.phoenix.shaded.org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:52) at org.apache.phoenix.shaded.org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.apache.phoenix.shaded.org.eclipse.jetty.server.Server.handle(Server.java:499) at org.apache.phoenix.shaded.org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) at org.apache.phoenix.shaded.org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.apache.phoenix.shaded.org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) at org.apache.phoenix.shaded.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.apache.phoenix.shaded.org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) Caused by: java.sql.SQLException: ERROR 103 (08004): Unable to establish connection. at org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:454) at org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:145) at org.apache.phoenix.query.ConnectionQueryServicesImpl.openConnection(ConnectionQueryServicesImpl.java:393) at org.apache.phoenix.query.ConnectionQueryServicesImpl.access$300(ConnectionQueryServicesImpl.java:219) at org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2321) at org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2300) at org.apache.phoenix.util.PhoenixContextExecutor.call(PhoenixContextExecutor.java:78) at org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:2300) at org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:231) at org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.createConnection(PhoenixEmbeddedDriver.java:144) at org.apache.phoenix.jdbc.PhoenixDriver.connect(PhoenixDriver.java:202) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.apache.calcite.avatica.jdbc.JdbcMeta.openConnection(JdbcMeta.java:616) ... 15 more Caused by: java.io.IOException: java.lang.reflect.InvocationTargetException at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:240) at
Can query server run with hadoop ha mode??
I have a hadoop ha cluster and hbase, and have installed phoenix. I try to use query server today , I start the queryserver and then I exec the following command ./sqlline-thin.py http://tnode02:8765 sel.sql the terminal responds the following error , and the stage-cluster is the value of hadoop dfs.nameservices , how to solve this error? AvaticaClientRuntimeException: Remote driver error: RuntimeException: java.sql.SQLException: ERROR 103 (08004): Unable to establish connection. -> SQLException: ERROR 103 (08004): Unable to establish connection. -> IOException: java.lang.reflect.InvocationTargetException -> InvocationTargetException: (null exception message) -> ExceptionInInitializerError: (null exception message) -> IllegalArgumentException: java.net.UnknownHostException: stage-cluster -> UnknownHostException: stage-cluster. Error -1 (0) null java.lang.RuntimeException: java.sql.SQLException: ERROR 103 (08004): Unable to establish connection. at org.apache.calcite.avatica.jdbc.JdbcMeta.openConnection(JdbcMeta.java:619) at org.apache.calcite.avatica.remote.LocalService.apply(LocalService.java:299) at org.apache.calcite.avatica.remote.Service$OpenConnectionRequest.accept(Service.java:1748) at org.apache.calcite.avatica.remote.Service$OpenConnectionRequest.accept(Service.java:1728) at org.apache.calcite.avatica.remote.AbstractHandler.apply(AbstractHandler.java:95) at org.apache.calcite.avatica.remote.ProtobufHandler.apply(ProtobufHandler.java:46) at org.apache.calcite.avatica.server.AvaticaProtobufHandler.handle(AvaticaProtobufHandler.java:124) at org.apache.phoenix.shaded.org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:52) at org.apache.phoenix.shaded.org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.apache.phoenix.shaded.org.eclipse.jetty.server.Server.handle(Server.java:499) at org.apache.phoenix.shaded.org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) at org.apache.phoenix.shaded.org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.apache.phoenix.shaded.org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) at org.apache.phoenix.shaded.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.apache.phoenix.shaded.org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) Caused by: java.sql.SQLException: ERROR 103 (08004): Unable to establish connection. at org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:454) at org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:145) at org.apache.phoenix.query.ConnectionQueryServicesImpl.openConnection(ConnectionQueryServicesImpl.java:393) at org.apache.phoenix.query.ConnectionQueryServicesImpl.access$300(ConnectionQueryServicesImpl.java:219) at org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2321) at org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2300) at org.apache.phoenix.util.PhoenixContextExecutor.call(PhoenixContextExecutor.java:78) at org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:2300) at org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:231) at org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.createConnection(PhoenixEmbeddedDriver.java:144) at org.apache.phoenix.jdbc.PhoenixDriver.connect(PhoenixDriver.java:202) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.apache.calcite.avatica.jdbc.JdbcMeta.openConnection(JdbcMeta.java:616) ... 15 more Caused by: java.io.IOException: java.lang.reflect.InvocationTargetException at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:240) at org.apache.hadoop.hbase.client.ConnectionManager.createConnection(ConnectionManager.java:421) at org.apache.hadoop.hbase.client.ConnectionManager.createConnectionInternal(ConnectionManager.java:330) at org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:144) at org.apache.phoenix.query.HConnectionFactory$HConnectionFactoryImpl.createConnection(HConnectionFactory.java:47) at org.apache.phoenix.query.ConnectionQueryServicesImpl.openConnection(ConnectionQueryServicesImpl.java:391) ... 26 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
Re: Full text query in Phoenix
Hi Cheyenne,
Phoenix does not have full text query capability, so the best you can do
today is use our regex built-in functions (which won't be particularly
performant). Would you mind filing a JIRA with any ideas for how best to
expose this functionality?
Thanks,
James
On Wednesday, September 7, 2016, Cheyenne Forbes <
cheyenne.osanu.for...@gmail.com> wrote:
> I am using phoenix for my platform but I cant do full text queries
>
> "SELECT ID, FirstName, Lastname FROM users
>WHERE MATCH (FirstName, Lastname)
> AGAINST ('first_name last_name' IN BOOLEAN MODE)
>AND [Searcher not blocked by user]
>
> Regards,
> Cheyenne
>
Full text query in Phoenix
I am using phoenix for my platform but I cant do full text queries
"SELECT ID, FirstName, Lastname FROM users
WHERE MATCH (FirstName, Lastname)
AGAINST ('first_name last_name' IN BOOLEAN MODE)
AND [Searcher not blocked by user]
Regards,
Cheyenne
Caused by: org.apache.calcite.avatica.NoSuchStatementException: null
Hi. sporadically NoSuchStatementException occured when i’m using simple upsert. What shall I do? Regards.
View on existing hbase table with dynamic column family
Hey Everybody, i've got an existing hbase table with a rowkey consists of two numbers = and a columnfamily which is a date as running number followed by a characte= r e.g. 20160808[c|s|m]. So how can i map the cf via a view or something else? Thanks in advance. Greets Florian Fiducia & GAD IT AG | www.fiduciagad.de AG Frankfurt a. M. HRB 102381 | Sitz der Gesellschaft: Hahnstr. 48, 60528 Frankfurt a. M. | USt-IdNr. DE 143582320 Vorstand: Klaus-Peter Bruns (Vorsitzender), Claus-Dieter Toben (stv. Vorsitzender), Jens-Olaf Bartels, Martin Beyer, Jörg Dreinhöfer, Wolfgang Eckert, Carsten Pfläging, Jörg Staff Vorsitzender des Aufsichtsrats: Jürgen Brinkmann
