Re: Passing arguments (schema name) to .sql file while executing from command line

2017-04-20 Thread Ankit Singhal
If you are using phoenix 4.8 onwards then you can try giving zookeeper string appended with a schema like below. psql.py ;schema= /create_table.sql psql.py zookeeer1;schema=TEST_SCHEMA /create_table.sql On Sat, Apr 15, 2017 at 2:25 AM, sid red wrote: > Hi, > > I am trying to find a solution, w

Re: Limit of phoenix connections on client side

2017-04-20 Thread Ankit Singhal
bq. 1. How many concurrent phoenix connections the application can open? I don't think there is any limit on this. bq. 2. Is there any limitations regarding the number of connections I should consider? I think as many till your JVM permits. bq. 3. Is the client side config parameter phoenix.que

Re: load kafka to phoenix

2017-04-20 Thread Ankit Singhal
It seems we don't pack the dependencies in phoenix-kafka jar yet. Try including flume-ng-configuration-1.3.0.jar in your classpath to resolve the above issue. On Thu, Apr 20, 2017 at 9:27 AM, lk_phoenix wrote: > hi,all: > I try to read data from kafka_2.11-0.10.2.0 , I get error: > > Exception

Re: Bad performance of the first resultset.next()

2017-04-20 Thread Ankit Singhal
+1 for Joanthan comment, -- Take multiple jstack of the client during the query time and check which thread is working for long. If you find merge sort is the bottleneck then removing salting and using SERIAL scan will help in the query given above. Ensure that your queries are not causing hotspott

Re: View timestamp on existing table (potential defect)

2017-04-20 Thread Ankit Singhal
This is because we cap the scan with the current timestamp so anything beyond the current time will not be seen. This is needed mainly to avoid UPSERT SELECT to see its own new writes. https://issues.apache.org/jira/browse/PHOENIX-3176 On Thu, Apr 20, 2017 at 11:52 PM, Randy wrote: > I was try

Re: phoenix.schema.isNamespaceMappingEnabled

2017-04-20 Thread Ankit Singhal
Sudhir, Relevant JIRA for the same. https://issues.apache.org/jira/browse/PHOENIX-3288 Let me see if I can crack this for the coming release. On Fri, Apr 21, 2017 at 8:42 AM, Josh Elser wrote: > Sudhir, > > Didn't meant to imply that asking the question was a waste of time. > Instead, I want

Re: phoenix.schema.isNamespaceMappingEnabled

2017-04-20 Thread Josh Elser
Sudhir, Didn't meant to imply that asking the question was a waste of time. Instead, I wanted to try to redirect you into coming up with solutions to the problem instead of rehashing that this is something that could be improved :) Sudhir Babu Pothineni wrote: Thanks Josh, Sorry if you felt

View timestamp on existing table (potential defect)

2017-04-20 Thread Randy
I was trying to map existing HBase table to view based on the instruction: https://phoenix.apache.org/faq.html#How_I_map_Phoenix_table_to_an_existing_HBase_table One surprise from query on the view is all values from one column are all null although they are clearly populated with data when viewed

Re: phoenix.schema.isNamespaceMappingEnabled

2017-04-20 Thread Sudhir Babu Pothineni
Thanks Josh, Sorry if you felt like I am wasting community time, it took some time for me to figure out how to handle hbase-site.xml for Zeppelin phoenix connection, may be its a zeppelin question than phoenix, in my case the only extra parameter I am using is phoenix.schema.isNamespaceMappingEnabl

Re: phoenix.schema.isNamespaceMappingEnabled

2017-04-20 Thread Josh Elser
Most likely to avoid breaking existing functionality. As this mapping is a relatively new feature, we wouldn't want to force it upon new users. The need for Phoenix to have the proper core-site, hdfs-site, and hbase-site XML files on the classpath is a fair knock though (although, the lack o

phoenix.schema.isNamespaceMappingEnabled

2017-04-20 Thread Sudhir Babu Pothineni
is there any specific reason default value of phoenix.schema.isNamespaceMappingEnabled set to false? when using multiple clients like Zeppelin, DbVisualizer etc.. we need to maintain hbase-site.xml. Particularly latest version of Zeppelin is not recognizing hbase-site.xml, it worked only when I in

Re: Bad performance of the first resultset.next()

2017-04-20 Thread ashish tapdiya
execQuery() is asynchronous and returns immediately. next() has blocking semantics and that is why it waits for the result set to be generated by the server side. On Thu, Apr 20, 2017 at 10:18 AM, Jonathan Leech wrote: > Client merge sort is just merging already sorted data from the parallel >

Re: Bad performance of the first resultset.next()

2017-04-20 Thread Jonathan Leech
Client merge sort is just merging already sorted data from the parallel scan. Look into the number of simultaneous queries vs the Phoenix thread pool size and numActiveHandlers in Hbase region servers. Salting might not be helping you. Also try setting the fetch size on the query in JDBC. Make s

Bad performance of the first resultset.next()

2017-04-20 Thread Binh Luong
Hi Josh, thank you for your answer. Yes, I am using HDP 2.3.4. You're right, with the newer versions it may improve the performance significantly. However, we are going to have a release shortly, so now it's not possible for an upgrade. But yes, it should happen in the upcoming application rele

Re: Bad performance of the first resultset.next()

2017-04-20 Thread Binh Luong
Hi Josh, thank you for your answer. Yes, I am using HDP 2.3.4. You're right, with the newer versions it may improve the performance significantly. However, we are going to have a release shortly, so now it's not possible for an upgrade. But yes, it should happen in the upcoming application release