Re: will hbase storage engine scan twice?

2016-08-09 Thread qiang li
Yes, that's it. Waiting for your new release to solve it. 2016-08-09 23:26 GMT+08:00 Zelaine Fong <zf...@maprtech.com>: > It looks like you're encountering DRILL-4771. Note that the problem is not > specific to querying from HBase. > > -- Zelaine > > On Tue, Aug 9, 2

will hbase storage engine scan twice?

2016-08-09 Thread qiang li
Hi We use drill to query hbase. Recently I check one of our query's plan: 0: jdbc:drill:drillbit=rfdc2> explain plan for SELECT '2016-07-27 00:00' as key, sum(convert_from(action.`v`.`c`,'INT_BE')) AS pv,COUNT(DISTINCT BYTE_SUBSTR(action.row_key,-8,8)) AS uv,

hbase concurrently scan

2016-08-08 Thread qiang li
Hi I recently use drill to join hbase table. I have one question, does there a way to make the scan concurrently? We have a big table and scan very slow. I researched the hbase storage engine and find there have a similar logic in HBaseGroupScan class which created a sub scan list for each

Re: concurrent get connection in different node

2016-08-02 Thread qiang li
nevermind , I changed to jdbc:drill:drillbit=node1;schema=hbase and its work now. 2016-08-02 20:04 GMT+08:00 qiang li <tiredqi...@gmail.com>: > Sorry , I follow the doc use the url : > > jdbc:drill:drillbit=node1/drill/drillbits2;schema=hbase

Re: concurrent get connection in different node

2016-08-02 Thread qiang li
Sorry , I follow the doc use the url : jdbc:drill:drillbit=node1/drill/drillbits2;schema=hbase It's throw java.nio.channels.UnresolvedAddressException. But the host name is configured in the hosts file. Did I miss something? Thanks 2016-08-02 17:45 GMT+08:00 qiang li <tiredqi...@gmail.

Re: concurrent get connection in different node

2016-08-02 Thread qiang li
g/docs/using-the-jdbc-driver/#using-the-jdbc-url-format-for-a-direct-drillbit-connection > > > On Fri, Jul 29, 2016 at 2:27 AM, qiang li <tiredqi...@gmail.com> wrote: > > > We are running query concurrently and get connection through jdbc. > > > > We found t

concurrent get connection in different node

2016-07-29 Thread qiang li
We are running query concurrently and get connection through jdbc. We found that the querys are not distributed equally in the cluster. That is some nodes have more querys while others are less. This will cause query running slow at the busy node. Does there have any way to let the query

Re: Information about ENQUEUED state in Drill

2016-06-29 Thread qiang li
I have the same doult. I set the queue.threshold to 5000, queue.large to 20 and the queue.small to 200. But when I query with about 100 small querys concurrently, most of them are ENQUEUED. If I turn off the queue, it will query fast. If turn on the queue , our querys will speed about 7

Re: DRILL-4199: Add Support for HBase 1.X - planning to merge

2016-06-23 Thread qiang li
row_key < '0bs' ) t2 on t1.uid = t2.uid limit 10 Now, my work can going on. But I think the first SQL should working too, hope someone can take a look at it. 2016-06-23 10:59 GMT+08:00 qiang li <tiredqi...@gmail.com>: > Dear all, > > Today ,I retest it again step by step.

Re: DRILL-4199: Add Support for HBase 1.X - planning to merge

2016-06-22 Thread qiang li
this issue, we are very need this function working. Thanks 2016-06-22 9:39 GMT+08:00 qiang li <tiredqi...@gmail.com>: > Thanks Aman. > > I think the second is not related to hbase too. Its happened occasionally. > I wil give you more detail when its happen again. > > Hi A

Re: DRILL-4199: Add Support for HBase 1.X - planning to merge

2016-06-21 Thread qiang li
om> wrote: > >> There should be another stack trace in drillbit.out when this happens, >> could you please check that file. >> >> On Mon, Jun 20, 2016 at 8:14 PM, qiang li <tiredqi...@gmail.com> wrote: >> >> > Another issue is some time when I restart t

Re: DRILL-4199: Add Support for HBase 1.X - planning to merge

2016-06-20 Thread qiang li
] at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:267) [drill-java-exec-1.7.0-SNAPSHOT.jar:1.7.0-SNAPSHOT] 2016-06-20 19:10:31,137 [main] INFO o.apache.drill.exec.server.Drillbit - Shutdown completed (1914 ms). I did nothing and start it at next day, then it can startup. 2016-06-21 9:48 GMT+08:00 qiang li

Re: DRILL-4199: Add Support for HBase 1.X - planning to merge

2016-06-20 Thread qiang li
with relevant details. > > -Aman > > On Mon, Jun 20, 2016 at 5:13 AM, qiang li <tiredqi...@gmail.com> wrote: > > > Thanks Aditya. > > > > By the way, I found another issue. > > > > Let say I have two tables. > > > > offers_ref0 : rowkey

Re: DRILL-4199: Add Support for HBase 1.X - planning to merge

2016-06-15 Thread qiang li
(II)V at org.objectweb.asm.util.CheckMethodAdapter$1.visitEnd(CheckMethodAdapter.java:463) ~[asm-debug-all-5.0.3.jar:5.0.3] But the query is success. Does this exception will affect the query process, for example will it affect the query speed or data integrity? 2016-06-16 10:27 GMT+08:00 qiang li

Re: DRILL-4199: Add Support for HBase 1.X - planning to merge

2016-06-15 Thread qiang li
Hi Aditya, I tested the latest version and got this exception and the drillbit fail to startup . Exception in thread "main" java.lang.NoSuchMethodError: io.netty.util.UniqueName.(Ljava/lang/String;)V at io.netty.channel.ChannelOption.(ChannelOption.java:136) at

Re: query from hbase issue

2016-05-23 Thread qiang li
startRow and stopRow can meet it. for example : select row_key from hbase.browser_action a where a.row_key >'0' and a.row_key < '1' , I think sql like this will query faster without rowfilter. 2016-05-24 9:29 GMT+08:00 qiang li <tiredqi...@gmail.com>: > Yes, Its seems like th

Re: query from hbase issue

2016-05-23 Thread qiang li
Am I right? 2016-05-23 23:38 GMT+08:00 Krystal Nguyen <kngu...@maprtech.com>: > Hi Qiang, > > Looks like you might be encountering this issue: > https://issues.apache.org/jira/browse/DRILL-4271 > > Thanks > > On Sun, May 22, 2016 at 8:38 PM, qiang li <tiredqi...@gma

Re: query from hbase issue

2016-05-22 Thread qiang li
a.`v`.`e0`; +-+---+ | k | p | +-+---+ | e0 | 9094 | +-+---+ if I put the qualifier "e3" into the table(that is more than 3 qulifier), then the issue reproduced. 2016-05-23 9:23 GMT+08:00 qiang li <tiredqi...@gmail.com>: > Sorry late. >

Re: query from hbase issue

2016-05-22 Thread qiang li
AM, Krystal Nguyen <kngu...@maprtech.com> > wrote: > > > Can you please let us know the hbase version and hadoop distribution > > version that you are using. > > > > > > On Fri, May 20, 2016 at 1:35 AM, qiang li <tiredqi...@gmail.com> wrote: > > >

Re: query from hbase issue

2016-05-20 Thread qiang li
.com> >> wrote: >> >> > Hello Qiang, >> > >> > DRILL-4686 is reported to track this problem. >> > >> > Thanks, >> > Khurram >> > >> > On Wed, May 18, 2016 at 3:16 PM, qiang li <tiredqi...@gmail.com> wrote:

Re: query from hbase issue

2016-05-18 Thread qiang li
ome one from MapR San Jose will get back to you as soon > as possible. > > Thanks, > Khurram > > On Wed, May 18, 2016 at 3:09 PM, qiang li <tiredqi...@gmail.com> wrote: > >> Hi Khurram, Thanks very much to reproduce it, so what's the conclusion? >> >>

Re: query from hbase issue

2016-05-18 Thread qiang li
($0)]) > 03-02 HashAgg(group=[{0}], p=[COUNT($1)]) > 03-03Project($f0=[BYTE_SUBSTR($0, 1, 9)], > row_key=[$0]) > 03-04 Scan(groupscan=[HBaseGroupScan > [HBaseScanSpec=HBaseScanSpec [tableName=browser_action2,

query from hbase issue

2016-05-17 Thread qiang li
Hi , I recently meet a issue that can not query the correct data from hbase with sql by drill, can anybody help me. I test with the drill 1.6. My hbase scheme: rowkey: salt+day+event+uid + ts , eg: 120160411visituidts cf : v qualifier: v, e0, e1 The wrong result only happened when I use group