Kunal
Correct this is the exact issue, it looks like drill is trying to push while 
hive doesn't pass it. 
When you work without hive, it works fine.
+ 
As result - you get very bad performance.

Regards,
Dor

-----Original Message-----
From: Kunal Khatua [mailto:kkha...@mapr.com] 
Sent: יום ד 13 דצמבר 2017 09:43
To: dev@drill.apache.org
Subject: RE: Drill over Hive

It appears you are trying to use Drill to query an Hbase via Hive. It is 
possible that Drill is not able to push down the filters to Hive, though I'm 
not sure why.

Aman/Chunhui
Any idea why is Drill triggering a full table scan?

From: Dor Ben Dov [mailto:dor.ben-...@amdocs.com]
Sent: Tuesday, December 12, 2017 11:39 PM
To: dev@drill.apache.org
Subject: Drill over Hive

Hi

This is our query
select * from hive.mytable where key >= '0001:10:2017:0410:0000000000003157781' 
  and key < '0001:10:2017:0410:0000000000003157782';

Same query in Drill over hbase takes less than a sec, in hive it takes few 
seconds and with drill over hive it quits with a timeout.
When you look in the sql profile of drill (using the web), you see a table full 
scan for millions of records, while actually it was supposed to return 9 rows.

Does Drill on top of hive is using the key to access only the relevant region 
of the table?

Regards,
Dor Ben Dov
Research Manager, Digital - BSS - Research
+972-9-7764043   (office)
+972-52-3573492 (mobile)
[cid:image001.png@01D28AC9.B559B360]

Follow us on 
Facebook<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.facebook.com_amdocs_&d=DwMFAg&c=cskdkSMqhcnjZxdQVpwTXg&r=-cT6otg6lpT_XkmYy7yg3A&m=DAE0fF7_P8TSmHMGxIfhw27jKB1kOw1D8qaGAn6q32M&s=bS0vtglEQKbSVkT6_3T5N1ckKa-48J2rFdz0A-GkFxg&e=>,
 
Twitter<https://urldefense.proofpoint.com/v2/url?u=http-3A__twitter.com_amdocs&d=DwMFAg&c=cskdkSMqhcnjZxdQVpwTXg&r=-cT6otg6lpT_XkmYy7yg3A&m=DAE0fF7_P8TSmHMGxIfhw27jKB1kOw1D8qaGAn6q32M&s=HwJx9gvHHvHV9u0nW_0dLjEPhSGcfsWLH-iTUFNV6mc&e=>,
 
LinkedIn<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.linkedin.com_company_amdocs&d=DwMFAg&c=cskdkSMqhcnjZxdQVpwTXg&r=-cT6otg6lpT_XkmYy7yg3A&m=DAE0fF7_P8TSmHMGxIfhw27jKB1kOw1D8qaGAn6q32M&s=cjcmCjbbkgov6zg8GJnuJOOAm6G9HTtY4ppZ170IDb4&e=>,
 
YouTube<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.youtube.com_amdocsinc&d=DwMFAg&c=cskdkSMqhcnjZxdQVpwTXg&r=-cT6otg6lpT_XkmYy7yg3A&m=DAE0fF7_P8TSmHMGxIfhw27jKB1kOw1D8qaGAn6q32M&s=fp9qmbPyYRdiNYDwUDH44HUALaqsbKvfWBv_Dcy7UAo&e=>,
 
Google+<https://urldefense.proofpoint.com/v2/url?u=https-3A__plus.google.com_105657940751678445194&d=DwMFAg&c=cskdkSMqhcnjZxdQVpwTXg&r=-cT6otg6lpT_XkmYy7yg3A&m=DAE0fF7_P8TSmHMGxIfhw27jKB1kOw1D8qaGAn6q32M&s=n0coUEV3Sf7O_MbrqI7cAr5f6d7OG_vL1jK2n3z-AvM&e=>
 and the Amdocs blog 
network<https://urldefense.proofpoint.com/v2/url?u=http-3A__blogs.amdocs.com_&d=DwMFAg&c=cskdkSMqhcnjZxdQVpwTXg&r=-cT6otg6lpT_XkmYy7yg3A&m=DAE0fF7_P8TSmHMGxIfhw27jKB1kOw1D8qaGAn6q32M&s=RxKGDS-92_svSBQlnTdpn8NSr3-1A9Mcp7UbmZsv1bE&e=>|
 Digital BSS 
Research@Yammer<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.yammer.com_amdocs.com_-23_threads_inGroup-3Ftype-3Din-5Fgroup-26feedId-3D7043838&d=DwMFAg&c=cskdkSMqhcnjZxdQVpwTXg&r=-cT6otg6lpT_XkmYy7yg3A&m=DAE0fF7_P8TSmHMGxIfhw27jKB1kOw1D8qaGAn6q32M&s=A20YnBgQgpBLzoXN-rOK49KCStW9haqs7atynBoQz-s&e=>

This message and the information contained herein is proprietary and 
confidential and subject to the Amdocs policy statement, you may review at 
https://www.amdocs.com/about/email-disclaimer<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.amdocs.com_about_email-2Ddisclaimer&d=DwMFAg&c=cskdkSMqhcnjZxdQVpwTXg&r=-cT6otg6lpT_XkmYy7yg3A&m=DAE0fF7_P8TSmHMGxIfhw27jKB1kOw1D8qaGAn6q32M&s=xqkKqSeAK9HGozYmTy7lO0eKTkY4CG5npyWKUM9XeAY&e=>
This message and the information contained herein is proprietary and 
confidential and subject to the Amdocs policy statement,

you may review at https://www.amdocs.com/about/email-disclaimer 
<https://www.amdocs.com/about/email-disclaimer>

Reply via email to