Re: Query Optimization

Hi, Another observation is My query had where conditions based on the partition values Total number of parquet files in directory - 102290 > Before Metadata refresh - Its reading only 4 files > After metadata refresh - its reading 102290 files This is how the refresh metadata works I mean it

Re: Query Optimization

Hi, Another observation is My query had where conditions based on the partition values Before Metadata refresh - Its reading only 4 files After metadata refresh - its reading 102290 files Thanks, Divya On 17 August 2017 at 13:03, Padma Penumarthy wrote: > Does your query

Re: Query Optimization

Does your query have partition filter ? Execution time is increased most likely because partition pruning is not happening. Did you get a chance to look at the logs ? That might give some clues. Thanks, Padma > On Aug 16, 2017, at 9:32 PM, Divya Gehlot wrote: > >

Re: Query Optimization

Hi, Even I am surprised . I am running Drill version 1.10 on MapR enterprise version. *Query *- Selecting all the columns on partitioned parquet table I observed few things from Query statistics : Value Before Refresh Metadata After Refresh Metadata Fragments 1 13 DURATION 01 min 0.233

Re: Query Optimization

Refresh table metadata should help reduce query planning time. It is odd that it went up after you did refresh table metadata. Did you check the logs to see what is happening ? You might have to turn on some debugs if needed. BTW, what version of Drill are you running ? Thanks, Padma > On Aug

Query Optimization

Hi, I have data in parquet file format . when I run the query the data and see the execution plan I could see following statistics > TOTAL FRAGMENTS: 1 >> DURATION: 01 min 0.233 sec >> PLANNING: 59.818 sec >> QUEUED: Not Available >> EXECUTION: 0.415 sec > > As its a paquet file format I tried

RE: drill error connecting to Hbase

We re-install drill, with newer version ( 1.11) and played a bit in with the configuration using the Web access and made it work. Thanks a lot for your help!! Thanks, Shai -Original Message- From: Dor Ben Dov Sent: Sunday, August 06, 2017 2:09 PM To: user@drill.apache.org Subject: RE: