RE: [External] Re: UNORDERED_RECEIVER taking 70% of query time

Thanks Kunal. Query that I am running on Apache Drill is - select sum(sales), week from dfs.`C:\parquet-location\F8894180-AFFB-4803-B8CF-CCF883AA5AAF-Search_Snapshot_Data.parquet` where model_component_id in(select model_component_id from dfs.`C:\parquet-location\poc48k.parquet`) group by

RE: [External] Re: UNORDERED_RECEIVER taking 70% of query time

Hi, Please find the attached query profile. I am running Drill in local mode on my laptop with default memory allocation to Apache Drill. Let me know if you are not able to find the attachment. Also, sending the file in RAR format. Regards, Jasbir Singh -Original Message- From:

UNORDERED_RECEIVER taking 70% of query time

Hi, I am running a simple query which performs JOIN operation between two parquet files and it takes around 3-4 secs and I noticed that 70% of the time is used by UNORDERED_RECEIVER. Sample query is - select sum(sales),week from

Apache Drill takes 5-6 secs in fetching 1000 records from PostgreSQL table

Hi, I am creating an UNLOGGED table in PostgreSQL and reading it using Apache Drill. Table contains just one column with 1000 UUID entries. It is taking 5-6 secs for me to read those records. I am fetching data using below query, Select uuidColumn from pgPlugin.public.uuidTable Is there

RE: [DRILL HANGOUT] Topics for 5/16/2017

Hi, I am stuck in a problem where instance of apache drill stops working. My topic of discussion will be - For a scenario, I have 25 parquet file with around 400K-500K records with around 10 columns. My select query is such that for one column in clause values are around 100K. When I run

RE: Drill query are stuck in ENQUEUED mode

Hi, Thanks for the updates. Just want to update you that we are already following this parameter. Value of below parameters are - 1. exec.queue.enable = TRUE 2. exec.queue.large = 10 (Default) 3. exec.queue.small = 100 (Default) 4. exec.queue.threshold = 3000(Default)

RE: Drill query are stuck in ENQUEUED mode

Few things to update - My parquet files are having less than 1000 records. I create around 250 parquet files from my application and fetch data from them using Apache Drill. When I restart the drill instance all 250 queries on parquet files would execute, but after sometime out of 250 only 1

RE: Drill query are stuck in ENQUEUED mode

IN false state, over the period of time queries were getting stuck in ENQUEUED state because of which I had turned this to TRUE and now they are even getting stuck with this property as TRUE. -Original Message- From: Khurram Faraaz [mailto:kfar...@mapr.com] Sent: Wednesday, May 03,

Drill query are stuck in ENQUEUED mode

Hi, I am having queries in which I am fetching just 1 row from the parquet file using LIMIT 1, and even these queries are stuck in ENQUEUED state in DRILL. I am using exec.queue.enable = true and have default settings for the rest. Can you help me out in this. Regards, Jasbir Singh

Fetch temporary tables data of PostgreSQL from Apache Drill

Hi, I am able to fetch normal tables data from PostgreSQL using Apache Drill but not able to get the data of temporary tables. Is there any way how to fetch data from temporary tables? Regards, Jasbir Singh This message is for the designated recipient only

RE: Temporary table issue

Hi Arina, Thanks for your reply. I got that it can work like this also. But how to use it with Java collection, Array List which has records ranging from 5000 - 100,000. For every different hit, I will be creating a different temporary table. Regards, Jasbir Singh -Original Message-

Temporary table issue

Hi, I want to create temporary table in Apache Drill at runtime and want to insert few uuid's which user select. It could range from 5000 to 100,000. Using CTTAS if I do it requires data from some file whereas here I want to store it using a collection. Is this possible using Apache Drill?

Drill memory configuration in windows

Hi, I want to run Drill on my local machine (Windows) and want to assign 1GB heap memory and direct memory. Can someone help me how to do it? Regards, Jasbir Singh This message is for the designated recipient only and may contain privileged, proprietary, or

RE: Drill Hangout 2/7/2017

Hi, I am interested in joining this session. My area of interest would be - 1. Future roadmap of Apache Drill 2. How apache drill creates HashAgg when there are lot of IN members in a where clause 3. What is the upper limit of IN CLAUSE. Regards, Jasbir Singh -Original Message- From: