Re: Embeded drill

2019-03-28 Thread PRAVEEN DEVERACHETTY
ied shutting them. Is there a > reason you want to close these ports? > > > On 3/25/2019 6:04:03 PM, PRAVEEN DEVERACHETTY wrote: > Sorry. I am not aware of that. Here are the ports appear in net stat > > 31010 > 31011 > 31012 > > My question is how to disable th

Re: Embeded drill

2019-03-25 Thread PRAVEEN DEVERACHETTY
ports are they On Mon, Mar 25, 2019, 22:46 Kunal Khatua wrote: > Hi Praveen > > THe mailing lists dont allow attachments to be sent through. What ports > are you trying to change? > > ~ Kunal > On 3/25/2019 9:59:29 AM, PRAVEEN DEVERACHETTY wrote: > I have a question

Embeded drill

2019-03-25 Thread PRAVEEN DEVERACHETTY
I have a question regarding the ports used in embeded drill. Is there anyway to disable these ports in embeded drill option. I am trying to understand the ports opened during drill execution. There are lot of ports opened when i start drill under the same processid. btw i am running in windows.

Re: Update planner/configuration keys

2019-03-12 Thread PRAVEEN DEVERACHETTY
et param=value" usually persists the value. > Not sure if that works for an embedded mode. > Could you try and let us know if that works? > On 3/11/2019 11:19:13 AM, PRAVEEN DEVERACHETTY > wrote: > I am using apache drill on windows platform. My requirement is to udpate >

Update planner/configuration keys

2019-03-11 Thread PRAVEEN DEVERACHETTY
I am using apache drill on windows platform. My requirement is to udpate the following parameters during apache drill startup. These parameter vaules may differ in each apache drill nodes. can you share me an example of how to update these in windows. I know another option is to run on webUI or

Re: Performace issue

2019-02-14 Thread PRAVEEN DEVERACHETTY
On Thu, Feb 14, 2019 at 7:10 AM PRAVEEN DEVERACHETTY wrote: > HI Sorabh, > > Here is the sample query passed using REST API. This query is sent as a > body and submit job(REST). convert_from function convert json string to > json string object. Then flatten on the resultset

Re: Performace issue

2019-02-13 Thread PRAVEEN DEVERACHETTY
fetch it. Can you please > share the query profile for your query ? > > P.S. Attachments are not allowed through this mailing list. Would be great > if you can upload the profile somewhere (dropbox, gDrive, etc) and share > the link with us. > > Thanks, > Sorabh > >

Re: Performace issue

2019-02-13 Thread PRAVEEN DEVERACHETTY
, Praveen On Wed, Feb 13, 2019 at 11:46 AM PRAVEEN DEVERACHETTY wrote: > Hi Sorabh, Data is in json string format, sent over rest api. Using > convert_from function to convert json string to json array and flatten the > result array into multiple rows. Data is not stored in the disk.

Re: Performace issue

2019-02-12 Thread PRAVEEN DEVERACHETTY
s until you have a fully > > flattened dataset to work with directly. > > > > On 2/11/2019 10:37:58 PM, PRAVEEN DEVERACHETTY > > wrote: > > Thnks a lot Kunal. I am looking into that. I have one observation. > > > > With out flatten also, i tried to run a q

Re: Performace issue

2019-02-12 Thread PRAVEEN DEVERACHETTY
o work with directly. > > On 2/11/2019 10:37:58 PM, PRAVEEN DEVERACHETTY > wrote: > Thnks a lot Kunal. I am looking into that. I have one observation. > > With out flatten also, i tried to run a query of size 5MB, it is taking 5GB > of heap? how do i control heap? Are

Re: Performace issue

2019-02-11 Thread PRAVEEN DEVERACHETTY
RAL-UNNEST and how it > compares to the FLATTEN operator. > > https://drill.apache.org/docs/lateral-join/ > > > On 2/11/2019 9:03:42 PM, PRAVEEN DEVERACHETTY wrote: > Thanks Kunal. > i am not getting how to use lateral-unrest as dataset does not have child > rows. All da

Re: Performace issue

2019-02-11 Thread PRAVEEN DEVERACHETTY
te: > The memory (heap) would climb as it tries to flatten the JSON data. Have > you tried looking at Drill's LateralJoin-Unnest feature? It was meant to > address memory issues for some use cases of the FLATTEN operator. > > On 2/8/2019 5:17:01 AM, PRAVEEN DEVERACHETTY wrot

Performace issue

2019-02-08 Thread PRAVEEN DEVERACHETTY
I am running a query with UNION ALL. as below select from ( select FLATTEN(t.jdata) as record from ((select convert_from(json string, json) union all (select conver_from(json_string,json) union all ... ) as jdata) ) as t) ems Reason for giving union all is because we are invoking a call using