Re: Recursive CTE Support in Drill

2015-07-20 Thread Alexander Zarei
batch with actual records. This can give you an accurate measurement of the ODBC performance, removing the bottleneck of the disk. On Thu, Jul 16, 2015 at 3:24 PM, Alexander Zarei alexanderz.si...@gmail.com wrote: Thanks for the answers. @Ted my only goal

Re: Recursive CTE Support in Drill

2015-07-16 Thread Alexander Zarei
-synth On Thu, Jul 9, 2015 at 11:31 AM, Alexander Zarei alexanderz.si...@gmail.com wrote: Hi All, I am trying to come up with a query which returns a given number of rows without having a real table on Storage

Re: To EMRFS or not to EMRFS?

2015-06-18 Thread Alexander Zarei
What we learned through our research/experiments for doing performance test for Drill ODBC, you get the best throughput when Solid State Drive EC2 instances such as m3,xlarge are used to form the HDFS.

Re: Apache Drill and S3 performance

2015-06-07 Thread Alexander Zarei
It might be because of using S3 as your file system. We have done a similar experiment loading data to HDFS on m1.xlarge machines. A query profile analysis of the experiments showed reading from magnetic storage on m1.xlarge machines was the bottleneck. Hence we switched to m3.xlarge instances

Re: Stopping Drillbit and preventing it from restarting automatically on MapR sandbox

2015-04-30 Thread Alexander Zarei
, 2015 at 5:27 PM, Alexander Zarei alexanderz.si...@gmail.com wrote: Hi everyone, I am wondering if you could help me stop the drillbit in MapR sandbox as it keeps starting again by default. I build Drill from source from github and want to start it but the default (older) drill

Re: Documentation for Query Profile page in Web UI

2015-04-21 Thread Alexander Zarei
at 2:34 PM, Alexander Zarei alexanderz.si...@gmail.com wrote: Hi Team Drill! While performing performance testing on Drill clusters on AWS EMR, with TPC-H data of scale factor 100, I observed the results for a cluster of 3 nodes are similar to a cluster of 13 nodes. Hence, I am

Documentation for Query Profile page in Web UI

2015-04-21 Thread Alexander Zarei
Hi Team Drill! While performing performance testing on Drill clusters on AWS EMR, with TPC-H data of scale factor 100, I observed the results for a cluster of 3 nodes are similar to a cluster of 13 nodes. Hence, I am investigating how the query is being carried out and which part of the query

Re: Documentation for Query Profile page in Web UI

2015-04-21 Thread Alexander Zarei
much was assigned to a thread to complete the operation. A simple scan operation doesn’t require that much memory vs joins and other functions than can require much more memory —Andries On Apr 21, 2015, at 2:34 PM, Alexander Zarei alexanderz.si...@gmail.com wrote: Hi Team Drill! While