Re: Using Drill with EMR

2015-02-27 Thread Andries Engelbrecht
1. Yes. You can run Drill & ZK separate from Hadoop env. And it work on AWS. 2. I have not used it with Amazon EMR, maybe others can comment. Why are you looking at EMR and Drill vs spinning up instances with Drill & ZK? Drill does not work like Hive with underlying MR needed to execute queries,

Re: Using Drill with EMR

2015-02-27 Thread Ted Dunning
On Wed, Feb 25, 2015 at 8:17 PM, Mihai Stoicescu wrote: > Hello, > > My name is Mihai Stoicescu and I am trying to experiment with Apache > Drill. > > I have multiple questions that I hope you can help me find the answers: > >1. Can Drill & Zookeper work outside Hadoop environment? >

Using Drill with EMR

2015-02-27 Thread Mihai Stoicescu
Hello, My name is Mihai Stoicescu and I am trying to experiment with Apache Drill. I have multiple questions that I hope you can help me find the answers: 1. Can Drill & Zookeper work outside Hadoop environment? 2. What would be the configuration steps I would need to make to

Re: Query HDFS, MySQL and Microsoft SQL

2015-02-27 Thread Carol McDonald
You can register a storage plugin instance that connects Drill to a local file system or a distributed file system registered in core-site.xml, such as S3 or HDFS. When you register a storage plugin instance for a file system, provide a unique name for the instance, and identify the type as “ file”

Re: inverse of kvgen and flatten?

2015-02-27 Thread Jason Altekruse
This currently is not possible, considering the existence of flatten is should definitely be added. There is a larger issue that we do not support all of the patterns that users will expect with lists. Drill is also unable to apply a scalar function over all of the elements of a list, or apply an a

inverse of kvgen and flatten?

2015-02-27 Thread Ted Dunning
I was just looking through the documentation and I don't see a way to group data and then create a list. Flatten turns a list into individual records. I would like to turn some fields from a grouped set of records into a list of objects or a list of values.

Query HDFS, MySQL and Microsoft SQL

2015-02-27 Thread Shanmuga Sundaram Karunagaran
Hi Guys, I'm new to Apache Drill. I'm able to use it to query HBase and HDFS through Hive. Please help me in the following questions 1. Is it possible to query HDFS directly without using Hive, like dfs, if so please provide me the storage description (Thanks in advance) 2. Is it possible to que