Drill is a very different tool from spark or even from Spark SQL (aka Shark).
There is some overlap, but there are important differences. For instance, - Drill supports weakly typed SQL. - Drill has a very clever way to pass data from one processor to another. This allows very efficient processing - Drill generates code in response to query and to observed data. This is a big deal since it allows high speed with dynamic types - Drill supports full ANSII SQL, not Hive QL. - Spark supports programming in Scala - Spark ties distributed data object to objects in a language like Java or Scala rather than using a columnar form. This makes generic user written code easier, but is less efficient. On Thu, May 15, 2014 at 9:41 AM, N.Venkata Naga Ravi <[email protected]>wrote: > Hi, > > I started exploring Drill , it looks like very interesting tool. Can some > body explain how Drill is going to compare with Apache Spark and Storm. > Do we still need Apache Spark along with Drill in the Bigdata stack? Or > Drill can directly support as replacement with Spark? > > Thanks, > Ravi >
