Re: Querying Drill with Spark DataFrame

2017-07-22 Thread Luqman Ghani
BTW, do we have to register JdbcDialect for every Spark/SQL context, or once for a Spark server? On Sun, Jul 23, 2017 at 2:26 AM, Luqman Ghani wrote: > I have found the solution for this error. I have to register a JdbcDialect > for Drill as mentioned in the following post on SO: >

Re: Querying Drill with Spark DataFrame

2017-07-22 Thread Luqman Ghani
I have found the solution for this error. I have to register a JdbcDialect for Drill as mentioned in the following post on SO: https://stackoverflow.com/questions/35476076/integrating-spark-sql-and-apache-drill-through-jdbc Thanks On Sun, Jul 23, 2017 at 2:10 AM, Luqman Ghani wrote: > I h

Re: Querying Drill with Spark DataFrame

2017-07-22 Thread Luqman Ghani
I have done that, but Spark is encompassing my query with same clause: SELECT "CustomerID", etc FROM ( my query from table) so same error. On Sun, Jul 23, 2017 at 2:02 AM, ayan guha wrote: > You can formulate a query in dbtable clause in jdbc reader. > > On Sun, 23 Jul 2017

Querying Drill with Spark DataFrame

2017-07-22 Thread Luqman Ghani
Hi, I'm working on integrating Apache Drill with Apache Spark with Drill's JDBC driver. I'm trying a simple select * from table from Drill through spark.sqlContext.load via jdbc driver. I'm running the following code in Spark Shell: > ./bin/spark-shell --driver-class-path /home/ubuntu/dir/spark/j