Re: SQLContext and HiveContext parse a query string differently ?

2016-05-13 Thread Hao Ren
xt? The query parser are different, why do > you want to have this feature? Do I understand your question correctly? > > Yong > > ------------------ > Date: Thu, 12 May 2016 13:09:34 +0200 > Subject: SQLContext and HiveContext parse a query string differently ? >

RE: SQLContext and HiveContext parse a query string differently ?

2016-05-12 Thread Yong Zhang
HiveContext parse a query string differently ? From: inv...@gmail.com To: user@spark.apache.org HI, I just want to figure out why the two contexts behavior differently even on a simple query.In a netshell, I have a query in which there is a String containing single quote and casting to Array/Map.I have

Re: SQLContext and HiveContext parse a query string differently ?

2016-05-12 Thread Mich Talebzadeh
yep the same error I got root |-- a: array (nullable = true) ||-- element: integer (containsNull = false) |-- b: integer (nullable = false) NoViableAltException(35@[]) at org.apache.hadoop.hive.ql.parse.HiveParser.primitiveType(HiveParser.java:38886) at org.apache.hadoop.hiv

SQLContext and HiveContext parse a query string differently ?

2016-05-12 Thread Hao Ren
HI, I just want to figure out why the two contexts behavior differently even on a simple query. In a netshell, I have a query in which there is a String containing single quote and casting to Array/Map. I have tried all the combination of diff type of sql context and query call api (sql, df.select