Re: Unresolved attributes

2014-12-02 Thread Michael Armbrust
A little bit about how to read this output. Resolution occurs from the bottom up and when you see a tick (') it means that a field is unresolved. So here it looks like Year_2011_Month_0_Week_0_Site is missing from from your RDD. (We are working on more obvious error messages). Michael On Tue, D

Re: Unresolved Attributes

2014-11-09 Thread Srinivas Chamarthi
ok I am answering my question here. looks like name has a reserved key word or some special treatment. unless you use alias, it doesn't work. so use an alias always with name attribute. select a.name from xxx a where a. = 'y' // RIGHT select name from where t ='yy' // doesn't work

Re: Unresolved attributes: SparkSQL on the schemaRDD

2014-09-30 Thread Yin Huai
I think this problem has been fixed after the 1.1 release. Can you try the master branch? On Mon, Sep 29, 2014 at 10:06 PM, vdiwakar.malladi < vdiwakar.mall...@gmail.com> wrote: > I'm using the latest version i.e. Spark 1.1.0 > > Thanks. > > > > -- > View this message in context: > http://apache-

Re: Unresolved attributes: SparkSQL on the schemaRDD

2014-09-29 Thread vdiwakar.malladi
I'm using the latest version i.e. Spark 1.1.0 Thanks. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Unresolved-attributes-SparkSQL-on-the-schemaRDD-tp15339p15376.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --

Re: Unresolved attributes: SparkSQL on the schemaRDD

2014-09-29 Thread Akhil Das
Sorry. Not that, this one http://arjon.es/2014/07/01/processing-json-with-spark-sql/ Thanks Best Regards On Tue, Sep 30, 2014 at 1:43 AM, Akhil Das wrote: > This one explains it nicely > http://www.dofactory.com/topic/1816/spark-performing-a-join-and-getting-results-back-in-a-strongly-typed-col

Re: Unresolved attributes: SparkSQL on the schemaRDD

2014-09-29 Thread Akhil Das
This one explains it nicely http://www.dofactory.com/topic/1816/spark-performing-a-join-and-getting-results-back-in-a-strongly-typed-collection.aspx Thanks Best Regards On Tue, Sep 30, 2014 at 12:57 AM, Yin Huai wrote: > What version of Spark did you use? Can you try the master branch? > > On M

Re: Unresolved attributes: SparkSQL on the schemaRDD

2014-09-29 Thread Yin Huai
What version of Spark did you use? Can you try the master branch? On Mon, Sep 29, 2014 at 1:52 PM, vdiwakar.malladi < vdiwakar.mall...@gmail.com> wrote: > Thanks for your prompt response. > > Still on further note, I'm getting the exception while executing the query. > > "SELECT data[0].name FROM

Re: Unresolved attributes: SparkSQL on the schemaRDD

2014-09-29 Thread vdiwakar.malladi
Thanks for your prompt response. Still on further note, I'm getting the exception while executing the query. "SELECT data[0].name FROM people where data[0].age >=13" *Exception in thread "main" java.lang.RuntimeException: [1.46] failure: ``UNION'' expected but identifier .age found SELECT data[

Re: Unresolved attributes: SparkSQL on the schemaRDD

2014-09-29 Thread Cheng Lian
In your case, the table has only one row, whose contents is “data”, which is an array. You need something like |SELECT data[0].name FROM json_table| to access the |name| field. On 9/29/14 11:08 PM, vdiwakar.malladi wrote: Hello, I'm exploring SparkSQL and I'm facing issue while using the que