Re: Spark SQL Programming Guide - registerTempTable Error

2014-11-24 Thread Rishi Yadav
We keep conf  as symbolic link so that upgrade is as simple as drop-in
replacement

On Monday, November 24, 2014, riginos  wrote:

> OK thank you very much for that!
> On 23 Nov 2014 21:49, "Denny Lee [via Apache Spark User List]" <[hidden
> email] <http://user/SendEmail.jtp?type=node&node=19638&i=0>> wrote:
>
>> It sort of depends on your environment.  If you are running on your local
>> environment, I would just download the latest Spark 1.1 binaries and you'll
>> be good to go.  If its a production environment, it sort of depends on how
>> you are setup (e.g. AWS, Cloudera, etc.)
>>
>> On Sun Nov 23 2014 at 11:27:49 AM riginos <[hidden email]
>> <http://user/SendEmail.jtp?type=node&node=19598&i=0>> wrote:
>>
>>> That was the problem ! Thank you Denny for your fast response!
>>> Another quick question:
>>> Is there any way to update spark to 1.1.0 fast?
>>>
>>>
>>>
>>>
>>> --
>>> View this message in context: http://apache-spark-user-list.
>>> 1001560.n3.nabble.com/Spark-SQL-Programming-Guide-
>>> registerTempTable-Error-tp19591p19595.html
>>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>>
>>> -
>>> To unsubscribe, e-mail: [hidden email]
>>> <http://user/SendEmail.jtp?type=node&node=19598&i=1>
>>> For additional commands, e-mail: [hidden email]
>>> <http://user/SendEmail.jtp?type=node&node=19598&i=2>
>>>
>>>
>>
>> --
>>  If you reply to this email, your message will be added to the
>> discussion below:
>>
>> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19598.html
>>  To unsubscribe from Spark SQL Programming Guide - registerTempTable
>> Error, click here.
>> NAML
>> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>
>
> --
> View this message in context: Re: Spark SQL Programming Guide -
> registerTempTable Error
> <http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19638.html>
> Sent from the Apache Spark User List mailing list archive
> <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.
>


-- 
- Rishi


Re: Spark SQL Programming Guide - registerTempTable Error

2014-11-24 Thread riginos
OK thank you very much for that!
On 23 Nov 2014 21:49, "Denny Lee [via Apache Spark User List]" <
ml-node+s1001560n19598...@n3.nabble.com> wrote:

> It sort of depends on your environment.  If you are running on your local
> environment, I would just download the latest Spark 1.1 binaries and you'll
> be good to go.  If its a production environment, it sort of depends on how
> you are setup (e.g. AWS, Cloudera, etc.)
>
> On Sun Nov 23 2014 at 11:27:49 AM riginos <[hidden email]
> <http://user/SendEmail.jtp?type=node&node=19598&i=0>> wrote:
>
>> That was the problem ! Thank you Denny for your fast response!
>> Another quick question:
>> Is there any way to update spark to 1.1.0 fast?
>>
>>
>>
>>
>> --
>> View this message in context: http://apache-spark-user-list.
>> 1001560.n3.nabble.com/Spark-SQL-Programming-Guide-
>> registerTempTable-Error-tp19591p19595.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> -
>> To unsubscribe, e-mail: [hidden email]
>> <http://user/SendEmail.jtp?type=node&node=19598&i=1>
>> For additional commands, e-mail: [hidden email]
>> <http://user/SendEmail.jtp?type=node&node=19598&i=2>
>>
>>
>
> --
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19598.html
>  To unsubscribe from Spark SQL Programming Guide - registerTempTable
> Error, click here
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=19591&code=c2FtYXJhc3JpZ2lub3NAZ21haWwuY29tfDE5NTkxfDE4MjAzNjYzMjQ=>
> .
> NAML
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19638.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Spark SQL Programming Guide - registerTempTable Error

2014-11-23 Thread Denny Lee
It sort of depends on your environment.  If you are running on your local
environment, I would just download the latest Spark 1.1 binaries and you'll
be good to go.  If its a production environment, it sort of depends on how
you are setup (e.g. AWS, Cloudera, etc.)

On Sun Nov 23 2014 at 11:27:49 AM riginos  wrote:

> That was the problem ! Thank you Denny for your fast response!
> Another quick question:
> Is there any way to update spark to 1.1.0 fast?
>
>
>
>
> --
> View this message in context: http://apache-spark-user-list.
> 1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-
> tp19591p19595.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>


Re: Spark SQL Programming Guide - registerTempTable Error

2014-11-23 Thread riginos
That was the problem ! Thank you Denny for your fast response!
Another quick question:
Is there any way to update spark to 1.1.0 fast?




--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19595.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org



Re: Spark SQL Programming Guide - registerTempTable Error

2014-11-23 Thread Denny Lee
By any chance are you using Spark 1.0.2?  registerTempTable was introduced
from Spark 1.1+ while for Spark 1.0.2, it would be registerAsTable.

On Sun Nov 23 2014 at 10:59:48 AM riginos  wrote:

> Hi guys ,
> Im trying to do the Spark SQL Programming Guide but after the:
>
> case class Person(name: String, age: Int)
> // Create an RDD of Person objects and register it as a table.
> val people =
> sc.textFile("examples/src/main/resources/people.txt").
> map(_.split(",")).map(p
> => Person(p(0), p(1).trim.toInt))
>
> im issuing:
> people.registerTempTable("people")
>  :20: error: value registerTempTable is not a member of
> org.apache.spark.rdd.RDD[Person]
>   people.registerTempTable("people")
>
> why is that what I'm i doing wrong?
>
>
>
> --
> View this message in context: http://apache-spark-user-list.
> 1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-
> tp19591.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>


Spark SQL Programming Guide - registerTempTable Error

2014-11-23 Thread riginos
Hi guys ,
Im trying to do the Spark SQL Programming Guide but after the:

case class Person(name: String, age: Int)
// Create an RDD of Person objects and register it as a table.
val people =
sc.textFile("examples/src/main/resources/people.txt").map(_.split(",")).map(p
=> Person(p(0), p(1).trim.toInt)) 

im issuing:
people.registerTempTable("people")
 :20: error: value registerTempTable is not a member of
org.apache.spark.rdd.RDD[Person]
  people.registerTempTable("people")

why is that what I'm i doing wrong?



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org