Re: Spark SQL Programming Guide - registerTempTable Error
OK thank you very much for that! On 23 Nov 2014 21:49, Denny Lee [via Apache Spark User List] ml-node+s1001560n19598...@n3.nabble.com wrote: It sort of depends on your environment. If you are running on your local environment, I would just download the latest Spark 1.1 binaries and you'll be good to go. If its a production environment, it sort of depends on how you are setup (e.g. AWS, Cloudera, etc.) On Sun Nov 23 2014 at 11:27:49 AM riginos [hidden email] http://user/SendEmail.jtp?type=nodenode=19598i=0 wrote: That was the problem ! Thank you Denny for your fast response! Another quick question: Is there any way to update spark to 1.1.0 fast? -- View this message in context: http://apache-spark-user-list. 1001560.n3.nabble.com/Spark-SQL-Programming-Guide- registerTempTable-Error-tp19591p19595.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: [hidden email] http://user/SendEmail.jtp?type=nodenode=19598i=1 For additional commands, e-mail: [hidden email] http://user/SendEmail.jtp?type=nodenode=19598i=2 -- If you reply to this email, your message will be added to the discussion below: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19598.html To unsubscribe from Spark SQL Programming Guide - registerTempTable Error, click here http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=19591code=c2FtYXJhc3JpZ2lub3NAZ21haWwuY29tfDE5NTkxfDE4MjAzNjYzMjQ= . NAML http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19638.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: Spark SQL Programming Guide - registerTempTable Error
We keep conf as symbolic link so that upgrade is as simple as drop-in replacement On Monday, November 24, 2014, riginos samarasrigi...@gmail.com wrote: OK thank you very much for that! On 23 Nov 2014 21:49, Denny Lee [via Apache Spark User List] [hidden email] http://user/SendEmail.jtp?type=nodenode=19638i=0 wrote: It sort of depends on your environment. If you are running on your local environment, I would just download the latest Spark 1.1 binaries and you'll be good to go. If its a production environment, it sort of depends on how you are setup (e.g. AWS, Cloudera, etc.) On Sun Nov 23 2014 at 11:27:49 AM riginos [hidden email] http://user/SendEmail.jtp?type=nodenode=19598i=0 wrote: That was the problem ! Thank you Denny for your fast response! Another quick question: Is there any way to update spark to 1.1.0 fast? -- View this message in context: http://apache-spark-user-list. 1001560.n3.nabble.com/Spark-SQL-Programming-Guide- registerTempTable-Error-tp19591p19595.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: [hidden email] http://user/SendEmail.jtp?type=nodenode=19598i=1 For additional commands, e-mail: [hidden email] http://user/SendEmail.jtp?type=nodenode=19598i=2 -- If you reply to this email, your message will be added to the discussion below: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19598.html To unsubscribe from Spark SQL Programming Guide - registerTempTable Error, click here. NAML http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml -- View this message in context: Re: Spark SQL Programming Guide - registerTempTable Error http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19638.html Sent from the Apache Spark User List mailing list archive http://apache-spark-user-list.1001560.n3.nabble.com/ at Nabble.com. -- - Rishi
Re: Spark SQL Programming Guide - registerTempTable Error
By any chance are you using Spark 1.0.2? registerTempTable was introduced from Spark 1.1+ while for Spark 1.0.2, it would be registerAsTable. On Sun Nov 23 2014 at 10:59:48 AM riginos samarasrigi...@gmail.com wrote: Hi guys , Im trying to do the Spark SQL Programming Guide but after the: case class Person(name: String, age: Int) // Create an RDD of Person objects and register it as a table. val people = sc.textFile(examples/src/main/resources/people.txt). map(_.split(,)).map(p = Person(p(0), p(1).trim.toInt)) im issuing: people.registerTempTable(people) console:20: error: value registerTempTable is not a member of org.apache.spark.rdd.RDD[Person] people.registerTempTable(people) why is that what I'm i doing wrong? -- View this message in context: http://apache-spark-user-list. 1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error- tp19591.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: Spark SQL Programming Guide - registerTempTable Error
That was the problem ! Thank you Denny for your fast response! Another quick question: Is there any way to update spark to 1.1.0 fast? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19595.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: Spark SQL Programming Guide - registerTempTable Error
It sort of depends on your environment. If you are running on your local environment, I would just download the latest Spark 1.1 binaries and you'll be good to go. If its a production environment, it sort of depends on how you are setup (e.g. AWS, Cloudera, etc.) On Sun Nov 23 2014 at 11:27:49 AM riginos samarasrigi...@gmail.com wrote: That was the problem ! Thank you Denny for your fast response! Another quick question: Is there any way to update spark to 1.1.0 fast? -- View this message in context: http://apache-spark-user-list. 1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error- tp19591p19595.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
