Re: Spark SQL Programming Guide - registerTempTable Error
We keep conf as symbolic link so that upgrade is as simple as drop-in replacement On Monday, November 24, 2014, riginos wrote: > OK thank you very much for that! > On 23 Nov 2014 21:49, "Denny Lee [via Apache Spark User List]" <[hidden > email] <http://user/SendEmail.jtp?type=node&node=19638&i=0>> wrote: > >> It sort of depends on your environment. If you are running on your local >> environment, I would just download the latest Spark 1.1 binaries and you'll >> be good to go. If its a production environment, it sort of depends on how >> you are setup (e.g. AWS, Cloudera, etc.) >> >> On Sun Nov 23 2014 at 11:27:49 AM riginos <[hidden email] >> <http://user/SendEmail.jtp?type=node&node=19598&i=0>> wrote: >> >>> That was the problem ! Thank you Denny for your fast response! >>> Another quick question: >>> Is there any way to update spark to 1.1.0 fast? >>> >>> >>> >>> >>> -- >>> View this message in context: http://apache-spark-user-list. >>> 1001560.n3.nabble.com/Spark-SQL-Programming-Guide- >>> registerTempTable-Error-tp19591p19595.html >>> Sent from the Apache Spark User List mailing list archive at Nabble.com. >>> >>> - >>> To unsubscribe, e-mail: [hidden email] >>> <http://user/SendEmail.jtp?type=node&node=19598&i=1> >>> For additional commands, e-mail: [hidden email] >>> <http://user/SendEmail.jtp?type=node&node=19598&i=2> >>> >>> >> >> -- >> If you reply to this email, your message will be added to the >> discussion below: >> >> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19598.html >> To unsubscribe from Spark SQL Programming Guide - registerTempTable >> Error, click here. >> NAML >> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> >> > > -- > View this message in context: Re: Spark SQL Programming Guide - > registerTempTable Error > <http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19638.html> > Sent from the Apache Spark User List mailing list archive > <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com. > -- - Rishi
Re: Spark SQL Programming Guide - registerTempTable Error
OK thank you very much for that! On 23 Nov 2014 21:49, "Denny Lee [via Apache Spark User List]" < ml-node+s1001560n19598...@n3.nabble.com> wrote: > It sort of depends on your environment. If you are running on your local > environment, I would just download the latest Spark 1.1 binaries and you'll > be good to go. If its a production environment, it sort of depends on how > you are setup (e.g. AWS, Cloudera, etc.) > > On Sun Nov 23 2014 at 11:27:49 AM riginos <[hidden email] > <http://user/SendEmail.jtp?type=node&node=19598&i=0>> wrote: > >> That was the problem ! Thank you Denny for your fast response! >> Another quick question: >> Is there any way to update spark to 1.1.0 fast? >> >> >> >> >> -- >> View this message in context: http://apache-spark-user-list. >> 1001560.n3.nabble.com/Spark-SQL-Programming-Guide- >> registerTempTable-Error-tp19591p19595.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> - >> To unsubscribe, e-mail: [hidden email] >> <http://user/SendEmail.jtp?type=node&node=19598&i=1> >> For additional commands, e-mail: [hidden email] >> <http://user/SendEmail.jtp?type=node&node=19598&i=2> >> >> > > -- > If you reply to this email, your message will be added to the discussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19598.html > To unsubscribe from Spark SQL Programming Guide - registerTempTable > Error, click here > <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=19591&code=c2FtYXJhc3JpZ2lub3NAZ21haWwuY29tfDE5NTkxfDE4MjAzNjYzMjQ=> > . > NAML > <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19638.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: Spark SQL Programming Guide - registerTempTable Error
It sort of depends on your environment. If you are running on your local environment, I would just download the latest Spark 1.1 binaries and you'll be good to go. If its a production environment, it sort of depends on how you are setup (e.g. AWS, Cloudera, etc.) On Sun Nov 23 2014 at 11:27:49 AM riginos wrote: > That was the problem ! Thank you Denny for your fast response! > Another quick question: > Is there any way to update spark to 1.1.0 fast? > > > > > -- > View this message in context: http://apache-spark-user-list. > 1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error- > tp19591p19595.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
Re: Spark SQL Programming Guide - registerTempTable Error
That was the problem ! Thank you Denny for your fast response! Another quick question: Is there any way to update spark to 1.1.0 fast? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591p19595.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: Spark SQL Programming Guide - registerTempTable Error
By any chance are you using Spark 1.0.2? registerTempTable was introduced from Spark 1.1+ while for Spark 1.0.2, it would be registerAsTable. On Sun Nov 23 2014 at 10:59:48 AM riginos wrote: > Hi guys , > Im trying to do the Spark SQL Programming Guide but after the: > > case class Person(name: String, age: Int) > // Create an RDD of Person objects and register it as a table. > val people = > sc.textFile("examples/src/main/resources/people.txt"). > map(_.split(",")).map(p > => Person(p(0), p(1).trim.toInt)) > > im issuing: > people.registerTempTable("people") > :20: error: value registerTempTable is not a member of > org.apache.spark.rdd.RDD[Person] > people.registerTempTable("people") > > why is that what I'm i doing wrong? > > > > -- > View this message in context: http://apache-spark-user-list. > 1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error- > tp19591.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
Spark SQL Programming Guide - registerTempTable Error
Hi guys , Im trying to do the Spark SQL Programming Guide but after the: case class Person(name: String, age: Int) // Create an RDD of Person objects and register it as a table. val people = sc.textFile("examples/src/main/resources/people.txt").map(_.split(",")).map(p => Person(p(0), p(1).trim.toInt)) im issuing: people.registerTempTable("people") :20: error: value registerTempTable is not a member of org.apache.spark.rdd.RDD[Person] people.registerTempTable("people") why is that what I'm i doing wrong? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Programming-Guide-registerTempTable-Error-tp19591.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org