just simple as: val df = sqlContext.sql(“select * from table”) or
val df = sqlContext.read.json(“hdfs_path”) > On Nov 24, 2015, at 3:09 AM, spark_user_2015 <li...@adobe.com> wrote: > > Dear all, > > is the following usage of the Dataframe constructor correct or does it > trigger any side effects that I should be aware of? > > My goal is to keep track of my dataframe's state and allow custom > transformations accordingly. > > val df: Dataframe = ...some dataframe... > val newDf = new DF(df.sqlContext, df.queryExecution.logical) with StateA > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Dataframe-constructor-tp25455.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org