on all this parquet files. Is there any other
> way of doing this different to DataFrame’s unionAll?
>
>
>
> Thank you very much in advance.
>
>
>
> Andres Fernandez
>
>
>
> *From:* Mich Talebzadeh [mailto:mich.talebza...@gmail.com]
> *Sent:* Tuesday, March 01,
at 12:00 PM
To: "user@spark.apache.org<mailto:user@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: RE: Save DataFrame to Hive Table
Good day colleagues. Quick question on Parquet and Dataframes. Right now I have
the 4 parquet files stored in HDFS under the sam
DataFrame to Hive Table
Hi
It seems that your code is not specifying which database is your table created
Try this
scala> val HiveContext = new org.apache.spark.sql.hive.HiveContext(sc)
scala> // Choose a database
scala> HiveContext.sql("show databases").show
scala> Hiv
Hi
It seems that your code is not specifying which database is your table
created
Try this
scala> val HiveContext = new org.apache.spark.sql.hive.HiveContext(sc)
scala> // Choose a database
scala> HiveContext.sql("show databases").show
scala> HiveContext.sql("use test") // I chose test databas
The following line does not execute the sql so the table is not created.
Add .show() at the end to execute the sql.
hiveContext.sql("CREATE TABLE IF NOT EXISTS TableName (key INT, value
STRING)")
On Tue, Mar 1, 2016 at 2:22 PM, Yogesh Vyas wrote:
> Hi,
>
> I have created a DataFrame in Spark, n
Hi,
I have created a DataFrame in Spark, now I want to save it directly
into the hive table. How to do it.?
I have created the hive table using following hiveContext:
HiveContext hiveContext = new org.apache.spark.sql.hive.HiveContext(sc.sc());
hiveContext.sql("CREATE TABLE IF NOT EXISTS
