Re: Spark SQL drops the HIVE table in "overwrite" mode while writing into table

2016-03-06 Thread Dhaval Modi
Hi Gourav, I am trying to overwrite existing managed/internal table. I havent register dataframe, so it's not a temporary table. BTW, I have added code in JIRA as comment. Thanks, Dhaval On Mar 6, 2016 17:07, "Gourav Sengupta" wrote: > hi, > > is the table that

Re: Spark SQL drops the HIVE table in "overwrite" mode while writing into table

2016-03-06 Thread Gourav Sengupta
hi, is the table that you are trying to overwrite an external table or temporary table created in hivecontext? Regards, Gourav Sengupta On Sat, Mar 5, 2016 at 3:01 PM, Dhaval Modi wrote: > Hi Team, > > I am facing a issue while writing dataframe back to HIVE table. >

Spark SQL drops the HIVE table in "overwrite" mode while writing into table

2016-03-05 Thread Dhaval Modi
Hi Team, I am facing a issue while writing dataframe back to HIVE table. When using "SaveMode.Overwrite" option the table is getting dropped and Spark is unable to recreate it thus throwing error. JIRA: https://issues.apache.org/jira/browse/SPARK-13699 E.g.