r parquet to ORC, not sure if this have an impact or not.
>
> Thanks you for our help.
>
> From: Mich Talebzadeh
> Date: Sunday, April 10, 2016 at 11:54 PM
> To: maurin lenglart
> Cc: "user @spark"
> Subject: Re: alter table add columns aternatives or hive refresh
gt;>
Cc: "user @spark" mailto:user@spark.apache.org>>
Subject: Re: alter table add columns aternatives or hive refresh
This should work. Make sure that you use HiveContext.sql and sqlContext
correctly
This is an example in Spark, reading a CSV file, doing some manipulation,
crea
Lenglart
mailto:mau...@cuberonlabs.com>> wrote:
Your solution works in hive, but not in spark, even if I use hive context.
I tried to create a temp table and then this query:
- sqlContext.sql("insert into table myTable select * from myTable_temp”)
But I still get the same error.
thank
Dr Mich Talebzadeh
LinkedIn *
https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
http://talebzadehmich.wordpress.com
On 11 April 2016 at 01:36, Maurin Lenglart wrote:
> Yo
l.com>>
Date: Sunday, April 10, 2016 at 12:25 PM
To: "user @spark" mailto:user@spark.apache.org>>
Subject: Re: alter table add columns aternatives or hive refresh
Hi,
I am confining myself to Hive tables. As I stated it before I have not tried it
in Spark. So I stand correct
llow me not to move TB of data
> everyday?
>
> Thanks for you answer
>
> From: Mich Talebzadeh
> Date: Sunday, April 10, 2016 at 3:41 AM
> To: maurin lenglart
> Cc: "user@spark.apache.org"
> Subject: Re: alter table add columns aternatives or hive refresh
>
>
ser@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: Re: alter table add columns aternatives or hive refresh
I have not tried it on Spark but the column added in Hive to an existing table
cannot be updated for existing rows. In other words the new column is set to
null which
I have not tried it on Spark but the column added in Hive to an existing
table cannot be updated for existing rows. In other words the new column is
set to null which does not require the change in the existing file length.
So basically as I understand when a column is added to an already table.
Hi,
I am trying to add columns to table that I created with the “saveAsTable” api.
I update the columns using sqlContext.sql(‘alter table myTable add columns
(mycol string)’).
The next time I create a df and save it in the same table, with the new columns
I get a :
“ParquetRelation
requires that
