RE: Spark Hive Rejection

2016-10-03 Thread Mostafa Alaa Mohamed
Segel [mailto:msegel_had...@hotmail.com] Sent: Thursday, September 29, 2016 04:26 PM To: Mostafa Alaa Mohamed Cc: user@spark.apache.org Subject: Re: Spark Hive Rejection Correct me if I’m wrong but isn’t hive schema on read and not on write? So you shouldn’t fail on write. On Sep 29, 2016, at 1:25 AM, M

Re: Spark Hive Rejection

2016-09-29 Thread Michael Segel
Correct me if I’m wrong but isn’t hive schema on read and not on write? So you shouldn’t fail on write. On Sep 29, 2016, at 1:25 AM, Mostafa Alaa Mohamed mailto:mohamedamost...@etisalat.ae>> wrote: Dears, I want to ask • What will happened if there are rejections rows when inserting da

Spark Hive Rejection

2016-09-28 Thread Mostafa Alaa Mohamed
Dears, I want to ask * What will happened if there are rejections rows when inserting dataframe into hive? o Rejection will be for example table required integer into column and dataframe include string. o Duplication rejection restriction from the table itself? * How can