Re: Dismatch when use sparkSQL insert data into a hive table with dynamic partition datetype

Resolved by create udf to match different format of DateType in sparksql and HIVE suggest fix it in next release On Fri, May 8, 2015 at 11:07 AM, Gerald-G wrote: > Hi: > > Spark version is 1.3.1 > > I used sparksql insert data into a hive table with datetype partition > > The column is trans

Dismatch when use sparkSQL insert data into a hive table with dynamic partition datetype

Hi: Spark version is 1.3.1 I used sparksql insert data into a hive table with datetype partition The column is translate to an int num which is the date diff from 1970-01-01 fat_tbUser is a very simple hive table with partition dtstatdate DateType And date column userid INSERT INTO TABLE