for this case? Do you convert on insert or on RDD
to DF conversion?
Regards,
Bryan Jeffrey
Sent from Outlook Mail
*From: *Cheng Lian
*Sent: *Tuesday, November 24, 2015 6:49 AM
*To: *Bryan;user
*Subject: *Re: DateTime Support - Hive Parquet
I see, then this is actually irrelevant to Parquet. I
(to nanos, Timestamp, etc) prior to
writing records to hive.
Regards,
Bryan Jeffrey
Sent from Outlook Mail
*From: *Cheng Lian
*Sent: *Tuesday, November 24, 2015 1:42 AM
*To: *Bryan Jeffrey;user
*Subject: *Re: DateTime Support - Hive Parquet
Hey Bryan,
What do you mean by "DateTime prope
?
Regards,
Bryan Jeffrey
Sent from Outlook Mail
From: Cheng Lian
Sent: Tuesday, November 24, 2015 6:49 AM
To: Bryan;user
Subject: Re: DateTime Support - Hive Parquet
I see, then this is actually irrelevant to Parquet. I guess can support Joda
DateTime in Spark SQL reflective schema inference
Lian
Sent: Tuesday, November 24, 2015 1:42 AM
To: Bryan Jeffrey;user
Subject: Re: DateTime Support - Hive Parquet
Hey Bryan,
What do you mean by "DateTime properties"? Hive and Spark SQL both
support DATE and TIMESTAMP types, but there's no DATETIME type. So I
assume you are referri
All,
I am attempting to write objects that include a DateTime properties to a
persistent table using Spark 1.5.2 / HiveContext. In 1.4.1 I was forced to
convert the DateTime properties to Timestamp properties. I was under the
impression that this issue was fixed in the default Hive supported
Hey Bryan,
What do you mean by "DateTime properties"? Hive and Spark SQL both
support DATE and TIMESTAMP types, but there's no DATETIME type. So I
assume you are referring to Java class DateTime (possibly the one in
joda)? Could you please provide a sample snippet that illustrates your
