[
https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193006#comment-17193006
]
Felix Kizhakkel Jose edited comment on HUDI-83 at 9/9/20, 4:05 PM:
-------------------------------------------------------------------
[~uditme] we are using EMR 6.1.0, the very recent one. Where Spark 3.0, Hive
3.1.2. So could you please elaborate a little on your response - "Yes, in hive3
it is supported, and we can just replace timestamp column from long to
timestamp.". What should be done and is it possible to make in my pyspark
script or does this change should happen in HUDI code?
was (Author: felixkjose):
[~uditme] we are using EMR 6.1.0, the very recent one. Where Spark 3.0, Hive
3.1.2. So could you please elaborate a little on your response - "Yes, in hive3
it is supported, and we can just replace timestamp column from long to
timestamp.". What should be done and is it possible to make in the pyspark
script?
> Map Timestamp type in spark to corresponding Timestamp type in Hive during
> Hive sync
> ------------------------------------------------------------------------------------
>
> Key: HUDI-83
> URL: https://issues.apache.org/jira/browse/HUDI-83
> Project: Apache Hudi
> Issue Type: Bug
> Components: Hive Integration, Usability
> Reporter: Vinoth Chandar
> Assignee: cdmikechen
> Priority: Major
> Labels: bug-bash-0.6.0
> Fix For: 0.6.1
>
>
> [https://github.com/apache/incubator-hudi/issues/543] &; related issues
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
