FelixKJose commented on issue #1895: URL: https://github.com/apache/hudi/issues/1895#issuecomment-687621720
@bvaradar I was on vacation thats why I couldn't reply in time. Actually this is related to HUDI as well, since HUDI doesn't respect the spark output timestamp type property. Secondly there is no official documentation on this limitation saying "if you use HUDI, all your timestamps should be either string or double to get it working with Presto". HUDI uses Avro schema rather than parquet schema and thereby causing timestamp macro issue. But when I looked avro seems supporting timestamp millis, so I am wondering why HUDI written data is not getting recognized as timestamp_millis? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
