MaxGekk commented on issue #25678: [SPARK-28973][SQL] Add `TimeType` and support `java.time.LocalTime` as its external type. URL: https://github.com/apache/spark/pull/25678#issuecomment-529991848 @srowen Thank you for your quick response. > For example, what if I write this type as Parquet? I get a long type out? are there any related types in Parquet or otherwise that we need to consider the behavior of, whether it's consistent with those? Parquet has appropriate logical type for `TIME`, see https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#time : _"TIME with precision MICROS is used for microsecond precision. It must annotate an int64 that stores the number of microseconds after midnight."_ This type directly maps to new Catalyst's type.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
