mapleFU commented on issue #36426: URL: https://github.com/apache/arrow/issues/36426#issuecomment-1615941946
Hi @HanpyBin Parquet format itself doesn't have "second": https://github.com/apache/parquet-format/blob/master/src/main/thrift/parquet.thrift#L90-L120 , and arrow schema would cast Second to Micro Seconds during converting: ```c++ // The user implicitly wants timestamp data to retain its original time units, // however the Arrow seconds time unit can not be represented (annotated) in // any version of Parquet and so must be coerced to milliseconds. if (type.unit() == ::arrow::TimeUnit::SECOND) { *logical_type = TimestampLogicalTypeFromArrowTimestamp(type, ::arrow::TimeUnit::MILLI); return Status::OK(); } ``` You can also see: https://arrow.apache.org/docs/cpp/parquet.html#logical-types . And maybe you can use "CAST" during read. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
