emkornfield commented on issue #36799: URL: https://github.com/apache/arrow/issues/36799#issuecomment-1656758955
Yeah, Parquet does not have an analogous type. Besides for nanos vs nanoseconds, the type in parquet has each integer unsigned. I think we have three options to try to fix this: 1. Ask parquet to introduce a new type. 2. Allow for writing to existing logical type with validation that there is no data loss. 3. Specifying a mapping on our own and use the stored arrow schema to resurrect the type properly. For the latter we should collaborate with other implementations. @alamb has Rust established a convention for mapping MONTH_DAY_NANOSECONDS to parquet? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
