jorisvandenbossche commented on PR #41823: URL: https://github.com/apache/arrow/pull/41823#issuecomment-2165452361
It's ambiguous in Parquet because it uses, confusingly, "Unknown" to mean "Null" (which means you can only have unknown data if there is no data, only nulls), while there is also "Undefined" for unknown logical types. But personally I don't think we should let ourselves from using the more descriptive term because of Parquet (in Arrow, we never use "unknown" in the context of the null type, so I would say there is no ambiguity here) Personally I find "Other" rather broad, because this is not an extension type to just bucket any other type, it is meant for a very specific type of extension types that are unknown to the producer. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
