lidavidm commented on code in PR #41823: URL: https://github.com/apache/arrow/pull/41823#discussion_r1639807409
########## docs/source/format/CanonicalExtensions.rst: ########## @@ -283,6 +283,155 @@ UUID A specific UUID version is not required or guaranteed. This extension represents UUIDs as FixedSizeBinary(16) with big-endian notation and does not interpret the bytes in any way. +Unknown +======= + +Unknown represents a type or array that an Arrow-based system received from an +external (often non-Arrow) system, which it cannot interpret itself or did not +have support for in advance. In this case, it can pass on Unknown to its own +clients to communicate that a field exists, but that it cannot interpret the +field or data. + +Extension parameters: + +* Extension name: ``arrow.unknown``. + +* The storage type of this extension is any type. If there is no underlying + data, the storage type should be Null. If there is data, the storage type + should preferably be binary or fixed-size binary, but may be any type. Review Comment: Originally @pitrou's suggestion IIRC, but most likely if you have uninterpretable data it's probably a binary blob. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org