clbarnes opened a new issue, #49058:
URL: https://github.com/apache/arrow/issues/49058

   ### Describe the bug, including details regarding any error messages, 
version, and platform.
   
   
[Schema.fbs](https://github.com/apache/arrow/blob/main/format/Schema.fbs#L475) 
requires that custom metadata keys and values are strings, which in flatbuffer 
world are [length-prefixed, null-terminated runs of UTF-8 or 7-bit ASCII code 
points](https://flatbuffers.dev/schema/#strings). However, pyarrow allows you 
to create and read metadata with arbitrary bytes. This is inconsistent with 
other implementations, such as rust, which uses the String type, enforcing 
UTF-8.
   
   ### Component(s)
   
   Python


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to