anjakefala opened a new issue, #36960:
URL: https://github.com/apache/arrow/issues/36960

   ### Describe the enhancement requested
   
   I ran into at least two situations where [empty buffers were represented as 
null buffers](https://github.com/jorgecarleitao/arrow2/issues/1524) in Arrow, 
on with `read_ipc` and one with `read_feather`. 
   
   I want to clarify that [null buffers are legal in the 
spec](https://arrow.apache.org/docs/format/CDataInterface.html#c.ArrowArray.buffers),
 so this is not a bug report.
   
   However, this is running into compatibility problems with [arrow2, which 
doesn't allow null 
buffers](https://github.com/jorgecarleitao/arrow2/blob/031bc7bc9ff720073b553a23696e7288db269229/src/ffi/array.rs#L209-L214).
 [polars users are bumping into 
it](https://github.com/pola-rs/polars/issues/9822). 
   
   This could be resolved, if those buffers were instead pointed to 
[kNonNullFiller](https://github.com/apache/arrow/blob/a06b2618420ef89431373a9e8f07a5da64d546a5/cpp/src/arrow/util/ubsan.h#L33),
 which I believe was set up to handle compatibility issues like this. 
   
   The alternative to resolve this problem is for [arrow2 to allow null 
buffers](https://github.com/jorgecarleitao/arrow2/issues/1524). I did open an 
issue, but I am not sure how active the maintainer is, and why they disallowed 
them in the first place. 
   
   ### Component(s)
   
   C++


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to