lidavidm commented on issue #38837: URL: https://github.com/apache/arrow/issues/38837#issuecomment-2089533055
We talked about this a little, but what about approach (2) from [Kou's comment above](https://github.com/apache/arrow/issues/38837#issuecomment-2088101530), but for now only defining table-level statistics (primarily row count)? AIUI, row count is the important statistic to have for @pdet's use case, and it is simple to define. We can wait and see on more complicated or column-level statistics. Also for the ArrowDeviceArray, there is some room for extension: https://github.com/apache/arrow/blob/14c54bbfb7d9305e79a2c2d016c34a655773e5cb/cpp/src/arrow/c/abi.h#L134-L135 Could that be useful here? (Unfortunately there isn't any room for extension on ArrowDeviceArrayStream.) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
