kou commented on PR #43632: URL: https://github.com/apache/arrow/pull/43632#issuecomment-2309579712
> > FWIW, do we need to do anything to accommodate the arrow::ArrayStatistics API that @kou has been working on? > > That's a good question, should we add some other callback / method for providing statistics? Or would this be something that we'd add to the `on_next` method? Ah, new method is better than integrating into `on_next()` method. Because statistics may be needed before an array/record batch is received. But we may not need the feature in `ArrowAsyncDeviceStreamHandler`. We will not provide a specific API to retrieve statistics for the Arrow C data interface: https://github.com/apache/arrow/pull/43553 We just provide a schema for statistics. The Arrow C data interface users will pass a statistics array like a normal array. We don't provide a statistics specific API for it. Users may want to use two separated `ArrowAsyncDeviceStreamHandler`s. One `ArrowAsyncDeviceStreamHandler` is for statistics and another is for data. Statistics array can be passed via `on_next()` because it's a normal Arrow array. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
