matanper commented on issue #68906: URL: https://github.com/apache/doris/issues/68906#issuecomment-7004814392
Fixed on master by #69668: Arrow Stream Load now goes through the FileScannerV2 Arrow reader, which keeps the IPC reader open and reads one record batch at a time (`ReadNext`), returns blocks of at most `batch_size` rows, and allocates Arrow buffers from a tracked `ArrowMemoryPool`. The legacy reader that called `ToRecordBatches()` was removed in #69723. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
