Luosuu commented on issue #38275: URL: https://github.com/apache/arrow/issues/38275#issuecomment-1763450564
@mapleFU Thank you for reply! Actually in my scenario I have a very long list of indices lists so I will need to repeat the I/O operation many times. The major performance concern is on extracting record batches on disks. Is there anything possible to block multi-threading RecordBatch take operation? And could you please provide more details about what is the recommended practice to parallelize multiple RecordBatch reading including how should I use thread API to accelerate? Thank you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
