lwhite1 commented on issue #14411: URL: https://github.com/apache/arrow/issues/14411#issuecomment-1280922513
All you can do is read the vectors in separate threads, which should speed things up considerably if you have enough cores available. Ultimately, there is no support in the Arrow java code for vectorizing the reads so if you want to read 100 million values you have to read 100 million values individually. OTOH, what is "slow" depends on your requirements. I wouldn't expect it to take very long to read 100 million primitive values from memory. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
