youngfn commented on issue #33627: URL: https://github.com/apache/arrow/issues/33627#issuecomment-1381226315
> thx~~~ I will test it right now. Btw what about batch_size and batch_readahead, do they affect the thread number? Also, Do you think the HDFS connection number will affect the reading performance? I mean that each reading thread owns its HDFS connection will read faster than the case all reading threads share one HDFS connection. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
