StephanEwen commented on pull request #13885:
URL: https://github.com/apache/flink/pull/13885#issuecomment-731580036
Yes, I think that makes sense. Adding a `fs.buffer` config option, maybe
with a default value of 64k?
- For local streams, it would be good as well, that is true.
- For S3, we get that implicitly if we buffer the `HadoopDataInputStream`,
because the S3 reads go through some Hadoop utilities and also wrap the stream
with the `HadoopDataInputStream` in the end.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
