felipecrv commented on issue #41604: URL: https://github.com/apache/arrow/issues/41604#issuecomment-2112729397
> That's another possibility, but it forces the caller to allocate `maxBytes` even if the result could be as small as `minBytes`. But the caller chooses `maxBytes` :) The existing `Read(n, ptr)` calls become `Read(min_bytes, /*max_bytes=*/n, ptr)` where `min_bytes` is the minimum amount of data that lets the caller make progress on whatever algorithm it's implementing. The stream tries to fill buffer as much as possible if that is desirable like in the case of S3 calls. > Note that those are not either/or. We could start with one and add the other if needed/desired. Which one you think is simpler? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
