zhztheplayer commented on code in PR #13830:
URL: https://github.com/apache/arrow/pull/13830#discussion_r945379331
##########
cpp/src/arrow/dataset/file_base.cc:
##########
@@ -89,6 +89,28 @@ Result<std::shared_ptr<io::InputStream>>
FileSource::OpenCompressed(
return io::CompressedInputStream::Make(codec.get(), std::move(file));
}
+Result<std::shared_ptr<io::InputStream>> FileSource::OpenRange(int64_t start,
+ int64_t end)
const {
Review Comment:
OK. Then it seems to me workable to have the fragments produced from dataset
factory directly without re-splitting.
And a naive question around the codes: should we avoid `set_bounds` since it
brings extra states to file fragment class?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
