marsupialtail commented on code in PR #13830:
URL: https://github.com/apache/arrow/pull/13830#discussion_r956277407
##########
cpp/src/arrow/dataset/file_base.cc:
##########
@@ -89,6 +89,28 @@ Result<std::shared_ptr<io::InputStream>>
FileSource::OpenCompressed(
return io::CompressedInputStream::Make(codec.get(), std::move(file));
}
+Result<std::shared_ptr<io::InputStream>> FileSource::OpenRange(int64_t start,
+ int64_t end)
const {
+ ARROW_ASSIGN_OR_RAISE(auto file, Open());
+
+ auto actual_compression = Compression::type::UNCOMPRESSED;
+
+ auto extension = fs::internal::GetAbstractPathExtension(path());
+ if (extension == "gz") {
Review Comment:
The CSV reader does this in other places probably to save time and not run
the getcompressionType. So I just copy it here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
