bkietz commented on a change in pull request #7692:
URL: https://github.com/apache/arrow/pull/7692#discussion_r452394725
##########
File path: python/pyarrow/_dataset.pyx
##########
@@ -909,13 +909,24 @@ cdef class ParquetFileFragment(FileFragment):
def __reduce__(self):
buffer = self.buffer
+ if self.row_groups is not None:
Review comment:
When I started working on the python binding, the compiler complained
that RowGroupInfo is not pickleable. I'm not sure why this didn't fail before;
we've never had RowGroupInfo.__reduce__ and ParquetFileFormat.make_fragment
only accepts a list of integers for the row_groups argument
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
