rdblue commented on code in PR #6645:
URL: https://github.com/apache/iceberg/pull/6645#discussion_r1085887188
##########
python/pyiceberg/io/pyarrow.py:
##########
@@ -470,13 +471,54 @@ def expression_to_pyarrow(expr: BooleanExpression) ->
pc.Expression:
return boolean_expression_visit(expr, _ConvertToArrowExpression())
+def _file_to_table(
Review Comment:
The reason why I passed `row_filter` and `table` to this method in my branch
was so that we could make the method public. I think we are going to need that
so that tasks can be distributed to other nodes or processes and read
independently. Having a method that reads a task and another that reads an
iterable of tasks in a threadpool seems like a good API to provide.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
