Stephen0421 commented on code in PR #10570:
URL: https://github.com/apache/paimon/pull/10570#discussion_r4290760004
##########
paimon-python/pypaimon/read/table_read.py:
##########
@@ -886,6 +887,7 @@ def _arrow_batch_generator(self, splits: List[Split],
schema: pyarrow.Schema,
batch = batch.slice(0, remaining)
batch = self._serialize_blob_views_as_descriptors(
batch, reader)
+ batch = self._materialize_managed_blob_batch(batch)
Review Comment:
Fixed by moving managed-payload resolution into the reader chain. The
internal read schema retains predicate-only columns, and the original predicate
is evaluated on resolved payloads before output projection. This also avoids
reapplying payload predicates to descriptor bytes in the projection fallback.
Regression coverage includes projected-out payload columns and reordered
projections through both Arrow and iterator APIs, for raw and merge reads.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
