XiaoHongbo-Hope opened a new pull request, #9537:
URL: https://github.com/apache/paimon/pull/9537
### Purpose
The low-level `TableRead` API already exposes `to_arrow_batch_reader`, but
the
high-level multimodal `ScanQuery` only exposes collecting `to_arrow()` reads.
Callers should not need to rebuild the scan plan just to stream record
batches.
This PR adds the same high-level entry point to ordinary scans:
```python
for batch in table.scan().where("score > 0").to_arrow_batch_reader():
consume(batch)
```
The method preserves the query's predicate, projection, limit, and optional
BLOB parallelism, then delegates directly to the existing `TableRead` batch
reader. Search queries reject it because their result planning follows a
different path.
### Tests
```text
python -m pytest pypaimon/tests/multimodal_table_test.py -q
77 passed
```
```text
python -m flake8 --config=dev/cfg.ini \
pypaimon/multimodal/query.py \
pypaimon/tests/multimodal_table_test.py
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
