wangzhigang1999 opened a new issue, #11168:
URL: https://github.com/apache/paimon/issues/11168

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/paimon/issues) 
and found nothing similar.
   
   ### Motivation
   
   When reading columns such as `['value', 'rid']`, PyPaimon can already 
produce them in the requested order. It then applies the same projection again 
to each batch, recalculating the reader adapter and output schema and wrapping 
the arrays in another `RecordBatch`.
   
   This adds overhead when a read returns many batches.
   
   ### Solution
   
   Skip the extra output projection when the requested columns and order match 
the reader output and no field conversion is needed. Keep the existing handling 
for aliases, duplicate columns and nested-field extraction.
   
   ### Anything else?
   
   The proposed change requires no new configuration. Tests and performance 
results will be included in the PR.
   
   ### Are you willing to submit a PR?
   
   - [x] I'm willing to submit a PR!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to