TheR1sing3un opened a new pull request, #8636:
URL: https://github.com/apache/paimon/pull/8636

   ### Purpose
   
   Two small pypaimon read/write consistency fixes:
   
   - `write_pandas` built the RecordBatch against the full table schema, so a 
column-subset write set up via `with_write_type` raised `KeyError` on the 
missing columns — column-subset writes only worked through `write_arrow`. It 
now builds the batch against the `write_cols` subset schema when one is set 
(reusing `_write_cols_pyarrow_schema`, matching the `write_arrow_batch` 
validation path). Full-column writes are unchanged.
   - `to_duckdb` now forwards `parallelism` and `blob_parallelism` to 
`to_arrow`, matching `to_pandas`/`to_arrow`.
   
   ### Tests
   
   New unit/integration tests in `table_write_test.py` (column-subset and 
full-column `write_pandas`) and `reader_base_test.py` (`to_duckdb` parallel vs 
serial parity over a multi-split table).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to