TheR1sing3un opened a new pull request, #10095:
URL: https://github.com/apache/paimon/pull/10095

   ### Purpose
   
   Resolve ARRAY BLOB elements to payload bytes in `ContiguousWindowDataset`. 
Window reads previously recognized scalar and MAP BLOB columns only, allowing 
serialized descriptors to reach training code when an ARRAY BLOB column was 
selected.
   
   Recognize all BLOB file column types and pass ARRAY metadata to the existing 
shared payload loader. Reuse its coalesced reads and preservation of null 
cells, null elements, empty arrays and empty payloads.
   
   ### Tests
   
   - All 39 contiguous-window tests passed on PyArrow 19.0.1; the new ARRAY 
regression also passed on 16.0.0.
   - Real-table coverage includes ARRAY-only and mixed scalar/MAP projections, 
batched duplicate requests, reordered/repeated frame offsets, endpoint and 
constant padding, null/empty values, and mutable sample isolation.
   - The new regression fails against the original implementation.
   - Python 3.6 syntax, flake8, license headers and `git diff --check` passed.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to