Zouxxyy opened a new pull request, #7913:
URL: https://github.com/apache/paimon/pull/7913

   ### Purpose
   
   Integrate Spark 4.1+ `SupportsPushDownVariantExtractions` so that 
`variant_get(col, '$.path', type)` is pushed into the Paimon read path as a 
shredded variant struct. Same trait-shadowing pattern as 
`PaimonSupportsRuntimeFiltering` — no-op trait in `paimon-spark-common`, 4.1 
binding overrides at the same FQN. Nested variant columns supported; column 
pruning preserved; full-Variant access on a column rejects per-column pushdown.
   
   ### Tests
   
   Six new pushdown checks in `VariantTestBase` (gated `assume(gteqSpark4_1)`), 
running across 4 `sparkConf` subclasses. Existing 84 functional Variant tests 
cover correctness unchanged.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to