acvictor opened a new pull request, #11710:
URL: https://github.com/apache/incubator-gluten/pull/11710

   ## What changes are proposed in this pull request?
   This PR fixes a regression introduced by 11113 where Dynamic Partition 
Pruning (DPP) queries on Hive tables fail with `requirement failed: input[0, 
bigint, true] IN dynamicpruning has not finished` because 
   `doValidateInternal()` calls `getDistinctPartitionReadFileFormats`, which 
triggers evaluation of `prunedPartitions` and this evaluates DPP subqueries 
that haven't executed yet at plan validation time.
   
   The fix overrides `getDistinctPartitionReadFileFormats` in 
`HiveTableScanExecTransformer` to use `relation.prunedPartitions` (statically 
pruned by the optimizer, always available at plan time) instead of the lazy val 
chain that triggers DPP subquery evaluation. This is safe because validation 
only checks whether file formats are supported.
   
   ## How was this patch tested?
   Added `GlutenDynamicPartitionPruningHiveScanSuite` (AEOff/AEOn) test suites
   
   ## Was this patch authored or co-authored using generative AI tooling?
   No
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to