zhangyue19921010 opened a new pull request, #11332:
URL: https://github.com/apache/paimon/pull/11332

   ### Purpose
   
   Fixes #11331.
   
   Fix incorrect nested values when ORC row filtering is enabled with 
`orc.sarg.to.filter=true` and `orc.filter.use.selected=true`. ROW, ARRAY and 
MAP adapters can apply a top-level selection to physical child positions, so a 
matching row can contain another row's values.
   
   Request selected-row batches only for primitive projections. Nested 
projections retain row-group pruning and residual filtering, at the cost of 
disabling their optional row-level pushdown.
   
   ### Tests
   
   Added real ORC file and ordinary append table regressions, covering nested 
rows, arrays, maps, nulls, empty collections, noncontiguous selections and 
multiple batches. The unchanged base has six failures across 14 cases; all 14 
pass with the fix. Primitive and non-selected controls are included.
   
   Final verification: 52 tests passed, with no skips, using `mvn -pl 
paimon-core -am -DfailIfNoTests=false -DwildcardSuites=none 
-Dtest=OrcNestedSelectionTest,OrcNestedFilterTableTest,OrcReaderFactoryTest,OrcFormatReadWriteTest,OrcPositionalSchemaEvolutionTest,OrcCaseInsensitiveReadTest,OrcFileFormatTest
 test` on JDK 11. Checkstyle, Spotless and Enforcer passed without 
`fast-build`; the repository-wide license check passed separately with `mvn -N 
apache-rat:check`.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to