JingsongLi opened a new pull request, #9891:
URL: https://github.com/apache/paimon/pull/9891

   ### Purpose
   
   Expand Spark DataSource V2 filter conversion with direct-column support for:
   
   - `<>` / not-equal predicates
   - `CHAR_LENGTH`
   - `YEAR`, `MONTH`, `DAY`, `HOUR`, `MINUTE`, and `SECOND` extraction for 
`DATE` and timestamp-without-time-zone fields
   - `NOT LIKE` predicate representation and safe fallback behavior in index 
and format visitors
   
   Remove Spark-side `Cast` conversion. Nested transforms and `COALESCE` / 
`GREATEST` / `LEAST` are intentionally not supported.
   
   ### Tests
   
   - `paimon-common`: 291 targeted predicate and transform tests
   - `paimon-format`: 57 ORC and Parquet filter tests
   - Spark 3.5 `SparkV2FilterConverterTest`: 35 tests
   - Spark 3.3 compatibility `SparkV2FilterConverterTest`: 35 tests
   - Spotless and Checkstyle for affected modules


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to