JingsongLi opened a new pull request, #9846: URL: https://github.com/apache/paimon/pull/9846
### Purpose Expand native scan coverage while keeping Java's read semantics. This follows #9839 and depends on apache/paimon-rust#841 for stream-aware splits and selector normalization. The Rust-main CI job checks the new API so incremental coverage cannot silently skip on an older runtime. - Enable `scan.version`, including tag precedence and historical schemas; ordinary postpone-bucket batch reads; and supplied scored DE index results with scores attached to the ranges retained by Rust. - Refine native PK batch splits through the existing Python sorted-index reader, using the planned snapshot and preserving merge-required splits. Index evaluation is still performed in Python. - Align timestamp incremental reads with Java: retain physical versions and row kinds across APPEND commits, include L0, and omit endpoint DVs and automatic global indexes. Explicit split DVs still apply. Preserve the streaming bit in the split codec and wrappers; continuous Python delta/changelog reads also retain retracts, while their initial snapshot remains merged. For example, an incremental window containing two committed values for the same key now returns both events instead of only the final value. Both planners reject manifest DELETE entries in APPEND deltas before file reconciliation. Chunk shuffle, query authorization, supplied PK index results, continuous-stream planning and write planning retain their existing Python entrypoints. Native planning remains opt-in. ### Tests - Real committed-file tests run against both Python planning and a local Rust wheel; native cases reject fallback. - Cover postpone buckets/shards/limits, scored DE selections and DVs, historical schemas, sorted-index snapshot selection and uncovered files, same-key versions, four row kinds, first-row, malformed manifests and explicit split DVs. - Relevant planner, codec, time-travel, streaming and sorted-index suites: 282 passed. Two unrelated modules were skipped because optional PIL/lumina_data dependencies are absent. - Flake8 and `git diff --check` passed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
