sundapeng opened a new pull request, #1013:
URL: https://github.com/apache/paimon-rust/pull/1013
### Purpose
`FileType` decides which files the local cache (`local-cache.*`) may hold,
and paimon-rust classified several paths differently from Java and pypaimon, so
the same `local-cache.whitelist` selected different files depending on the
client.
### Brief change log
- Classify `.{name}.{uuid}.tmp` temp files by the name they will be renamed
to, as Java does.
- Check `.index` before `manifest`, so a global or file index whose name
contains `manifest` is still an index.
- Treat manifest sidecars (`*.avro.sidecar`), `EARLIEST` / `LATEST`,
`_SUCCESS` files and changelog metadata under `changelog/` as meta instead of
data.
- Bypass the local cache for `_SUCCESS` files and the Iceberg-compatible
`version-hint.text` and `retire-pending`, which are rewritten in place.
- Accept `*` in `local-cache.whitelist` to select every file type.
Related: apache/paimon#10342 (Java), apache/paimon#10344 (Python).
### Tests
- `io::cache` unit tests: new cases for temp names, sidecars, hint and
`_SUCCESS` files, changelog metadata, index-before-manifest and the `*`
whitelist; `io::` tests 128 passed.
- `cargo fmt --all -- --check` and `cargo clippy --all-targets --workspace
--features fulltext,vortex -- -D warnings`.
### API and Format
No.
### Documentation
`docs/src/getting-started.md`: `local-cache.whitelist` mentions `*`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
