JingsongLi opened a new pull request, #8393:
URL: https://github.com/apache/paimon/pull/8393
## Summary
Add PyPaimon support for building and dropping BTree global indexes, and
expose the metadata needed to inspect global index coverage from Python.
## Changes
- Add Python global index lifecycle APIs on `FileStoreTable`:
- `table.create_global_index(...)`
- `table.drop_global_index(...)`
- Implement Python BTree global index file writing and index manifest
commits for index additions/deletions.
- Register `$table_indexes` and `$file_key_ranges` system tables in PyPaimon
for metadata inspection.
- Document SQL and Python SDK usage for create, drop, system-table
inspection, and global-index options.
- Add end-to-end PyPaimon tests for create, metadata inspection, dry-run
drop, and drop.
## Testing
- [x] `pytest -q paimon-python/pypaimon/tests/global_index_build_test.py`
- [x] `pytest -q
paimon-python/pypaimon/tests/system/system_table_loader_test.py
paimon-python/pypaimon/tests/system/list_tables_no_system_test.py`
- [x] `pytest -q paimon-python/pypaimon/tests/index_manifest_write_test.py
paimon-python/pypaimon/tests/global_index_update_action_test.py
paimon-python/pypaimon/tests/global_index_test.py`
- [x] `pytest -q paimon-python/pypaimon/tests/table_commit_test.py
paimon-python/pypaimon/tests/file_store_commit_test.py`
- [x] `python -m compileall -q paimon-python/pypaimon/globalindex
paimon-python/pypaimon/table/system
paimon-python/pypaimon/table/file_store_table.py
paimon-python/pypaimon/tests/global_index_build_test.py
paimon-python/pypaimon/tests/system/system_table_loader_test.py`
- [x] `git diff --check`
## Notes
PyPaimon global index build currently supports single-column BTree indexes
on row-tracking tables.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
