YannByron opened a new pull request, #9496: URL: https://github.com/apache/paimon/pull/9496
## Summary Add a distributed canonical-action backfill for the RoboMIND AgileX sample. The Ray ingestion workflow now keeps action materialization distributed instead of switching back to the local iterable path. ## Changes - Add `backfill_canonical_action_ray` with the same result and statistics-refresh contract as the local backfill. - Reuse the existing Ray self-merge optimization so rows are grouped by target file and committed once after distributed processing. - Share target schema preparation between local and Ray backfills. - Exercise Ray ingestion and Ray action backfill together in the end-to-end pipeline test. - Document the distributed ingestion and backfill workflow. ## Testing - [x] `python3.13 -m pytest -q pypaimon/tests/robomind_agilex_pipeline_test.py` (16 passed, 1 skipped) - [x] flake8 with `paimon-python/dev/cfg.ini` on the changed Python files - [x] `python3.13 -m py_compile` on the changed Python files - [x] `git diff --check origin/master...HEAD` ## Notes Follow-up to #9445. The local row-id batch safety change was handled separately by #9484. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
