YannByron opened a new pull request, #9676: URL: https://github.com/apache/paimon/pull/9676
### Purpose Decouple LeRobot ingestion from dataset version publication. Store dataset info and optional statistics in companion tables with `key STRING, value STRING`, using JSON-encoded values to preserve nested metadata without a fixed schema. `load_from_lerobot` returns the committed frame snapshot ID and accepts an optional `tag_name`. `create_lerobot_tag` pins the current snapshots of all recorded components under a shared name for training, checks conflicts before creating tags, and supports retries while snapshots remain unchanged. Cross-table tagging is not atomic: callers must pause group writes until the call succeeds and read every component through the same tag. Documentation and regression tests cover this contract. ### Tests - LeRobot import suite: 54 tests and 46 subtests passed, including JSON round-trips, optional metadata, stable tagged reads after appends, conflicts, missing components, and partial tag failure/retry. - Multimodal table and filesystem catalog tag suites: 103 passed, 2 skipped because Ray was unavailable. - Flake8 on changed Python files and `git diff --check` passed. LeRobot tests ran with Python 3.12, LeRobot 0.4.4, PyArrow 19.0.1, and NumPy 2.3.5. NumPy 2.5 fails in the existing SDK fixture's array-to-scalar conversion; project dependencies are unchanged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
