XiaoHongbo-Hope opened a new pull request, #11299: URL: https://github.com/apache/paimon/pull/11299
A LeRobot table group could be imported into Paimon but not exported as a standalone LeRobot dataset. Add `conn.export_to_lerobot(...)` for LeRobot v2.0, v2.1, and v3.0. A multi-source group exports one source selected by `_datasets.id`; a tagged group can be exported from one fixed snapshot. V3 preserves source-local indices and copies each shared encoded MP4 once. V2 writes one Parquet and one H.264 MP4 per Episode and camera, with the v2.0 global-statistics and v2.1 per-Episode-statistics metadata layouts. The exporter handles imported groups and groups captured by `PaimonLeRobotWriter`. A small sidecar preserves the Paimon Dataset ID, name, and extra text fields outside the LeRobot schema. Validation: LeRobot-related regression tests passed (397 passed, 1 skipped), plus 10 export tests after the final video chunk change; flake8 and `git diff --check` passed. A 224-frame, two-camera sample exported to v3 with original `info.json`, Episode Parquet, and frame Parquet values unchanged, and its encoded MP4 bytes preserved. Official LeRobot v0.4.4 read valid v3 frames; v0.3.3 read all tested v2.0/v2.1 frames, including video. The source's final frame has a null `subtask_index`, which the older official v3 reader also rejects in the original dataset; export preserves it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
