JingsongLi commented on PR #9529: URL: https://github.com/apache/paimon/pull/9529#issuecomment-5510169244
I suggest two additional schema-alignment changes: 1. Remove the denormalized `task` column from the frames table. LeRobot V3 frame data persists `task_index`, while the task text belongs to `tasks.parquet`. Repeating the full task string in every frame makes the frame schema non-native, duplicates storage, and creates a second source of truth. The reader should resolve task text from the version-tagged tasks table. 2. Support optional `meta/subtasks.parquet` instead of rejecting it. LeRobot 0.4.4 treats subtasks as part of the dataset metadata. When present, it should be stored in a `__subtasks` component table with its native schema and published under the same `version_id` tag as frames, tasks, and episodes. The version manifest should also make the optional component presence explicit. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
