tanishqgandhi1908 opened a new pull request, #6872:
URL: https://github.com/apache/texera/pull/6872
### What changes were proposed in this PR?
Completes the model management API (#6498) with **file upload +
versioning**, building on the metadata/access PR. A model version is a folder
of files assembled from uploads and committed as an immutable LakeFS version.
- **Schema:** `model_upload_session` + `model_upload_session_part` in
`texera_ddl.sql` + migration `sql/updates/32.sql`.
- **`ModelResource`:** version create/list/latest/rootFileNodes; one-shot
`/{mid}/upload`; staged-file delete; session-based multipart
(`/multipart-upload` init/finish/abort + `/multipart-upload/part`).
- **File types:** any file is accepted — a model bundles weights with
`config.json`, tokenizer/vocab, sharded checkpoints, etc. `framework`
("pytorch") is stored as metadata;
Stacked on the metadata/access PR → #6860 (#6497) → #6502 (#6495);
### Any related issues, documentation, discussions?
Closes #6498. Umbrella #6494.
### How was this PR tested?
New `ModelUploadResourceSpec` (7): one-shot upload + version lifecycle,
`.pth` acceptance, empty-version rejection, staged-file delete,
companion-files-with- weights commit, multipart init→part→finish→version, and
abort. Extraction verified
non-regressive: full `DatasetResourceSpec` passes (118).
`sbt "FileService/testOnly *ModelUploadResourceSpec *DatasetResourceSpec"`;
`scalafmtCheckAll` + `scalafixAll --check` clean.
### Was this PR authored or co-authored using generative AI tooling?
Generated-by: Claude Code (Claude Opus 4.8)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
