aicam opened a new issue, #6895:
URL: https://github.com/apache/texera/issues/6895
### Task Summary
**Consume mounted datasets in Python UDFs** — the final step of the
dataset-mounting feature (part of #6606), built on per-computing-unit mounting.
Let a Python UDF bind mounted datasets to variables. Each binding maps a
dataset version to a Python variable that, at runtime, holds the local
filesystem path of the mounted dataset (e.g. `open(f"{A}/file.csv")`).
- **`PythonUDFOpDescV2`** — a list of `(variableName -> dataset)` bindings,
validated as Python identifiers and resolved via `FileResolver`; the locators
flow through `PhysicalOp` and `WorkerConfig`.
- **`DatasetMountManager`** — on the executor, ensures each bound dataset is
mounted on the computing unit and hands its path to the Python worker, which
injects it as a module-level variable (`MOUNTED_DATASETS`).
- **"Mounted dataset variables" property editor** for the Python UDF.
### Task Type
- [x] Other (feature implementation)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
