This is an automated email from the ASF dual-hosted git repository.
zhongjiajie pushed a change to branch 3.1.0-prepare
in repository https://gitbox.apache.org/repos/asf/dolphinscheduler.git
from e462918ac9 [Feat][python] Add parameter environment to task (#11763)
(#11989)
new 6f3b4c1624 [feat][python] Support Pytorch task in python api (#11975)
new 1ac2e4a8f3 [feat][python] Add sagemaker yaml example (#11925)
new f66dedc9da [feat][python] Support OpenMLDB task in python api (#11944)
new cb063732d7 [feat][python] Support MLflow task in python api (#11962)
new dde6f63c31 [Feature][PyDolphinScheduler] Support DVC task in pyds
#11922 (#11941)
The 5 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../docs/source/tasks/{spark.rst => dvc.rst} | 12 +-
.../pydolphinscheduler/docs/source/tasks/index.rst | 4 +
.../docs/source/tasks/{switch.rst => mlflow.rst} | 14 +-
.../source/tasks/{condition.rst => openmldb.rst} | 12 +-
.../docs/source/tasks/{switch.rst => pytorch.rst} | 14 +-
.../docs/source/tasks/sagemaker.rst | 12 +
.../examples/yaml_define/{Shell.yaml => Dvc.yaml} | 36 +--
.../yaml_define/{DataX.yaml => OpenMLDB.yaml} | 22 +-
.../examples/yaml_define/Pytorch.yaml | 53 +++++
.../yaml_define/{Procedure.yaml => Sagemaker.yaml} | 13 +-
.../yaml_define/example_sagemaker_params.json | 18 ++
.../examples/yaml_define/mlflow.yaml | 78 ++++++
.../src/pydolphinscheduler/constants.py | 4 +
...sk_sagemaker_example.py => task_dvc_example.py} | 42 ++--
.../examples/task_mlflow_example.py | 104 ++++++++
...k_flink_example.py => task_openmldb_example.py} | 28 ++-
.../examples/task_pytorch_example.py | 62 +++++
.../src/pydolphinscheduler/tasks/__init__.py | 18 ++
.../src/pydolphinscheduler/tasks/dvc.py | 124 ++++++++++
.../src/pydolphinscheduler/tasks/mlflow.py | 265 +++++++++++++++++++++
.../tasks/{sagemaker.py => openmldb.py} | 32 ++-
.../src/pydolphinscheduler/tasks/pytorch.py | 95 ++++++++
.../pydolphinscheduler/tests/tasks/test_dvc.py | 173 ++++++++++++++
.../pydolphinscheduler/tests/tasks/test_mlflow.py | 211 ++++++++++++++++
.../tasks/{test_map_reduce.py => test_openmldb.py} | 51 ++--
.../pydolphinscheduler/tests/tasks/test_pytorch.py | 124 ++++++++++
.../plugin/task/dvc/DvcConstants.java | 6 +
.../plugin/task/dvc/DvcParameters.java | 91 +++----
.../dolphinscheduler/plugin/task/dvc/DvcTask.java | 8 +-
.../plugin/task/dvc/TaskTypeEnum.java | 30 ---
.../plugin/task/dvc/DvcTaskTest.java | 6 +-
31 files changed, 1542 insertions(+), 220 deletions(-)
copy dolphinscheduler-python/pydolphinscheduler/docs/source/tasks/{spark.rst
=> dvc.rst} (83%)
copy dolphinscheduler-python/pydolphinscheduler/docs/source/tasks/{switch.rst
=> mlflow.rst} (83%)
copy
dolphinscheduler-python/pydolphinscheduler/docs/source/tasks/{condition.rst =>
openmldb.rst} (82%)
copy dolphinscheduler-python/pydolphinscheduler/docs/source/tasks/{switch.rst
=> pytorch.rst} (82%)
copy
dolphinscheduler-python/pydolphinscheduler/examples/yaml_define/{Shell.yaml =>
Dvc.yaml} (59%)
copy
dolphinscheduler-python/pydolphinscheduler/examples/yaml_define/{DataX.yaml =>
OpenMLDB.yaml} (72%)
create mode 100644
dolphinscheduler-python/pydolphinscheduler/examples/yaml_define/Pytorch.yaml
copy
dolphinscheduler-python/pydolphinscheduler/examples/yaml_define/{Procedure.yaml
=> Sagemaker.yaml} (80%)
create mode 100644
dolphinscheduler-python/pydolphinscheduler/examples/yaml_define/example_sagemaker_params.json
create mode 100644
dolphinscheduler-python/pydolphinscheduler/examples/yaml_define/mlflow.yaml
copy
dolphinscheduler-python/pydolphinscheduler/src/pydolphinscheduler/examples/{task_sagemaker_example.py
=> task_dvc_example.py} (55%)
create mode 100644
dolphinscheduler-python/pydolphinscheduler/src/pydolphinscheduler/examples/task_mlflow_example.py
copy
dolphinscheduler-python/pydolphinscheduler/src/pydolphinscheduler/examples/{task_flink_example.py
=> task_openmldb_example.py} (63%)
create mode 100644
dolphinscheduler-python/pydolphinscheduler/src/pydolphinscheduler/examples/task_pytorch_example.py
create mode 100644
dolphinscheduler-python/pydolphinscheduler/src/pydolphinscheduler/tasks/dvc.py
create mode 100644
dolphinscheduler-python/pydolphinscheduler/src/pydolphinscheduler/tasks/mlflow.py
copy
dolphinscheduler-python/pydolphinscheduler/src/pydolphinscheduler/tasks/{sagemaker.py
=> openmldb.py} (52%)
create mode 100644
dolphinscheduler-python/pydolphinscheduler/src/pydolphinscheduler/tasks/pytorch.py
create mode 100644
dolphinscheduler-python/pydolphinscheduler/tests/tasks/test_dvc.py
create mode 100644
dolphinscheduler-python/pydolphinscheduler/tests/tasks/test_mlflow.py
copy
dolphinscheduler-python/pydolphinscheduler/tests/tasks/{test_map_reduce.py =>
test_openmldb.py} (64%)
create mode 100644
dolphinscheduler-python/pydolphinscheduler/tests/tasks/test_pytorch.py
delete mode 100644
dolphinscheduler-task-plugin/dolphinscheduler-task-dvc/src/main/java/org/apache/dolphinscheduler/plugin/task/dvc/TaskTypeEnum.java
