Could you give me a example??3Q. ????????????????????????

By the way, I have more than 100 tasks in one DAG. These tasks connect two 
other server to execute. So SSH tasks must have pool to manager. Now I use JSch 
and realize a simple pool.


??????????????????????????????????100???? SSH 
?????????????????????????????????????????????????? SSH 
?????????????????????????????????????????????????? 
JSch????????????????????????????


------------------ ???????? ------------------
??????:&nbsp;"wenhemin"<whm_...@163.com&gt;;
????????:&nbsp;2020??5??13??(??????) ????5:24
??????:&nbsp;"dev"<dev@dolphinscheduler.apache.org&gt;;

????:&nbsp;Re: [Feature] Support SSH Task and Support dummy task like airflow



The shell node is supports remote calling, and get the remote command result 
code.


&gt; ?? 2020??5??13????15:16???????? <peilon...@qq.com&gt; ??????
&gt; 
&gt; Dear ALL??
&gt; 
&gt; 
&gt; Support Linux SSH Task ???? Linux SSH ????
&gt; 
&gt; ???????????????????????????????????????????????????????? Shell ??????Shell 
???????????????????????????????????? Worker 
???????????????????????????????????????????????????? Shell 
??????????????????????????????????????????????????????????????????
&gt; 
&gt; For example, in my project, the workflow's tasks want to execute shell 
scripts where are in different server's different directory. When worker 
execute these shell scripts, it must use the same user to login these server. 
Also, the worker can get the executing state of these server. We can config 
these server 's host,user and password.
&gt; 
&gt; SSH Task is very useful for most user SSH ????????????????????????????
&gt; 
&gt; ?????????????????????? Shell 
???????????????????????????????????????????????????????????????? 
Worker?????????? Worker 
??????????????????????????????????????????????????????????????
&gt; 
&gt; In dolphinscheduler, the most executing tasks are in different servers who 
are not workers. These servers also have their different fixed services. We 
just have to pass different parameters to schedule these shell scripts to 
execute.
&gt; 
&gt; Python has a module to execute ssh script Python 
??????????????????????????SSH Shell ????
&gt; 
&gt; Python ??????????????????????SSH Shell??????????????????????paramiko??
&gt; 
&gt; Python has a module that can execute SSH Shell script. It's paramiko.
&gt; 
&gt; Others ????????
&gt; 
&gt; ????????????????????????????????????????????????????????????????????
&gt; 
&gt; I found this described in previous feature, but it was relatively simple.
&gt; Feature URL
&gt; 
&gt; ???????????? Shell Task 
??????????????????????????????????????????????????????????????????????
&gt; 
&gt; In addition, it is very inconvenient for me to perform remote tasks 
through Shell Task. Here is my script. I don't know if there's a better way.
&gt; sshpass -p 'password' ssh user@host echo 'ssh success' echo 'Hello World' 
-&amp;gt; /home/dolphinscheduler/test/hello.txt echo 'end'
&gt; 
&gt; 
&gt; 
&gt; Support dummy task like airflow ?????? Airflow ????????????
&gt; 
&gt; ???????????????????????????????? DAG ??????DAG 
??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????
 Dummy 
Task????????????????????????????????????????????????????????????????????????AirFlow??????????????DummyOperator????????
&gt; 
&gt; For example, in my project, it has a productized DAG file. The file 
contains different modules, some of which are interdependent and some of which 
are not. When customers purchase different modules, we need to set some tasks 
as dummy tasks, which some modules are not purchased and the purchased module 
is not dependent. Because of this setting, these dummy tasks are actually not 
executed. The benefits of this setup are product unity and diagram integrity. 
In airflow, these task execute by dummy operator.
&gt; 
&gt; ** Realize ????????**
&gt; 
&gt; Dummy Task 
???????????????????????????????????????????????????????????????? dummy 
?????????????????????????? Dummy Task??
&gt; 
&gt; Dummy Task is easy to realize, but it need to use with other different 
tasks. When the task's executed type is set to dummy type, the task are 
executed as a dummy task and the real task is not executed.
&gt; 
&gt; 
&gt; 
&gt; 
&gt; 
????????????????????????????????????Fork??????????????????????????????????????????????????????????
&gt; 
&gt; By the way??I already realize these two&amp;nbsp; features in my fork 
branch.&amp;nbsp;Whether the follow-up release can be supported

Reply via email to