Hi,
Thanks for your question, but 1. The mail is expected to be written in English. 2. I think this problem needs more details, could you raise an issue on [1]? [1] https://github.com/apache/dolphinscheduler/issues <https://github.com/apache/shardingsphere/issues> 王峰 <[email protected]> 于2021年12月1日周三 下午12:25写道: > Dear, > ds版本1.3.3 > > 同样的sqoop任务都在01:07分调起,其中一部分返回成功状态,另外一部分显示一直运行中,查ds日志发现sqoop已经执行完毕,yran作业正常结束。 > 查ds源库也存在app_link信息,然后我对比了两个作业(正常,异常)worker日志,信息如下: > ------------------------------------------------------ 异常 > ------------------------------------------------------------- > [INFO] 2021-12-01 01:06:59.949 > org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[95] - > script path : /tmp/dolphinscheduler/exec/process/6/163/113409/533404 > [INFO] 2021-12-01 01:06:59.950 - [taskAppId=TASK-163-113409-533404]:[82] > - shell task params {"rawScript":"sh > /data/scripts/ods/opt/sqoop_import/xxx_sqoop.sh > ${global_p_dt}","localParams":[],"resourceList":[]} > [INFO] 2021-12-01 01:06:59.951 - [taskAppId=TASK-163-113409-533404]:[156] > - raw script : sh /data/scripts/ods/opt/sqoop_import/xxx_sqoop.sh 20211130 > [INFO] 2021-12-01 01:06:59.952 - [taskAppId=TASK-163-113409-533404]:[157] > - task execute path : /tmp/dolphinscheduler/exec/process/6/163/113409/533404 > [INFO] 2021-12-01 01:06:59.952 - [taskAppId=TASK-163-113409-533404]:[87] > - tenantCode user:xxx, task dir:163_113409_533404 > [INFO] 2021-12-01 01:06:59.952 - [taskAppId=TASK-163-113409-533404]:[92] > - create command > file:/tmp/dolphinscheduler/exec/process/6/163/113409/533404/163_113409_533404.command > [INFO] 2021-12-01 01:06:59.953 - [taskAppId=TASK-163-113409-533404]:[111] > - command : #!/bin/sh > BASEDIR=$(cd `dirname $0`; pwd) > cd $BASEDIR > source /opt/dolphinscheduler/conf/env/dolphinscheduler_env.sh > > /tmp/dolphinscheduler/exec/process/6/163/113409/533404/163_113409_533404_node.sh > [INFO] 2021-12-01 01:06:59.957 - [taskAppId=TASK-163-113409-533404]:[312] > - task run command: > sudo -u zj-developer sh > /tmp/dolphinscheduler/exec/process/6/163/113409/533404/163_113409_533404.command > [INFO] 2021-12-01 01:06:59.958 - [taskAppId=TASK-163-113409-533404]:[193] > - process start, process id is: 49423 > [INFO] 2021-12-01 01:07:09.365 > org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[95] - > script path : /tmp/dolphinscheduler/exec/process/6/163/113409/533406 > > > --------------------------------------------------- 正常 > --------------------------------------------------------------- > INFO] 2021-12-01 01:06:48.729 - [taskAppId=TASK-163-113409-533380]:[82] - > shell task params {"rawScript":"sh > /data/scripts/ods/opt/sqoop_import/xxx_sqoop.sh > ${global_p_dt}","localParams":[],"resourceList":[]} > [INFO] 2021-12-01 01:06:48.729 - [taskAppId=TASK-163-113409-533380]:[156] > - raw script : sh /data/scripts/ods/opt/sqoop_import/xxxx_sqoop.sh 20211130 > [INFO] 2021-12-01 01:06:48.765 - [taskAppId=TASK-163-113409-533380]:[157] > - task execute path : /tmp/dolphinscheduler/exec/process/6/163/113409/533380 > [INFO] 2021-12-01 01:06:48.766 - [taskAppId=TASK-163-113409-533380]:[87] > - tenantCode user:xxx, task dir:163_113409_533380 > [INFO] 2021-12-01 01:06:48.766 - [taskAppId=TASK-163-113409-533380]:[92] > - create command > file:/tmp/dolphinscheduler/exec/process/6/163/113409/533380/163_113409_533380.command > [INFO] 2021-12-01 01:06:48.766 - [taskAppId=TASK-163-113409-533380]:[111] > - command : #!/bin/sh > BASEDIR=$(cd `dirname $0`; pwd) > cd $BASEDIR > source /opt/dolphinscheduler/conf/env/dolphinscheduler_env.sh > > /tmp/dolphinscheduler/exec/process/6/163/113409/533380/163_113409_533380_node.sh > [INFO] 2021-12-01 01:06:48.770 - [taskAppId=TASK-163-113409-533380]:[312] > - task run command: > sudo -u zj-developer sh > /tmp/dolphinscheduler/exec/process/6/163/113409/533380/163_113409_533380.command > [INFO] 2021-12-01 01:06:48.772 - [taskAppId=TASK-124-113406-533248]:[419] > - find app id: application_1635487561336_86389 > [INFO] 2021-12-01 01:06:48.781 - [taskAppId=TASK-163-113409-533380]:[193] > - process start, process id is: 55605 > [INFO] 2021-12-01 01:06:48.800 > org.apache.dolphinscheduler.common.utils.HadoopUtils:[206] - application > url : http://xxx:8088/ws/v1/cluster/apps/%s > [INFO] 2021-12-01 01:06:48.841 > org.apache.dolphinscheduler.common.utils.HadoopUtils:[206] - application > url : > http://xxxzj1-dipper40-cdh-hadoop01.cicc.com:8088/ws/v1/cluster/apps/%s > [INFO] 2021-12-01 01:06:48.852 - [taskAppId=TASK-163-113409-533307]:[379] > - appId:application_1635487561336_86401, final state:SUCCESS > [INFO] 2021-12-01 01:06:48.852 > org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[137] - > task instance id : 533307,task final status : SUCCESS > [INFO] 2021-12-01 01:06:48.853 > org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[95] - > script path : /tmp/dolphinscheduler/exec/process/6/163/113409/533381 > > > > -- DolphinScheduler PMC BaoLiang 鲍亮 [email protected]
