hi chao, if you submitted an issue, you can paste the issue url here. From the two task logs info, I noticed that the application id was not found
Best Regards --------------- Apache DolphinScheduler PMC Chair LidongDai [email protected] Linkedin: https://www.linkedin.com/in/dailidong Twitter: @WorkflowEasy <https://twitter.com/WorkflowEasy> --------------- On Wed, Dec 1, 2021 at 7:54 PM leon bao <[email protected]> wrote: > Hi, > > > Thanks for your question, but > 1. The mail is expected to be written in English. > 2. I think this problem needs more details, could you raise an issue on > [1]? > > > [1] https://github.com/apache/dolphinscheduler/issues > <https://github.com/apache/shardingsphere/issues> > > 王峰 <[email protected]> 于2021年12月1日周三 下午12:25写道： > > > Dear, > > ds版本1.3.3 > > > > > 同样的sqoop任务都在01:07分调起，其中一部分返回成功状态，另外一部分显示一直运行中，查ds日志发现sqoop已经执行完毕，yran作业正常结束。 > > 查ds源库也存在app_link信息，然后我对比了两个作业(正常，异常)worker日志，信息如下： > > ------------------------------------------------------ 异常 > > ------------------------------------------------------------- > > [INFO] 2021-12-01 01:06:59.949 > > org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[95] - > > script path : /tmp/dolphinscheduler/exec/process/6/163/113409/533404 > > [INFO] 2021-12-01 01:06:59.950 - [taskAppId=TASK-163-113409-533404]:[82] > > - shell task params {"rawScript":"sh > > /data/scripts/ods/opt/sqoop_import/xxx_sqoop.sh > > ${global_p_dt}","localParams":[],"resourceList":[]} > > [INFO] 2021-12-01 01:06:59.951 - > [taskAppId=TASK-163-113409-533404]:[156] > > - raw script : sh /data/scripts/ods/opt/sqoop_import/xxx_sqoop.sh > 20211130 > > [INFO] 2021-12-01 01:06:59.952 - > [taskAppId=TASK-163-113409-533404]:[157] > > - task execute path : > /tmp/dolphinscheduler/exec/process/6/163/113409/533404 > > [INFO] 2021-12-01 01:06:59.952 - [taskAppId=TASK-163-113409-533404]:[87] > > - tenantCode user:xxx, task dir:163_113409_533404 > > [INFO] 2021-12-01 01:06:59.952 - [taskAppId=TASK-163-113409-533404]:[92] > > - create command > > > file:/tmp/dolphinscheduler/exec/process/6/163/113409/533404/163_113409_533404.command > > [INFO] 2021-12-01 01:06:59.953 - > [taskAppId=TASK-163-113409-533404]:[111] > > - command : #!/bin/sh > > BASEDIR=$(cd `dirname $0`; pwd) > > cd $BASEDIR > > source /opt/dolphinscheduler/conf/env/dolphinscheduler_env.sh > > > > > /tmp/dolphinscheduler/exec/process/6/163/113409/533404/163_113409_533404_node.sh > > [INFO] 2021-12-01 01:06:59.957 - > [taskAppId=TASK-163-113409-533404]:[312] > > - task run command: > > sudo -u zj-developer sh > > > /tmp/dolphinscheduler/exec/process/6/163/113409/533404/163_113409_533404.command > > [INFO] 2021-12-01 01:06:59.958 - > [taskAppId=TASK-163-113409-533404]:[193] > > - process start, process id is: 49423 > > [INFO] 2021-12-01 01:07:09.365 > > org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[95] - > > script path : /tmp/dolphinscheduler/exec/process/6/163/113409/533406 > > > > > > --------------------------------------------------- 正常 > > --------------------------------------------------------------- > > INFO] 2021-12-01 01:06:48.729 - [taskAppId=TASK-163-113409-533380]:[82] > - > > shell task params {"rawScript":"sh > > /data/scripts/ods/opt/sqoop_import/xxx_sqoop.sh > > ${global_p_dt}","localParams":[],"resourceList":[]} > > [INFO] 2021-12-01 01:06:48.729 - > [taskAppId=TASK-163-113409-533380]:[156] > > - raw script : sh /data/scripts/ods/opt/sqoop_import/xxxx_sqoop.sh > 20211130 > > [INFO] 2021-12-01 01:06:48.765 - > [taskAppId=TASK-163-113409-533380]:[157] > > - task execute path : > /tmp/dolphinscheduler/exec/process/6/163/113409/533380 > > [INFO] 2021-12-01 01:06:48.766 - [taskAppId=TASK-163-113409-533380]:[87] > > - tenantCode user:xxx, task dir:163_113409_533380 > > [INFO] 2021-12-01 01:06:48.766 - [taskAppId=TASK-163-113409-533380]:[92] > > - create command > > > file:/tmp/dolphinscheduler/exec/process/6/163/113409/533380/163_113409_533380.command > > [INFO] 2021-12-01 01:06:48.766 - > [taskAppId=TASK-163-113409-533380]:[111] > > - command : #!/bin/sh > > BASEDIR=$(cd `dirname $0`; pwd) > > cd $BASEDIR > > source /opt/dolphinscheduler/conf/env/dolphinscheduler_env.sh > > > > > /tmp/dolphinscheduler/exec/process/6/163/113409/533380/163_113409_533380_node.sh > > [INFO] 2021-12-01 01:06:48.770 - > [taskAppId=TASK-163-113409-533380]:[312] > > - task run command: > > sudo -u zj-developer sh > > > /tmp/dolphinscheduler/exec/process/6/163/113409/533380/163_113409_533380.command > > [INFO] 2021-12-01 01:06:48.772 - > [taskAppId=TASK-124-113406-533248]:[419] > > - find app id: application_1635487561336_86389 > > [INFO] 2021-12-01 01:06:48.781 - > [taskAppId=TASK-163-113409-533380]:[193] > > - process start, process id is: 55605 > > [INFO] 2021-12-01 01:06:48.800 > > org.apache.dolphinscheduler.common.utils.HadoopUtils:[206] - application > > url : http://xxx:8088/ws/v1/cluster/apps/%s > > [INFO] 2021-12-01 01:06:48.841 > > org.apache.dolphinscheduler.common.utils.HadoopUtils:[206] - application > > url : > > http://xxxzj1-dipper40-cdh-hadoop01.cicc.com:8088/ws/v1/cluster/apps/%s > > [INFO] 2021-12-01 01:06:48.852 - > [taskAppId=TASK-163-113409-533307]:[379] > > - appId:application_1635487561336_86401, final state:SUCCESS > > [INFO] 2021-12-01 01:06:48.852 > > org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[137] > - > > task instance id : 533307,task final status : SUCCESS > > [INFO] 2021-12-01 01:06:48.853 > > org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[95] - > > script path : /tmp/dolphinscheduler/exec/process/6/163/113409/533381 > > > > > > > > > > -- > DolphinScheduler PMC > BaoLiang 鲍亮 > [email protected] >
