hillyuen commented on issue #4584:
URL:
https://github.com/apache/incubator-dolphinscheduler/issues/4584#issuecomment-768073418
If I specify the default worker to run this process, the result is: the
execution of the two task nodes will be executed on the corresponding machine,
but the log printing is not normal
Post the log of the master node below:
如果我指定default worker来运行这个流程，结果是：两个任务节点执行会在对应的机器执行，但是日志打印不是正常的
下面贴出master节点的日志：
[INFO] 2021-01-27 14:23:12.430
org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[132] -
find one command: id: 130, type: START_PROCESS
[INFO] 2021-01-27 14:23:12.439
org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[140] -
start master exec thread , split DAG ...
[INFO] 2021-01-27 14:23:12.441
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[315] -
prepare process :111 end
[INFO] 2021-01-27 14:23:12.442
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[792] - add
task to stand by list: 测试3work执行shell
[INFO] 2021-01-27 14:23:12.442
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[805] -
remove task from stand by list: 测试3work执行shell
[INFO] 2021-01-27 14:23:12.444
org.apache.dolphinscheduler.service.process.ProcessService:[839] - start submit
task : 测试3work执行shell, instance id:111, state: RUNNING_EXEUTION
[INFO] 2021-01-27 14:23:12.446
org.apache.dolphinscheduler.service.process.ProcessService:[852] - end submit
task to db successfully:测试3work执行shell state:SUBMITTED_SUCCESS complete,
instance id:111 state: RUNNING_EXEUTION
[INFO] 2021-01-27 14:23:12.451
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[216] -
task ready to submit: TaskInstance{id=141, name='测试3work执行shell',
taskType='SHELL', processDefinitionId=4, processInstanceId=111,
processInstanceName='null',
taskJson='{"conditionResult":"{\"successNode\":[\"\"],\"failedNode\":[\"\"]}","conditionsTask":false,"depList":[],"dependence":"{}","forbidden":false,"id":"tasks-56734","maxRetryTimes":0,"name":"测试3work执行shell","params":"{\"rawScript\":\"echo
'hello world'\\nhostname
-f\",\"localParams\":[],\"resourceList\":[]}","preTasks":"[]","retryInterval":1,"runFlag":"NORMAL","taskInstancePriority":"MEDIUM","taskTimeoutParameter":{"enable":false,"interval":0},"timeout":"{\"enable\":false,\"strategy\":\"\"}","type":"SHELL","workerGroup":"work1"}',
state=SUBMITTED_SUCCESS, submitTime=Wed Jan 27 14:23:12 CST 2021,
startTime=null, endTime=null, host='null', executePath='null', logPath='null',
retryTimes=0, alertFlag=NO
, processInstance=null, processDefine=null, pid=0, appLink='null', flag=YES,
dependency='null', duration=null, maxRetryTimes=0, retryInterval=1,
taskInstancePriority=MEDIUM, processInstancePriority=MEDIUM,
dependentResult='null', workerGroup='work1', executorId=1, executorName='null'}
[INFO] 2021-01-27 14:23:12.451
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[227] -
master submit success, task : 测试3work执行shell
[INFO] 2021-01-27 14:23:12.452
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[116] -
wait task: process id: 111, task id:141, task name:测试3work执行shell complete
[ERROR] 2021-01-27 14:23:13.384
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5345,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:15.396
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5346,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:18.412
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5347,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:21.428
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5348,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:24.444
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5349,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:27.460
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5350,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:30.476
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5351,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:33.492
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5352,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:36.509
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5353,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:39.528
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5354,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:42.545
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5355,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:45.565
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5356,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:48.580
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5357,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:51.596
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5358,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:54.612
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5359,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:23:57.629
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5360,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:00.648
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5361,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:03.664
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5362,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:06.680
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5363,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:09.696
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5364,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:12.711
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5365,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:15.728
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5366,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:18.744
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5367,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:21.760
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5368,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:24.776
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5369,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:27.791
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5370,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:30.808
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5371,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:33.825
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5372,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:36.839
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5373,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:39.856
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5374,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:42.872
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5375,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:45.887
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5376,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:48.903
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5377,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:51.921
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5378,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:54.936
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5379,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[ERROR] 2021-01-27 14:24:57.951
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer:[153]
- dispatch error
org.apache.dolphinscheduler.server.master.dispatch.exceptions.ExecuteException:
fail to execute : Command [type=TASK_EXECUTE_REQUEST, opaque=5380,
bodyLen=1617] due to no suitable worker , current task need to work1 worker
group execute
at
org.apache.dolphinscheduler.server.master.dispatch.ExecutorDispatcher.dispatch(ExecutorDispatcher.java:87)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.dispatch(TaskPriorityQueueConsumer.java:150)
at
org.apache.dolphinscheduler.server.master.consumer.TaskPriorityQueueConsumer.run(TaskPriorityQueueConsumer.java:112)
[INFO] 2021-01-27 14:25:00.973
org.apache.dolphinscheduler.server.master.processor.TaskAckProcessor:[69] -
taskAckCommand : TaskExecuteAckCommand{taskInstanceId=141, startTime=Wed Jan 27
14:25:00 CST 2021, host='10.66.93.89:1234', status=1,
logPath='/mnt/bigdata/dolphinscheduler/dolphinscheduler/logs/4/111/141.log',
executePath='/tmp/dolphinscheduler/exec/process/1/4/111/141'}
[INFO] 2021-01-27 14:25:00.996
org.apache.dolphinscheduler.server.master.processor.TaskResponseProcessor:[71]
- received command : TaskExecuteResponseCommand{taskInstanceId=141, status=7,
endTime=Wed Jan 27 14:25:00 CST 2021, processId=24280, appIds=''}
[INFO] 2021-01-27 14:25:02.903
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[102] -
task :测试3work执行shell id:141, process id:111, exec thread completed
[INFO] 2021-01-27 14:25:03.896
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[864] - task
:测试3work执行shell, id:141 complete, state is SUCCESS
[INFO] 2021-01-27 14:25:03.897
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[792] - add
task to stand by list: 测试4执行shell
[INFO] 2021-01-27 14:25:03.897
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[540] -
taskName: 测试4执行shell completeDependTaskList: [测试3work执行shell]
[INFO] 2021-01-27 14:25:03.898
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[805] -
remove task from stand by list: 测试4执行shell
[INFO] 2021-01-27 14:25:03.900
org.apache.dolphinscheduler.service.process.ProcessService:[839] - start submit
task : 测试4执行shell, instance id:111, state: RUNNING_EXEUTION
[INFO] 2021-01-27 14:25:03.903
org.apache.dolphinscheduler.service.process.ProcessService:[852] - end submit
task to db successfully:测试4执行shell state:SUBMITTED_SUCCESS complete, instance
id:111 state: RUNNING_EXEUTION
[INFO] 2021-01-27 14:25:03.908
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[216] -
task ready to submit: TaskInstance{id=142, name='测试4执行shell', taskType='SHELL',
processDefinitionId=4, processInstanceId=111, processInstanceName='null',
taskJson='{"conditionResult":"{\"successNode\":[\"\"],\"failedNode\":[\"\"]}","conditionsTask":false,"depList":["测试3work执行shell"],"dependence":"{}","forbidden":false,"id":"tasks-34099","maxRetryTimes":0,"name":"测试4执行shell","params":"{\"rawScript\":\"echo
'hello world'\\nhostname
-f\",\"localParams\":[],\"resourceList\":[]}","preTasks":"[\"测试3work执行shell\"]","retryInterval":1,"runFlag":"NORMAL","taskInstancePriority":"MEDIUM","taskTimeoutParameter":{"enable":false,"interval":0},"timeout":"{\"enable\":false,\"strategy\":\"\"}","type":"SHELL","workerGroup":"default"}',
state=SUBMITTED_SUCCESS, submitTime=Wed Jan 27 14:25:03 CST 2021,
startTime=null, endTime=null, host='null', executePath='null'
, logPath='null', retryTimes=0, alertFlag=NO, processInstance=null,
processDefine=null, pid=0, appLink='null', flag=YES, dependency='null',
duration=null, maxRetryTimes=0, retryInterval=1, taskInstancePriority=MEDIUM,
processInstancePriority=MEDIUM, dependentResult='null', workerGroup='default',
executorId=1, executorName='null'}
[INFO] 2021-01-27 14:25:03.908
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[227] -
master submit success, task : 测试4执行shell
[INFO] 2021-01-27 14:25:03.909
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[116] -
wait task: process id: 111, task id:142, task name:测试4执行shell complete
[INFO] 2021-01-27 14:25:03.991
org.apache.dolphinscheduler.server.master.processor.TaskAckProcessor:[69] -
taskAckCommand : TaskExecuteAckCommand{taskInstanceId=142, startTime=Wed Jan 27
14:25:03 CST 2021, host='10.30.220.164:1234', status=1,
logPath='/mnt/bigdata/dolphinscheduler/dolphinscheduler/logs/4/111/142.log',
executePath='/tmp/dolphinscheduler/exec/process/1/4/111/142'}
[INFO] 2021-01-27 14:25:04.019
org.apache.dolphinscheduler.server.master.processor.TaskResponseProcessor:[71]
- received command : TaskExecuteResponseCommand{taskInstanceId=142, status=7,
endTime=Wed Jan 27 14:25:04 CST 2021, processId=13745, appIds=''}
[INFO] 2021-01-27 14:25:05.922
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[102] -
task :测试4执行shell id:142, process id:111, exec thread completed
[INFO] 2021-01-27 14:25:06.912
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[864] - task
:测试4执行shell, id:142 complete, state is SUCCESS
[INFO] 2021-01-27 14:25:07.914
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[764] - work
flow process instance [id: 111, name:work执行测试-0-1611728592431], state change
from RUNNING_EXEUTION to SUCCESS, cmd type: START_PROCESS
[INFO] 2021-01-27 14:25:07.921
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[925] -
process:111 end, state :SUCCESS
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
