gaoyu2016 commented on issue #4296:
URL:
https://github.com/apache/incubator-dolphinscheduler/issues/4296#issuecomment-749967583
master log如下:
[INFO] 2020-12-23 10:49:07.381
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[939] -
remove task from stand by list: test_spark
[INFO] 2020-12-23 10:49:07.383
org.apache.dolphinscheduler.service.process.ProcessService:[833] - start submit
task : test_spark, instance id:622681, state:
RUNNING_EXEUTION
[INFO] 2020-12-23 10:49:07.385
org.apache.dolphinscheduler.service.process.ProcessService:[846] - end submit
task to db successfully:test_spark state:SUBMITT
ED_SUCCESS complete, instance id:622681 state: RUNNING_EXEUTION
[INFO] 2020-12-23 10:49:07.387
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[179] -
task ready to submit: TaskInstance{id=631654, na
me='test_spark', taskType='SHELL', processDefinitionId=292,
processInstanceId=622681, processInstanceName='null',
taskJson='{"conditionResult":"{\"successNod
e\":[\"\"],\"failedNode\":[\"\"]}","conditionsTask":false,"depList":[],"dependence":"{}","forbidden":false,"id":"tasks-79700","maxRetryTimes":0,"name":"test_
spark","params":"{\"rawScript\":\"spark-submit --master yarn --deploy-mode
cluster --num-executors 6 --driver-memory 1g --executor-memory 4g
--executor-cores
2
test_spark.py\",\"localParams\":[],\"resourceList\":[{\"res\":\"test_spark.py\",\"name\":\"test_spark.py\",\"id\":143}]}","preTasks":"[]","retryInterval":
1,"runFlag":"NORMAL","taskInstancePriority":"MEDIUM","taskTimeoutParameter":{"enable":false,"interval":0},"timeout":"{\"enable\":false,\"strategy\":\"\"}","t
ype":"SHELL","workerGroup":"default"}', state=SUBMITTED_SUCCESS,
submitTime=Wed Dec 23 10:49:07 CST 2020, startTime=Wed Dec 23 10:49:07 CST
2020, endTime=nul
l, host='null', executePath='null', logPath='null', retryTimes=0,
alertFlag=NO, processInstance=null, processDefine=null, pid=0, appLink='null',
flag=YES, de
pendency='null', duration=null, maxRetryTimes=0, retryInterval=1,
taskInstancePriority=MEDIUM, processInstancePriority=MEDIUM,
dependentResult='null', worker
Group='default', executorId=31, executorName='null'}
[INFO] 2020-12-23 10:49:07.387
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[190] -
master submit success, task : test_spark
[INFO] 2020-12-23 10:49:07.388
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[123] -
wait task: process id: 622681, task id:631654, t
ask name:test_spark complete
[INFO] 2020-12-23 10:49:07.528
org.apache.dolphinscheduler.server.master.processor.TaskAckProcessor:[81] -
taskAckCommand : TaskExecuteAckCommand{taskInstanc
eId=631654, startTime=Wed Dec 23 10:49:07 CST 2020,
host='10.11.54.133:1234', status=1,
logPath='/home/shared/opt/soft/ds/logs/292/622681/631654.log', execut
ePath='/home/shared/opt/soft/ds/tmp/dolphinscheduler/exec/process/32/292/622681/631654'}
[INFO] 2020-12-23 10:50:00.004
org.apache.dolphinscheduler.service.quartz.ProcessScheduleJob:[75] - scheduled
fire time :Wed Dec 23 10:50:00 CST 2020, fire t
ime :Wed Dec 23 10:50:00 CST 2020, process id :26
[WARN] 2020-12-23 10:50:00.006
org.apache.dolphinscheduler.service.quartz.ProcessScheduleJob:[90] - process
definition does not exist in db or offline,need
not to create command, projectId:14, processId:26
[INFO] 2020-12-23 10:50:08.466
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[902] - work
flow process instance [id: 622681, name:test_sp
ark-0-1608691747369], state change from RUNNING_EXEUTION to READY_STOP, cmd
type: START_PROCESS
[INFO] 2020-12-23 10:50:09.503
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[225] -
master kill taskInstance name :test_spark taskIn
stance id:631654
[INFO] 2020-12-23 10:50:09.510
org.apache.dolphinscheduler.server.master.processor.TaskKillResponseProcessor:[49]
- received task kill response command : Tas
kKillResponseCommand{taskInstanceId=631654, host='10.11.54.133:1234',
status=6, processId=215490, appIds=[]}
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]