quanzhian commented on issue #5917:
URL:
https://github.com/apache/dolphinscheduler/issues/5917#issuecomment-891664328
> @quanzhian 如果是bug的话，能继续看下这两条工作流是否都继续向下执行了？也许时机最终master继续split
的只有一台机器，能再多提供一下下吗的日志么
2条工作流实例都正确执行了，一个ID是 4225，一个ID是 4226
第一个master节点关键日志如下：
[INFO] 2021-07-29 15:43:15.022
org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[145] -
find one command: id: 4761, type: START_PROCESS
[INFO] 2021-07-29 15:43:15.028
org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[153] -
start master exec thread , split DAG ...
[INFO] 2021-07-29 15:43:15.030
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[315] -
prepare process :4226 end
[INFO] 2021-07-29 15:43:15.031
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[792] - add
task to stand by list: oracle-postgresql
[INFO] 2021-07-29 15:43:15.031
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[805] -
remove task from stand by list: oracle-postgresql
[INFO] 2021-07-29 15:43:15.033
org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit
task : oracle-postgresql, instance id:4226, state: RUNNING_EXECUTION
[INFO] 2021-07-29 15:43:15.035
org.apache.dolphinscheduler.service.process.ProcessService:[858] - end submit
task to db successfully:oracle-postgresql state:SUBMITTED_SUCCESS complete,
instance id:4226 state: RUNNING_EXECUTION
[INFO] 2021-07-29 15:43:15.037
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[216] -
task ready to submit: TaskInstance{id=5279, name='oracle-postgresql',
taskType='QTDI', processDefinitionId=1100, processInstanceId=4226,
processInstanceName='null',
taskJson='{"conditionResult":"{\"successNode\":[],\"failedNode\":[]}","conditionsTask":false,"depList":[],"dependence":"{}","extras":"{\"targetTable\":\"t_ds_user\",\"sourceDatasourceId\":756,\"sourceTable\":\"T_DS_USER_U\",\"sourceType\":\"oracle\",\"dsSourceDatasourceId\":394,\"targetDatasourceId\":748,\"targetType\":\"hive\",\"sourceSchema\":\"INVENTORY\",\"dsTargetDatasourceId\":386,\"targetDatabase\":\"dip_mxl\"}","forbidden":false,"id":"b393040f76bff88728460a683628355a","loc":"","maxRetryTimes":0,"name":"oracle-postgresql","params":"{\"customConfig\":1,\"extra\":{\"targetTable\":\"user_tbl\",\"targetSchema\":\"lzp-schema\",\"sourceTable\":\"T_DS_USER_U\",\"dsSourceDatasourceId\":394,\"targetDatasourceId\":
757,\"targetType\":\"postgresql\",\"sourceSchema\":\"INVENTORY\",\"targetDatabase\":\"liuzhipeng\",\"sourceDatasourceId\":756,\"sourceType\":\"oracle\",\"syncWay\":\"full\",\"dsTargetDatasourceId\":395,\"syncType\":\"insert\",\"projectId\":355},\"json\":\"{\\\"job\\\":{\\\"setting\\\":{\\\"speed\\\":{\\\"channel\\\":1,\\\"bytes\\\":0},\\\"errorLimit\\\":{\\\"record\\\":100}},\\\"content\\\":[{\\\"reader\\\":{\\\"parameter\\\":{\\\"customSql\\\":\\\"\\\",\\\"where\\\":\\\"\\\",\\\"splitPk\\\":\\\"\\\",\\\"queryTimeOut\\\":3600,\\\"requestAccumulatorInterval\\\":2,\\\"username\\\":\\\"inventory\\\",\\\"password\\\":\\\"********\\\",\\\"connection\\\":[{\\\"jdbcUrl\\\":[\\\"jdbc:oracle:thin:@//bigdata-app01:1521/ORCLPDB1\\\"],\\\"table\\\":[\\\"T_DS_USER_U\\\"]}],\\\"column\\\":[{\\\"name\\\":\\\"ID\\\",\\\"type\\\":\\\"NUMBER\\\"},{\\\"name\\\":\\\"USER_NAME\\\",\\\"type\\\":\\\"VARCHAR2(64)\\\"},{\\\"name\\\":\\\"USER_PASSWORD\\\",\\\"type\\\":\\\"VARCHAR2(64)\\\"},{\\\"name\\\":\\\"
USER_TYPE\\\",\\\"type\\\":\\\"NUMBER\\\"},{\\\"name\\\":\\\"EMAIL\\\",\\\"type\\\":\\\"VARCHAR2(64)\\\"}]},\\\"name\\\":\\\"oraclereader\\\",\\\"extra\\\":[\\\"ID\\\",\\\"USER_NAME\\\",\\\"USER_PASSWORD\\\",\\\"USER_TYPE\\\",\\\"EMAIL\\\"]},\\\"writer\\\":{\\\"parameter\\\":{\\\"jdbcUrl\\\":\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\",\\\"username\\\":\\\"postgres\\\",\\\"password\\\":\\\"********\\\",\\\"connection\\\":[{\\\"jdbcUrl\\\":\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\",\\\"table\\\":\\\"user_tbl\\\"}],\\\"insertSqlMode\\\":\\\"\\\",\\\"writeMode\\\":\\\"insert\\\",\\\"batchSize\\\":1024,\\\"preSql\\\":[],\\\"postSql\\\":[],\\\"column\\\":[{\\\"name\\\":\\\"id\\\",\\\"type\\\":\\\"int4\\\"},{\\\"name\\\":\\\"user_name\\\",\\\"type\\\":\\\"varchar(64)\\\"},{\\\"name\\\":\\\"user_password\\\",\\\"type\\\":\\\"varchar(128)\\\"},{\\\"name\\\":\\\"user_type\\\",\\\"type\\\":\\\"int4\\\"},{\\\"name\\\":\\\"email\\\",\\\"type\\\":\\\"varchar(64)\\\"}]},\\\"na
me\\\":\\\"postgresqlwriter\\\"}}]}}\",\"localParams\":[]}","preTasks":"[]","retryInterval":1,"runFlag":"NORMAL","taskInstancePriority":"MEDIUM","taskTimeoutParameter":{"enable":false,"interval":0},"timeout":"{\"enable\":false,\"interval\":\"\",\"strategy\":\"\"}","type":"QTDI","workerGroup":"default","workerGroupId":0}',
state=SUBMITTED_SUCCESS, submitTime=Thu Jul 29 15:43:15 CST 2021,
startTime=null, endTime=null, host='null', executePath='null', logPath='null',
retryTimes=0, alertFlag=NO, processInstance=null, processDefine=null, pid=0,
appLink='null', flag=YES, dependency='null', duration=null, maxRetryTimes=0,
retryInterval=1, taskInstancePriority=MEDIUM, processInstancePriority=MEDIUM,
dependentResult='null', workerGroup='default', executorId=8,
executorName='null'}
[INFO] 2021-07-29 15:43:15.037
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[227] -
master submit success, task : oracle-postgresql
[INFO] 2021-07-29 15:43:15.038
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[116] -
wait task: process id: 4226, task id:5279, task name:oracle-postgresql complete
[INFO] 2021-07-29 15:43:15.068
org.apache.dolphinscheduler.server.master.processor.TaskAckProcessor:[69] -
taskAckCommand : TaskExecuteAckCommand{taskInstanceId=5279, startTime=Thu Jul
29 15:43:15 CST 2021, host='172.18.70.220:1234', status=1,
logPath='/mnt/services/dolphinscheduler136/logs/1100/4226/5279.log',
executePath='/tmp/dolphinscheduler/exec/process/26/1100/4226/5279'}
第二个master节点关键日志如下：
[INFO] 2021-07-29 15:43:15.020
org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[145] -
find one command: id: 4761, type: START_PROCESS
[INFO] 2021-07-29 15:43:15.027
org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[153] -
start master exec thread , split DAG ...
[INFO] 2021-07-29 15:43:15.028
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[315] -
prepare process :4225 end
[INFO] 2021-07-29 15:43:15.029
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[792] - add
task to stand by list: oracle-postgresql
[INFO] 2021-07-29 15:43:15.029
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[805] -
remove task from stand by list: oracle-postgresql
[INFO] 2021-07-29 15:43:15.031
org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit
task : oracle-postgresql, instance id:4225, state: RUNNING_EXECUTION
[INFO] 2021-07-29 15:43:15.033
org.apache.dolphinscheduler.service.process.ProcessService:[858] - end submit
task to db successfully:oracle-postgresql state:SUBMITTED_SUCCESS complete,
instance id:4225 state: RUNNING_EXECUTION
[INFO] 2021-07-29 15:43:15.035
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[216] -
task ready to submit: TaskInstance{id=5278, name='oracle-postgresql',
taskType='QTDI', processDefinitionId=1100, processInstanceId=4225,
processInstanceName='null',
taskJson='{"conditionResult":"{\"successNode\":[],\"failedNode\":[]}","conditionsTask":false,"depList":[],"dependence":"{}","extras":"{\"targetTable\":\"t_ds_user\",\"sourceDatasourceId\":756,\"sourceTable\":\"T_DS_USER_U\",\"sourceType\":\"oracle\",\"dsSourceDatasourceId\":394,\"targetDatasourceId\":748,\"targetType\":\"hive\",\"sourceSchema\":\"INVENTORY\",\"dsTargetDatasourceId\":386,\"targetDatabase\":\"dip_mxl\"}","forbidden":false,"id":"b393040f76bff88728460a683628355a","loc":"","maxRetryTimes":0,"name":"oracle-postgresql","params":"{\"customConfig\":1,\"extra\":{\"targetTable\":\"user_tbl\",\"targetSchema\":\"lzp-schema\",\"sourceTable\":\"T_DS_USER_U\",\"dsSourceDatasourceId\":394,\"targetDatasourceId\":
757,\"targetType\":\"postgresql\",\"sourceSchema\":\"INVENTORY\",\"targetDatabase\":\"liuzhipeng\",\"sourceDatasourceId\":756,\"sourceType\":\"oracle\",\"syncWay\":\"full\",\"dsTargetDatasourceId\":395,\"syncType\":\"insert\",\"projectId\":355},\"json\":\"{\\\"job\\\":{\\\"setting\\\":{\\\"speed\\\":{\\\"channel\\\":1,\\\"bytes\\\":0},\\\"errorLimit\\\":{\\\"record\\\":100}},\\\"content\\\":[{\\\"reader\\\":{\\\"parameter\\\":{\\\"customSql\\\":\\\"\\\",\\\"where\\\":\\\"\\\",\\\"splitPk\\\":\\\"\\\",\\\"queryTimeOut\\\":3600,\\\"requestAccumulatorInterval\\\":2,\\\"username\\\":\\\"inventory\\\",\\\"password\\\":\\\"********\\\",\\\"connection\\\":[{\\\"jdbcUrl\\\":[\\\"jdbc:oracle:thin:@//bigdata-app01:1521/ORCLPDB1\\\"],\\\"table\\\":[\\\"T_DS_USER_U\\\"]}],\\\"column\\\":[{\\\"name\\\":\\\"ID\\\",\\\"type\\\":\\\"NUMBER\\\"},{\\\"name\\\":\\\"USER_NAME\\\",\\\"type\\\":\\\"VARCHAR2(64)\\\"},{\\\"name\\\":\\\"USER_PASSWORD\\\",\\\"type\\\":\\\"VARCHAR2(64)\\\"},{\\\"name\\\":\\\"
USER_TYPE\\\",\\\"type\\\":\\\"NUMBER\\\"},{\\\"name\\\":\\\"EMAIL\\\",\\\"type\\\":\\\"VARCHAR2(64)\\\"}]},\\\"name\\\":\\\"oraclereader\\\",\\\"extra\\\":[\\\"ID\\\",\\\"USER_NAME\\\",\\\"USER_PASSWORD\\\",\\\"USER_TYPE\\\",\\\"EMAIL\\\"]},\\\"writer\\\":{\\\"parameter\\\":{\\\"jdbcUrl\\\":\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\",\\\"username\\\":\\\"postgres\\\",\\\"password\\\":\\\"********\\\",\\\"connection\\\":[{\\\"jdbcUrl\\\":\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\",\\\"table\\\":\\\"user_tbl\\\"}],\\\"insertSqlMode\\\":\\\"\\\",\\\"writeMode\\\":\\\"insert\\\",\\\"batchSize\\\":1024,\\\"preSql\\\":[],\\\"postSql\\\":[],\\\"column\\\":[{\\\"name\\\":\\\"id\\\",\\\"type\\\":\\\"int4\\\"},{\\\"name\\\":\\\"user_name\\\",\\\"type\\\":\\\"varchar(64)\\\"},{\\\"name\\\":\\\"user_password\\\",\\\"type\\\":\\\"varchar(128)\\\"},{\\\"name\\\":\\\"user_type\\\",\\\"type\\\":\\\"int4\\\"},{\\\"name\\\":\\\"email\\\",\\\"type\\\":\\\"varchar(64)\\\"}]},\\\"na
me\\\":\\\"postgresqlwriter\\\"}}]}}\",\"localParams\":[]}","preTasks":"[]","retryInterval":1,"runFlag":"NORMAL","taskInstancePriority":"MEDIUM","taskTimeoutParameter":{"enable":false,"interval":0},"timeout":"{\"enable\":false,\"interval\":\"\",\"strategy\":\"\"}","type":"QTDI","workerGroup":"default","workerGroupId":0}',
state=SUBMITTED_SUCCESS, submitTime=Thu Jul 29 15:43:15 CST 2021,
startTime=null, endTime=null, host='null', executePath='null', logPath='null',
retryTimes=0, alertFlag=NO, processInstance=null, processDefine=null, pid=0,
appLink='null', flag=YES, dependency='null', duration=null, maxRetryTimes=0,
retryInterval=1, taskInstancePriority=MEDIUM, processInstancePriority=MEDIUM,
dependentResult='null', workerGroup='default', executorId=8,
executorName='null'}
[INFO] 2021-07-29 15:43:15.035
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[227] -
master submit success, task : oracle-postgresql
[INFO] 2021-07-29 15:43:15.036
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[116] -
wait task: process id: 4225, task id:5278, task name:oracle-postgresql complete
[INFO] 2021-07-29 15:43:15.882
org.apache.dolphinscheduler.server.master.processor.TaskAckProcessor:[69] -
taskAckCommand : TaskExecuteAckCommand{taskInstanceId=5278, startTime=Thu Jul
29 15:43:15 CST 2021, host='172.18.70.241:1234', status=1,
logPath='/mnt/services/dolphinscheduler_poc/logs/1100/4225/5278.log',
executePath='/tmp/dolphinscheduler/exec/process/26/1100/4225/5278'}
[INFO] 2021-07-29 15:43:45.717
org.apache.dolphinscheduler.server.master.processor.TaskResponseProcessor:[71]
- received command : TaskExecuteResponseCommand{taskInstanceId=5278, status=6,
endTime=Thu Jul 29 15:43:45 CST 2021, processId=22898,
appIds='application_1624943793042_1602'}
[INFO] 2021-07-29 15:43:47.103
org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[102] -
task :oracle-postgresql id:5278, process id:4225, exec thread completed
[INFO] 2021-07-29 15:43:48.094
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[864] - task
:oracle-postgresql, id:5278 complete, state is FAILURE
[INFO] 2021-07-29 15:43:49.096
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[764] - work
flow process instance [id: 4225, name:oracle-reader-where-0-1627544595022],
state change from RUNNING_EXECUTION to FAILURE, cmd type: START_PROCESS
[INFO] 2021-07-29 15:43:49.101
org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[925] -
process:4225 end, state :FAILURE
[INFO] 2021-07-29 15:45:18.868
org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[145] -
find one command: id: 4762, type: START_PROCESS
第一个worker节点日志：
[INFO] 2021-07-29 15:43:15.066
org.apache.dolphinscheduler.server.worker.processor.TaskExecuteProcessor:[110]
- received command :
TaskExecuteRequestCommand{taskExecutionContext='{"cmdTypeIfComplement":0,"dataxTaskExecutionContext":{"dataSourceId":0,"dataTargetId":0,"sourcetype":0,"targetType":0},"executorId":8,"procedureTaskExecutionContext":{},"processDefineId":1100,"processId":0,"processInstanceId":4226,"projectId":26,"queue":"default","resources":{},"sqlTaskExecutionContext":{"warningGroupId":0},"sqoopTaskExecutionContext":{"dataSourceId":0,"dataTargetId":0,"sourcetype":0,"targetType":0},"taskInstanceId":5279,"taskJson":"{\"conditionResult\":\"{\\\"successNode\\\":[],\\\"failedNode\\\":[]}\",\"conditionsTask\":false,\"depList\":[],\"dependence\":\"{}\",\"extras\":\"{\\\"targetTable\\\":\\\"t_ds_user\\\",\\\"sourceDatasourceId\\\":756,\\\"sourceTable\\\":\\\"T_DS_USER_U\\\",\\\"sourceType\\\":\\\"oracle\\\",\\\"dsSourceDatasourceId\\\":394,\\\"targetDatasourceId\\\":748,\\\"tar
getType\\\":\\\"hive\\\",\\\"sourceSchema\\\":\\\"INVENTORY\\\",\\\"dsTargetDatasourceId\\\":386,\\\"targetDatabase\\\":\\\"dip_mxl\\\"}\",\"forbidden\":false,\"id\":\"b393040f76bff88728460a683628355a\",\"loc\":\"\",\"maxRetryTimes\":0,\"name\":\"oracle-postgresql\",\"params\":\"{\\\"customConfig\\\":1,\\\"extra\\\":{\\\"targetTable\\\":\\\"user_tbl\\\",\\\"targetSchema\\\":\\\"lzp-schema\\\",\\\"sourceTable\\\":\\\"T_DS_USER_U\\\",\\\"dsSourceDatasourceId\\\":394,\\\"targetDatasourceId\\\":757,\\\"targetType\\\":\\\"postgresql\\\",\\\"sourceSchema\\\":\\\"INVENTORY\\\",\\\"targetDatabase\\\":\\\"liuzhipeng\\\",\\\"sourceDatasourceId\\\":756,\\\"sourceType\\\":\\\"oracle\\\",\\\"syncWay\\\":\\\"full\\\",\\\"dsTargetDatasourceId\\\":395,\\\"syncType\\\":\\\"insert\\\",\\\"projectId\\\":355},\\\"json\\\":\\\"{\\\\\\\"job\\\\\\\":{\\\\\\\"setting\\\\\\\":{\\\\\\\"speed\\\\\\\":{\\\\\\\"channel\\\\\\\":1,\\\\\\\"bytes\\\\\\\":0},\\\\\\\"errorLimit\\\\\\\":{\\\\\\\"record\\\\\\\":100}},\
\\\\\\"content\\\\\\\":[{\\\\\\\"reader\\\\\\\":{\\\\\\\"parameter\\\\\\\":{\\\\\\\"customSql\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"where\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"splitPk\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"queryTimeOut\\\\\\\":3600,\\\\\\\"requestAccumulatorInterval\\\\\\\":2,\\\\\\\"username\\\\\\\":\\\\\\\"inventory\\\\\\\",\\\\\\\"password\\\\\\\":\\\\\\\"********\\\\\\\",\\\\\\\"connection\\\\\\\":[{\\\\\\\"jdbcUrl\\\\\\\":[\\\\\\\"jdbc:oracle:thin:@//bigdata-app01:1521/ORCLPDB1\\\\\\\"],\\\\\\\"table\\\\\\\":[\\\\\\\"T_DS_USER_U\\\\\\\"]}],\\\\\\\"column\\\\\\\":[{\\\\\\\"name\\\\\\\":\\\\\\\"ID\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"NUMBER\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"USER_NAME\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"VARCHAR2(64)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"USER_PASSWORD\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"VARCHAR2(64)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"USER_TYPE\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"NUMBER\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"EMAIL\\\\\
\\",\\\\\\\"type\\\\\\\":\\\\\\\"VARCHAR2(64)\\\\\\\"}]},\\\\\\\"name\\\\\\\":\\\\\\\"oraclereader\\\\\\\",\\\\\\\"extra\\\\\\\":[\\\\\\\"ID\\\\\\\",\\\\\\\"USER_NAME\\\\\\\",\\\\\\\"USER_PASSWORD\\\\\\\",\\\\\\\"USER_TYPE\\\\\\\",\\\\\\\"EMAIL\\\\\\\"]},\\\\\\\"writer\\\\\\\":{\\\\\\\"parameter\\\\\\\":{\\\\\\\"jdbcUrl\\\\\\\":\\\\\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\\\\\",\\\\\\\"username\\\\\\\":\\\\\\\"postgres\\\\\\\",\\\\\\\"password\\\\\\\":\\\\\\\"********\\\\\\\",\\\\\\\"connection\\\\\\\":[{\\\\\\\"jdbcUrl\\\\\\\":\\\\\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\\\\\",\\\\\\\"table\\\\\\\":\\\\\\\"user_tbl\\\\\\\"}],\\\\\\\"insertSqlMode\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"writeMode\\\\\\\":\\\\\\\"insert\\\\\\\",\\\\\\\"batchSize\\\\\\\":1024,\\\\\\\"preSql\\\\\\\":[],\\\\\\\"postSql\\\\\\\":[],\\\\\\\"column\\\\\\\":[{\\\\\\\"name\\\\\\\":\\\\\\\"id\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"int4\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"user_name\\\\\\\",\\\\\
\\"type\\\\\\\":\\\\\\\"varchar(64)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"user_password\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"varchar(128)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"user_type\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"int4\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"email\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"varchar(64)\\\\\\\"}]},\\\\\\\"name\\\\\\\":\\\\\\\"postgresqlwriter\\\\\\\"}}]}}\\\",\\\"localParams\\\":[]}\",\"preTasks\":\"[]\",\"retryInterval\":1,\"runFlag\":\"NORMAL\",\"taskInstancePriority\":\"MEDIUM\",\"taskTimeoutParameter\":{\"enable\":false,\"interval\":0},\"timeout\":\"{\\\"enable\\\":false,\\\"interval\\\":\\\"\\\",\\\"strategy\\\":\\\"\\\"}\",\"type\":\"QTDI\",\"workerGroup\":\"default\",\"workerGroupId\":0}","taskName":"oracle-postgresql","taskTimeout":0,"taskTimeoutStrategy":0,"taskType":"QTDI","tenantCode":"dolphinscheduler","workerGroup":"default"}'}
[INFO] 2021-07-29 15:43:15.067
org.apache.dolphinscheduler.server.worker.processor.TaskExecuteProcessor:[137]
- task instance local execute path :
/tmp/dolphinscheduler/exec/process/26/1100/4226/5279
[INFO] 2021-07-29 15:43:15.067
org.apache.dolphinscheduler.common.utils.FileUtils:[115] - create dir success
/tmp/dolphinscheduler/exec/process/26/1100/4226/5279
[INFO] 2021-07-29 15:43:15.067 - [taskAppId=TASK-1100-4226-5279]:[115] -
create dir success /tmp/dolphinscheduler/exec/process/26/1100/4226/5279
[INFO] 2021-07-29 15:43:15.068
org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[107] -
script path : /tmp/dolphinscheduler/exec/process/26/1100/4226/5279
第二个worker节点日志：
[INFO] 2021-07-29 15:43:15.880
org.apache.dolphinscheduler.server.worker.processor.TaskExecuteProcessor:[110]
- received command :
TaskExecuteRequestCommand{taskExecutionContext='{"cmdTypeIfComplement":0,"dataxTaskExecutionContext":{"dataSourceId":0,"dataTargetId":0,"sourcetype":0,"targetType":0},"executorId":8,"procedureTaskExecutionContext":{},"processDefineId":1100,"processId":0,"processInstanceId":4225,"projectId":26,"queue":"default","resources":{},"sqlTaskExecutionContext":{"warningGroupId":0},"sqoopTaskExecutionContext":{"dataSourceId":0,"dataTargetId":0,"sourcetype":0,"targetType":0},"taskInstanceId":5278,"taskJson":"{\"conditionResult\":\"{\\\"successNode\\\":[],\\\"failedNode\\\":[]}\",\"conditionsTask\":false,\"depList\":[],\"dependence\":\"{}\",\"extras\":\"{\\\"targetTable\\\":\\\"t_ds_user\\\",\\\"sourceDatasourceId\\\":756,\\\"sourceTable\\\":\\\"T_DS_USER_U\\\",\\\"sourceType\\\":\\\"oracle\\\",\\\"dsSourceDatasourceId\\\":394,\\\"targetDatasourceId\\\":748,\\\"tar
getType\\\":\\\"hive\\\",\\\"sourceSchema\\\":\\\"INVENTORY\\\",\\\"dsTargetDatasourceId\\\":386,\\\"targetDatabase\\\":\\\"dip_mxl\\\"}\",\"forbidden\":false,\"id\":\"b393040f76bff88728460a683628355a\",\"loc\":\"\",\"maxRetryTimes\":0,\"name\":\"oracle-postgresql\",\"params\":\"{\\\"customConfig\\\":1,\\\"extra\\\":{\\\"targetTable\\\":\\\"user_tbl\\\",\\\"targetSchema\\\":\\\"lzp-schema\\\",\\\"sourceTable\\\":\\\"T_DS_USER_U\\\",\\\"dsSourceDatasourceId\\\":394,\\\"targetDatasourceId\\\":757,\\\"targetType\\\":\\\"postgresql\\\",\\\"sourceSchema\\\":\\\"INVENTORY\\\",\\\"targetDatabase\\\":\\\"liuzhipeng\\\",\\\"sourceDatasourceId\\\":756,\\\"sourceType\\\":\\\"oracle\\\",\\\"syncWay\\\":\\\"full\\\",\\\"dsTargetDatasourceId\\\":395,\\\"syncType\\\":\\\"insert\\\",\\\"projectId\\\":355},\\\"json\\\":\\\"{\\\\\\\"job\\\\\\\":{\\\\\\\"setting\\\\\\\":{\\\\\\\"speed\\\\\\\":{\\\\\\\"channel\\\\\\\":1,\\\\\\\"bytes\\\\\\\":0},\\\\\\\"errorLimit\\\\\\\":{\\\\\\\"record\\\\\\\":100}},\
\\\\\\"content\\\\\\\":[{\\\\\\\"reader\\\\\\\":{\\\\\\\"parameter\\\\\\\":{\\\\\\\"customSql\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"where\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"splitPk\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"queryTimeOut\\\\\\\":3600,\\\\\\\"requestAccumulatorInterval\\\\\\\":2,\\\\\\\"username\\\\\\\":\\\\\\\"inventory\\\\\\\",\\\\\\\"password\\\\\\\":\\\\\\\"********\\\\\\\",\\\\\\\"connection\\\\\\\":[{\\\\\\\"jdbcUrl\\\\\\\":[\\\\\\\"jdbc:oracle:thin:@//bigdata-app01:1521/ORCLPDB1\\\\\\\"],\\\\\\\"table\\\\\\\":[\\\\\\\"T_DS_USER_U\\\\\\\"]}],\\\\\\\"column\\\\\\\":[{\\\\\\\"name\\\\\\\":\\\\\\\"ID\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"NUMBER\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"USER_NAME\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"VARCHAR2(64)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"USER_PASSWORD\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"VARCHAR2(64)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"USER_TYPE\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"NUMBER\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"EMAIL\\\\\
\\",\\\\\\\"type\\\\\\\":\\\\\\\"VARCHAR2(64)\\\\\\\"}]},\\\\\\\"name\\\\\\\":\\\\\\\"oraclereader\\\\\\\",\\\\\\\"extra\\\\\\\":[\\\\\\\"ID\\\\\\\",\\\\\\\"USER_NAME\\\\\\\",\\\\\\\"USER_PASSWORD\\\\\\\",\\\\\\\"USER_TYPE\\\\\\\",\\\\\\\"EMAIL\\\\\\\"]},\\\\\\\"writer\\\\\\\":{\\\\\\\"parameter\\\\\\\":{\\\\\\\"jdbcUrl\\\\\\\":\\\\\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\\\\\",\\\\\\\"username\\\\\\\":\\\\\\\"postgres\\\\\\\",\\\\\\\"password\\\\\\\":\\\\\\\"********\\\\\\\",\\\\\\\"connection\\\\\\\":[{\\\\\\\"jdbcUrl\\\\\\\":\\\\\\\"jdbc:postgresql://bigdata-app01:5432/postgres\\\\\\\",\\\\\\\"table\\\\\\\":\\\\\\\"user_tbl\\\\\\\"}],\\\\\\\"insertSqlMode\\\\\\\":\\\\\\\"\\\\\\\",\\\\\\\"writeMode\\\\\\\":\\\\\\\"insert\\\\\\\",\\\\\\\"batchSize\\\\\\\":1024,\\\\\\\"preSql\\\\\\\":[],\\\\\\\"postSql\\\\\\\":[],\\\\\\\"column\\\\\\\":[{\\\\\\\"name\\\\\\\":\\\\\\\"id\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"int4\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"user_name\\\\\\\",\\\\\
\\"type\\\\\\\":\\\\\\\"varchar(64)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"user_password\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"varchar(128)\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"user_type\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"int4\\\\\\\"},{\\\\\\\"name\\\\\\\":\\\\\\\"email\\\\\\\",\\\\\\\"type\\\\\\\":\\\\\\\"varchar(64)\\\\\\\"}]},\\\\\\\"name\\\\\\\":\\\\\\\"postgresqlwriter\\\\\\\"}}]}}\\\",\\\"localParams\\\":[]}\",\"preTasks\":\"[]\",\"retryInterval\":1,\"runFlag\":\"NORMAL\",\"taskInstancePriority\":\"MEDIUM\",\"taskTimeoutParameter\":{\"enable\":false,\"interval\":0},\"timeout\":\"{\\\"enable\\\":false,\\\"interval\\\":\\\"\\\",\\\"strategy\\\":\\\"\\\"}\",\"type\":\"QTDI\",\"workerGroup\":\"default\",\"workerGroupId\":0}","taskName":"oracle-postgresql","taskTimeout":0,"taskTimeoutStrategy":0,"taskType":"QTDI","tenantCode":"dolphinscheduler","workerGroup":"default"}'}
[INFO] 2021-07-29 15:43:15.881
org.apache.dolphinscheduler.server.worker.processor.TaskExecuteProcessor:[137]
- task instance local execute path :
/tmp/dolphinscheduler/exec/process/26/1100/4225/5278
[INFO] 2021-07-29 15:43:15.881
org.apache.dolphinscheduler.common.utils.FileUtils:[115] - create dir success
/tmp/dolphinscheduler/exec/process/26/1100/4225/5278
[INFO] 2021-07-29 15:43:15.881 - [taskAppId=TASK-1100-4225-5278]:[115] -
create dir success /tmp/dolphinscheduler/exec/process/26/1100/4225/5278
[INFO] 2021-07-29 15:43:15.882
org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[107] -
script path : /tmp/dolphinscheduler/exec/process/26/1100/4225/5278
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
