kezhenxu94 opened a new pull request, #11730:
URL: https://github.com/apache/dolphinscheduler/pull/11730
```
[INFO] 2022-09-01 07:15:00.365 +0000
org.apache.dolphinscheduler.server.worker.task.WorkerHeartBeatTask:[86] -
[WorkflowInstance-0][TaskInstance-0] - Success write worker group heartBeatInfo
into registry, workGroupPath:
[/nodes/worker/default/demo-deployment-75b5f8457-ccnck:1234]
workerHeartBeatInfo:
{"startupTime":1662016367345,"reportTime":1662016500362,"cpuUsage":0.04,"memoryUsage":0.0,"loadAverage":0.17,"availablePhysicalMemorySize":12.96,"maxCpuloadAvg":8.0,"reservedMemory":0.3,"serverStatus":0,"processId":8,"workerHostWeight":100,"workerWaitingTaskCount":0,"workerExecThreadCount":10}
[WARN] 2022-09-01 07:15:03.775 +0000
org.springframework.cloud.kubernetes.fabric8.config.Fabric8ConfigUtils:[121] -
[WorkflowInstance-0][TaskInstance-0] - config-map with name :
'standalone-server-kubernetes' not present in namespace : 'default'
[WARN] 2022-09-01 07:15:03.780 +0000
org.springframework.cloud.kubernetes.fabric8.config.Fabric8ConfigUtils:[121] -
[WorkflowInstance-0][TaskInstance-0] - config-map with name :
'standalone-server-h2' not present in namespace : 'default'
[INFO] 2022-09-01 07:15:03.781 +0000
org.springframework.cloud.kubernetes.fabric8.config.reload.EventBasedConfigMapChangeDetector:[137]
- [WorkflowInstance-0][TaskInstance-0] - Detected change in config maps
[INFO] 2022-09-01 07:15:03.781 +0000
org.springframework.cloud.kubernetes.fabric8.config.reload.EventBasedConfigMapChangeDetector:[61]
- [WorkflowInstance-0][TaskInstance-0] - Reloading using strategy: REFRESH
[WARN] 2022-09-01 07:15:04.003 +0000
org.springframework.cloud.kubernetes.fabric8.config.Fabric8ConfigUtils:[121] -
[WorkflowInstance-0][TaskInstance-0] - config-map with name :
'standalone-server-kubernetes' not present in namespace : 'default'
[WARN] 2022-09-01 07:15:04.010 +0000
org.springframework.cloud.kubernetes.fabric8.config.Fabric8ConfigUtils:[121] -
[WorkflowInstance-0][TaskInstance-0] - config-map with name :
'standalone-server-h2' not present in namespace : 'default'
[INFO] 2022-09-01 07:15:04.011 +0000
org.springframework.cloud.bootstrap.config.PropertySourceBootstrapConfiguration:[109]
- [WorkflowInstance-0][TaskInstance-0] - Located property source:
[BootstrapPropertySource
{name='bootstrapProperties-configmap.standalone-server.default'}]
[INFO] 2022-09-01 07:15:04.017 +0000
org.springframework.boot.SpringApplication:[640] -
[WorkflowInstance-0][TaskInstance-0] - The following 2 profiles are active:
"kubernetes", "h2"
[INFO] 2022-09-01 07:15:04.050 +0000
org.springframework.boot.SpringApplication:[61] -
[WorkflowInstance-0][TaskInstance-0] - Started application in 0.261 seconds
(JVM running for 152.919)
[INFO] 2022-09-01 07:15:04.070 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[147] -
[WorkflowInstance-0][TaskInstance-0] - Master config: listenPort -> 5678
[INFO] 2022-09-01 07:15:04.070 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[148] -
[WorkflowInstance-0][TaskInstance-0] - Master config: fetchCommandNum -> 10
[INFO] 2022-09-01 07:15:04.070 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[149] -
[WorkflowInstance-0][TaskInstance-0] - Master config: preExecThreads -> 10
[INFO] 2022-09-01 07:15:04.070 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[150] -
[WorkflowInstance-0][TaskInstance-0] - Master config: execThreads -> 10
[INFO] 2022-09-01 07:15:04.071 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[151] -
[WorkflowInstance-0][TaskInstance-0] - Master config: dispatchTaskNumber -> 3
[INFO] 2022-09-01 07:15:04.071 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[152] -
[WorkflowInstance-0][TaskInstance-0] - Master config: hostSelector ->
LOWER_WEIGHT
[INFO] 2022-09-01 07:15:04.071 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[153] -
[WorkflowInstance-0][TaskInstance-0] - Master config: heartbeatInterval ->
PT10S
[INFO] 2022-09-01 07:15:04.071 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[154] -
[WorkflowInstance-0][TaskInstance-0] - Master config: taskCommitRetryTimes -> 5
[INFO] 2022-09-01 07:15:04.071 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[155] -
[WorkflowInstance-0][TaskInstance-0] - Master config: taskCommitInterval ->
PT1S
[INFO] 2022-09-01 07:15:04.072 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[156] -
[WorkflowInstance-0][TaskInstance-0] - Master config: stateWheelInterval ->
PT5S
[INFO] 2022-09-01 07:15:04.072 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[157] -
[WorkflowInstance-0][TaskInstance-0] - Master config: maxCpuLoadAvg -> 8.0
[INFO] 2022-09-01 07:15:04.072 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[158] -
[WorkflowInstance-0][TaskInstance-0] - Master config: reservedMemory -> 0.3
[INFO] 2022-09-01 07:15:04.073 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[159] -
[WorkflowInstance-0][TaskInstance-0] - Master config: failoverInterval -> PT10M
[INFO] 2022-09-01 07:15:04.073 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[160] -
[WorkflowInstance-0][TaskInstance-0] - Master config:
killYarnJobWhenTaskFailover -> true
[INFO] 2022-09-01 07:15:04.073 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[161] -
[WorkflowInstance-0][TaskInstance-0] - Master config:
registryDisconnectStrategy -> ConnectStrategyProperties(strategy=STOP,
maxWaitingTime=PT0S)
[INFO] 2022-09-01 07:15:04.073 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[162] -
[WorkflowInstance-0][TaskInstance-0] - Master config: masterAddress ->
demo-deployment-75b5f8457-ccnck:5678
[INFO] 2022-09-01 07:15:04.073 +0000
org.apache.dolphinscheduler.server.master.config.MasterConfig:[163] -
[WorkflowInstance-0][TaskInstance-0] - Master config: masterRegistryPath ->
/nodes/master/demo-deployment-75b5f8457-ccnck:5678
[INFO] 2022-09-01 07:15:04.254 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[100] -
[WorkflowInstance-0][TaskInstance-0] - Worker config: listenPort -> 1234
[INFO] 2022-09-01 07:15:04.255 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[101] -
[WorkflowInstance-0][TaskInstance-0] - Worker config: execThreads -> 20
[INFO] 2022-09-01 07:15:04.256 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[102] -
[WorkflowInstance-0][TaskInstance-0] - Worker config: heartbeatInterval -> PT10S
[INFO] 2022-09-01 07:15:04.257 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[103] -
[WorkflowInstance-0][TaskInstance-0] - Worker config: hostWeight -> 100
[INFO] 2022-09-01 07:15:04.258 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[104] -
[WorkflowInstance-0][TaskInstance-0] - Worker config: tenantAutoCreate -> true
[INFO] 2022-09-01 07:15:04.259 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[105] -
[WorkflowInstance-0][TaskInstance-0] - Worker config: tenantDistributedUser ->
false
[INFO] 2022-09-01 07:15:04.259 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[106] -
[WorkflowInstance-0][TaskInstance-0] - Worker config: maxCpuLoadAvg -> 8
[INFO] 2022-09-01 07:15:04.260 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[107] -
[WorkflowInstance-0][TaskInstance-0] - Worker config: reservedMemory -> 0.3
[INFO] 2022-09-01 07:15:04.260 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[108] -
[WorkflowInstance-0][TaskInstance-0] - Worker config: groups -> [default]
[INFO] 2022-09-01 07:15:04.260 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[109] -
[WorkflowInstance-0][TaskInstance-0] - Worker config: alertListenHost ->
localhost
[INFO] 2022-09-01 07:15:04.261 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[110] -
[WorkflowInstance-0][TaskInstance-0] - Worker config: alertListenPort -> 50052
[INFO] 2022-09-01 07:15:04.261 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[111] -
[WorkflowInstance-0][TaskInstance-0] - Worker config:
registryDisconnectStrategy -> ConnectStrategyProperties(strategy=STOP,
maxWaitingTime=PT0S)
[INFO] 2022-09-01 07:15:04.262 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[112] -
[WorkflowInstance-0][TaskInstance-0] - Worker config: workerAddress ->
ConnectStrategyProperties(strategy=STOP, maxWaitingTime=PT0S)
[INFO] 2022-09-01 07:15:04.262 +0000
org.apache.dolphinscheduler.server.worker.config.WorkerConfig:[113] -
[WorkflowInstance-0][TaskInstance-0] - Worker config: workerGroupRegistryPaths:
[/nodes/worker/default/demo-deployment-75b5f8457-ccnck:1234]
[INFO] 2022-09-01 07:15:09.042 +0000
org.apache.dolphinscheduler.server.master.task.MasterHeartBeatTask:[68] -
[WorkflowInstance-0][TaskInstance-0] - Success write master heartBeatInfo into
registry, masterRegistryPath:
/nodes/master/demo-deployment-75b5f8457-ccnck:5678, heartBeatInfo:
{"startupTime":1662016367345,"reportTime":1662016509037,"cpuUsage":0.08,"memoryUsage":0.0,"loadAverage":0.16,"availablePhysicalMemorySize":12.96,"maxCpuloadAvg":8.0,"reservedMemory":0.3,"processId":8}
[INFO] 2022-09-01 07:15:10.371 +0000
org.apache.dolphinscheduler.server.worker.task.WorkerHeartBeatTask:[86] -
[WorkflowInstance-0][TaskInstance-0] - Success write worker group heartBeatInfo
into registry, workGroupPath:
[/nodes/worker/default/demo-deployment-75b5f8457-ccnck:1234]
workerHeartBeatInfo:
{"startupTime":1662016367345,"reportTime":1662016510366,"cpuUsage":0.02,"memoryUsage":0.0,"loadAverage":0.14,"availablePhysicalMemorySize":12.96,"maxCpuloadAvg":8.0,"reservedMemory":0.3,"serverStatus":0,"processId":8,"workerHostWeight":100,"workerWaitingTaskCount":0,"workerExecThreadCount":20}
```
As we can see `Detected change in config maps` and `Reloading using
strategy: REFRESH`, and from the log `workerExecThreadCount":10` to
`workerExecThreadCount":20` when I modify the config map to change the
`workerExecThreadCount` from `10` to `20`.
Now all these work out of box in Kubernetes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
