lordk911 commented on issue #4462:
URL:
https://github.com/apache/incubator-seatunnel/issues/4462#issuecomment-1491428384
I've tried cluster mode , and my checkpoint config is :
```
seatunnel:
engine:
backup-count: 1
queue-type: blockingqueue
print-execution-info-interval: 60
print-job-metrics-info-interval: 60
slot-service:
dynamic-slot: true
checkpoint:
interval: 10000
timeout: 60000
max-concurrent: 5
tolerable-failure: 2
storage:
type: hdfs
max-retained: 3
plugin-config:
namespace: /tmp/seatunnel/checkpoint_snapshot
storage.type: hdfs
fs.defaultFS: hdfs://nsdev/tmp # Ensure that the directory has
written permission
```
I can see the `/tmp/seatunnel/checkpoint_snapshot` dir on hdfs
```
but when I try to restore my job , from the server log I found :
2023-03-31 15:14:08,580 INFO
com.hazelcast.client.impl.protocol.task.AuthenticationMessageTask -
[10.0.105.246]:5801 [seatunnel] [5.1] Received auth from Connection[id=5,
/10.0.105.246:5801->/10.0.105.250:50522, qualifier=null,
endpoint=[10.0.105.250]:50522, remoteUuid=47a60eba-f5a1-41e5-8d6e-a3b7a05aaaed,
alive=true, connectionType=JVM, planeIndex=-1], successfully authenticated,
clientUuid: 47a60eba-f5a1-41e5-8d6e-a3b7a05aaaed, client name: hz.client_1,
client version: 5.1
2023-03-31 15:14:09,438 INFO
org.apache.seatunnel.engine.server.master.JobMaster - Init JobMaster for Job
SeaTunnel_Job (694077488422191106)
2023-03-31 15:14:09,438 INFO
org.apache.seatunnel.engine.server.master.JobMaster - Job SeaTunnel_Job
(694077488422191106) needed jar urls
[file:/data/soft/seatunnel/seatunnel-2.3.1/connectors/seatunnel/connector-console-2.3.1.jar,
file:/data/soft/seatunnel/seatunnel-2.3.1/connectors/seatunnel/connector-doris-2.3.1.jar,
file:/data/soft/seatunnel/seatunnel-2.3.1/connectors/seatunnel/connector-cdc-mysql-2.3.1.jar]
2023-03-31 15:14:09,552 INFO
org.apache.seatunnel.engine.checkpoint.storage.hdfs.HdfsStorage - Path
/tmp/seatunnel/checkpoint_snapshot/694077488422191106 is not a directory
2023-03-31 15:14:09,552 INFO
org.apache.seatunnel.engine.checkpoint.storage.hdfs.HdfsStorage - No checkpoint
found for job, job id is: 694077488422191106
2023-03-31 15:14:09,562 INFO
org.apache.seatunnel.engine.checkpoint.storage.hdfs.HdfsStorage - Path
/tmp/seatunnel/checkpoint_snapshot/694077488422191106 is not a directory
2023-03-31 15:14:09,562 INFO
org.apache.seatunnel.engine.checkpoint.storage.hdfs.HdfsStorage - No checkpoint
found for job, job id is: 694077488422191106
```
It seems seatunnel still try to restore from localfile.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
