zhaoli2333 commented on issue #5952:
URL: https://github.com/apache/seatunnel/issues/5952#issuecomment-1870748989
> Configuring jdbc as above is itself a batch mode and there is no need to
run it in streaming mode @zhaoli2333
>
> ```
> env {
> job.mode = "BATCH"
> }
> source {
> Jdbc {
> url = "jdbc:mysql://localhost:3306/test?serverTimezone=GMT%2b8"
> driver = "com.mysql.cj.jdbc.Driver"
> connection_check_timeout_sec = 100
> user = "root"
> password = "12345678"
>
> table_path = "test.ogg"
> #split.size = 8096
> #split.even-distribution.factor.upper-bound = 100
> #split.even-distribution.factor.lower-bound = 0.05
> #split.sample-sharding.threshold = 1000
> #split.inverse-sampling.rate = 1000
> }
> }
>
> sink {
> HdfsFile {
> fs.defaultFS = "hdfs://localhost:9000"
> path = "/user/mac/seatunnel"
>
> }
> }
> ```
@zhilinli123 BATCH mode is ok cause it doesn't trigger any checkpoint. But
there is a bug when using STREAMING mode.
When using flink engine, BATCH mode is inefficient and unrecoverable, so we
must use STREAMING mode. For now, we have switched to Flink 1.14 to bypass this
issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
