zhangtao106 opened a new issue, #7133:
URL: https://github.com/apache/seatunnel/issues/7133

   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   
   
   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### Describe the proposal
   
       I was synchronized data from DRDS to Doris, my query range is “id < 
50000000”, but total data less than 50000000, when i synchorized, that speed 
was very slow! less than datax much .
        my data  in DRDS has 42  cloumns, and this is my conf:
   `env {
     checkpoint.interval = 10000
     job.mode = "batch"
   }
   source{
       Jdbc {
           url = 
"jdbc:mysql://x.x.x.x:3306/pp_data_ds?useSSL=false&serverTimezone=GMT%2B8&useUnicode=true&characterEncoding=utf8&socketTimeout=6000000&waitTimeout=60000&autoReconnect=true&rewriteBatchedStatements=true&connectTimeout=60000"
           driver = "com.mysql.cj.jdbc.Driver"
           connection_check_timeout_sec = 100
           user = "user_ro"
           password = "******"
           query = "select  `province_name`, ...  from table_data where id >0 
and id < 50000000"
           
       }
   }
   
   sink {
     Doris {
       fenodes = "x.x.x.x:8030"
       username = test
       password = "*******"
       database = "test"
       table = "td_sub_sms_port_bk"
       sink.label-prefix = "test-batch"
       sink.enable-2pc = "true"
       sink.enable-delete = "true"
       doris.config {
         format = "json"
         read_json_by_line = "true"
       }
     }
   }`
   
   when I submit job config into cluster, log info is update slow ,
   
![aaaa](https://github.com/apache/seatunnel/assets/42627122/dd2b5ff0-5e49-4088-8ea5-34caee9dec8a)
   
   
   
   ### Task list
   
   env {
     checkpoint.interval = 10000
     job.mode = "batch"
   }
   source{
       Jdbc {
           url = 
"jdbc:mysql://x.x.x.x:3306/pp_data_ds?useSSL=false&serverTimezone=GMT%2B8&useUnicode=true&characterEncoding=utf8&socketTimeout=6000000&waitTimeout=60000&autoReconnect=true&rewriteBatchedStatements=true&connectTimeout=60000"
           driver = "com.mysql.cj.jdbc.Driver"
           connection_check_timeout_sec = 100
           user = "user_ro"
           password = "******"
           query = "select  `province_name`, ...  from table_data where id >0 
and id < 50000000"
           
       }
   }
   
   sink {
     Doris {
       fenodes = "x.x.x.x:8030"
       username = test
       password = "*******"
       database = "test"
       table = "td_sub_sms_port_bk"
       sink.label-prefix = "test-batch"
       sink.enable-2pc = "true"
       sink.enable-delete = "true"
       doris.config {
         format = "json"
         read_json_by_line = "true"
       }
     }
   }
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to