yingh0ng opened a new issue, #9562:
URL: https://github.com/apache/seatunnel/issues/9562

   ### Search before asking
   
   - [x] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   Read a table from mysql, and write to sqlserver is very slow. As a 
comparison, the datax is more faster than seatunnel.
   Are my configs not right or other problems? Please tell me.
   
   ### SeaTunnel Version
   
   compile from dev
   
   ### SeaTunnel Config
   
   ```conf
   env {
     parallelism = 4
     job.mode = "BATCH"
   }
   source {
       Jdbc {
           driver = com.mysql.cj.jdbc.Driver
           url = 
"jdbc:mysql://***:3306/bi_test?serverTimezone=Asia/Shanghai&useUnicode=true&characterEncoding=UTF-8&rewriteBatchedStatements=true"
           user = "***"
           password = "***"
   
           # 分区读取配置(大数据量时启用)
           partition_column="id"
           partition_column = "id"   # 用于分区的列
           partition_num = 10        # 分区数量
           fetch_size = 10000
   
           query = "select id, 订单ID, 订单日期, 日期时间, 城市, 省自治区, 地区, 类别, 子类别, 产品名称, 
销售额, 销量, 利润 from 订单明细1000000"
       }
   }
   
   sink {
     Jdbc {
       driver = com.microsoft.sqlserver.jdbc.SQLServerDriver
       url = 
"jdbc:sqlserver://***:1433;databaseName=bi_test;useBulkCopyForBatchInsert=true;bulkCopyBatchSize=5000"
       user = SA
       password = "***"
       
       # 批量写入优化
       batch_size = 5000         # 每次批量写入的记录数
       batch_interval_ms = 1000  # 批处理间隔(毫秒)
   
       query = "INSERT INTO 订单明细100w (id,订单ID, 订单日期, 日期时间, 城市, 省自治区, 地区, 类别, 
子类别, 产品名称, 销售额, 销量, 利润) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)"
     }
   
   }
   ```
   
   ### Running Command
   
   ```shell
   ./bin/seatunnel.sh --config ./jobs/sqlserver100w.conf -m local
   ```
   
   ### Error Exception
   
   ```log
   See Screenshots
   ```
   
   ### Zeta or Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   java version: 17.0.15
   scala:2.11.12
   
   ### Screenshots
   
   ### The seatunnel job info
   <img width="1831" height="1054" alt="Image" 
src="https://github.com/user-attachments/assets/ed128367-da42-44a9-adc0-89b245236007";
 />
   
   
   ### The datax job info running in the same machine
   
   <img width="1875" height="1270" alt="Image" 
src="https://github.com/user-attachments/assets/54b7d70c-3c79-403b-94b0-206426710257";
 />
   
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to