happyboy1024 opened a new issue, #5008:
URL: https://github.com/apache/seatunnel/issues/5008

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   During my use of the mysql-cdc, I discovered a phenomenon. Firstly, I need 
to explain my environment. My source and target are both MySQL, and I have a 
batch of inventory data. In the process of fully synchronizing inventory data, 
there will be no problem if no new data is added to the source database. But if 
during this period, I have a batch of new data that needs to be inserted into 
the source library, during which time the JVM memory and MySQL connections will 
continue to grow. When this process is long enough, it can cause JVM memory to 
approach the threshold, triggering GC, but GC cannot effectively release 
memory. At the same time, it will cause excessive consumption of MySql 
Connection pool.
   
   ### SeaTunnel Version
   
   seatunnel-2.3.2
   
   ### SeaTunnel Config
   
   ```conf
   env {
     # You can set SeaTunnel environment configuration here
     job.name = "mysql_test"
     job.mode = "STREAMING"
     checkpoint.interval = 10000
     execution.checkpoint.interval = 10000
     execution.checkpoint.data-uri = "hdfs://localhost:9000/checkpoint"
   }
   
   source {
        MySQL-CDC {
           result_table_name = "mysql_cdc_test"
           snapshot.split.size = 3000
           incremental.parallelism = 1
           server-id = "5400"
           username = "xxxx"
           password = "xxxxxxxx"
           database-names = ["xxxxx"]
           table-names = ["xxxxx.test_data"]
           base-url = "jdbc:mysql://192.168.xxx.xxx:xxxx/xxxxx"
       }
   }
   sink{
       jdbc {
           url = "jdbc:mysql://192.168.xxx.xxx:xxxx/xxxxx"
           driver = "com.mysql.cj.jdbc.Driver"
           user = "xxxx"
           password = "xxxxxx"
           table = "xxxxx"
           primary_keys = ["id"]
        database = "xxxxxxxx"
        batch_size = 3000
        batch_interval_ms = 20
       }
   }
   ```
   
   
   ### Running Command
   
   ```shell
   ./bin/seatunnel.sh -c config/v2.mysql_cdc.config
   ```
   
   
   ### Error Exception
   
   ```log
   No obvious abnormality
   ```
   
   
   ### Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   Jdk11
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to