kuangye098 opened a new issue, #6687:
URL: https://github.com/apache/seatunnel/issues/6687

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   高并发场景,1000TPS左右,出现一条数据变更丢失(某个字段状态未同步过来),从kafka回放数据时未找到对应的变更。
   
   ### SeaTunnel Version
   
   2.3.4
   
   ### SeaTunnel Config
   
   ```conf
   {
     "env": {
       "execution.parallelism": 1,
       "job.mode": "STREAMING",
       "jobName": "ksa_bss_feature_multi_oracle_to_kafka"
     },
     "source": [
       {
         "plugin_name": "Oracle-CDC",
         "startup.mode": "latest",
         "format": "PAYLOAD_DEBEZIUM_JSON",
         "result_table_name": "ksa-bss-feature-oracle-source",
         "username": "sa_dbzu",
         "password": "sa_dbzu",
         "database-names": [
           "xxx"
         ],
         "schema-names": [
           "HSDC_ISX",
           "HSDC_ASSXXX",
           "HSDC_OMX"
         ],
         "table-names": [
           "HKHX.HSDC_ISD.XX",
           "HKHX.HSDC_ISD.XX2",
           "HKHX.HSDC_ASSE.CUSTOMER_X_LOG"
         ],
         "base-url": "jdbc:oracle:thin:@oracle.xx.com:1521:HKHX",
         "source.reader.close.timeout": 120000,
         "env": "feature",
         "country": "xsa",
         "business": "bsx"
       }
     ],
     "transform": [
     ],
     "sink": [
       {
         "source_table_name": [
           "X-feature-oracle-source"
         ],
         "plugin_name": "kafka",
         "topic": "${schema_name}",
         "bootstrap.servers": "x.kafka.ap-east-1.amazonaws.com:9092",
         "partition_key_fields": ["schema_name", "table_name", "data_id"],
         "kafka.config": {
           "acks": "-1",
           "request.timeout.ms": 60000,
           "buffer.memory": 33554432
         }
       }
     ]
   }
   ```
   
   
   ### Running Command
   
   ```shell
   curl -X POST -H "Content-Type: application/json" -d 
@json/xx_feature_multi_oracle_to_kafka.json 
http://localhost:5801/hazelcast/rest/maps/submit-job
   
   或
   
   bin/seatunnel-cluster.sh -d
   ```
   
   
   ### Error Exception
   
   ```log
   未发现异常
   ```
   
   
   ### Zeta or Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   JDK1.8
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to