Nethaje opened a new issue, #9262: URL: https://github.com/apache/seatunnel/issues/9262
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened When performing a batch load with PostgreSQL as the source and Apache Iceberg on S3 as the sink, I observe that when updating the column used for partitioning, duplicate records appear in the sink. ### SeaTunnel Version 2.3.9 ### SeaTunnel Config ```conf # Defining the runtime environment env { parallelism = 1 job.mode = "BATCH" } source { Jdbc { url = "jdbc:postgresql://*****:5432/postgres" driver = "org.postgresql.Driver" user = postgres password = "12345Welcome$" query = "select * from public.employee" } } sink { Iceberg { catalog_name = "Employee_iceberg" iceberg.catalog.config = { type = "hadoop" warehouse = "s3a://data-platform-hfn//Raw" fs.s3a.endpoint = "s3.ap-south-1.amazonaws.com" } namespace = /postgres/public table = employee_batch_new iceberg.table.write-props = { write.format.default = "parquet" } iceberg.table.primary-keys="emp_id" iceberg.table.partition-keys="dept_id" iceberg.table.upsert-mode-enabled = true iceberg.table.schema-evolution-enabled=true } } ``` ### Running Command ```shell ./bin/seatunnel.sh --config ./config/Final_Config/One_to_one_batch -e local ``` ### Error Exception ```log There are no noticeable errors, it's just an observation. ``` ### Zeta or Flink or Spark Version _No response_ ### Java or Scala Version _No response_ ### Screenshots   ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
