BlueKurimu opened a new issue, #7561: URL: https://github.com/apache/seatunnel/issues/7561
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened The FileSourceSplit class needs to implement the equals method to prevent pendingSplit from adding the same filePath multiple times in a parallel context. This bug was introduced by a previous merge[ #6033](https://github.com/apache/seatunnel/pull/6033) ### SeaTunnel Version from version 2.3.4 to now ### SeaTunnel Config ```conf { "env": { "job.mode": "BATCH", "parallelism": 5 }, "source": [ { "bucket": "oss://test", "path": "/seatunnel/test_data", "endpoint": "*", "file_format_type": "orc", "access_key": "*", "access_secret": "*", "plugin_name": "OssFile" } ], "transform": [ ], "sink": [ { "plugin_name": "Console", "log.print.data": false } ] } ``` ### Running Command ```shell run org.apache.seatunnel.example.flink.v2.SeaTunnelApiExample ``` ### Error Exception ```log no exception ``` ### Zeta or Flink or Spark Version flink ### Java or Scala Version jdk8 ### Screenshots log(has been anonymized) SubTask 1 is assigned to [ /20240903_065538_06031_hdesv_62e25e63-aa77-49fd-a8de-e2b57ed94402]org.apache.flink.runtime.source.coordinator.SourceCoordinator - Source Source: OssFile-source registering reader for parallel task 0 (#0) @ SubTask 0 is assigned to [ /20240903_065538_06031_hdesv_698ef44f-42f7-419e-9641-b062e02c5244, /20240903_065538_06031_hdesv_3abb6ddf-ec59-47ef-8516-7c30a609ab41, /20240903_065538_06031_hdesv_ede384ba-7102-4417-9106-e136b7776a59, /20240903_065538_06031_hdesv_698ef44f-42f7-419e-9641-b062e02c5244, /20240903_065538_06031_hdesv_3abb6ddf-ec59-47ef-8516-7c30a609ab41, /20240903_065538_06031_hdesv_bda369f9-6f28-4d3c-944c-68030556a148, /20240903_065538_06031_hdesv_bda369f9-6f28-4d3c-944c-68030556a148, /20240903_065538_06031_hdesv_ede384ba-7102-4417-9106-e136b7776a59] ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
