linruzhou opened a new issue, #7866: URL: https://github.com/apache/seatunnel/issues/7866
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened 使用seatunnel同步大量小文件，比如10000个jpg文件到minio时，开始运行正常，到最后会把物理内存耗尽 ### SeaTunnel Version 2.3.2 ### SeaTunnel Config ```conf seatunnel: engine: backup-count: 1 task_execution_thread_share_mode: OFF queue-type: blockingqueue print-execution-info-interval: 60 print-job-metrics-info-interval: 60 history-job-expire-minutes: 10 classloader-cache-mode: true slot-service: dynamic-slot: true checkpoint: interval: 100000 timeout: 60000 max-concurrent: 5 tolerable-failure: 2 storage: type: hdfs max-retained: 3 plugin-config: namespace: /tmp/seatunnel/checkpoint_snapshot storage.type: hdfs fs.defaultFS: file:///tmp/ # Ensure that the directory has written permission ``` ### Running Command ```shell ./seatunnel-cluster.sh ``` ### Error Exception ```log 物理内存耗尽，物理机内存32G jvm配置信息： # JVM Heap -Xms12g -Xmx12g # JVM Dump -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/seatunnel/dump/zeta-server -XX:+UseG1GC -XX:MaxGCPauseMillis=5000 -XX:MaxMetaspaceSize=4g -XX:G1HeapRegionSize=32M -XX:GCTimeRatio=4 -XX:G1ReservePercent=15 -XX:ConcGCThreads=8 -XX:+UseStringDeduplication -XX:InitiatingHeapOccupancyPercent=50 ``` ### Zeta or Flink or Spark Version Zeta ### Java or Scala Version jdk1.8 ### Screenshots _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
