pmx0117 opened a new issue, #10297:
URL: https://github.com/apache/seatunnel/issues/10297

   ### Search before asking
   
   - [x] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   When using SeaTunnel 2.3.11, we observed that IMAP-related data stored on 
disk increases abnormally over time, even though the number of running tasks 
and the volume of input data are very limited.
   After running SeaTunnel for approximately 2–3 months, the size of the IMAP 
data directory reached hundreds of GB, which appears disproportionate compared 
to the actual amount of data being processed.
   
   中文补充说明(Chinese description)
   在使用 SeaTunnel 2.3.11 版本时,我们发现存储在磁盘上的 IMAP 
相关数据会随着时间推移异常增长,尽管运行的任务数量以及输入数据量都非常有限。
   在 SeaTunnel 持续运行约 2–3 个月 后,IMAP 数据目录的大小达到了 数百 GB,与实际处理的数据量相比,这一规模显得不太合理。
   
   <img width="680" height="809" alt="Image" 
src="https://github.com/user-attachments/assets/147691ab-32cf-4e88-87a6-5e6c1acaf545";
 />
   
   ### SeaTunnel Version
   
   2.3.11
   
   ### SeaTunnel Config
   
   ```conf
   hazelcast:
     cluster-name: seatunnel
     network:
       rest-api:
         enabled: false
         endpoint-groups:
           CLUSTER_WRITE:
             enabled: true
           DATA:
             enabled: true
       join:
         tcp-ip:
           enabled: true
           member-list:
             - localhost
       port:
         auto-increment: false
         port: 5801
     properties:
       hazelcast.invocation.max.retry.count: 20
       hazelcast.tcp.join.port.try.count: 30
       hazelcast.logging.type: log4j2
       hazelcast.operation.generic.thread.count: 50
       hazelcast.heartbeat.failuredetector.type: phi-accrual
       hazelcast.heartbeat.interval.seconds: 2
       hazelcast.max.no.heartbeat.seconds: 180
       hazelcast.heartbeat.phiaccrual.failuredetector.threshold: 10
       hazelcast.heartbeat.phiaccrual.failuredetector.sample.size: 200
       hazelcast.heartbeat.phiaccrual.failuredetector.min.std.dev.millis: 100
     map:
       engine*:
        map-store:
          enabled: true
          initial-mode: EAGER
          factory-class-name: 
org.apache.seatunnel.engine.server.persistence.FileMapStoreFactory
          properties:
            type: hdfs
            namespace: /apache-seatunnel-2.3.11/data/seatunnel/imap
            clusterName: seatunnel-cluster
            storage.type: hdfs
            fs.defaultFS: /apache-seatunnel-2.3.11/data
   ```
   
   ### Running Command
   
   ```shell
   ./bin/seatunnel-cluster.sh
   ```
   
   ### Error Exception
   
   ```log
   No error or exception was reported during the execution.
   SeaTunnel jobs were running normally, and the issue was observed only 
through abnormal disk usage growth.
   ```
   
   ### Zeta or Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to