LeonYoah commented on code in PR #6718:
URL: https://github.com/apache/seatunnel/pull/6718#discussion_r1581716899


##########
docs/en/seatunnel-engine/checkpoint-storage.md:
##########
@@ -186,3 +186,40 @@ seatunnel:
 
 ```
 
+### Enable cache
+
+When storage:type is hdfs, cache is disabled by default. If you want to enable 
it, set `disable.cache: false`

Review Comment:
   > Could you share what risks will be caused if cache is turned on?
   
   You can take a look at the bug #6678 I proposed, which is [S3 connector], 
which causes occasional task failures due to the use of cache. at the same 
time, you can also refer to these two issues, which are bug: 
https://issues.apache.org/jira/browse/HADOOP-15819 and 
https://github.com/aws/aws-sdk-java/issues/2337 about hadoop-aws and 
aws-sdk-java. The problems caused by turning on cache in multithreaded 
environment are described in detail.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to