PyRSA opened a new pull request, #11037:
URL: https://github.com/apache/paimon/pull/11037

   ### Purpose
   
   Fixes #10711
   
   `S3FileIO` may continue reusing a cached `S3AFileSystem` after its 
underlying Apache HTTP connection pool has been shut down, causing subsequent 
S3 operations to fail with `IllegalStateException: Connection pool shut down`.
   
   ### Changes
   
   - Detect `Connection pool shut down` failures through an AWS SDK execution 
interceptor and mark the affected S3A filesystem as unusable.
   - Evict the unusable filesystem from the shared cache using identity-based 
removal to avoid removing a replacement instance.
   - Recreate the filesystem on subsequent access, allowing other `S3FileIO` 
instances with the same cache key to recover as well.
   - Handle filesystem initialization and cache publication failures safely, 
preventing unusable instances from being published or retained.
   - Add regression tests covering cache eviction and replacement, concurrent 
access, initialization failures, and unrelated exceptions.
   
   ### Scope
   
   - Applies to the Hadoop S3A client using the Apache HTTP transport.
   - Does not automatically retry failed S3 operations.
   - Does not cover the Netty async client.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to