jarredhj0214 opened a new pull request, #12121:
URL: https://github.com/apache/gravitino/pull/12121

   ### What changes were proposed in this pull request?
   
   Move Paimon Flink connector Hadoop filesystem options (`hadoop.*`, `fs.*`, 
and `dfs.*`) from Paimon catalog options into Hadoop `Configuration` before 
creating the inner Paimon catalog.
   
   This creates the inner Paimon catalog with a `CatalogContext` that carries 
the sanitized Paimon options plus Hadoop configuration, and keeps vended Paimon 
S3/OSS/JDBC credentials available as Paimon options.
   
   ### Why are the changes needed?
   
   Paimon can log dynamic/catalog options and expose sensitive filesystem 
credentials such as OSS/BOS access keys when they remain in Paimon options. 
Moving Hadoop filesystem credentials to Hadoop configuration follows the Flink 
Hive connector pattern and avoids passing these sensitive Hadoop properties 
through Paimon options.
   
   Fix: #12051
   
   ### Does this PR introduce _any_ user-facing change?
   
   No API changes. Existing Hadoop filesystem catalog properties continue to be 
accepted, but the Flink Paimon connector forwards them via Hadoop 
`Configuration` instead of Paimon catalog options.
   
   ### How was this patch tested?
   
   Added unit coverage for:
   - moving `hadoop.*`/`fs.*` filesystem options into Hadoop configuration
   - keeping vended S3/OSS credentials in Paimon options for native Paimon 
FileIOs
   - keeping JDBC credentials in Paimon options
   
   Local checks:
   - `git diff --check`
   
   Could not run Gradle tests locally because only JDK 8 is installed and the 
build requires JDK 17.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to