lasdf1234 commented on code in PR #10425:
URL: https://github.com/apache/gravitino/pull/10425#discussion_r2929538645
##########
spark-connector/spark-common/src/main/java/org/apache/gravitino/spark/connector/paimon/GravitinoPaimonCatalog.java:
##########
@@ -42,6 +43,13 @@ protected TableCatalog createAndInitSparkCatalog(
TableCatalog paimonCatalog = new SparkCatalog();
Map<String, String> all =
getPropertiesConverter().toSparkCatalogProperties(options, properties);
+ for (Map.Entry<String, String> entry : all.entrySet()) {
+ String key = entry.getKey();
+ String value = entry.getValue();
+ if (key != null && key.startsWith("fs.")) {
+ SparkSession.active().sessionState().conf().setConfString(key, value);
Review Comment:
<img width="1748" height="502" alt="038f89a3c8c62ffb4d99243ebbc03a83"
src="https://github.com/user-attachments/assets/f8dcd193-6dc9-4a6c-80c8-a61382d14fd5";
/>
As shown in the figure above, It only effect in hadoopConf. So I inject it
into SparkContext.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
