Zouxxyy opened a new issue, #6465:
URL: https://github.com/apache/hudi/issues/6465
**Describe the problem you faced**
I noticed that in HoodieSparkSqlWriter, the `init table()` uses
`hadoopConfiguration`. At this time, some configurations set in spark session
may not take effect. Maybe it is better to use
`sqlContext.sparkSession.sessionState.newHadoopConf` here? Just as used by
`HoodieCatalogTable.initHoodieTable()`
HoodieSparkSqlWriter
```java
val tableMetaClient = HoodieTableMetaClient.withPropertyBuilder()
.setTableType(tableType)
...
.initTable(sparkContext.hadoopConfiguration, path)
```
HoodieCatalogTable
```java
private val hadoopConf = spark.sessionState.newHadoopConf
HoodieTableMetaClient.withPropertyBuilder()
.fromProperties(properties)
...
.initTable(hadoopConf, tableLocation)
```
**Environment Description**
* Hudi version : master
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
