geserdugarov opened a new pull request, #11626: URL: https://github.com/apache/hudi/pull/11626
### Change Logs Before merge of https://github.com/apache/hudi/pull/10957, there was no need to pass Spark config: `spark.kryo.registrator=org.apache.spark.HoodieSparkKryoRegistrar` in PySpark. Now we got NullPointerException described in https://github.com/apache/hudi/issues/11616 due to not properly broadcasted `HadoopStorageConfiguration`. This MR brings back previous behavior by broadcasting of `org.apache.spark.util.SerializableConfiguration`. ### Impact Brings back the same behavior as 0.15.0 release without mandatory setting of `spark.kryo.registrator`. ### Risk level (write none, low medium or high below) Low ### Documentation Update No need ### Contributor's checklist - [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [x] Change Logs and Impact were stated clearly - [x] Adequate tests were added if applicable - [ ] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
