geserdugarov opened a new pull request, #10782: URL: https://github.com/apache/hudi/pull/10782
### Change Logs Reverting of adding of unnecessary parameter `hoodie.datasource.write.new.columns.nullable`. It started from [issue 9042](https://github.com/apache/hudi/issues/9042). The real problem was in inconsistency between Hudi table schema and Spark catalog schema. But during discussion of issue 9042 JIRA task [HUDI-6438](https://issues.apache.org/jira/browse/HUDI-6438) was created. As a results, this task HUDI-6438 was resolved by adding new parameters `hoodie.datasource.write.new.columns.nullable`, which is not right, because it allows to workaround implicit inconsistency in schemas. Furthermore, the real problem with inconsistency between Hudi table schema and Spark catalog schema was solved in [another MR](https://github.com/apache/hudi/pull/8725), which fix similar former JIRA task [HUDI-6219](https://issues.apache.org/jira/browse/HUDI-6219). This MR fix the issue properly. ### Impact Removes parameter, which allows to workaround implicit inconsistency in schemas. ### Risk level (write none, low medium or high below) Low ### Documentation Update Remove description of `hoodie.datasource.write.new.columns.nullable` from All Configurations list. I will open corresponding MR to `asf-site` and link this MR. ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [ ] Change Logs and Impact were stated clearly - [ ] Adequate tests were added if applicable - [ ] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
