kamronis opened a new pull request, #18011:
URL: https://github.com/apache/hudi/pull/18011

   ### Describe the issue this Pull Request addresses
   Current logic of HoodieHiveCatalog passes all the properites from 
hive-conf.xml to hive table. This was done to address the [this 
issue](https://github.com/apache/hudi/issues/9269). However, only 3 properties 
are really needed, according to @nylqd.
   Too many properties will significantly increase the size of the metadata of 
the table and bring big pressure to hive metastore if there are large amount of 
tables. 
   In my case tables had 2700+ properties which is unreasonable .
   
   
   ### Summary and Changelog
   
   Only 3 properties mentioned in https://github.com/apache/hudi/issues/9269 
left to pass from hive conf.
   
   ### Impact
   
   fix performance issues on hive
   
   ### Risk Level
   
   none
   
   ### Documentation Update
   
   none
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's 
guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Enough context is provided in the sections above
   - [ ] Adequate tests were added if applicable
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to