vamshikrishnakyatham opened a new pull request, #13728:
URL: https://github.com/apache/hudi/pull/13728

   ## What is the purpose of the pull request
   
   Fix HoodieTableMetaClient index metadata loading to ensure executors receive 
   pre-loaded metadata values through serialization instead of attempting to 
   execute storage access logic on executors.
   
   ## Brief change log
   
   - **Constructor**: Changed from `this.indexMetadataOpt = getIndexMetadata()` 
to 
     `this.indexMetadataOpt = readIndexDefFromStorage()` for direct loading
   - **getIndexMetadata()**: Simplified from complex conditional logic to 
     `return indexMetadataOpt` for direct value access
   - **deleteIndexDefinition()**: Fixed to properly handle empty metadata state
   - **Serialization**: Ensured indexMetadataOpt contains actual loaded values 
     that serialize to executors
   
   ## Verify this pull request
   
   - [x] TestHoodieTableMetaClient and dependent tests passes
   - [x] hudi-common module compiles successfully
   - [x] Index metadata is loaded once on driver and available on executors
   
   ## Risk level (write none, low, medium or high below)
   
   Low - This is a bug fix that improves reliability by eliminating 
executor-side 
   storage access failures. The change ensures consistent behavior between 
driver 
   and executors.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to