prasannarajaperumal commented on PR #5933: URL: https://github.com/apache/hudi/pull/5933#issuecomment-1248321034
> > @huberylee - Sorry I may not have all the context here. How does the Spark optimizer know to use the lucene based index for expressions that may benefit? I dont see any tests from the spark read side that uses the index. > > Can you point me to a plan on the index persistence and query processing usage plan for lucene based index? If we dont have one - we should write an RFC for it. I am confused to see code that persists index in hoodie.properties file. > > @prasannarajaperumal This PR is mainly for handling the persistency of secondary index metadata, the SQL syntax of Create/Drop/Show/Refresh Secondary index have been introduced by [PR-5761](https://github.com/apache/hudi/pull/5761). We will introduce a new action type called build to generate the actual index data later, and then adapt query engine to use secondary index, related PRs are on the way. Thanks for clarifying the scope. Found the RFC-52 - Will review the plan there. This PR looks good to me. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
