wombatu-kun commented on PR #11074: URL: https://github.com/apache/hudi/pull/11074#issuecomment-2071996001
@codope huh, probably i misunderstood the task. I focused on " All indexes are being used in lookupCandidateFilesInMetadataTable method through if-else branches. This is not only hard to maintain as we add more indexes, but also induces a static hierarchy. Instead, we need more flexibility so that we can alter logical plan based on availability of indexes... The goal of this ticket is to refactor index hierarchy and create new rules such that Spark version < 3.1.0 still go via the old path" So I've just created hierarchy of IndexSupport that is usable without if-else branches, is easy to extend with new types of indices and it works with Spark <3.1. And to be honest I don't really know yet what the `pre-CBO rules` are, so may be this PR is not what you wanted at all. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
