JingsongLi commented on PR #8478: URL: https://github.com/apache/paimon/pull/8478#issuecomment-4892936359
The optimizer rule is not registered in `PaimonSparkSessionExtensions` yet (there is only a TODO), so `pushedMapSelectedKeys` is never populated and the advertised Spark pushdown is not actually enabled. Could you either register the rule together with the reader support, or adjust the PR/title to make this explicitly preparatory? Also, when the rule is enabled, unsupported cases such as nested shared-shredding maps or literal keys containing the metadata delimiter should fall back without pushdown instead of failing a valid query during planning. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
