naveenp2708 commented on PR #59789: URL: https://github.com/apache/spark/pull/59789#issuecomment-6565282731
Thanks you @peter-toth . 12: fixed the description. Shape 2 now says it fails with INTERNAL_ERROR for both filters, and I spelled out the per-shape symptoms instead of saying all three hit both. 13: added shape 4. A scalar subquery over the keyed column becomes a runtime filter of the keyed scan just like you said, and the fix covers it through the same DataSourceV2Strategy gate. Confirmed it fails on master in both runtime-filter suites (with AQE on the rebuilt scan drops its KeyedPartitioning) and passes here. DPP stays off in that shape. Listed it in the description. 14: makes sense, that’s SPARK-60752 and not this PR’s to fix — it’s why shape 4 keeps DPP off. Thanks for filing it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
