ohad-definity commented on PR #59706: URL: https://github.com/apache/spark/pull/59706#issuecomment-6527509860
@sunchao addressed in 00f72e9a (replies inline): - map key types are never narrowed by this path, including keys read above a generator; - ORC (V1 and V2) is not pruned through generators until its readers handle narrowed nested schemas (positional evolution, explicit or inferred; the V1 timestamp check; row-reader map keys), so those queries read as on the base; the ORC suites check every generator query scans the same as with this path disabled; - the V2 fallback keeps one `Filter` per condition; - the replay test uses your partitioned fixture and checks `EqualTo(n, 7)`. The benchmark results are regenerated (4d548f98). I will file the three ORC reader issues that also reproduce on master separately. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
