mapleFU commented on PR #43256: URL: https://github.com/apache/arrow/pull/43256#issuecomment-2232616213
> IIUC, an in_list is often composed of constants. This list could be sorted-and-deduped only once in the planning phase (the "user" code on top of arrow expression). If we sort the in_list for the evaluation on every batch, that is probably redundant? I agree, but a flag in planning phase is so weird, and considering something like nan in float, I think we'd at least separating it? "In" list might be large, sort is important for performance, however still I think adding a "planning flag" is so hacking.. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
