zanmato1984 commented on PR #43256: URL: https://github.com/apache/arrow/pull/43256#issuecomment-2232608861
> What about removing `sorted_and_deduped` firstly and sort during simplify? IIUC, an `in_list` is often composed of constants. This list could be sorted-and-deduped only once in the planning phase (the "user" code on top of arrow expression). If we sort the `in_list` for the evaluation on **every** batch, that is probably redundant? IMHO, using a flag as a hint of the coupled `in_list` (whether it is already sorted-and-deduped), could be more flexible and compact. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
