Tanel Kiis created SPARK-33070: ---------------------------------- Summary: Optimizer rules for SimpleHigherOrderFunction Key: SPARK-33070 URL: https://issues.apache.org/jira/browse/SPARK-33070 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 3.1.0 Reporter: Tanel Kiis
SimpleHigherOrderFunction like ArrayTransform, ArrayFilter, etc, can be combined and reordered to achieve more optimal plan. Possible rules: * Combine 2 consecutive array transforms * Combine 2 consecutive array filters * Push array filter through array sort * Remove array sort before array exists and array forall. * Combine 2 consecutive map filters -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org