jiahong.li created SPARK-34067:
----------------------------------
Summary: PartitionPruning push down pruningHasBenefit function
into insertPredicate function to decrease calculate time
Key: SPARK-34067
URL: https://issues.apache.org/jira/browse/SPARK-34067
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.0.1, 3.0.0
Reporter: jiahong.li
in the class PartitionPruning, function prune, push pruningHasBenefit function
into insertPredicate function, as `SQLConf.get.exchangeReuseEnabled` is always
true default and `SQLConf.get.dynamicPartitionPruningReuseBroadcastOnly ` is
always true default.
by set hasBenefit to lazy ,we can do not need invoke hasBenefit ,so we can save
time.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
