LantaoJin edited a comment on pull request #31189:
URL: https://github.com/apache/spark/pull/31189#issuecomment-761745504
With new implementation:
```
14:56:09.840 WARN org.apache.spark.sql.TPCDSQueryWithStatsSuite:
=== Metrics of Analyzer/Optimizer Rules ===
Total number of runs: 249466
Total time: 50.504996132 seconds
Rule
Effective Time / Total Time Effective Runs / Total Runs
org.apache.spark.sql.catalyst.optimizer.Optimizer$OptimizeSubqueries
5525938117 / 7045073782 47 / 772
org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveAggregateFunctions
1019348088 / 2697818883 49 / 2166
org.apache.spark.sql.catalyst.optimizer.ColumnPruning
688619984 / 2690753573 355 / 2367
org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveSubquery
2325900771 / 2442063166 51 / 2166
org.apache.spark.sql.catalyst.analysis.Analyzer$AddMetadataColumns
0 / 2121456111 0 / 2176
org.apache.spark.sql.catalyst.optimizer.CostBasedJoinReorder
1301092679 / 1570122274 133 / 386
org.apache.spark.sql.catalyst.analysis.DecimalPrecision
1235782884 / 1422608560 361 / 2166
org.apache.spark.sql.catalyst.optimizer.PruneFilters
21634702 / 890693670 5 / 1981
org.apache.spark.sql.catalyst.analysis.UpdateAttributeNullability
14532116 / 771382850 12 / 1453
org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveReferences
629882128 / 771127588 815 / 2166
org.apache.spark.sql.catalyst.optimizer.ReorderJoin
411221235 / 700265199 177 / 1595
org.apache.spark.sql.catalyst.optimizer.InferFiltersFromConstraints
636513902 / 665802204 278 / 386
org.apache.spark.sql.catalyst.analysis.TypeCoercion$ImplicitTypeCasts
321449170 / 655463027 78 / 2166
org.apache.spark.sql.catalyst.optimizer.BooleanSimplification
7876361 / 646304371 5 / 1595
org.apache.spark.sql.catalyst.optimizer.PushDownPredicates
324125397 / 611326563 767 / 2374
org.apache.spark.sql.catalyst.optimizer.OptimizeCsvJsonExprs
0 / 582168029 0 / 1595
org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveMissingReferences
10877321 / 544247153 10 / 2166
org.apache.spark.sql.catalyst.optimizer.RemoveNoopOperators
68865060 / 512540469 202 / 2753
org.apache.spark.sql.catalyst.optimizer.NullPropagation
42609919 / 490666214 60 / 1595
org.apache.spark.sql.catalyst.optimizer.SimplifyBinaryComparison
513290 / 460445229 1 / 1595
org.apache.spark.sql.catalyst.optimizer.UnwrapCastInBinaryComparison
12976523 / 452264782 8 / 1595
org.apache.spark.sql.catalyst.optimizer.SimplifyConditionals
0 / 446647311 0 / 1595
org.apache.spark.sql.catalyst.optimizer.PushFoldableIntoBranches
10331123 / 444299002 23 / 1595
org.apache.spark.sql.catalyst.optimizer.SimplifyCaseConversionExpressions
0 / 433244147 0 / 1595
org.apache.spark.sql.catalyst.optimizer.ConstantFolding
90392965 / 433123242 202 / 1595
org.apache.spark.sql.catalyst.analysis.TypeCoercion$FunctionArgumentConversion
245236817 / 429948187 56 / 2166
org.apache.spark.sql.catalyst.optimizer.RemoveDuplicatedBranches
0 / 425637433 0 / 1595
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
