wangyum commented on issue #27252: [SPARK-29231][SQL] Constraints should be inferred from cast equality constraint URL: https://github.com/apache/spark/pull/27252#issuecomment-584452052 Metrics of `TPCDSQuerySuite` ``` 17:54:43.160 WARN org.apache.spark.sql.TPCDSQuerySuite: === Metrics of Analyzer/Optimizer Rules === Total number of runs: 222030 Total time: 48.578960704 seconds Rule Effective Time / Total Time Effective Runs / Total Runs org.apache.spark.sql.catalyst.optimizer.Optimizer$OptimizeSubqueries 7310666499 / 9332373660 47 / 772 org.apache.spark.sql.catalyst.optimizer.ColumnPruning 793520989 / 3063501387 327 / 2364 org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveAggregateFunctions 772649095 / 2061243824 49 / 2122 org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveSubquery 1874594633 / 2026784533 51 / 2122 org.apache.spark.sql.catalyst.analysis.DecimalPrecision 1408309553 / 1631320478 361 / 2122 org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveReferences 1046341260 / 1238423176 776 / 2122 org.apache.spark.sql.catalyst.optimizer.PruneFilters 20237051 / 948013330 5 / 1978 org.apache.spark.sql.catalyst.optimizer.BooleanSimplification 8931284 / 803774585 4 / 1592 org.apache.spark.sql.catalyst.analysis.TypeCoercion$ImplicitTypeCasts 350990812 / 726856285 78 / 2122 org.apache.spark.sql.catalyst.optimizer.PushDownPredicates 411736622 / 723335080 758 / 1979 org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveMissingReferences 12965626 / 722690000 10 / 2122 org.apache.spark.sql.catalyst.optimizer.ReorderJoin 311274660 / 667926756 177 / 1592 org.apache.spark.sql.catalyst.optimizer.NullPropagation 38084843 / 607061648 42 / 1592 org.apache.spark.sql.catalyst.optimizer.SimplifyBinaryComparison 0 / 592129742 0 / 1592 org.apache.spark.sql.catalyst.optimizer.ConstantFolding 122879475 / 548080283 194 / 1592 org.apache.spark.sql.catalyst.optimizer.ReorderAssociativeOperator 0 / 539223482 0 / 1592 org.apache.spark.sql.catalyst.optimizer.RemoveNoopOperators 49170375 / 535795847 116 / 2364 org.apache.spark.sql.catalyst.optimizer.SimplifyConditionals 0 / 526427607 0 / 1592 org.apache.spark.sql.catalyst.optimizer.SimplifyCaseConversionExpressions 0 / 513936310 0 / 1592 org.apache.spark.sql.catalyst.analysis.UpdateAttributeNullability 19179771 / 499121592 12 / 674 org.apache.spark.sql.catalyst.optimizer.InferFiltersFromConstraints 466238272 / 498265208 278 / 386 ``` ``` 17:59:54.723 WARN org.apache.spark.sql.TPCDSQuerySuite: === Metrics of Analyzer/Optimizer Rules === Total number of runs: 222030 Total time: 47.944935648 seconds Rule Effective Time / Total Time Effective Runs / Total Runs org.apache.spark.sql.catalyst.optimizer.Optimizer$OptimizeSubqueries 7155686537 / 9038108673 47 / 772 org.apache.spark.sql.catalyst.optimizer.ColumnPruning 745073517 / 2983636234 327 / 2364 org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveSubquery 1832499321 / 1986692816 51 / 2122 org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveAggregateFunctions 753677292 / 1961149358 49 / 2122 org.apache.spark.sql.catalyst.analysis.DecimalPrecision 1371117798 / 1599284119 361 / 2122 org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveReferences 950366647 / 1149095219 776 / 2122 org.apache.spark.sql.catalyst.optimizer.PruneFilters 23167031 / 941195892 5 / 1978 org.apache.spark.sql.catalyst.optimizer.BooleanSimplification 7571175 / 824779532 4 / 1592 org.apache.spark.sql.catalyst.analysis.TypeCoercion$ImplicitTypeCasts 346431701 / 766333714 78 / 2122 org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveMissingReferences 12621635 / 715199376 10 / 2122 org.apache.spark.sql.catalyst.optimizer.NullPropagation 43536492 / 669290872 42 / 1592 org.apache.spark.sql.catalyst.optimizer.PushDownPredicates 405449323 / 666785753 758 / 1979 org.apache.spark.sql.catalyst.optimizer.ReorderJoin 287896770 / 607153873 177 / 1592 org.apache.spark.sql.catalyst.optimizer.SimplifyBinaryComparison 0 / 554222459 0 / 1592 org.apache.spark.sql.catalyst.optimizer.SimplifyCaseConversionExpressions 0 / 545038757 0 / 1592 org.apache.spark.sql.catalyst.optimizer.ConstantFolding 119097848 / 540461946 194 / 1592 org.apache.spark.sql.catalyst.optimizer.SimplifyConditionals 0 / 539220068 0 / 1592 org.apache.spark.sql.catalyst.optimizer.RemoveNoopOperators 47342573 / 534440876 116 / 2364 org.apache.spark.sql.catalyst.optimizer.ReorderAssociativeOperator 0 / 522725061 0 / 1592 org.apache.spark.sql.catalyst.optimizer.SimplifyExtractValueOps 0 / 495697498 0 / 1592 org.apache.spark.sql.catalyst.analysis.TypeCoercion$FunctionArgumentConversion 262758723 / 493649938 56 / 2122 org.apache.spark.sql.catalyst.optimizer.OptimizeIn 12450356 / 490657369 27 / 1592 org.apache.spark.sql.catalyst.optimizer.SimplifyCasts 43052380 / 490516856 83 / 1592 org.apache.spark.sql.catalyst.optimizer.RemoveDispensableExpressions 0 / 488470430 0 / 1592 org.apache.spark.sql.catalyst.optimizer.LikeSimplification 995792 / 476321904 1 / 1592 org.apache.spark.sql.catalyst.optimizer.InferFiltersFromConstraints 440278960 / 470306508 278 / 386 ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
