Maxim Gekk created SPARK-30563:
----------------------------------
Summary: Regressions in Join benchmarks
Key: SPARK-30563
URL: https://issues.apache.org/jira/browse/SPARK-30563
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.0.0
Reporter: Maxim Gekk
Regenerated benchmark results in the https://github.com/apache/spark/pull/27078
shows many regressions in JoinBenchmark. The benchmarked queries slowed down by
up to 3 times, see
old results:
https://github.com/apache/spark/pull/27078/files#diff-d5cbaab2b49ee9fddfa0e229de8f607dL10
new results:
https://github.com/apache/spark/pull/27078/files#diff-d5cbaab2b49ee9fddfa0e229de8f607dR10
One of the difference in queries is using the `NoOp` datasource in new queries.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]