Thanks for providing the benchmark numbers! The result is very promising and I'm looking forward to seeing more feedback from real-world workloads.
On Wed, Feb 12, 2020 at 3:43 PM Jia, Ke A <ke.a....@intel.com> wrote: > Hi all, > > We have completed the Spark 3.0 Adaptive Query Execution(AQE) performance > tests in 3TB TPC-DS on 5 node Cascade Lake cluster. 2 queries bring about > more than 1.5x performance and 37 queries bring more than 1.1x performance > with AQE. There is no query has significant performance degradations. The > detail performance results and key configurations are shown in here > <https://docs.google.com/spreadsheets/d/1uija2AFblciMcYzU4jnPiy6I8mU8-M0-HwSNNns5aLU/edit?usp=sharing>. > Based on the performance result, we recommend users to turn on AQE in spark > 3.0. If encounter any bug or improvement when enable AQE, please help to > file related JIRAs. Thanks. > > > > Regards, > > Jia Ke > > >
