This is an automated email from the ASF dual-hosted git repository.
comphead pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion.git
The following commit(s) were added to refs/heads/main by this push:
new bdcf822593 Include IMDB in benchmark README (#13107)
bdcf822593 is described below
commit bdcf8225933c852e9f3a1b44a51d262627506f98
Author: Yongting You <[email protected]>
AuthorDate: Sat Oct 26 04:59:41 2024 +0800
Include IMDB in benchmark README (#13107)
---
benchmarks/README.md | 10 ++++++++++
1 file changed, 10 insertions(+)
diff --git a/benchmarks/README.md b/benchmarks/README.md
index afaf28bb75..a12662ccb8 100644
--- a/benchmarks/README.md
+++ b/benchmarks/README.md
@@ -330,6 +330,16 @@ steps.
The tests sort the entire dataset using several different sort
orders.
+## IMDB
+
+Run Join Order Benchmark (JOB) on IMDB dataset.
+
+The Internet Movie Database (IMDB) dataset contains real-world movie data.
Unlike synthetic datasets like TPCH, which assume uniform data distribution and
uncorrelated columns, the IMDB dataset includes skewed data and correlated
columns (which are common for real dataset), making it more suitable for
testing query optimizers, particularly for cardinality estimation.
+
+This benchmark is derived from [Join Order
Benchmark](https://github.com/gregrahn/join-order-benchmark).
+
+See paper [How Good Are Query Optimizers,
Really](http://www.vldb.org/pvldb/vol9/p204-leis.pdf) for more details.
+
## TPCH
Run the tpch benchmark.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
