Botong Huang created CALCITE-4568:
-------------------------------------
Summary: Tempura: extending Calcite into a incremental query
optimizer
Key: CALCITE-4568
URL: https://issues.apache.org/jira/browse/CALCITE-4568
Project: Calcite
Issue Type: New Feature
Reporter: Botong Huang
As discussed in the email thread, this is an attempt to extend the Calcite
optimizer into a general incremental query optimizer, based on our research
paper published in VLDB 2021:
Tempura: a general cost-based optimizer framework for incremental data
processing
To our best knowledge, this is the first general cost-based incremental
optimizer that can find the best plan across multiple families of incremental
computing methods, including IVM, Streaming, DBToaster, etc. Experiments (in
the paper) shows that the generated best plan is consistently much better than
the plans from each individual method alone.
In general, incremental query planning is central to database view maintenance
and stream processing systems, and are being adopted in active databases,
resumable query execution, approximate query processing, etc. We are hoping
that this feature can help widening the spectrum of Calcite, solicit more use
cases and adoption of Calcite.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
