Julian Feinauer created IOTDB-743:
-------------------------------------
Summary: Use Runtime Code-Generation to improve speed and
efficiency of Queries
Key: IOTDB-743
URL: https://issues.apache.org/jira/browse/IOTDB-743
Project: Apache IoTDB
Issue Type: New Feature
Components: Core/Engine, Core/TsFile
Reporter: Julian Feinauer
Many Databases and ohter Open Source projects that have to handle big chunks of
"similar" Data in one query use some sort of code-generation (e.g. Apache
Calcite, Apache Drill, Apache Spark, Postgres since 10.0, ...).
Generally, the idea is that its more efficient to create custom "Reader" or
even "Calculator" classes that are applied to each Row of a query. Although
there is initial cost of assembling the code and compiling it but this will pay
out in the long run as you save time for each row due to more efficient
generated code and fewer branching.
This could even make sense on TsFile Level if for a specific read operation the
exact shema that one wants to read is known and then fix we could genreate
specific code to only read that schema.
Altough one should also consider suitable benchmarks to estimate how much
efficiently that brings and ideally only activate that feature when the
optimizer decides that it may be beneficial.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
