This is an automated email from the ASF dual-hosted git repository.
shaofengshi pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/kylin.git.
from 55d8ada KYLIN-3424 invoke addCubingGarbageCollectionSteps in the
cleanup step for HBaseMROutput2Transition
new 76c9c96 KYLIN-3446 Connect to HBase out of Spark Signed-off-by:
shaofengshi <[email protected]>
new c9337cb KYLIN-3489 improve the efficiency of enumerating dictionary
values by pre-order visiting
new c9d7f5e KYLIN-3490 introduce DictionaryEnumerator to answer single
encoded column related queries which will not hit cuboid
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../org/apache/kylin/common/KylinConfigBase.java | 4 +
.../org/apache/kylin/common/util/Dictionary.java | 11 ++
.../java/org/apache/kylin/cube/model/CubeDesc.java | 81 +++++++-----
.../java/org/apache/kylin/dict/TrieDictionary.java | 51 ++++++++
.../org/apache/kylin/dict/TrieDictionaryTest.java | 30 +++++
.../apache/kylin/engine/mr/JobBuilderSupport.java | 4 +
.../kylin/engine/mr/common/AbstractHadoopJob.java | 3 +-
.../kylin/engine/mr/common/BatchConstants.java | 2 +-
.../org/apache/kylin/query/ITKylinQueryTest.java | 12 ++
.../query01.sql | 9 +-
.../query02.sql | 3 +-
.../query03.sql} | 4 +-
.../query/enumerator/DictionaryEnumerator.java | 142 +++++++++++++++++++++
.../apache/kylin/query/enumerator/OLAPQuery.java | 5 +-
.../apache/kylin/query/relnode/OLAPTableScan.java | 3 +
.../org/apache/kylin/query/schema/OLAPTable.java | 4 +
.../kylin/storage/hbase/steps/CreateHTableJob.java | 68 ++++++++--
.../kylin/storage/hbase/steps/HBaseJobSteps.java | 28 ++--
.../kylin/storage/hbase/steps/HBaseSparkSteps.java | 3 +-
.../kylin/storage/hbase/steps/SparkCubeHFile.java | 29 ++---
20 files changed, 411 insertions(+), 85 deletions(-)
copy kylin-it/src/test/resources/query/{sql_lookup =>
sql_dict_enumerator}/query01.sql (92%)
copy kylin-it/src/test/resources/query/{tableau_probing =>
sql_dict_enumerator}/query02.sql (94%)
copy kylin-it/src/test/resources/query/{sql_derived/query06.sql =>
sql_dict_enumerator/query03.sql} (94%)
create mode 100644
query/src/main/java/org/apache/kylin/query/enumerator/DictionaryEnumerator.java
