This is an automated email from the ASF dual-hosted git repository.
nic pushed a change to branch master-hadoop3.1
in repository https://gitbox.apache.org/repos/asf/kylin.git.
omit a1a1f79 KYLIN-4072 find-hbase-dependency.sh don't work at CDH 6.x
omit 4fc5e4a Minor, add curator-test's version
omit 0aad97c fix add jacoco.version in pom.xml (#699)
omit d901acf #KYLIN-4044, update curator version to avoid NPE issue
omit 2196713 Rebase master
omit e144a02 fix beeline meta data parser on partition information
omit 85b6c7c KYLIN-3537
omit 47bf750 KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT
add 7fe98c9 KYLIN-4049 Make storage clean configurable for refreshing job
add 807a571 KYLIN-4028 Speed up startup progress using cached dependency
add c3fd390 KYLIN-4033 Can not access Kerberized Cluster with DebugTomcat
add c3a1728 #KYLIN-4030, Resource deleteResource by comparing timestamp
may failed to delete caused by time precision loose
add 5b1d0a5 KYLIN-3999, make kylin.query.enable-dynamic-column default
true
add 5f5895d KYLIN-4041 CONCAT NULL not working properly
add 9708990 #KYLIN-4044, upgrade curator dependency version
add 37a1a80 KYLIN-3933 Invalid replica set cache after status updated
add 6fb7ff0 KYLIN-3933 Do not refresh front-end page after replica set
related operations
add 760aefd KYLIN-4035 Calculate column cardinality by using spark engine
add 9a72b9e KYLIN-4054 Logger of HCreateTableJob record error message
add 55f7140 KYLIN-4041 minor,fix it
add 916e51d minor update on ODBC driver readme
add 6f12aaf KYLIN-4046 Refine JDBC Source(source.default=8)
add 8712a87 KYLIN-4039, fix ZK distributed lock may not release lock when
catching interrupt exception
add 7b1927c KYLIN-4064 Make param engineType working in CI
add c17dc29 Minor, add Hive JDBC dependency for DebugTomcat
add 96ba0c6 Revert "KYLIN-4039, fix ZK distributed lock may not release
lock when catching interrupt exception"
add 9331a94 KYLIN-4062 Using a static hashmap to replace many "if-else"
to improve efficiency
add afe4e88 KYLIN-4074 Exception in thread "Memcached IO over
{MemcachedConnection to ..." java.lang.NullPointerException
add 8d5f4a4 KYLIN-4027, protect client execute
add 47cb8de KYLIN-4005: Saving Cube of a aggregation Groups(40
Dimensions, Max Dimension Combination:5) may cause kylin server OOM
add f17664c KYLIN-4005 Code review
add 46d3f09 KYLIN-4026: Avoid too many file append operations in
HiveProducer of hive metrics reporter
add 66e2325 KYLIN-4026 Code review
add 7466b79 Avoid repeatedly calling "string.toLowerCase" in
TimedJsonStreamParser#parse
add decaf23 KYLIN-4031 RestClient will throw exception with message
contains clear-text password
add e7f548c KYLIN-4047 Use push-down query when division dynamic column
cube query is not supported (#689)
add e5e253f KYLIN-4012 optimize cache in
TrieDictionary/TrieDictionaryForest
add 58f990c KYLIN-4013 Only show the cubes under one model
add 34a7172 KYLIN-4084 Reset kylin.stream.node in
kylin-port-replace-util.sh
add 82b088b Upgraded avatica calcite version due to issue in jdbc driver
like
https://community.jaspersoft.com/questions/1047476/i-can-not-connect-kylin-using-jdbc-driver
add db184be Kylin-4037 Fix can't Cleanup Data in Hbase's HDFS Storage
When Deploy Apache Kylin with Standalone HBase Cluster (#687)
new 47422bd KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT
new 98b166f KYLIN-3537
new 0ae5e8a fix beeline meta data parser on partition information
new b2c496e Rebase master
new fc90f96 fix add jacoco.version in pom.xml (#699)
new c292de4 KYLIN-4072 find-hbase-dependency.sh don't work at CDH 6.x
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a1a1f79)
\
N -- N -- N refs/heads/master-hadoop3.1 (c292de4)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 6 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
build/bin/find-hadoop-conf-dir.sh | 3 +-
build/bin/find-hbase-dependency.sh | 2 +
build/bin/find-hive-dependency.sh | 2 +
build/bin/find-kafka-dependency.sh | 1 +
build/bin/find-spark-dependency.sh | 1 +
build/bin/kylin-port-replace-util.sh | 5 +
build/bin/kylin.sh | 25 +-
.../org/apache/kylin/common/KylinConfigBase.java | 14 +-
.../org/apache/kylin/common/SourceDialect.java | 55 ++--
.../common/persistence/FileResourceStore.java | 6 +-
.../common/persistence/HDFSResourceStore.java | 7 +-
.../common/persistence/JDBCConnectionManager.java | 4 +-
.../common/persistence/JDBCResourceStore.java | 6 +-
.../kylin/common/persistence/ResourceStore.java | 17 +-
.../apache/kylin/common/restclient/RestClient.java | 2 +-
.../common/persistence/ResourceStoreTest.java | 10 +-
.../kylin/cube/cuboid/DefaultCuboidScheduler.java | 4 +-
.../kylin/cube/cuboid/CuboidSchedulerTest.java | 28 ++
.../org/apache/kylin/dict/CacheDictionary.java | 110 ++++---
.../apache/kylin/dict/ShrunkenDictionaryTest.java | 12 +
.../kylin/dict/TrieDictionaryForestTest.java | 12 +
.../org/apache/kylin/dict/TrieDictionaryTest.java | 85 +++++
.../java/org/apache/kylin/job/JoinedFlatTable.java | 2 +-
.../kylin/exception/QueryOnCubeException.java | 17 +-
.../metadata/expression/BinaryTupleExpression.java | 5 +-
.../apache/kylin/metadata/model/PartitionDesc.java | 27 +-
.../org/apache/kylin/metadata/model/TblColRef.java | 18 ++
.../metadata/expression/TupleExpressionTest.java | 9 +-
.../DefaultPartitionConditionBuilderTest.java | 8 +-
.../kylin/metrics/lib/impl/BlockingReservoir.java | 13 +-
.../storage/gtrecord/GTCubeStorageQueryBase.java | 32 +-
.../mr/steps/NumberDictionaryForestTest.java | 12 +
.../kylin/engine/spark/SparkColumnCardinality.java | 159 ++++++++++
.../apache/kylin/engine/spark/SparkExecutable.java | 33 +-
...{fifty_dim.json => fifty_dim_five_cap.json.bad} | 8 +-
.../java/org/apache/kylin/jdbc/KylinClient.java | 2 +-
.../java/org/apache/kylin/jdbc/KylinResultSet.java | 2 +-
.../kylin/provision/BuildCubeWithEngine.java | 22 +-
.../query12.sql => sql_verifyContent/query02.sql} | 22 +-
...1.sql.expected.xml => query02.sql.expected.xml} | 2 +-
metrics-reporter-hive/pom.xml | 5 +
.../kylin/metrics/lib/impl/hive/HiveProducer.java | 142 ++++++---
.../lib/impl/hive/HiveReservoirReporter.java | 43 ++-
odbc/README.md | 2 +-
pom.xml | 5 +-
.../kylin/query/adhoc/PushDownRunnerJdbcImpl.java | 73 ++---
.../java/org/apache/kylin/query/udf/ConcatUDF.java | 6 +
.../org/apache/kylin/query/util/PushDownUtil.java | 4 +-
.../apache/kylin/rest/job/StorageCleanupJob.java | 108 ++++---
.../kylin/rest/service/StreamingV2Service.java | 4 +
.../apache/kylin/rest/service/TableService.java | 24 +-
.../kylin/rest/job/StorageCleanupJobTest.java | 8 +-
server/pom.xml | 16 +
.../java/org/apache/kylin/rest/DebugTomcat.java | 17 +
server/src/main/resources/kylinMetrics.xml | 4 +-
.../org/apache/kylin/source/jdbc/JdbcDialect.java | 26 --
.../org/apache/kylin/source/jdbc/JdbcExplorer.java | 17 +-
.../kylin/source/jdbc/JdbcHiveInputBase.java | 344 +++++++++++++++++++--
.../apache/kylin/source/jdbc/JdbcTableReader.java | 15 +-
.../java/org/apache/kylin/source/jdbc/SqlUtil.java | 5 +-
.../source/jdbc/extensible/JdbcHiveInputBase.java | 2 +-
.../source/jdbc/metadata/DefaultJdbcMetadata.java | 6 +-
.../kylin/source/jdbc/metadata/IJdbcMetadata.java | 4 +
.../source/jdbc/metadata/JdbcMetadataFactory.java | 16 +-
.../source/jdbc/metadata/MySQLJdbcMetadata.java | 6 +
.../jdbc/metadata/SQLServerJdbcMetadata.java | 6 +
.../apache/kylin/source/jdbc/JdbcExplorerTest.java | 4 +-
.../kylin/source/jdbc/JdbcHiveInputBaseTest.java | 68 ++++
.../jdbc/metadata/JdbcMetadataFactoryTest.java | 35 ---
.../kylin/source/kafka/TimedJsonStreamParser.java | 7 +-
.../kylin/storage/hbase/HBaseConnection.java | 9 +
.../kylin/storage/hbase/HBaseResourceStore.java | 4 +
.../storage/hbase/cube/v2/SegmentQueryCache.java | 2 +-
.../kylin/storage/hbase/steps/CreateHTableJob.java | 27 +-
.../kylin/storage/hbase/steps/HBaseJobSteps.java | 3 +-
.../org/apache/kylin/tool/CubeMetaIngester.java | 8 +-
webapp/app/js/controllers/adminStreaming.js | 16 +-
webapp/app/js/controllers/models.js | 30 +-
webapp/app/partials/models/models_tree.html | 1 +
79 files changed, 1457 insertions(+), 469 deletions(-)
copy core-job/src/main/java/org/apache/kylin/job/exception/JobException.java
=> core-common/src/main/java/org/apache/kylin/common/SourceDialect.java (56%)
copy
stream-core/src/main/java/org/apache/kylin/stream/core/exception/StreamingException.java
=>
core-metadata/src/main/java/org/apache/kylin/exception/QueryOnCubeException.java
(72%)
create mode 100644
engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkColumnCardinality.java
copy examples/test_case_data/localmeta/cube_desc/{fifty_dim.json =>
fifty_dim_five_cap.json.bad} (98%)
copy kylin-it/src/test/resources/query/{sql_tableau/query12.sql =>
sql_verifyContent/query02.sql} (66%)
copy
kylin-it/src/test/resources/query/sql_verifyContent/{query01.sql.expected.xml
=> query02.sql.expected.xml} (52%)
delete mode 100644
source-jdbc/src/main/java/org/apache/kylin/source/jdbc/JdbcDialect.java
create mode 100644
source-jdbc/src/test/java/org/apache/kylin/source/jdbc/JdbcHiveInputBaseTest.java
delete mode 100644
source-jdbc/src/test/java/org/apache/kylin/source/jdbc/metadata/JdbcMetadataFactoryTest.java
