This is an automated email from the ASF dual-hosted git repository.
nic pushed a change to branch 2.6.x-hadoop3.1
in repository https://gitbox.apache.org/repos/asf/kylin.git.
discard 2b72346 [maven-release-plugin] prepare release kylin-2.6.4
discard e54200a remove htable toUpperCase, for HBase tableName is case
sensitive
discard f0f17a1 [maven-release-plugin] prepare release kylin-2.6.3
discard 5520624 fix beeline meta data parser on partition information
discard bf8aa79 KYLIN-2565 Fix use of HBaseAdmin
discard a2d1d04 KYLIN-3537
discard 64fd808 KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT
add baba299 KYLIN-4176 Filter the intermediate tables when loading table
metadata from tree
add 9bb057f Revert "KYLIN-3999, make kylin.query.enable-dynamic-column
default true"
add 33480dc KYLIN-4160 Auto redirect to host:port/kylin when user only
enter host:port in broswer
add ca72e64 KYLIN-4283: return SUCCEED while IOException happend in
GarbageCollectionStep
add 6ac1d7c KYLIN-4292 Use HFileOutputFormat3 in all places to replace
HFileOutputFormat2
add cd7fb00 KYLIN-4180 Prevent abnormal CPU usage by limiting flat
filters length
add 32364bd KYLIN-1716 fix
add 116fcc1 KYLIN-4183 Clicking 'Submit' button is unresponsive, when the
segment is not selected.
add 4a1184e KYLIN-4169 remove useless listModels() in
DataModelManager.curd.initE… (#843)
add 099326b KYLIN-4198 “bin/system-cube.sh cron” will overwrite user's
crontab (#893)
add 3f746ad KYLIN-3741 when the sql result is empty and limit is 0
,should not have 'load more' bar
add f2f8591 KYLIN-4195 The cube size is 'NaN KB' after purging one cube.
add f4f9520 KYLIN-4244: add com.tdunning shade in tool assembly
add ed82551 KYLIN-2431 Use StorageCleanupJob cleanup intermediate hive
tables after check whether it was created by current deployment
add 0467a19 KYLIN-3842: fix partial match regression in the
kylinProperties.js
add ccb90cc KYLIN-4254: The result exporting from Insight with CSV format
is empty, when sql contains Chinese
add 1175527 KYLIN-1716 UI Location Change Bug Fix
add f940526 #4238 Fix kylin_streaming_model broken when changing
kylin.source.hive.database-for-flattable to non-default value
add 472f8c2 KYLIN-4280 SegmenPruner support 'OR' and 'NOT'
add b6b2e16 KYLIN-4287 segmenPruner satisfy "IN" filter bug
add 09074e1 KYLIN-4166 Case when return null when SQL no GROUP BY
add 9d2007f KYLIN-4226: Skip current unavailable tables when updating
hbase coprocessor
add 6d7cf02 KYLIN-4290 Add file lock to kylin startup script to avoid
starting multiple instances on one node
add 51dcec3 KYLIN-4225 close hive session manually
add fe762b1 KYLIN-4304 Project list cannot be correctly sorted by 'Create
Time'
add a578105 KYLIN-4252 Fix the error "Cannot read property 'index' of
null" in visualization page
add 8f49194 KYLIN-3609 KYLIN-3409 KYLIN-4161 CubeSegmentStatisticsMap
exist only on OLAPQuery.EnumeratorTypeEnum.OLAP query type. (#942)
add 786728e KYLIN-4309 Fixed bug that failed to send to one mailbox will
caused other mailboxes have no chance to send
add 2634a7e KYLIN-4080 Project schema update event casues error reload
NEW DataModelDesc
add bc11001 Collect information of NumberFormatException
add ae63d70 Set repository sites to https
add 1f9f44c Fix sql injection issue
add 0556b00 Prevent uncontrolled data used in path expression
add 995d5b2 Encrept response output for BroadcasterReceiveServlet
add a3ec2e6 Fix "equals" on incomparable types
add 9e35338 Fix not thread-safe double-checked locking
add 9720715 Fix potential possibility of array index out of bounds error
add fb924fa Remove container never accessed
add b2c529d Ensure the validity of http header from concated string
add 79207d8 Fix synchronization on boxed types or strings
add 88fce9a KYLIN-4327 TOPN Comparator may violate its general contract
add 25e879c Prevent uncontrolled data used in path expression
add 8546645 Fix equals method does not inspect argument type
add 34eb54c Fix queries built from user-controlled sources
add e946dc6 Prevent uncontrolled data used in path expression
add 1d5eac6 Prevent uncontrolled data used in path expression
add ec62484 KYLIN-4291 Parallel segment building may causes
WriteConflictException
add 5fbb6c9 Validate uuid to prevent sql injection
add eb9f916 KYLIN-4359 Param Value should be required when creating a
cube and adding a new measure
add b39f6fe Minor, throw exception in case of illegal project name
add 18908be Minor, add class TableDesc.TableProject to avoid the use of
Pair
add 1ad9167 Add keys
new fb7a6cf KYLIN-2565 upgrade to hadoop 3.0 hbase 2.0, pass UT
new 5a11a0b KYLIN-3537
new e5859d7 KYLIN-2565 Fix use of HBaseAdmin
new bf803cf fix beeline meta data parser on partition information
new 2e69f86 [maven-release-plugin] prepare release kylin-2.6.3
new b07764b remove htable toUpperCase, for HBase tableName is case
sensitive
new 63236cc [maven-release-plugin] prepare release kylin-2.6.4
new aec95c8 Remove useless import
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (2b72346)
\
N -- N -- N refs/heads/2.6.x-hadoop3.1 (aec95c8)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 8 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
KEYS | 57 ++
build/bin/kylin.sh | 10 +
build/bin/sample.sh | 13 +-
build/bin/system-cube.sh | 5 +-
build/deploy/server.xml | 1 +
build/script/download-tomcat.sh | 9 +
.../org/apache/kylin/common/KylinConfigBase.java | 2 +-
.../common/metrics/metrics2/CodahaleMetrics.java | 10 -
.../common/persistence/JDBCResourceStore.java | 47 +-
.../org/apache/kylin/common/util/MailService.java | 23 +-
.../apache/kylin/cube/common/SegmentPruner.java | 56 +-
.../apache/kylin/cube/common/TupleFilterNode.java | 76 +++
.../kylin/cube/common/SegmentPrunerTest.java | 176 ++++++
.../org/apache/kylin/dict/DictionaryManager.java | 31 +-
.../apache/kylin/dict/lookup/SnapshotManager.java | 64 +-
.../kylin/job/execution/ExecutableManager.java | 4 +
.../org/apache/kylin/measure/topn/TopNCounter.java | 8 +-
.../apache/kylin/measure/topn/TopNMeasureType.java | 2 +-
.../kylin/metadata/TableMetadataManager.java | 15 +-
.../metadata/badquery/BadQueryHistoryManager.java | 2 +
.../apache/kylin/metadata/filter/TupleFilter.java | 13 +-
.../apache/kylin/metadata/model/DataModelDesc.java | 22 +-
.../kylin/metadata/model/DataModelManager.java | 31 +-
.../org/apache/kylin/metadata/model/TableDesc.java | 31 +-
.../apache/kylin/metadata/model/TableExtDesc.java | 137 ++---
.../kylin/measure/topn/TopNCounterBasicTest.java | 47 ++
.../kylin/metrics/lib/impl/hive/HiveProducer.java | 12 +-
pom.xml | 6 +-
.../apache/kylin/query/relnode/OLAPProjectRel.java | 32 +-
.../org/apache/kylin/query/util/QueryUtil.java | 5 +
.../broadcaster/BroadcasterReceiveServlet.java | 24 +-
.../kylin/rest/controller/CubeController.java | 3 +-
.../kylin/rest/controller/DashboardController.java | 17 +-
.../rest/controller/ExternalFilterController.java | 12 +-
.../kylin/rest/controller/ModelController.java | 1 +
.../kylin/rest/controller/QueryController.java | 10 +-
.../apache/kylin/rest/job/StorageCleanupJob.java | 22 +
.../kylin/rest/metrics/QueryMetricsFacade.java | 47 +-
.../kylin/rest/security/AclEntityFactory.java | 6 +
.../org/apache/kylin/rest/service/CubeService.java | 33 +-
.../kylin/rest/service/DashboardService.java | 250 ++++----
.../apache/kylin/rest/service/ModelService.java | 3 +-
.../apache/kylin/rest/service/TableService.java | 14 +-
.../org/apache/kylin/rest/util/ValidateUtil.java | 8 +-
.../kylin/source/hive/BeelineHiveClient.java | 2 +-
.../hbase/lookup/LookupTableToHFileJob.java | 4 +-
.../kylin/storage/hbase/steps/CreateHTableJob.java | 3 +-
.../hbase/steps/HDFSPathGarbageCollectionStep.java | 1 -
.../storage/hbase/steps/HFileOutputFormat3.java | 674 +++++++++++++++++++++
.../storage/hbase/util/DeployCoprocessorCLI.java | 7 +
tool-assembly/pom.xml | 5 +
.../org/apache/kylin/tool/CubeMigrationCLI.java | 4 +-
webapp/app/js/controllers/cubes.js | 2 +-
webapp/app/js/controllers/page.js | 3 +
webapp/app/js/controllers/query.js | 37 +-
webapp/app/js/model/projectConfig.js | 2 +-
webapp/app/js/services/kylinProperties.js | 22 +-
webapp/app/partials/cubeDesigner/measures.html | 1 +
webapp/app/partials/query/query_detail.html | 2 +-
59 files changed, 1718 insertions(+), 448 deletions(-)
create mode 100644
core-cube/src/main/java/org/apache/kylin/cube/common/TupleFilterNode.java
create mode 100644
storage-hbase/src/main/java/org/apache/kylin/storage/hbase/steps/HFileOutputFormat3.java
