This is an automated email from the ASF dual-hosted git repository.
liyang pushed a change to branch sync
in repository https://gitbox.apache.org/repos/asf/kylin.git.
from 76dc049 minor, fix DefaultSchedulerTest.testMetaStoreRecover()
add a2af43d KYLIN-3205 Allow one column is used for both dimension and
precisely count distinct measure
add 4a29d92 KYLIN-2929, speed up dump performance, write dump file to
disk in lazy way
add 61f36a2 APACHE-KYLIN-3235: add null check for SQL
add 148f5c6 KYLIN-3069 Add proper time zone support to the WebUI instead
of GMT/PST kludge
add d4c8fbc KYLIN-3215
add d31a009 KYLIN-3219
add 5bc5e65 KYLIN-2980, Remove getKey/Value setKey/Value from Kylin's
Pair.
add ff6f6c7 KYLIN-3199 The login dialog should be closed when ldap user
with no permission login correctly
add ebfce48 KYLIN 3199 code review
add eac03cd KYLIN-3214
add c686b84 KYLIN-2999 fix cube auto-migration
add 0432487 KYLIN-2999 fix ut
add 9347f0b KYLIN-3195 update Billy Liu public keys to KEYS
add 0bc0677 update calcite to 1.13.0-r4
add 56ec6af KYLIN-3243
add ce76ed9 KYLIN-3245 Searching cube support fuzzy search
add 6a558d8 KYLIN-3241
add d06b72e KYLIN-3131
add bc040a9 Minor, make the sample kylin_streaming_cube be consistent
with kylin_sales
add 8826e1d KYLIN-3277 Automatically remove the blank at the end of lines
in properties files
add 46d4f97 KYLIN-3139 - Failure in map-reduce job due to undefined
hdp.version variable when using HDP stack and remote HBase cluster
add 5075f59 KYLIN-3145 Support Kafka JSON message whose property name
includes _
add 01bd0d4 KYLIN-3145 Support Kafka JSON message whose property name
includes _ (#4028)
add 50435e1 KYLIN-3145 minor, update sample streaming message (#4013)
add 0655dbc KYLIN-3223 - Query for the list of hybrid cubes results in NPE
add 0550cc3 KYLIN-3247
add d4f9d56 KYLIN-3223 fix compile
add 139c303 KYLIN-2884 Add delete segment function for portal
add 65c2315 KYLIN-2672 Only clean necessary cache for CubeMigrationCLI
add 5cecbce KYLIN-2672 minor code review
add 5099066 KYLIN-2672 Add UT
add da0e6b0 KYLIN-3242
add c86f30f KYLIN-3239 Refactor the ACL code about checkPermission and
hasPermission
add 82f76db APACHE-KYLIN-2730: add note for some GeneticAlgorithm related
lib files that are modified from https://github.com/apache/commons-math
add 3fa11b2 KYLIN-3223 fix adjustment based on new ACL check API added by
KYLIN-3239
add 2fd676b KYLIN-3197 When ldap is opened, I use an ignored case user to
login, the page does not respond.
add 17435fa KYLIN-3224 Make the column label of pushdown same with query
result of cube
add 24c489a KYLIN-3224 code review This closes #100
add f1e9f18 KYLIN-3135 revert first regex too
add 714aee0 revert KYLIN-3197 2fd676b36ec9e0f853d59db31ee62cd90a647641
add e59c33e KYLIN-2960, modify the default LDAP admin group config.
add 99d68c8 minor, update README.md
add c234f8f add coveralls badge
add 519f486 enable coveralls
add 3be7af9 Merge pull request #103 from yiming187/travis
add 21ef4d6 minor update github scm in pom.xml
add 74dff9f KYLIN-3263, bugfix with AbstractExecutable's retry.
add 66ea154 Merge pull request #104 from tttMelody/master
add 23641a2 KYLIN-2884 Add delete segment function for portal - bug fix
add 865e377 Merge pull request #105 from sanjulian/APACHE-KYLIN-2884
add 045b22d KYLIN-3268 Tomcat Security Vulnerability Alert. The version
of the tomcat for kylin should upgrade to 7.0.85.
add 2b38b3b ignore checkstyle on external htrace
add 76934db KYLIN-3265 Add jobSearchMode as a filter condition for jobs
api
add 31cc006 KYLIN-3265 Add jobSearchMode as a filter condition for jobs
UI part
add 6afe713 Merge pull request #109 from chenzhx/master
add 39ef73c KYLIN-3236 The function 'reGenerateAdvancedDict()' has an
error logical judgment, which will cause an exception when you edit the cube.
new c5e46bb KYLIN-3234, add a API to ResourceStore that can recursively
new d63160d KYLIN-3233, fix CacheController if cacheKey has "/".
new 4823d8b KYLIN-3234, add HDFS resource store implementation.
new 24d319e KYLIN-3227 Automatically remove the blank at the end of lines
in properties files (#4035)
new 4b2ead2 Move out the wrong execute metadata to a test folder
new c6829f1 Fix unstable ut
org.apache.kylin.job.impl.threadpool.DefaultSchedulerTest#testMetaStoreRecover
new a040c9a KYLIN-3266 improve kylin CI BuildCubeWithEngine coverage
new 31af5c2 bug fix,fix KylinConfig deadlock
new 0efcf9c KYLIN-3265 update test case to cover it
new 451b7ba KYLIN-3267 MR config override at project/cube level only for
mem-hungry build steps
new a05a4d0 KYLIN-3251, add a hook that can customize test_case_data and
add MetadataCleanupJob UT.
The 11 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.travis.yml | 5 +-
KEYS | 59 ++++++++
README.md | 3 +-
build/bin/sample.sh | 2 +
build/conf/kylin_job_conf_inmem.xml | 4 +
build/conf/setenv.sh | 18 ++-
build/script/download-tomcat.sh | 4 +-
.../java/org/apache/kylin/common/KylinConfig.java | 4 +-
.../org/apache/kylin/common/KylinConfigBase.java | 31 +++--
.../common/persistence/FileResourceStore.java | 28 +++-
.../common/persistence/HDFSResourceStore.java | 36 ++++-
.../kylin/common/persistence/ResourceStore.java | 12 +-
.../apache/kylin/common/restclient/RestClient.java | 33 ++++-
.../java/org/apache/kylin/common/util/Pair.java | 16 ---
.../src/main/resources/kylin-defaults.properties | 2 +-
.../org/apache/kylin/common/KylinConfigTest.java | 9 ++
.../common/persistence/HDFSResourceStoreTest.java | 77 +++++++++++
.../common/util/LocalFileMetadataTestCase.java | 77 ++++++++---
.../java/org/apache/kylin/cube/CubeManager.java | 3 +-
.../cuboid/algorithm/generic/GeneticAlgorithm.java | 2 +
.../cuboid/algorithm/generic/lib/BitsMutation.java | 2 +
.../cuboid/algorithm/generic/lib/Chromosome.java | 2 +
.../algorithm/generic/lib/ChromosomePair.java | 2 +
.../algorithm/generic/lib/CrossoverPolicy.java | 2 +
.../generic/lib/ElitisticListPopulation.java | 2 +
.../cube/cuboid/algorithm/generic/lib/Fitness.java | 2 +
.../generic/lib/FixedGenerationCount.java | 2 +
.../algorithm/generic/lib/ListPopulation.java | 2 +
.../algorithm/generic/lib/MutationPolicy.java | 2 +
.../algorithm/generic/lib/OnePointCrossover.java | 2 +
.../cuboid/algorithm/generic/lib/Population.java | 2 +
.../algorithm/generic/lib/SelectionPolicy.java | 2 +
.../algorithm/generic/lib/StoppingCondition.java | 2 +
.../algorithm/generic/lib/TournamentSelection.java | 2 +
.../kylin/cube/model/CubeJoinedFlatTableDesc.java | 4 +
.../cube/model/validation/rule/DictionaryRule.java | 6 +-
.../apache/kylin/gridtable/GTAggregateScanner.java | 70 ++++++++--
.../kylin/job/execution/AbstractExecutable.java | 32 ++---
.../apache/kylin/job/ExecutableManagerTest.java | 2 +-
.../apache/kylin/job/RetryableTestExecutable.java | 50 -------
.../job/impl/threadpool/DefaultSchedulerTest.java | 35 +++--
.../kylin/metadata/TableMetadataManager.java | 12 ++
.../org/apache/kylin/metadata/model/TableDesc.java | 2 +-
.../org/apache/kylin/metadata/model/TblColRef.java | 6 +
.../kylin/metadata/project/ProjectL2Cache.java | 4 +
.../kylin/metadata/project/ProjectManager.java | 6 +-
.../org/apache/kylin/metrics/MetricsManager.java | 14 +-
.../java/org/apache/kylin/engine/mr/CubingJob.java | 17 ++-
.../engine/mr/common/MapReduceExecutable.java | 21 ++-
.../engine/mr/common/MapReduceExecutableTest.java | 50 +++++++
.../template/cube_desc/kylin_streaming_cube.json | 4 +-
examples/test_case_data/localmeta/kylin.properties | 6 +-
examples/test_case_data/sandbox/kylin.properties | 2 +-
.../sandbox/kylin_job_conf_inmem.xml | 4 +
external/htrace/pom.xml | 1 +
.../kylin/provision/BuildCubeWithEngine.java | 75 +++++-----
pom.xml | 29 ++--
.../kylin/query/adhoc/PushDownRunnerJdbcImpl.java | 151 ++++++++++++++++++++-
.../org/apache/kylin/query/util/QueryUtil.java | 2 +-
.../org/apache/kylin/query/util/QueryUtilTest.java | 7 +-
.../broadcaster/BroadcasterReceiveServlet.java | 21 ++-
.../kylin/rest/controller/AccessController.java | 10 +-
.../kylin/rest/controller/CacheController.java | 20 +++
.../kylin/rest/controller/CubeController.java | 18 ++-
.../kylin/rest/controller/JobController.java | 14 +-
.../kylin/rest/controller/ProjectController.java | 10 +-
.../kylin/rest/controller/QueryController.java | 2 +-
.../java/org/apache/kylin/rest/msg/Message.java | 4 +
...ybridRequest.java => CubeMigrationRequest.java} | 36 ++---
.../apache/kylin/rest/request/JobListRequest.java | 10 ++
.../rest/security/LDAPAuthoritiesPopulator.java | 1 +
.../apache/kylin/rest/service/CacheService.java | 34 ++++-
.../org/apache/kylin/rest/service/CubeService.java | 82 +++++------
.../apache/kylin/rest/service/HybridService.java | 53 +++++---
.../org/apache/kylin/rest/service/JobService.java | 48 ++++---
.../apache/kylin/rest/service/ModelService.java | 20 ++-
.../apache/kylin/rest/service/ProjectService.java | 10 +-
.../apache/kylin/rest/service/QueryService.java | 76 +++++------
.../org/apache/kylin/rest/util/AclEvaluate.java | 78 +++++++----
.../kylin/rest/controller/CacheControllerTest.java | 54 +++++++-
.../kylin/rest/controller/CubeControllerTest.java | 2 +-
.../kylin/rest/controller/JobControllerTest.java | 21 ++-
.../kylin/rest/service/AdminServiceTest.java | 3 +-
.../apache/kylin/rest/service/JobServiceTest.java | 12 +-
.../execute/d9a2b721-9916-4607-8047-148ceb2473b1 | 0
.../apache/kylin/source/kafka/StreamingParser.java | 6 +-
.../kylin/source/kafka/TimedJsonStreamParser.java | 47 +++++--
.../source/kafka/util/KafkaSampleProducer.java | 1 +
.../source/kafka/TimedJsonStreamParserTest.java | 36 ++++-
source-kafka/src/test/resources/message.json | 2 +-
.../kylin/storage/hbase/HBaseResourceStore.java | 24 ++--
.../org/apache/kylin/tool/CubeMigrationCLI.java | 28 ++--
.../org/apache/kylin/tool/MetadataCleanupJob.java | 56 ++++----
.../tool/metrics/systemcube/CubeDescCreator.java | 8 +-
.../apache/kylin/tool/MetadataCleanupJobTest.java | 76 +++++++++++
.../src/test/resources/test_meta}/UUID | Bin
.../test_meta/cube/ci_inner_join_cube.json | 60 ++++++++
.../test_meta}/cube_desc/ci_inner_join_cube.json | 0
.../04b6db34-b243-4780-855a-4c7ea4cee817.seq | Bin 0 -> 2605183 bytes
.../NAME/b58ce89d-3df6-46d1-8cff-2a9cfc8b7510.dict | Bin 0 -> 823 bytes
.../NAME/64ca8fea-b859-4e63-aea3-bfb4c6ee0c9d.dict | Bin 0 -> 844 bytes
.../execute/d861b8b7-c773-47ab-bb1e-c8782ae8d930 | 41 ++++++
.../d861b8b7-c773-47ab-bb1e-c8782ae8d930 | 13 ++
.../d861b8b7-c773-47ab-bb1e-c8782ae8d930-00 | 13 ++
.../d861b8b7-c773-47ab-bb1e-c8782ae8d930-01 | 13 ++
.../src/test/resources/test_meta/kylin.properties | 0
.../test_meta}/model_desc/ci_inner_join_model.json | 0
.../test/resources/test_meta/project/default.json | 35 +++++
.../test_meta}/table/DEFAULT.TEST_ACCOUNT.json | 0
.../table/DEFAULT.TEST_CATEGORY_GROUPINGS.json | 0
.../test_meta}/table/DEFAULT.TEST_COUNTRY.json | 0
.../test_meta}/table/DEFAULT.TEST_KYLIN_FACT.json | 0
.../test_meta}/table/DEFAULT.TEST_ORDER.json | 0
.../test_meta}/table/EDW.TEST_CAL_DT.json | 0
.../test_meta}/table/EDW.TEST_SELLER_TYPE_DIM.json | 0
.../resources/test_meta}/table/EDW.TEST_SITES.json | 0
.../92456efe-9b79-4385-a5a3-e7f37b677bf7.snapshot | Bin 0 -> 16063 bytes
.../7ecdb07b-a8d0-49d8-892b-fe2dd75512ca.snapshot | Bin 0 -> 16061 bytes
webapp/app/js/controllers/cubeAdvanceSetting.js | 9 +-
webapp/app/js/controllers/cubeEdit.js | 15 +-
webapp/app/js/controllers/cubes.js | 72 +++++++++-
webapp/app/js/controllers/job.js | 5 +-
webapp/app/js/controllers/sourceMeta.js | 11 +-
webapp/app/js/filters/filter.js | 42 ++----
webapp/app/js/model/cubeDescModel.js | 16 ++-
webapp/app/js/model/jobConfig.js | 5 +
webapp/app/js/model/jobListModel.js | 2 +
webapp/app/js/services/cubes.js | 1 +
webapp/app/js/services/kylinProperties.js | 3 +
webapp/app/js/services/users.js | 15 +-
webapp/app/partials/common/access.html | 18 +--
.../cube_delete_segment.html} | 49 +++----
webapp/app/partials/cubes/cube_detail.html | 4 +-
webapp/app/partials/cubes/cubes.html | 9 +-
webapp/app/partials/jobs/jobList.html | 5 +-
webapp/app/partials/query/query.html | 2 +-
136 files changed, 1792 insertions(+), 654 deletions(-)
create mode 100644
core-common/src/test/java/org/apache/kylin/common/persistence/HDFSResourceStoreTest.java
delete mode 100644
core-job/src/test/java/org/apache/kylin/job/RetryableTestExecutable.java
create mode 100644
engine-mr/src/test/java/org/apache/kylin/engine/mr/common/MapReduceExecutableTest.java
copy
server-base/src/main/java/org/apache/kylin/rest/request/{HybridRequest.java =>
CubeMigrationRequest.java} (66%)
rename {examples/test_case_data/localmeta =>
server/src/test/resources/ut_meta/broken_executable}/execute/d9a2b721-9916-4607-8047-148ceb2473b1
(100%)
create mode 100644
tool/src/test/java/org/apache/kylin/tool/MetadataCleanupJobTest.java
copy {examples/test_case_data/localmeta =>
tool/src/test/resources/test_meta}/UUID (100%)
create mode 100644
tool/src/test/resources/test_meta/cube/ci_inner_join_cube.json
copy {examples/test_case_data/localmeta =>
tool/src/test/resources/test_meta}/cube_desc/ci_inner_join_cube.json (100%)
create mode 100644
tool/src/test/resources/test_meta/cube_statistics/kylin_sales_cube/04b6db34-b243-4780-855a-4c7ea4cee817.seq
create mode 100644
tool/src/test/resources/test_meta/dict/DEFAULT.KYLIN_COUNTRY/NAME/b58ce89d-3df6-46d1-8cff-2a9cfc8b7510.dict
create mode 100644
tool/src/test/resources/test_meta/dict/DEFAULT.TEST_COUNTRY/NAME/64ca8fea-b859-4e63-aea3-bfb4c6ee0c9d.dict
create mode 100644
tool/src/test/resources/test_meta/execute/d861b8b7-c773-47ab-bb1e-c8782ae8d930
create mode 100644
tool/src/test/resources/test_meta/execute_output/d861b8b7-c773-47ab-bb1e-c8782ae8d930
create mode 100644
tool/src/test/resources/test_meta/execute_output/d861b8b7-c773-47ab-bb1e-c8782ae8d930-00
create mode 100644
tool/src/test/resources/test_meta/execute_output/d861b8b7-c773-47ab-bb1e-c8782ae8d930-01
copy engine-mr/src/test/resources/multi_file_empty_file/empty.txt =>
tool/src/test/resources/test_meta/kylin.properties (100%)
copy {examples/test_case_data/localmeta =>
tool/src/test/resources/test_meta}/model_desc/ci_inner_join_model.json (100%)
create mode 100644 tool/src/test/resources/test_meta/project/default.json
copy {examples/test_case_data/localmeta =>
tool/src/test/resources/test_meta}/table/DEFAULT.TEST_ACCOUNT.json (100%)
copy {examples/test_case_data/localmeta =>
tool/src/test/resources/test_meta}/table/DEFAULT.TEST_CATEGORY_GROUPINGS.json
(100%)
copy {examples/test_case_data/localmeta =>
tool/src/test/resources/test_meta}/table/DEFAULT.TEST_COUNTRY.json (100%)
copy {examples/test_case_data/localmeta =>
tool/src/test/resources/test_meta}/table/DEFAULT.TEST_KYLIN_FACT.json (100%)
copy {examples/test_case_data/localmeta =>
tool/src/test/resources/test_meta}/table/DEFAULT.TEST_ORDER.json (100%)
copy {examples/test_case_data/localmeta =>
tool/src/test/resources/test_meta}/table/EDW.TEST_CAL_DT.json (100%)
copy {examples/test_case_data/localmeta =>
tool/src/test/resources/test_meta}/table/EDW.TEST_SELLER_TYPE_DIM.json (100%)
copy {examples/test_case_data/localmeta =>
tool/src/test/resources/test_meta}/table/EDW.TEST_SITES.json (100%)
create mode 100644
tool/src/test/resources/test_meta/table_snapshot/DEFAULT.KYLIN_COUNTRY/92456efe-9b79-4385-a5a3-e7f37b677bf7.snapshot
create mode 100644
tool/src/test/resources/test_meta/table_snapshot/DEFAULT.TEST_COUNTRY/7ecdb07b-a8d0-49d8-892b-fe2dd75512ca.snapshot
copy webapp/app/partials/{jobs/job_refresh.html =>
cubes/cube_delete_segment.html} (59%)
--
To stop receiving notification emails like this one, please contact
[email protected].
