After setting kylin.server.query-metrics-enabled to true, kylin query metrics
will send to JMX.
As for How to collect JMX info:
For prod, you could use any well-known jmxtools to collect JMX info.
For debug and test, you could use jconsole tools:
1. set following commands to setenv.sh
export
Hi, Shaofeng. Thanks for your reminder.
This Release vote is canceled.
When I resolve the released source package issue, I will vote
apache-kylin-2.3.2 (RC2).
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Hi all,
I have created a build for Apache Kylin 2.3.2, release candidate 1.
Changes highlights:
[KYLIN-3372] - Upgrade jackson-databind version due to security concerns
[KYLIN-3388] - Data may become not correct if mappers fail during the
redistribute step, "distribute by rand()"
[KYLIN-3400]
Hi all,
I have created a build for Apache Kylin 2.3.2, release candidate 2.
Changes highlights:
[KYLIN-3372] - Upgrade jackson-databind version due to security concerns
[KYLIN-3388] - Data may become not correct if mappers fail during the
redistribute step, "distribute by rand()"
[KYLIN-3400]
Thanks to everyone who has tested the release candidate and given
their comments and votes.
The tally is as follows.
5 binding +1s:
Shaofeng Shi
Yerui Sun
Dayue Gao
Billy Liu
Dong Li
1 non-binding +1s:
Kaisen Kang
No 0s or -1s.
Therefore I am delighted to announce that the proposal to
+1. Thanks Shaofeng.
It's more friendly for new contributors.
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
+1. Thanks Shaofeng.
It's great. Code review is necessary.
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Welcome Jianhua!
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
I would like to take the ownership of "Spark engine" components.
I also could be a backup owner for "Job Engine" components.
In this year，I and Dayue will contribute and take over "Storage-Druid"
components.
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
+1.
It's very cool and exciting！
Thanks,
Kaisen Kang
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
The Apache Kylin team is pleased to announce the immediate availability of
the 2.3.2 release.
This is a bug fix release after 2.3.1, with 12 bug fixes and enhancements;
All of the changes in this release can be found in:
https://kylin.apache.org/docs23/release_notes.html
You can download the
+1
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Hi all,
Meituan Kylin team has implemented a new storage engine for Kylin: Druid
Storage Engine.
The attach file is the Kylin On Druid Storage Engine architecture design
doc.
We would like to contribute the feature to community, please let us know if
you have any concern.
Hi, Shaofeng
1 I done a fully regression test in our internal env. I will think how to
add Druid to Kylin integration test.
2 Yes, you are right.
3 This is a related Jira: https://issues.apache.org/jira/browse/KYLIN-3694
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
+1, It’s awesome.
Best regards.
Kaisen Kang
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
+1 Binding.
Thanks,
Kaisen Kang.
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
+1 Binding.
Thanks,
Kaisen Kang.
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
kangkaisen created KYLIN-1695:
-
Summary: disable cardinality calculation job when loading hive
table
Key: KYLIN-1695
URL: https://issues.apache.org/jira/browse/KYLIN-1695
Project: Kylin
Issue
kangkaisen created KYLIN-1694:
-
Summary: make multiply coefficient configurable when estimating
cuboid size
Key: KYLIN-1694
URL: https://issues.apache.org/jira/browse/KYLIN-1694
Project: Kylin
kangkaisen created KYLIN-1884:
-
Summary: Reload metadata automatically after migrating cube
Key: KYLIN-1884
URL: https://issues.apache.org/jira/browse/KYLIN-1884
Project: Kylin
Issue Type
kangkaisen created KYLIN-1893:
-
Summary: Upgrade spring-boot framework because of security
vulnerabilities
Key: KYLIN-1893
URL: https://issues.apache.org/jira/browse/KYLIN-1893
Project: Kylin
kangkaisen created KYLIN-1896:
-
Summary: JDBC support mybatis
Key: KYLIN-1896
URL: https://issues.apache.org/jira/browse/KYLIN-1896
Project: Kylin
Issue Type: Bug
Components: Driver
kangkaisen created KYLIN-1908:
-
Summary: Collect Metrics to JMX
Key: KYLIN-1908
URL: https://issues.apache.org/jira/browse/KYLIN-1908
Project: Kylin
Issue Type: New Feature
Components
kangkaisen created KYLIN-2430:
-
Summary: Unnecessary exception catching in BulkLoadJob
Key: KYLIN-2430
URL: https://issues.apache.org/jira/browse/KYLIN-2430
Project: Kylin
Issue Type: Bug
kangkaisen created KYLIN-2433:
-
Summary: NPE in MergeCuboidMapper
Key: KYLIN-2433
URL: https://issues.apache.org/jira/browse/KYLIN-2433
Project: Kylin
Issue Type: Bug
Components: Job
kangkaisen created KYLIN-2446:
-
Summary: Support project names filter in DeployCoprocessorCLI
Key: KYLIN-2446
URL: https://issues.apache.org/jira/browse/KYLIN-2446
Project: Kylin
Issue Type
kangkaisen created KYLIN-1965:
-
Summary: Check duplicated measure name
Key: KYLIN-1965
URL: https://issues.apache.org/jira/browse/KYLIN-1965
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-1992:
-
Summary: Clear ThreadLocal Contexts when query failed before
scaning HBase
Key: KYLIN-1992
URL: https://issues.apache.org/jira/browse/KYLIN-1992
Project: Kylin
kangkaisen created KYLIN-2006:
-
Summary: Make job build server distributed
Key: KYLIN-2006
URL: https://issues.apache.org/jira/browse/KYLIN-2006
Project: Kylin
Issue Type: New Feature
kangkaisen created KYLIN-1982:
-
Summary: CubeMigrationCLI: associate model_name with project
Key: KYLIN-1982
URL: https://issues.apache.org/jira/browse/KYLIN-1982
Project: Kylin
Issue Type: Bug
kangkaisen created KYLIN-2130:
-
Summary: QueryMetrics concurrent bug fix
Key: KYLIN-2130
URL: https://issues.apache.org/jira/browse/KYLIN-2130
Project: Kylin
Issue Type: Bug
Components
kangkaisen created KYLIN-2109:
-
Summary: Deploy coprocessor only this server own the table
Key: KYLIN-2109
URL: https://issues.apache.org/jira/browse/KYLIN-2109
Project: Kylin
Issue Type: Bug
kangkaisen created KYLIN-2127:
-
Summary: UI bug fix for Extend Column
Key: KYLIN-2127
URL: https://issues.apache.org/jira/browse/KYLIN-2127
Project: Kylin
Issue Type: Bug
Components
kangkaisen created KYLIN-2135:
-
Summary: Enlarge FactDistinctColumns reducer number
Key: KYLIN-2135
URL: https://issues.apache.org/jira/browse/KYLIN-2135
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2153:
-
Summary: Allow user to skip the check in CubeMetaIngester
Key: KYLIN-2153
URL: https://issues.apache.org/jira/browse/KYLIN-2153
Project: Kylin
Issue Type: Bug
kangkaisen created KYLIN-2093:
-
Summary: Clear cache in CubeMetaIngester
Key: KYLIN-2093
URL: https://issues.apache.org/jira/browse/KYLIN-2093
Project: Kylin
Issue Type: Bug
Components
kangkaisen created KYLIN-2269:
-
Summary: Reduce MR memory usage for global dict
Key: KYLIN-2269
URL: https://issues.apache.org/jira/browse/KYLIN-2269
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2270:
-
Summary: Reduce MR memory usage for global dict
Key: KYLIN-2270
URL: https://issues.apache.org/jira/browse/KYLIN-2270
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2287:
-
Summary: Speed up model and cube list load in Web
Key: KYLIN-2287
URL: https://issues.apache.org/jira/browse/KYLIN-2287
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2389:
-
Summary: Improve resource utilization for DistributedScheduler
Key: KYLIN-2389
URL: https://issues.apache.org/jira/browse/KYLIN-2389
Project: Kylin
Issue Type
kangkaisen created KYLIN-2237:
-
Summary: Ensure dimensions and measures of model don't have null
column
Key: KYLIN-2237
URL: https://issues.apache.org/jira/browse/KYLIN-2237
Project: Kylin
kangkaisen created KYLIN-2238:
-
Summary: Add query server scan threshold
Key: KYLIN-2238
URL: https://issues.apache.org/jira/browse/KYLIN-2238
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2242:
-
Summary: Directly write hdfs file in reducer is dangerous
Key: KYLIN-2242
URL: https://issues.apache.org/jira/browse/KYLIN-2242
Project: Kylin
Issue Type: Bug
kangkaisen created KYLIN-2239:
-
Summary: Remove refreshSegment in JobService
Key: KYLIN-2239
URL: https://issues.apache.org/jira/browse/KYLIN-2239
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2357:
-
Summary: Make ERROR_RECORD_LOG_THRESHOLD configurable
Key: KYLIN-2357
URL: https://issues.apache.org/jira/browse/KYLIN-2357
Project: Kylin
Issue Type: Bug
kangkaisen created KYLIN-2349:
-
Summary: Serialize BitmapCounter with peekLength
Key: KYLIN-2349
URL: https://issues.apache.org/jira/browse/KYLIN-2349
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2353:
-
Summary: Serialize BitmapCounter with distinct count
Key: KYLIN-2353
URL: https://issues.apache.org/jira/browse/KYLIN-2353
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2364:
-
Summary: Output table name to error info in LookupTable
Key: KYLIN-2364
URL: https://issues.apache.org/jira/browse/KYLIN-2364
Project: Kylin
Issue Type
kangkaisen created KYLIN-2379:
-
Summary: Add UseCMSInitiatingOccupancyOnly to KYLIN_JVM_SETTINGS
Key: KYLIN-2379
URL: https://issues.apache.org/jira/browse/KYLIN-2379
Project: Kylin
Issue Type
kangkaisen created KYLIN-2377:
-
Summary: Add kylin client query timeout
Key: KYLIN-2377
URL: https://issues.apache.org/jira/browse/KYLIN-2377
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2378:
-
Summary: Set job thread name with job uuid
Key: KYLIN-2378
URL: https://issues.apache.org/jira/browse/KYLIN-2378
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2308:
-
Summary: Allow user to set more columnFamily in web
Key: KYLIN-2308
URL: https://issues.apache.org/jira/browse/KYLIN-2308
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2304:
-
Summary: Only copy latest version dict for global dict
Key: KYLIN-2304
URL: https://issues.apache.org/jira/browse/KYLIN-2304
Project: Kylin
Issue Type
kangkaisen created KYLIN-2547:
-
Summary: Fix the bug of multi-process concurrence in
mergeCubeSegment
Key: KYLIN-2547
URL: https://issues.apache.org/jira/browse/KYLIN-2547
Project: Kylin
Issue
kangkaisen created KYLIN-2506:
-
Summary: Refactor Global Dictionary
Key: KYLIN-2506
URL: https://issues.apache.org/jira/browse/KYLIN-2506
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2744:
-
Summary: Should return correct type for SUM measure in web
Key: KYLIN-2744
URL: https://issues.apache.org/jira/browse/KYLIN-2744
Project: Kylin
Issue Type: Bug
kangkaisen created KYLIN-2764:
-
Summary: Build the dict for UHC column with MR
Key: KYLIN-2764
URL: https://issues.apache.org/jira/browse/KYLIN-2764
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2707:
-
Summary: Fxi NPE in JobInfoConverter
Key: KYLIN-2707
URL: https://issues.apache.org/jira/browse/KYLIN-2707
Project: Kylin
Issue Type: Bug
Components
kangkaisen created KYLIN-2706:
-
Summary: Should disable Storage limit push down when singleValuesD
doesn't containsAll othersD
Key: KYLIN-2706
URL: https://issues.apache.org/jira/browse/KYLIN-2706
kangkaisen created KYLIN-2705:
-
Summary: Should allow user to remove partition_date_column for
model in web
Key: KYLIN-2705
URL: https://issues.apache.org/jira/browse/KYLIN-2705
Project: Kylin
kangkaisen created KYLIN-2693:
-
Summary: Should use overrideHiveConfig for
LookupHiveViewMaterialization and RedistributeFlatHiveTable
Key: KYLIN-2693
URL: https://issues.apache.org/jira/browse/KYLIN-2693
kangkaisen created KYLIN-2694:
-
Summary: Fix ArrayIndexOutOfBoundsException in SparkCubingByLayer
Key: KYLIN-2694
URL: https://issues.apache.org/jira/browse/KYLIN-2694
Project: Kylin
Issue Type
kangkaisen created KYLIN-2695:
-
Summary: Should allow user to override spark conf in cube
Key: KYLIN-2695
URL: https://issues.apache.org/jira/browse/KYLIN-2695
Project: Kylin
Issue Type
kangkaisen created KYLIN-2563:
-
Summary: Fix bug in checkCubeAuthorization
Key: KYLIN-2563
URL: https://issues.apache.org/jira/browse/KYLIN-2563
Project: Kylin
Issue Type: Bug
kangkaisen created KYLIN-2619:
-
Summary: Use newCachedThreadPool instead of newFixedThreadPool in
Broadcaster
Key: KYLIN-2619
URL: https://issues.apache.org/jira/browse/KYLIN-2619
Project: Kylin
kangkaisen created KYLIN-2601:
-
Summary: The return type of tinyint for sum measure should be
bigint
Key: KYLIN-2601
URL: https://issues.apache.org/jira/browse/KYLIN-2601
Project: Kylin
Issue
kangkaisen created KYLIN-2602:
-
Summary: Add optional job threshold arg for MetadataCleanupJob
Key: KYLIN-2602
URL: https://issues.apache.org/jira/browse/KYLIN-2602
Project: Kylin
Issue Type
kangkaisen created KYLIN-2607:
-
Summary: Add http timeout for RestClient
Key: KYLIN-2607
URL: https://issues.apache.org/jira/browse/KYLIN-2607
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2604:
-
Summary: Use global dict as the default encoding for precise
distinct count in web
Key: KYLIN-2604
URL: https://issues.apache.org/jira/browse/KYLIN-2604
Project: Kylin
kangkaisen created KYLIN-2606:
-
Summary: Only return counter for precise count_distinct if query
is exactAggregate
Key: KYLIN-2606
URL: https://issues.apache.org/jira/browse/KYLIN-2606
Project: Kylin
kangkaisen created KYLIN-2626:
-
Summary: Fix InstantiationException in ZookeeperDistributedJobLock
Key: KYLIN-2626
URL: https://issues.apache.org/jira/browse/KYLIN-2626
Project: Kylin
Issue Type
kangkaisen created KYLIN-2628:
-
Summary: Remove synchronized modifier for reloadCubeLocalAt
Key: KYLIN-2628
URL: https://issues.apache.org/jira/browse/KYLIN-2628
Project: Kylin
Issue Type
kangkaisen created KYLIN-2622:
-
Summary: AppendTrieDictionary support not global
Key: KYLIN-2622
URL: https://issues.apache.org/jira/browse/KYLIN-2622
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2664:
-
Summary: Fix Extended column bug in web
Key: KYLIN-2664
URL: https://issues.apache.org/jira/browse/KYLIN-2664
Project: Kylin
Issue Type: Bug
Components
kangkaisen created KYLIN-2665:
-
Summary: Add model JSON edit in web
Key: KYLIN-2665
URL: https://issues.apache.org/jira/browse/KYLIN-2665
Project: Kylin
Issue Type: New Feature
kangkaisen created KYLIN-2642:
-
Summary: Relax check in RowKeyColDesc to keep backward
compatibility
Key: KYLIN-2642
URL: https://issues.apache.org/jira/browse/KYLIN-2642
Project: Kylin
Issue
kangkaisen created KYLIN-2647:
-
Summary: Should get FileSystem from HBaseConfiguration in
HBaseResourceStore
Key: KYLIN-2647
URL: https://issues.apache.org/jira/browse/KYLIN-2647
Project: Kylin
kangkaisen created KYLIN-2653:
-
Summary: Spark cubing support HBase cluster with kerberos on Yarn
client mode
Key: KYLIN-2653
URL: https://issues.apache.org/jira/browse/KYLIN-2653
Project: Kylin
kangkaisen created KYLIN-2652:
-
Summary: Make KylinConfig threadsafe in CubeVisitService
Key: KYLIN-2652
URL: https://issues.apache.org/jira/browse/KYLIN-2652
Project: Kylin
Issue Type: Bug
kangkaisen created KYLIN-2673:
-
Summary: Should allow user to change fact table as long as the
cube is disable
Key: KYLIN-2673
URL: https://issues.apache.org/jira/browse/KYLIN-2673
Project: Kylin
kangkaisen created KYLIN-2672:
-
Summary: Only clean necessary cache for CubeMigrationCLI
Key: KYLIN-2672
URL: https://issues.apache.org/jira/browse/KYLIN-2672
Project: Kylin
Issue Type
kangkaisen created KYLIN-2675:
-
Summary: The hfileSizeMB should not relay on kylin.env
Key: KYLIN-2675
URL: https://issues.apache.org/jira/browse/KYLIN-2675
Project: Kylin
Issue Type: Bug
kangkaisen created KYLIN-2674:
-
Summary: Should not catch OutOfMemoryError in coprocessor
Key: KYLIN-2674
URL: https://issues.apache.org/jira/browse/KYLIN-2674
Project: Kylin
Issue Type: Bug
kangkaisen created KYLIN-2838:
-
Summary: Should get storageType in changeHtableHost of
CubeMigrationCLI
Key: KYLIN-2838
URL: https://issues.apache.org/jira/browse/KYLIN-2838
Project: Kylin
kangkaisen created KYLIN-3113:
-
Summary: Editing Measure supports fuzzy search in web
Key: KYLIN-3113
URL: https://issues.apache.org/jira/browse/KYLIN-3113
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-3117:
-
Summary: Hide project config in cube level
Key: KYLIN-3117
URL: https://issues.apache.org/jira/browse/KYLIN-3117
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2992:
-
Summary: Avoid OOM in CubeHFileJob.Reducer
Key: KYLIN-2992
URL: https://issues.apache.org/jira/browse/KYLIN-2992
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2994:
-
Summary: Handle NPE when load dict in DictionaryManager
Key: KYLIN-2994
URL: https://issues.apache.org/jira/browse/KYLIN-2994
Project: Kylin
Issue Type: Bug
kangkaisen created KYLIN-2995:
-
Summary: Set SparkContext.hadoopConfiguration to HadoopUtil in
Spark Cuing
Key: KYLIN-2995
URL: https://issues.apache.org/jira/browse/KYLIN-2995
Project: Kylin
kangkaisen created KYLIN-2997:
-
Summary: Allow change engineType even if there are segments in cube
Key: KYLIN-2997
URL: https://issues.apache.org/jira/browse/KYLIN-2997
Project: Kylin
Issue
kangkaisen created KYLIN-2998:
-
Summary: Kill spark app when job was discarded
Key: KYLIN-2998
URL: https://issues.apache.org/jira/browse/KYLIN-2998
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-3002:
-
Summary: Use Spark as default engine for none-global-dict cube
Key: KYLIN-3002
URL: https://issues.apache.org/jira/browse/KYLIN-3002
Project: Kylin
Issue Type
kangkaisen created KYLIN-2996:
-
Summary: DeployCoprocessorCLI Log failed tables info
Key: KYLIN-2996
URL: https://issues.apache.org/jira/browse/KYLIN-2996
Project: Kylin
Issue Type: Improvement
kangkaisen created KYLIN-2999:
-
Summary: One click migrate cube in web
Key: KYLIN-2999
URL: https://issues.apache.org/jira/browse/KYLIN-2999
Project: Kylin
Issue Type: New Feature
kangkaisen created KYLIN-3425:
-
Summary: Kylin v2.3.2 Release
Key: KYLIN-3425
URL: https://issues.apache.org/jira/browse/KYLIN-3425
Project: Kylin
Issue Type: Task
Reporter
kangkaisen created KYLIN-3205:
-
Summary: Allow one column is used for both dimension and precisely
count distinct measure
Key: KYLIN-3205
URL: https://issues.apache.org/jira/browse/KYLIN-3205
Project
kangkaisen created KYLIN-3133:
-
Summary: Fix KYLIN-2717 compatibility issue
Key: KYLIN-3133
URL: https://issues.apache.org/jira/browse/KYLIN-3133
Project: Kylin
Issue Type: Bug
kangkaisen created KYLIN-3694:
-
Summary: Kylin On Druid Storage
Key: KYLIN-3694
URL: https://issues.apache.org/jira/browse/KYLIN-3694
Project: Kylin
Issue Type: New Feature
Components
98 matches
Mail list logo
