Modified: kylin/site/docs15/release_notes.html URL: http://svn.apache.org/viewvc/kylin/site/docs15/release_notes.html?rev=1735396&r1=1735395&r2=1735396&view=diff ============================================================================== --- kylin/site/docs15/release_notes.html (original) +++ kylin/site/docs15/release_notes.html Thu Mar 17 10:34:37 2016 @@ -1657,541 +1657,714 @@ there are source code package, binary pa <p>Any problem or issue, please report to Apache Kylin JIRA project: <a href="https://issues.apache.org/jira/browse/KYLIN";>https://issues.apache.org/jira/browse/KYLIN</a></p> -<p>or send to Apache Kylin mailing list: <br /> -* User relative: <a href="mailto:user@kylin.apache.org">user@kylin.apache.org</a><br /> -* Development relative: <a href="mailto:dev@kylin.apache.org">dev@kylin.apache.org</a></p> +<p>or send to Apache Kylin mailing list:</p> + +<ul> + <li>User relative: <a href="mailto:user@kylin.apache.org">user@kylin.apache.org</a></li> + <li>Development relative: <a href="mailto:dev@kylin.apache.org">dev@kylin.apache.org</a></li> +</ul> <h2 id="v150---2016-03-12">v1.5.0 - 2016-03-12</h2> <p><em>Tag:</em> <a href="https://github.com/apache/kylin/tree/kylin-1.5.0";>kylin-1.5.0</a></p> -<p><strong>Significant changes have taken place in metadata and cube data, upgrade from v1.3 and before is difficult. Recommend build new cube from scratch with this version.</strong></p> - -<p><strong>JIRA system is down at the time of writing, below is pending manual revision.</strong></p> +<p>Significant changes have taken place in metadata and cube data, upgrade from v1.3 and before is difficult. Recommend build new cube from scratch with this version.</p> <p><strong>Highlights</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-875] - A plugin-able architecture, to allow alternative cube engine / storage engine / data source. -* [KYLIN-1245] - A better MR cubing algorithm, about 1.5 times faster by comparing hundreds of jobs. -* [KYLIN-942] - A better storage engine, makes query roughly 2 times faster (especially for slow queries) by comparing tens of thousands sqls. -* [KYLIN-738] - Streaming cubing EXPERIMENTAL support, source from kafka, build cube in-mem at minutes interval. -* [KYLIN-242] - Redesign aggregation group, support of 20+ dimensions made easy. -* [KYLIN-976] - Custom aggregation types (or UDF in other words). -* [KYLIN-943] - TopN aggregation type. -* [KYLIN-1065] - ODBC compatible with Tableau 9.1, MS Excel, MS PowerBI. -* [KYLIN-1219] - Kylin support SSO with Spring SAML. -</code></pre> -</div> +<ul> + <li>[KYLIN-875] - A plugin-able architecture, to allow alternative cube engine / storage engine / data source.</li> + <li>[KYLIN-1245] - A better MR cubing algorithm, about 1.5 times faster by comparing hundreds of jobs.</li> + <li>[KYLIN-942] - A better storage engine, makes query roughly 2 times faster (especially for slow queries) by comparing tens of thousands sqls.</li> + <li>[KYLIN-738] - Streaming cubing EXPERIMENTAL support, source from kafka, build cube in-mem at minutes interval.</li> + <li>[KYLIN-242] - Redesign aggregation group, support of 20+ dimensions made easy.</li> + <li>[KYLIN-976] - Custom aggregation types (or UDF in other words).</li> + <li>[KYLIN-943] - TopN aggregation type.</li> + <li>[KYLIN-1065] - ODBC compatible with Tableau 9.1, MS Excel, MS PowerBI.</li> + <li>[KYLIN-1219] - Kylin support SSO with Spring SAML.</li> +</ul> + +<p><strong>New Feature</strong></p> + +<ul> + <li>[KYLIN-528] - Build job flow for Inverted Index building</li> + <li>[KYLIN-579] - Unload table from Kylin</li> + <li>[KYLIN-596] - Support Excel and Power BI</li> + <li>[KYLIN-599] - Near real-time support</li> + <li>[KYLIN-607] - More efficient cube building</li> + <li>[KYLIN-609] - Add Hybrid as a federation of Cube and Inverted-index realization</li> + <li>[KYLIN-625] - Create GridTable, a data structure that abstracts vertical and horizontal partition of a table</li> + <li>[KYLIN-728] - IGTStore implementation which use disk when memory runs short</li> + <li>[KYLIN-738] - StreamingOLAP</li> + <li>[KYLIN-749] - support timestamp type in II and cube</li> + <li>[KYLIN-774] - Automatically merge cube segments</li> + <li>[KYLIN-868] - add a metadata backup/restore script in bin folder</li> + <li>[KYLIN-886] - Data Retention for streaming data</li> + <li>[KYLIN-906] - cube retention</li> + <li>[KYLIN-943] - Approximate TopN supported by Cube</li> + <li>[KYLIN-986] - Generalize Streaming scripts and put them into code repository</li> + <li>[KYLIN-1219] - Kylin support SSO with Spring SAML</li> + <li>[KYLIN-1277] - Upgrade tool to put old-version cube and new-version cube into a hybrid model</li> + <li> + <p>[KYLIN-1458] - Checking the consistency of cube segment host with the environment after cube migration</p> + </li> + <li>[KYLIN-976] - Support Custom Aggregation Types</li> + <li>[KYLIN-1054] - Support Hive client Beeline</li> + <li>[KYLIN-1128] - Clone Cube Metadata</li> + <li>[KYLIN-1186] - Support precise Count Distinct using bitmap (under limited conditions)</li> + <li>[KYLIN-1458] - Checking the consistency of cube segment host with the environment after cube migration</li> + <li>[KYLIN-1483] - Command tool to visualize all cuboids in a cube/segment</li> +</ul> + +<p><strong>Improvement</strong></p> + +<ul> + <li>[KYLIN-225] - Support edit âcostâ of cube</li> + <li>[KYLIN-410] - table schema not expand when clicking the database text</li> + <li>[KYLIN-589] - Cleanup Intermediate hive table after cube build</li> + <li>[KYLIN-623] - update Kylin UI Style to latest AdminLTE</li> + <li>[KYLIN-633] - Support Timestamp for cube partition</li> + <li>[KYLIN-649] - move the cache layer from service tier back to storage tier</li> + <li>[KYLIN-655] - Migrate cube storage (query side) to use GridTable API</li> + <li>[KYLIN-663] - Push time condition down to ii endpoint</li> + <li>[KYLIN-668] - Out of memory in mapper when building cube in mem</li> + <li>[KYLIN-671] - Implement fine grained cache for cube and ii</li> + <li>[KYLIN-674] - IIEndpoint return metrics as well</li> + <li>[KYLIN-675] - cube&model designer refactor</li> + <li>[KYLIN-678] - optimize RowKeyColumnIO</li> + <li>[KYLIN-697] - Reorganize all test cases to unit test and integration tests</li> + <li>[KYLIN-702] - When Kylin create the flat hive table, it generates large number of small files in HDFS</li> + <li>[KYLIN-708] - replace BitSet for AggrKey</li> + <li>[KYLIN-712] - some enhancement after code review</li> + <li>[KYLIN-717] - optimize OLAPEnumerator.convertCurrentRow()</li> + <li>[KYLIN-718] - replace aliasMap in storage context with a clear specified return column list</li> + <li>[KYLIN-719] - bundle statistics info in endpoint response</li> + <li>[KYLIN-720] - Optimize endpointâs response structure to suit with no-dictionary data</li> + <li>[KYLIN-721] - streaming cli support third-party streammessage parser</li> + <li>[KYLIN-726] - add remote cli port configuration for KylinConfig</li> + <li>[KYLIN-729] - IIEndpoint eliminate the non-aggregate routine</li> + <li>[KYLIN-734] - Push cache layer to each storage engine</li> + <li>[KYLIN-752] - Improved IN clause performance</li> + <li>[KYLIN-753] - Make the dependency on hbase-common to âprovidedâ</li> + <li>[KYLIN-755] - extract copying libs from prepare.sh so that it can be reused</li> + <li>[KYLIN-760] - Improve the hasing performance in Sampling cuboid size</li> + <li>[KYLIN-772] - Continue cube job when hive query return empty resultset</li> + <li>[KYLIN-773] - performance is slow list jobs</li> + <li>[KYLIN-783] - update hdp version in test cases to 2.2.4</li> + <li>[KYLIN-796] - Add REST API to trigger storage cleanup/GC</li> + <li>[KYLIN-809] - Streaming cubing allow multiple kafka clusters/topics</li> + <li>[KYLIN-816] - Allow gap in cube segments, for streaming case</li> + <li>[KYLIN-822] - list cube overview in one page</li> + <li>[KYLIN-823] - replace fk on fact table on rowkey & aggregation group generate</li> + <li>[KYLIN-838] - improve performance of job query</li> + <li>[KYLIN-844] - add backdoor toggles to control query behavior</li> + <li>[KYLIN-845] - Enable coprocessor even when there is memory hungry distinct count</li> + <li>[KYLIN-858] - add snappy compression support</li> + <li>[KYLIN-866] - Confirm with user when he selects empty segments to merge</li> + <li>[KYLIN-869] - Enhance mail notification</li> + <li>[KYLIN-870] - Speed up hbase segments info by caching</li> + <li>[KYLIN-871] - growing dictionary for streaming case</li> + <li>[KYLIN-874] - script for fill streaming gap automatically</li> + <li>[KYLIN-875] - Decouple with Hadoop to allow alternative Input / Build Engine / Storage</li> + <li>[KYLIN-879] - add a tool to collect orphan hbases</li> + <li>[KYLIN-880] - Kylin should change the default folder from /tmp to user configurable destination</li> + <li>[KYLIN-881] - Upgrade Calcite to 1.3.0</li> + <li>[KYLIN-882] - check access to kylin.hdfs.working.dir</li> + <li>[KYLIN-883] - Using configurable option for Hive intermediate tables created by Kylin job</li> + <li>[KYLIN-893] - Remove the dependency on quartz and metrics</li> + <li>[KYLIN-895] - Add âretention_rangeâ attribute for cube instance, and automatically drop the oldest segment when exceeds retention</li> + <li>[KYLIN-896] - Clean ODBC code, add them into main repository and write docs to help compiling</li> + <li>[KYLIN-901] - Add tool for cleanup Kylin metadata storage</li> + <li>[KYLIN-902] - move streaming related parameters into StreamingConfig</li> + <li>[KYLIN-909] - Adapt GTStore to hbase endpoint</li> + <li>[KYLIN-919] - more friendly UI for 0.8</li> + <li>[KYLIN-922] - Enforce same code style for both intellij and eclipse user</li> + <li>[KYLIN-926] - Make sure Kylin leaves no garbage files in local OS and HDFS/HBASE</li> + <li>[KYLIN-927] - Real time cubes merging skipping gaps</li> + <li>[KYLIN-933] - friendly UI to use data model</li> + <li>[KYLIN-938] - add friendly tip to page when rest request failed</li> + <li>[KYLIN-942] - Cube parallel scan on Hbase</li> + <li>[KYLIN-956] - Allow users to configure hbase compression algorithm in kylin.properties</li> + <li>[KYLIN-957] - Support HBase in a separate cluster</li> + <li>[KYLIN-960] - Split storage module to core-storage and storage-hbase</li> + <li>[KYLIN-973] - add a tool to analyse streaming output logs</li> + <li>[KYLIN-984] - Behavior change in streaming data consuming</li> + <li>[KYLIN-987] - Rename 0.7-staging and 0.8 branch</li> + <li>[KYLIN-1014] - Support kerberos authentication while getting status from RM</li> + <li>[KYLIN-1018] - make TimedJsonStreamParser default parser</li> + <li>[KYLIN-1019] - Remove v1 cube model classes from code repository</li> + <li>[KYLIN-1021] - upload dependent jars of kylin to HDFS and set tmpjars</li> + <li>[KYLIN-1025] - Save cube change is very slow</li> + <li>[KYLIN-1036] - Code Clean, remove code which never used at front end</li> + <li>[KYLIN-1041] - ADD Streaming UI</li> + <li>[KYLIN-1048] - CPU and memory killer in Cuboid.findById()</li> + <li>[KYLIN-1058] - Remove âright joinâ during model creation</li> + <li>[KYLIN-1061] - âkylin.sh startâ should check whether kylin has already been running</li> + <li>[KYLIN-1064] - restore disabled queries in KylinQueryTest.testVerifyQuery</li> + <li>[KYLIN-1065] - ODBC driver support tableau 9.1</li> + <li>[KYLIN-1068] - Optimize the memory footprint for TopN counter</li> + <li>[KYLIN-1069] - update tip for âPartition Columnâ on UI</li> + <li>[KYLIN-1074] - Load hive tables with selecting mode</li> + <li>[KYLIN-1095] - Update AdminLTE to latest version</li> + <li>[KYLIN-1096] - Deprecate minicluster</li> + <li>[KYLIN-1099] - Support dictionary of cardinality over 10 millions</li> + <li>[KYLIN-1101] - Allow âYYYYMMDDâ as a date partition column</li> + <li>[KYLIN-1105] - Cache in AbstractRowKeyEncoder.createInstance() is useless</li> + <li>[KYLIN-1116] - Use local dictionary for InvertedIndex batch building</li> + <li>[KYLIN-1119] - refine find-hive-dependency.sh to correctly get hcatalog path</li> + <li>[KYLIN-1126] - v2 storage(for parallel scan) backward compatibility with v1 storage</li> + <li>[KYLIN-1135] - Pscan use share thread pool</li> + <li>[KYLIN-1136] - Distinguish fast build mode and complete build mode</li> + <li>[KYLIN-1139] - Hive job not starting due to error âconflicting lock present for default mode EXCLUSIVE â</li> + <li>[KYLIN-1149] - When yarn return an incomplete job tracking URL, Kylin will fail to get job status</li> + <li>[KYLIN-1154] - Load job page is very slow when there are a lot of history job</li> + <li>[KYLIN-1157] - CubeMigrationCLI doesnât copy ACL</li> + <li>[KYLIN-1160] - Set default logger appender of log4j for JDBC</li> + <li>[KYLIN-1161] - Rest API /api/cubes?cubeName= is doing fuzzy match instead of exact match</li> + <li>[KYLIN-1162] - Enhance HadoopStatusGetter to be compatible with YARN-2605</li> + <li>[KYLIN-1190] - Make memory budget per query configurable</li> + <li>[KYLIN-1211] - Add âEnable Cacheâ button in System page</li> + <li>[KYLIN-1234] - Cube ACL does not work</li> + <li>[KYLIN-1235] - allow user to select dimension column as options when edit COUNT_DISTINCT measure</li> + <li>[KYLIN-1237] - Revisit on cube size estimation</li> + <li>[KYLIN-1239] - attribute each htable with team contact and owner name</li> + <li>[KYLIN-1244] - In query window, enable fast copy&paste by double clicking tables/columnsâ names.</li> + <li>[KYLIN-1245] - Switch between layer cubing and in-mem cubing according to stats</li> + <li>[KYLIN-1246] - get cubes API update - offset,limit not required</li> + <li>[KYLIN-1251] - add toggle event for tree label</li> + <li>[KYLIN-1259] - Change font/background color of job progress</li> + <li>[KYLIN-1265] - Make sure 1.4-rc query is no slower than 1.0</li> + <li>[KYLIN-1266] - Tune release package size</li> + <li>[KYLIN-1267] - Check Kryo performance when spilling aggregation cache</li> + <li>[KYLIN-1268] - Fix 2 kylin logs</li> + <li>[KYLIN-1270] - improve TimedJsonStreamParser to support month_start,quarter_start,year_start</li> + <li>[KYLIN-1281] - Add âpartition_date_endâ, and move âpartition_date_startâ into cube descriptor</li> + <li>[KYLIN-1283] - Replace GTScanRequestâs SerDer form Kryo to manual</li> + <li>[KYLIN-1287] - UI update for streaming build action</li> + <li>[KYLIN-1297] - Diagnose query performance issues in 1.4 branch</li> + <li>[KYLIN-1301] - fix segment pruning failure</li> + <li>[KYLIN-1308] - query storage v2 enable parallel cube visiting</li> + <li>[KYLIN-1312] - Enhance DeployCoprocessorCLI to support Cube level filter</li> + <li>[KYLIN-1317] - Kill underlying running hadoop job while discard a job</li> + <li>[KYLIN-1318] - enable gc log for kylin server instance</li> + <li>[KYLIN-1323] - Improve performance of converting data to hfile</li> + <li>[KYLIN-1327] - Tool for batch updating host information of htables</li> + <li>[KYLIN-1333] - Kylin Entity Permission Control</li> + <li>[KYLIN-1334] - allow truncating string for fixed length dimensions</li> + <li>[KYLIN-1341] - Display JSON of Data Model in the dialog</li> + <li>[KYLIN-1350] - hbase Result.binarySearch is found to be problematic in concurrent environments</li> + <li>[KYLIN-1365] - Kylin ACL enhancement</li> + <li>[KYLIN-1368] - JDBC Driver is not generic to restAPI json result</li> + <li>[KYLIN-1424] - Should support multiple selection in picking up dimension/measure column step in data model wizard</li> + <li>[KYLIN-1438] - auto generate aggregation group</li> + <li>[KYLIN-1474] - expose list, remove and cat in metastore.sh</li> + <li> + <p>[KYLIN-1475] - Inject ehcache manager for any test case that will touch ehcache manager</p> + </li> + <li>[KYLIN-242] - Redesign aggregation group</li> + <li>[KYLIN-770] - optimize memory usage for GTSimpleMemStore GTAggregationScanner</li> + <li>[KYLIN-955] - HiveColumnCardinalityJob should use configurations in conf/kylin_job_conf.xml</li> + <li>[KYLIN-980] - FactDistinctColumnsJob to support high cardinality columns</li> + <li>[KYLIN-1079] - Manager large number of entries in metadata store</li> + <li>[KYLIN-1082] - Hive dependencies should be add to tmpjars</li> + <li>[KYLIN-1201] - Enhance project level ACL</li> + <li>[KYLIN-1222] - restore testing v1 query engine in case need it as a fallback for v2</li> + <li>[KYLIN-1232] - Refine ODBC Connection UI</li> + <li>[KYLIN-1237] - Revisit on cube size estimation</li> + <li>[KYLIN-1239] - attribute each htable with team contact and owner name</li> + <li>[KYLIN-1245] - Switch between layer cubing and in-mem cubing according to stats</li> + <li>[KYLIN-1265] - Make sure 1.4-rc query is no slower than 1.0</li> + <li>[KYLIN-1266] - Tune release package size</li> + <li>[KYLIN-1270] - improve TimedJsonStreamParser to support month_start,quarter_start,year_start</li> + <li>[KYLIN-1283] - Replace GTScanRequestâs SerDer form Kryo to manual</li> + <li>[KYLIN-1297] - Diagnose query performance issues in 1.4 branch</li> + <li>[KYLIN-1301] - fix segment pruning failure</li> + <li>[KYLIN-1308] - query storage v2 enable parallel cube visiting</li> + <li>[KYLIN-1318] - enable gc log for kylin server instance</li> + <li>[KYLIN-1327] - Tool for batch updating host information of htables</li> + <li>[KYLIN-1343] - Upgrade calcite version to 1.6</li> + <li>[KYLIN-1350] - hbase Result.binarySearch is found to be problematic in concurrent environments</li> + <li>[KYLIN-1366] - Bind metadata version with release version</li> + <li>[KYLIN-1389] - Formatting ODBC Drive C++ code</li> + <li>[KYLIN-1405] - Aggregation group validation</li> + <li>[KYLIN-1465] - Beautify kylin log to convenience both production trouble shooting and CI debuging</li> + <li>[KYLIN-1475] - Inject ehcache manager for any test case that will touch ehcache manager</li> +</ul> + +<p><strong>Bug</strong></p> + +<ul> + <li>[KYLIN-404] - Canât get cube source record size.</li> + <li>[KYLIN-457] - log4j error and dup lines in kylin.log</li> + <li>[KYLIN-521] - No verification even if join condition is invalid</li> + <li>[KYLIN-632] - âkylin.sh stopâ doesnât check whether KYLIN_HOME was set</li> + <li>[KYLIN-635] - IN clause within CASE when is not working</li> + <li>[KYLIN-656] - REST API get cube desc NullPointerException when cube is not exists</li> + <li>[KYLIN-660] - Make configurable of dictionary cardinality cap</li> + <li>[KYLIN-665] - buffer error while in mem cubing</li> + <li>[KYLIN-688] - possible memory leak for segmentIterator</li> + <li>[KYLIN-731] - Parallel stream build will throw OOM</li> + <li>[KYLIN-740] - Slowness with many IN() values</li> + <li>[KYLIN-747] - bad query performance when IN clause contains a value doesnât exist in the dictionary</li> + <li>[KYLIN-748] - II returned result not correct when decimal omits precision and scal</li> + <li>[KYLIN-751] - Max on negative double values is not working</li> + <li>[KYLIN-766] - round BigDecimal according to the DataType scale</li> + <li>[KYLIN-769] - empty segment build fail due to no dictionary</li> + <li>[KYLIN-771] - query cache is not evicted when metadata changes</li> + <li>[KYLIN-778] - canât build cube after package to binary</li> + <li>[KYLIN-780] - Upgrade Calcite to 1.0</li> + <li>[KYLIN-797] - Cuboid cache will cache massive invalid cuboid if existed many cubes which already be deleted</li> + <li>[KYLIN-801] - fix remaining issues on query cache and storage cache</li> + <li>[KYLIN-805] - Drop useless Hive intermediate table and HBase tables in the last step of cube build/merge</li> + <li>[KYLIN-807] - Avoid write conflict between job engine and stream cube builder</li> + <li>[KYLIN-817] - Support Extract() on timestamp column</li> + <li>[KYLIN-824] - Cube Build fails if lookup table doesnât have any files under HDFS location</li> + <li>[KYLIN-828] - kylin still use ldap profile when comment the line âkylin.sandbox=falseâ in kylin.properties</li> + <li>[KYLIN-834] - optimize StreamingUtil binary search perf</li> + <li>[KYLIN-837] - fix submit build type when refresh cube</li> + <li>[KYLIN-873] - cancel button does not work when [resume][discard] job</li> + <li>[KYLIN-889] - Support more than one HDFS files of lookup table</li> + <li>[KYLIN-897] - Update CubeMigrationCLI to copy data model info</li> + <li>[KYLIN-898] - âCUBOID_CACHEâ in Cuboid.java never flushes</li> + <li>[KYLIN-905] - Boolean type not supported</li> + <li>[KYLIN-911] - NEW segments not DELETED when cancel BuildAndMerge Job</li> + <li>[KYLIN-912] - $KYLIN_HOME/tomcat/temp folder takes much disk space after long run</li> + <li>[KYLIN-913] - Cannot find rowkey column XXX in cube CubeDesc</li> + <li>[KYLIN-914] - Scripts shebang should use /bin/bash</li> + <li>[KYLIN-918] - Calcite throws âjava.lang.Float cannot be cast to java.lang.Doubleâ error while executing SQL</li> + <li>[KYLIN-929] - can not sort cubes by [Source Records] at cubes list page</li> + <li>[KYLIN-930] - canât see realizations under each project at project list page</li> + <li>[KYLIN-934] - Negative number in SUM result and Kylin results not matching exactly Hive results</li> + <li>[KYLIN-935] - always loading when try to view the log of the sub-step of cube build job</li> + <li>[KYLIN-936] - can not see job step log</li> + <li>[KYLIN-944] - update doc about how to consume kylin API in javascript</li> + <li>[KYLIN-946] - [UI] refresh page show no results when Project selected as [âSelect Allâ]</li> + <li>[KYLIN-950] - Web UI âJobsâ tab view the job reduplicated</li> + <li>[KYLIN-951] - Drop RowBlock concept from GridTable general API</li> + <li>[KYLIN-952] - User can trigger a Refresh job on an non-existing cube segment via REST API</li> + <li>[KYLIN-967] - Dump running queries on memory shortage</li> + <li>[KYLIN-975] - change kylin.job.hive.database.for.intermediatetable cause job to fail</li> + <li>[KYLIN-978] - GarbageCollectionStep dropped Hive Intermediate Table but didnât drop external hdfs path</li> + <li>[KYLIN-982] - package.sh should grep out âDownload*â messages when determining version</li> + <li>[KYLIN-983] - Query sql offset keyword bug</li> + <li>[KYLIN-985] - Donât suppoprt aggregation AVG while executing SQL</li> + <li>[KYLIN-991] - StorageCleanupJob may clean a newly created HTable in streaming cube building</li> + <li>[KYLIN-992] - ConcurrentModificationException when initializing ResourceStore</li> + <li>[KYLIN-993] - implement substr support in kylin</li> + <li>[KYLIN-1001] - Kylin generates wrong HDFS path in creating intermediate table</li> + <li>[KYLIN-1004] - Dictionary with ââ value cause cube merge to fail</li> + <li>[KYLIN-1020] - Although âkylin.query.scan.thresholdâ is set, it still be restricted to less than 4 million</li> + <li>[KYLIN-1026] - Error message for git check is not correct in package.sh</li> + <li>[KYLIN-1027] - HBase Token not added after KYLIN-1007</li> + <li>[KYLIN-1033] - Error when joining two sub-queries</li> + <li>[KYLIN-1039] - Filter like (A or false) yields wrong result</li> + <li>[KYLIN-1047] - Upgrade to Calcite 1.4</li> + <li>[KYLIN-1066] - Only 1 reducer is started in the âBuild cubeâ step of MR_Engine_V2</li> + <li>[KYLIN-1067] - Support get MapReduce Job status for ResourceManager HA Env</li> + <li>[KYLIN-1075] - select [MeasureCol] from [FactTbl] is not supported</li> + <li>[KYLIN-1093] - Consolidate getCurrentHBaseConfiguration() and newHBaseConfiguration() in HadoopUtil</li> + <li>[KYLIN-1106] - Can not send email caused by Build Base Cuboid Data step failed</li> + <li>[KYLIN-1108] - Return Type Empty When Measure-> Count In Cube Design</li> + <li>[KYLIN-1113] - Support TopN query in v2/CubeStorageQuery.java</li> + <li>[KYLIN-1115] - Clean up ODBC driver code</li> + <li>[KYLIN-1121] - ResourceTool download/upload does not work in binary package</li> + <li>[KYLIN-1127] - Refactor CacheService</li> + <li>[KYLIN-1137] - TopN measure need support dictionary merge</li> + <li>[KYLIN-1138] - Bad CubeDesc signature cause segment be delete when enable a cube</li> + <li>[KYLIN-1140] - Kylinâs sample cube âkylin_sales_cubeâ couldnât be saved.</li> + <li>[KYLIN-1151] - Menu items should be aligned when create new model</li> + <li>[KYLIN-1152] - ResourceStore should read content and timestamp in one go</li> + <li>[KYLIN-1153] - Upgrade is needed for cubedesc metadata from 1.3 to 1.4</li> + <li>[KYLIN-1171] - KylinConfig truncate bug</li> + <li>[KYLIN-1179] - Cannot use String as partition column</li> + <li>[KYLIN-1180] - Some NPE in Dictionary</li> + <li>[KYLIN-1181] - Split metadata size exceeded when data got huge in one segment</li> + <li>[KYLIN-1182] - DataModelDesc needs to be updated from v1.x to v2.0</li> + <li>[KYLIN-1192] - Cannot edit data model desc without name change</li> + <li>[KYLIN-1205] - hbase RpcClient java.io.IOException: Unexpected closed connection</li> + <li>[KYLIN-1216] - Canât parse DateFormat like âYYYYMMDDâ correctly in query</li> + <li>[KYLIN-1218] - java.lang.NullPointerException in MeasureTypeFactory when sync hive table</li> + <li>[KYLIN-1220] - JsonMappingException: Can not deserialize instance of java.lang.String out of START_ARRAY</li> + <li>[KYLIN-1225] - Only 15 cubes listed in the /models page</li> + <li>[KYLIN-1226] - InMemCubeBuilder throw OOM for multiple HLLC measures</li> + <li>[KYLIN-1230] - When CubeMigrationCLI copied ACL from one env to another, it may not work</li> + <li>[KYLIN-1236] - redirect to home page when input invalid url</li> + <li>[KYLIN-1250] - Got NPE when discarding a job</li> + <li>[KYLIN-1260] - Job status labels are not in same style</li> + <li>[KYLIN-1269] - Can not get last error message in email</li> + <li>[KYLIN-1271] - Create streaming table layer will disappear if click on outside</li> + <li>[KYLIN-1274] - Query from JDBC is partial results by default</li> + <li>[KYLIN-1282] - Comparison filter on Date/Time column not work for query</li> + <li>[KYLIN-1289] - Click on subsequent wizard steps doesnât work when editing existing cube or model</li> + <li>[KYLIN-1303] - Error when in-mem cubing on empty data source which has boolean columns</li> + <li>[KYLIN-1306] - Null strings are not applied during fast cubing</li> + <li>[KYLIN-1314] - Display issue for aggression groups</li> + <li>[KYLIN-1315] - UI: Cannot add normal dimension when creating new cube</li> + <li>[KYLIN-1316] - Wrong label in Dialog CUBE REFRESH CONFIRM</li> + <li>[KYLIN-1328] - âUnsupportedOperationExceptionâ is thrown when remove a data model</li> + <li>[KYLIN-1330] - UI create model: Press enter will go back to pre step</li> + <li>[KYLIN-1336] - 404 errors of model page and api âaccess/DataModelDescâ in console</li> + <li>[KYLIN-1337] - Sort cube name doesnât work well</li> + <li>[KYLIN-1346] - IllegalStateException happens in SparkCubing</li> + <li>[KYLIN-1347] - UI: cannot place cursor in front of the last dimension</li> + <li>[KYLIN-1349] - âundefinedâ is logged in console when adding lookup table</li> + <li>[KYLIN-1352] - âCache already existsâ exception in high-concurrency query situation</li> + <li>[KYLIN-1356] - use exec-maven-plugin for IT environment provision</li> + <li>[KYLIN-1357] - Cloned cube has build time information</li> + <li>[KYLIN-1372] - Query using PrepareStatement failed with multi OR clause</li> + <li>[KYLIN-1382] - CubeMigrationCLI reports error when migrate cube</li> + <li>[KYLIN-1387] - Streaming cubing doesnât generate cuboids files on HDFS, cause cube merge failure</li> + <li>[KYLIN-1396] - minor bug in BigDecimalSerializer - avoidVerbose should be incremented each time when input scale is larger than given scale</li> + <li>[KYLIN-1400] - kylin.metadata.url with hbase namespace problem</li> + <li>[KYLIN-1402] - StringIndexOutOfBoundsException in Kylin Hive Column Cardinality Job</li> + <li>[KYLIN-1412] - Widget width of âPartition date columnâ is too small to select</li> + <li>[KYLIN-1413] - Row key columnâs sequence is wrong after saving the cube</li> + <li>[KYLIN-1414] - Couldnât drag and drop rowkey, js error is thrown in browser console</li> + <li>[KYLIN-1417] - TimedJsonStreamParser is case sensitive for messageâs property name</li> + <li>[KYLIN-1419] - NullPointerException occurs when query from subqueries with order by</li> + <li>[KYLIN-1420] - Query returns empty result on partition columnâs boundary condition</li> + <li>[KYLIN-1421] - Cube âsource recordâ is always zero for streaming</li> + <li>[KYLIN-1423] - HBase size precision issue</li> + <li>[KYLIN-1430] - Not add âSTREAMING_â prefix when import a streaming table</li> + <li>[KYLIN-1443] - For setting Auto Merge Time Ranges, before sending them to backend, the related time ranges should be sorted increasingly</li> + <li>[KYLIN-1456] - Shouldnât use â1970-01-01â as the default end date</li> + <li>[KYLIN-1471] - LIMIT after having clause should not be pushed down to storage context</li> + <li></li> + <li>[KYLIN-1104] - Long dimension value cause ArrayIndexOutOfBoundsException</li> + <li>[KYLIN-1331] - UI Delete Aggregation Groups: cursor disappeared after delete 1 dimension</li> + <li>[KYLIN-1344] - Bitmap measure defined after TopN measure can cause merge to fail</li> + <li>[KYLIN-1356] - use exec-maven-plugin for IT environment provision</li> + <li>[KYLIN-1386] - Duplicated projects appear in connection dialog after clicking CONNECT button multiple times</li> + <li>[KYLIN-1396] - minor bug in BigDecimalSerializer - avoidVerbose should be incremented each time when input scale is larger than given scale</li> + <li>[KYLIN-1419] - NullPointerException occurs when query from subqueries with order by</li> + <li>[KYLIN-1445] - Kylin should throw error if HIVE_CONF dir cannot be found</li> + <li>[KYLIN-1466] - Some environment variables are not used in bin/kylin.sh <runnable_class_name></runnable_class_name></li> + <li>[KYLIN-1469] - Hive dependency jars are hard coded in test</li> + <li>[KYLIN-1471] - LIMIT after having clause should not be pushed down to storage context</li> + <li>[KYLIN-1473] - Cannot have comments in the end of New Query textbox</li> +</ul> + +<p><strong>Task</strong></p> + +<ul> + <li>[KYLIN-529] - Migrate ODBC source code to Apache Git</li> + <li>[KYLIN-650] - Move all document from github wiki to code repository (using md file)</li> + <li>[KYLIN-762] - remove quartz dependency</li> + <li>[KYLIN-763] - remove author name</li> + <li>[KYLIN-820] - support streaming cube of exact timestamp range</li> + <li>[KYLIN-907] - Improve Kylin community development experience</li> + <li> + <p>[KYLIN-1112] - Reorganize InvertedIndex source codes into plug-in architecture</p> + </li> + <li>[KYLIN-808] - streaming cubing support split by data timestamp</li> + <li>[KYLIN-1427] - Enable partition date column to support date and hour as separate columns for increment cube build</li> +</ul> + +<p><strong>Test</strong></p> + +<ul> + <li>[KYLIN-677] - benchmark for Endpoint without dictionary</li> + <li>[KYLIN-826] - create new test case for streaming building & queries</li> +</ul> + +<h2 id="v130---2016-03-14">v1.3.0 - 2016-03-14</h2> +<p><em>Tag:</em> <a href="https://github.com/apache/kylin/tree/kylin-1.3.0";>kylin-1.3.0</a></p> <p><strong>New Feature</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-196] - Support Job Priority -* [KYLIN-528] - Build job flow for Inverted Index building -* [KYLIN-596] - Support Excel and Power BI -* [KYLIN-599] - Near real-time support -* [KYLIN-603] - Add mem store for seconds data latency -* [KYLIN-606] - Block level index for Inverted-Index -* [KYLIN-607] - More efficient cube building -* [KYLIN-609] - Add Hybrid as a federation of Cube and Inverted-index realization -* [KYLIN-625] - Create GridTable, a data structure that abstracts vertical and horizontal partition of a table -* [KYLIN-728] - IGTStore implementation which use disk when memory runs short -* [KYLIN-738] - StreamingOLAP -* [KYLIN-749] - support timestamp type in II and cube -* [KYLIN-774] - Automatically merge cube segments -* [KYLIN-868] - add a metadata backup/restore script in bin folder -* [KYLIN-886] - Data Retention for streaming data -* [KYLIN-906] - cube retention -* [KYLIN-943] - Approximate TopN supported by Cube -* [KYLIN-986] - Generalize Streaming scripts and put them into code repository -* [KYLIN-1219] - Kylin support SSO with Spring SAML -* [KYLIN-1277] - Upgrade tool to put old-version cube and new-version cube into a hybrid model -</code></pre> -</div> +<ul> + <li>[KYLIN-579] - Unload table from Kylin</li> + <li>[KYLIN-976] - Support Custom Aggregation Types</li> + <li>[KYLIN-1054] - Support Hive client Beeline</li> + <li>[KYLIN-1128] - Clone Cube Metadata</li> + <li>[KYLIN-1186] - Support precise Count Distinct using bitmap (under limited conditions)</li> +</ul> <p><strong>Improvement</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-225] - Support edit "cost" of cube -* [KYLIN-589] - Cleanup Intermediate hive table after cube build -* [KYLIN-623] - update Kylin UI Style to latest AdminLTE -* [KYLIN-633] - Support Timestamp for cube partition -* [KYLIN-649] - move the cache layer from service tier back to storage tier -* [KYLIN-655] - Migrate cube storage (query side) to use GridTable API -* [KYLIN-663] - Push time condition down to ii endpoint -* [KYLIN-668] - Out of memory in mapper when building cube in mem -* [KYLIN-671] - Implement fine grained cache for cube and ii -* [KYLIN-673] - Performance tuning for In-Mem cubing -* [KYLIN-674] - IIEndpoint return metrics as well -* [KYLIN-675] - cube&model designer refactor -* [KYLIN-678] - optimize RowKeyColumnIO -* [KYLIN-697] - Reorganize all test cases to unit test and integration tests -* [KYLIN-702] - When Kylin create the flat hive table, it generates large number of small files in HDFS -* [KYLIN-708] - replace BitSet for AggrKey -* [KYLIN-712] - some enhancement after code review -* [KYLIN-717] - optimize OLAPEnumerator.convertCurrentRow() -* [KYLIN-718] - replace aliasMap in storage context with a clear specified return column list -* [KYLIN-719] - bundle statistics info in endpoint response -* [KYLIN-720] - Optimize endpoint's response structure to suit with no-dictionary data -* [KYLIN-721] - streaming cli support third-party streammessage parser -* [KYLIN-726] - add remote cli port configuration for KylinConfig -* [KYLIN-729] - IIEndpoint eliminate the non-aggregate routine -* [KYLIN-734] - Push cache layer to each storage engine -* [KYLIN-752] - Improved IN clause performance -* [KYLIN-753] - Make the dependency on hbase-common to "provided" -* [KYLIN-755] - extract copying libs from prepare.sh so that it can be reused -* [KYLIN-760] - Improve the hasing performance in Sampling cuboid size -* [KYLIN-772] - Continue cube job when hive query return empty resultset -* [KYLIN-773] - performance is slow list jobs -* [KYLIN-783] - update hdp version in test cases to 2.2.4 -* [KYLIN-796] - Add REST API to trigger storage cleanup/GC -* [KYLIN-809] - Streaming cubing allow multiple kafka clusters/topics -* [KYLIN-816] - Allow gap in cube segments, for streaming case -* [KYLIN-822] - list cube overview in one page -* [KYLIN-823] - replace fk on fact table on rowkey & aggregation group generate -* [KYLIN-838] - improve performance of job query -* [KYLIN-844] - add backdoor toggles to control query behavior -* [KYLIN-845] - Enable coprocessor even when there is memory hungry distinct count -* [KYLIN-858] - add snappy compression support -* [KYLIN-866] - Confirm with user when he selects empty segments to merge -* [KYLIN-869] - Enhance mail notification -* [KYLIN-870] - Speed up hbase segments info by caching -* [KYLIN-871] - growing dictionary for streaming case -* [KYLIN-874] - script for fill streaming gap automatically -* [KYLIN-875] - Decouple with Hadoop to allow alternative Input / Build Engine / Storage -* [KYLIN-879] - add a tool to collect orphan hbases -* [KYLIN-880] - Kylin should change the default folder from /tmp to user configurable destination -* [KYLIN-881] - Upgrade Calcite to 1.3.0 -* [KYLIN-882] - check access to kylin.hdfs.working.dir -* [KYLIN-883] - Using configurable option for Hive intermediate tables created by Kylin job -* [KYLIN-893] - Remove the dependency on quartz and metrics -* [KYLIN-895] - Add "retention_range" attribute for cube instance, and automatically drop the oldest segment when exceeds retention -* [KYLIN-896] - Clean ODBC code, add them into main repository and write docs to help compiling -* [KYLIN-901] - Add tool for cleanup Kylin metadata storage -* [KYLIN-902] - move streaming related parameters into StreamingConfig -* [KYLIN-903] - automate metadata cleanup job -* [KYLIN-909] - Adapt GTStore to hbase endpoint -* [KYLIN-919] - more friendly UI for 0.8 -* [KYLIN-922] - Enforce same code style for both intellij and eclipse user -* [KYLIN-926] - Make sure Kylin leaves no garbage files in local OS and HDFS/HBASE -* [KYLIN-927] - Real time cubes merging skipping gaps -* [KYLIN-933] - friendly UI to use data model -* [KYLIN-938] - add friendly tip to page when rest request failed -* [KYLIN-942] - Cube parallel scan on Hbase -* [KYLIN-956] - Allow users to configure hbase compression algorithm in kylin.properties -* [KYLIN-957] - Support HBase in a separate cluster -* [KYLIN-960] - Split storage module to core-storage and storage-hbase -* [KYLIN-973] - add a tool to analyse streaming output logs -* [KYLIN-984] - Behavior change in streaming data consuming -* [KYLIN-987] - Rename 0.7-staging and 0.8 branch -* [KYLIN-1014] - Support kerberos authentication while getting status from RM -* [KYLIN-1018] - make TimedJsonStreamParser default parser -* [KYLIN-1019] - Remove v1 cube model classes from code repository -* [KYLIN-1021] - upload dependent jars of kylin to HDFS and set tmpjars -* [KYLIN-1025] - Save cube change is very slow -* [KYLIN-1036] - Code Clean, remove code which never used at front end -* [KYLIN-1041] - ADD Streaming UI -* [KYLIN-1048] - CPU and memory killer in Cuboid.findById() -* [KYLIN-1058] - Remove "right join" during model creation -* [KYLIN-1061] - "kylin.sh start" should check whether kylin has already been running -* [KYLIN-1064] - restore disabled queries in KylinQueryTest.testVerifyQuery -* [KYLIN-1065] - ODBC driver support tableau 9.1 -* [KYLIN-1068] - Optimize the memory footprint for TopN counter -* [KYLIN-1069] - update tip for 'Partition Column' on UI -* [KYLIN-1095] - Update AdminLTE to latest version -* [KYLIN-1096] - Deprecate minicluster in 2.x staging -* [KYLIN-1099] - Support dictionary of cardinality over 10 millions -* [KYLIN-1101] - Allow "YYYYMMDD" as a date partition column -* [KYLIN-1105] - Cache in AbstractRowKeyEncoder.createInstance() is useless -* [KYLIN-1116] - Use local dictionary for InvertedIndex batch building -* [KYLIN-1119] - refine find-hive-dependency.sh to correctly get hcatalog path -* [KYLIN-1126] - v2 storage(for parallel scan) backward compatibility with v1 storage -* [KYLIN-1135] - Pscan use share thread pool -* [KYLIN-1136] - Distinguish fast build mode and complete build mode -* [KYLIN-1139] - Hive job not starting due to error "conflicting lock present for default mode EXCLUSIVE " -* [KYLIN-1149] - When yarn return an incomplete job tracking URL, Kylin will fail to get job status -* [KYLIN-1154] - Load job page is very slow when there are a lot of history job -* [KYLIN-1157] - CubeMigrationCLI doesn't copy ACL -* [KYLIN-1160] - Set default logger appender of log4j for JDBC -* [KYLIN-1161] - Rest API /api/cubes?cubeName= is doing fuzzy match instead of exact match -* [KYLIN-1162] - Enhance HadoopStatusGetter to be compatible with YARN-2605 -* [KYLIN-1190] - Make memory budget per query configurable -* [KYLIN-1234] - Cube ACL does not work -* [KYLIN-1235] - allow user to select dimension column as options when edit COUNT_DISTINCT measure -* [KYLIN-1237] - Revisit on cube size estimation -* [KYLIN-1239] - attribute each htable with team contact and owner name -* [KYLIN-1244] - In query window, enable fast copy&paste by double clicking tables/columns' names. -* [KYLIN-1245] - Switch between layer cubing and in-mem cubing according to stats -* [KYLIN-1246] - get cubes API update - offset,limit not required -* [KYLIN-1251] - add toggle event for tree label -* [KYLIN-1259] - Change font/background color of job progress -* [KYLIN-1265] - Make sure 2.0 query is no slower than 1.0 -* [KYLIN-1266] - Tune 2.0 release package size -* [KYLIN-1267] - Check Kryo performance when spilling aggregation cache -* [KYLIN-1268] - Fix 2 kylin logs -* [KYLIN-1270] - improve TimedJsonStreamParser to support month_start,quarter_start,year_start -* [KYLIN-1281] - Add "partition_date_end", and move "partition_date_start" into cube descriptor -* [KYLIN-1283] - Replace GTScanRequest's SerDer form Kryo to manual -* [KYLIN-1287] - UI update for streaming build action -* [KYLIN-1297] - Diagnose query performance issues in 2.x versions -* [KYLIN-1301] - fix segment pruning failure in 2.x versions -* [KYLIN-1308] - query storage v2 enable parallel cube visiting -* [KYLIN-1312] - Enhance DeployCoprocessorCLI to support Cube level filter -* [KYLIN-1318] - enable gc log for kylin server instance -* [KYLIN-1323] - Improve performance of converting data to hfile -* [KYLIN-1327] - Tool for batch updating host information of htables -* [KYLIN-1334] - allow truncating string for fixed length dimensions -* [KYLIN-1341] - Display JSON of Data Model in the dialog -* [KYLIN-1350] - hbase Result.binarySearch is found to be problematic in concurrent environments -* [KYLIN-1368] - JDBC Driver is not generic to restAPI json result -</code></pre> -</div> +<ul> + <li>[KYLIN-955] - HiveColumnCardinalityJob should use configurations in conf/kylin_job_conf.xml</li> + <li>[KYLIN-1014] - Support kerberos authentication while getting status from RM</li> + <li>[KYLIN-1074] - Load hive tables with selecting mode</li> + <li>[KYLIN-1082] - Hive dependencies should be add to tmpjars</li> + <li>[KYLIN-1132] - make filtering input easier in creating cube</li> + <li>[KYLIN-1201] - Enhance project level ACL</li> + <li>[KYLIN-1211] - Add âEnable Cacheâ button in System page</li> + <li>[KYLIN-1234] - Cube ACL does not work</li> + <li>[KYLIN-1240] - Fix link and typo in README</li> + <li>[KYLIN-1244] - In query window, enable fast copy&paste by double clicking tables/columnsâ names.</li> + <li>[KYLIN-1246] - get cubes API update - offset,limit not required</li> + <li>[KYLIN-1251] - add toggle event for tree label</li> + <li>[KYLIN-1259] - Change font/background color of job progress</li> + <li>[KYLIN-1312] - Enhance DeployCoprocessorCLI to support Cube level filter</li> + <li>[KYLIN-1317] - Kill underlying running hadoop job while discard a job</li> + <li>[KYLIN-1323] - Improve performance of converting data to hfile</li> + <li>[KYLIN-1333] - Kylin Entity Permission Control</li> + <li>[KYLIN-1343] - Upgrade calcite version to 1.6</li> + <li>[KYLIN-1365] - Kylin ACL enhancement</li> + <li>[KYLIN-1368] - JDBC Driver is not generic to restAPI json result</li> +</ul> <p><strong>Bug</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-404] - Can't get cube source record size. -* [KYLIN-457] - log4j error and dup lines in kylin.log -* [KYLIN-521] - No verification even if join condition is invalid -* [KYLIN-632] - "kylin.sh stop" doesn't check whether KYLIN_HOME was set -* [KYLIN-635] - IN clause within CASE when is not working -* [KYLIN-656] - REST API get cube desc NullPointerException when cube is not exists -* [KYLIN-660] - Make configurable of dictionary cardinality cap -* [KYLIN-665] - buffer error while in mem cubing -* [KYLIN-688] - possible memory leak for segmentIterator -* [KYLIN-731] - Parallel stream build will throw OOM -* [KYLIN-740] - Slowness with many IN() values -* [KYLIN-747] - bad query performance when IN clause contains a value doesn't exist in the dictionary -* [KYLIN-748] - II returned result not correct when decimal omits precision and scal -* [KYLIN-751] - Max on negative double values is not working -* [KYLIN-766] - round BigDecimal according to the DataType scale -* [KYLIN-769] - empty segment build fail due to no dictionary -* [KYLIN-771] - query cache is not evicted when metadata changes -* [KYLIN-778] - can't build cube after package to binary -* [KYLIN-780] - Upgrade Calcite to 1.0 -* [KYLIN-797] - Cuboid cache will cache massive invalid cuboid if existed many cubes which already be deleted -* [KYLIN-801] - fix remaining issues on query cache and storage cache -* [KYLIN-805] - Drop useless Hive intermediate table and HBase tables in the last step of cube build/merge -* [KYLIN-807] - Avoid write conflict between job engine and stream cube builder -* [KYLIN-817] - Support Extract() on timestamp column -* [KYLIN-824] - Cube Build fails if lookup table doesn't have any files under HDFS location -* [KYLIN-828] - kylin still use ldap profile when comment the line "kylin.sandbox=false" in kylin.properties -* [KYLIN-834] - optimize StreamingUtil binary search perf -* [KYLIN-837] - fix submit build type when refresh cube -* [KYLIN-873] - cancel button does not work when [resume][discard] job -* [KYLIN-889] - Support more than one HDFS files of lookup table -* [KYLIN-897] - Update CubeMigrationCLI to copy data model info -* [KYLIN-898] - "CUBOID_CACHE" in Cuboid.java never flushes -* [KYLIN-905] - Boolean type not supported -* [KYLIN-911] - NEW segments not DELETED when cancel BuildAndMerge Job -* [KYLIN-912] - $KYLIN_HOME/tomcat/temp folder takes much disk space after long run -* [KYLIN-913] - Cannot find rowkey column XXX in cube CubeDesc -* [KYLIN-914] - Scripts shebang should use /bin/bash -* [KYLIN-918] - Calcite throws "java.lang.Float cannot be cast to java.lang.Double" error while executing SQL -* [KYLIN-929] - can not sort cubes by [Source Records] at cubes list page -* [KYLIN-930] - can't see realizations under each project at project list page -* [KYLIN-934] - Negative number in SUM result and Kylin results not matching exactly Hive results -* [KYLIN-935] - always loading when try to view the log of the sub-step of cube build job -* [KYLIN-936] - can not see job step log -* [KYLIN-944] - update doc about how to consume kylin API in javascript -* [KYLIN-946] - [UI] refresh page show no results when Project selected as [--Select All--] -* [KYLIN-950] - Web UI "Jobs" tab view the job reduplicated -* [KYLIN-951] - Drop RowBlock concept from GridTable general API -* [KYLIN-952] - User can trigger a Refresh job on an non-existing cube segment via REST API -* [KYLIN-967] - Dump running queries on memory shortage -* [KYLIN-975] - change kylin.job.hive.database.for.intermediatetable cause job to fail -* [KYLIN-978] - GarbageCollectionStep dropped Hive Intermediate Table but didn't drop external hdfs path -* [KYLIN-982] - package.sh should grep out "Download*" messages when determining version -* [KYLIN-983] - Query sql offset keyword bug -* [KYLIN-985] - Don't suppoprt aggregation AVG while executing SQL -* [KYLIN-991] - StorageCleanupJob may clean a newly created HTable in streaming cube building -* [KYLIN-992] - ConcurrentModificationException when initializing ResourceStore -* [KYLIN-1001] - Kylin generates wrong HDFS path in creating intermediate table -* [KYLIN-1004] - Dictionary with '' value cause cube merge to fail -* [KYLIN-1020] - Although "kylin.query.scan.threshold" is set, it still be restricted to less than 4 million -* [KYLIN-1026] - Error message for git check is not correct in package.sh -* [KYLIN-1027] - HBase Token not added after KYLIN-1007 -* [KYLIN-1033] - Error when joining two sub-queries -* [KYLIN-1039] - Filter like (A or false) yields wrong result -* [KYLIN-1047] - Upgrade to Calcite 1.4 -* [KYLIN-1066] - Only 1 reducer is started in the "Build cube" step of MR_Engine_V2 -* [KYLIN-1067] - Support get MapReduce Job status for ResourceManager HA Env -* [KYLIN-1075] - select [MeasureCol] from [FactTbl] is not supported -* [KYLIN-1078] - UI - Cannot have comments in the end of New Query textbox -* [KYLIN-1093] - Consolidate getCurrentHBaseConfiguration() and newHBaseConfiguration() in HadoopUtil -* [KYLIN-1106] - Can not send email caused by Build Base Cuboid Data step failed -* [KYLIN-1108] - Return Type Empty When Measure-> Count In Cube Design -* [KYLIN-1113] - Support TopN query in v2/CubeStorageQuery.java -* [KYLIN-1115] - Clean up ODBC driver code -* [KYLIN-1121] - ResourceTool download/upload does not work in binary package -* [KYLIN-1127] - Refactor CacheService -* [KYLIN-1137] - TopN measure need support dictionary merge -* [KYLIN-1138] - Bad CubeDesc signature cause segment be delete when enable a cube -* [KYLIN-1140] - Kylin's sample cube "kylin_sales_cube" couldn't be saved. -* [KYLIN-1151] - Menu items should be aligned when create new model -* [KYLIN-1152] - ResourceStore should read content and timestamp in one go -* [KYLIN-1153] - Upgrade is needed for cubedesc metadata from 1.x to 2.0 -* [KYLIN-1171] - KylinConfig truncate bug -* [KYLIN-1179] - Cannot use String as partition column -* [KYLIN-1180] - Some NPE in Dictionary -* [KYLIN-1181] - Split metadata size exceeded when data got huge in one segment -* [KYLIN-1192] - Cannot edit data model desc without name change -* [KYLIN-1205] - hbase RpcClient java.io.IOException: Unexpected closed connection -* [KYLIN-1211] - Add 'Enable Cache' button in System page -* [KYLIN-1216] - Can't parse DateFormat like 'YYYYMMDD' correctly in query -* [KYLIN-1218] - java.lang.NullPointerException in MeasureTypeFactory when sync hive table -* [KYLIN-1220] - JsonMappingException: Can not deserialize instance of java.lang.String out of START_ARRAY -* [KYLIN-1225] - Only 15 cubes listed in the /models page -* [KYLIN-1226] - InMemCubeBuilder throw OOM for multiple HLLC measures -* [KYLIN-1230] - When CubeMigrationCLI copied ACL from one env to another, it may not work -* [KYLIN-1236] - redirect to home page when input invalid url -* [KYLIN-1250] - Got NPE when discarding a job -* [KYLIN-1260] - Job status labels are not in same style -* [KYLIN-1269] - Can not get last error message in email -* [KYLIN-1271] - Create streaming table layer will disappear if click on outside -* [KYLIN-1274] - Query from JDBC is partial results by default -* [KYLIN-1282] - Comparison filter on Date/Time column not work for query -* [KYLIN-1289] - Click on subsequent wizard steps doesn't work when editing existing cube or model -* [KYLIN-1303] - Error when in-mem cubing on empty data source which has boolean columns -* [KYLIN-1306] - Null strings are not applied during fast cubing -* [KYLIN-1314] - Display issue for aggression groups -* [KYLIN-1315] - UI: Cannot add normal dimension when creating new cube -* [KYLIN-1316] - Wrong label in Dialog CUBE REFRESH CONFIRM -* [KYLIN-1317] - Kill underlying running hadoop job while discard a job -* [KYLIN-1328] - "UnsupportedOperationException" is thrown when remove a data model -* [KYLIN-1330] - UI create model: Press enter will go back to pre step -* [KYLIN-1336] - 404 errors of model page and api 'access/DataModelDesc' in console -* [KYLIN-1337] - Sort cube name doesn't work well -* [KYLIN-1346] - IllegalStateException happens in SparkCubing -* [KYLIN-1347] - UI: cannot place cursor in front of the last dimension -* [KYLIN-1349] - 'undefined' is logged in console when adding lookup table -* [KYLIN-1352] - 'Cache already exists' exception in high-concurrency query situation -* [KYLIN-1356] - use exec-maven-plugin for IT environment provision -* [KYLIN-1357] - Cloned cube has build time information -* [KYLIN-1372] - Query using PrepareStatement failed with multi OR clause -* [KYLIN-1382] - CubeMigrationCLI reports error when migrate cube -* [KYLIN-1396] - minor bug in BigDecimalSerializer - avoidVerbose should be incremented each time when input scale is larger than given scale -* [KYLIN-1400] - kylin.metadata.url with hbase namespace problem -* [KYLIN-1402] - StringIndexOutOfBoundsException in Kylin Hive Column Cardinality Job -* [KYLIN-1414] - Couldn't drag and drop rowkey, js error is thrown in browser console -</code></pre> -</div> +<ul> + <li>[KYLIN-918] - Calcite throws âjava.lang.Float cannot be cast to java.lang.Doubleâ error while executing SQL</li> + <li>[KYLIN-1075] - select [MeasureCol] from [FactTbl] is not supported</li> + <li>[KYLIN-1078] - Cannot have comments in the end of New Query textbox</li> + <li>[KYLIN-1104] - Long dimension value cause ArrayIndexOutOfBoundsException</li> + <li>[KYLIN-1110] - can not see project options after clear brower cookie and cache</li> + <li>[KYLIN-1159] - problem about kylin web UI</li> + <li>[KYLIN-1214] - Remove âBack to My Cubesâ link in non-edit mode</li> + <li>[KYLIN-1215] - minor, update website memberâs info on community page</li> + <li>[KYLIN-1230] - When CubeMigrationCLI copied ACL from one env to another, it may not work</li> + <li>[KYLIN-1236] - redirect to home page when input invalid url</li> + <li>[KYLIN-1250] - Got NPE when discarding a job</li> + <li>[KYLIN-1254] - cube model will be overridden while creating a new cube with the same name</li> + <li>[KYLIN-1260] - Job status labels are not in same style</li> + <li>[KYLIN-1274] - Query from JDBC is partial results by default</li> + <li>[KYLIN-1316] - Wrong label in Dialog CUBE REFRESH CONFIRM</li> + <li>[KYLIN-1330] - UI create model: Press enter will go back to pre step</li> + <li>[KYLIN-1331] - UI Delete Aggregation Groups: cursor disappeared after delete 1 dimension</li> + <li>[KYLIN-1342] - Typo in doc</li> + <li>[KYLIN-1354] - Couldnât edit a cube if it has no âpartition dateâ set</li> + <li>[KYLIN-1372] - Query using PrepareStatement failed with multi OR clause</li> + <li>[KYLIN-1396] - minor bug in BigDecimalSerializer - avoidVerbose should be incremented each time when input scale is larger than given scale</li> + <li>[KYLIN-1400] - kylin.metadata.url with hbase namespace problem</li> + <li>[KYLIN-1402] - StringIndexOutOfBoundsException in Kylin Hive Column Cardinality Job</li> + <li>[KYLIN-1412] - Widget width of âPartition date columnâ is too small to select</li> + <li>[KYLIN-1419] - NullPointerException occurs when query from subqueries with order by</li> + <li>[KYLIN-1423] - HBase size precision issue</li> + <li>[KYLIN-1443] - For setting Auto Merge Time Ranges, before sending them to backend, the related time ranges should be sorted increasingly</li> + <li>[KYLIN-1445] - Kylin should throw error if HIVE_CONF dir cannot be found</li> + <li>[KYLIN-1456] - Shouldnât use â1970-01-01â as the default end date</li> + <li>[KYLIN-1466] - Some environment variables are not used in bin/kylin.sh <runnable_class_name></runnable_class_name></li> + <li>[KYLIN-1469] - Hive dependency jars are hard coded in test</li> +</ul> + +<p><strong>Test</strong></p> + +<ul> + <li>[KYLIN-1335] - Disable PrintResult in KylinQueryTest</li> +</ul> <h2 id="v12---2015-12-15">v1.2 - 2015-12-15</h2> <p><em>Tag:</em> <a href="https://github.com/apache/kylin/tree/kylin-1.2";>kylin-1.2</a></p> <p><strong>New Feature</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-596] - Support Excel and Power BI -</code></pre> -</div> +<ul> + <li>[KYLIN-596] - Support Excel and Power BI</li> +</ul> <p><strong>Improvement</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-389] - Can't edit cube name for existing cubes -* [KYLIN-702] - When Kylin create the flat hive table, it generates large number of small files in HDFS -* [KYLIN-1021] - upload dependent jars of kylin to HDFS and set tmpjars -* [KYLIN-1058] - Remove "right join" during model creation -* [KYLIN-1064] - restore disabled queries in KylinQueryTest.testVerifyQuery -* [KYLIN-1065] - ODBC driver support tableau 9.1 -* [KYLIN-1069] - update tip for 'Partition Column' on UI -* [KYLIN-1081] - ./bin/find-hive-dependency.sh may not find hive-hcatalog-core.jar -* [KYLIN-1095] - Update AdminLTE to latest version -* [KYLIN-1099] - Support dictionary of cardinality over 10 millions -* [KYLIN-1101] - Allow "YYYYMMDD" as a date partition column -* [KYLIN-1105] - Cache in AbstractRowKeyEncoder.createInstance() is useless -* [KYLIN-1119] - refine find-hive-dependency.sh to correctly get hcatalog path -* [KYLIN-1139] - Hive job not starting due to error "conflicting lock present for default mode EXCLUSIVE " -* [KYLIN-1149] - When yarn return an incomplete job tracking URL, Kylin will fail to get job status -* [KYLIN-1154] - Load job page is very slow when there are a lot of history job -* [KYLIN-1157] - CubeMigrationCLI doesn't copy ACL -* [KYLIN-1160] - Set default logger appender of log4j for JDBC -* [KYLIN-1161] - Rest API /api/cubes?cubeName= is doing fuzzy match instead of exact match -* [KYLIN-1162] - Enhance HadoopStatusGetter to be compatible with YARN-2605 -* [KYLIN-1166] - CubeMigrationCLI should disable and purge the cube in source store after be migrated -* [KYLIN-1168] - Couldn't save cube after doing some modification, get "Update data model is not allowed! Please create a new cube if needed" error -* [KYLIN-1190] - Make memory budget per query configurable -</code></pre> -</div> +<ul> + <li>[KYLIN-389] - Canât edit cube name for existing cubes</li> + <li>[KYLIN-702] - When Kylin create the flat hive table, it generates large number of small files in HDFS</li> + <li>[KYLIN-1021] - upload dependent jars of kylin to HDFS and set tmpjars</li> + <li>[KYLIN-1058] - Remove âright joinâ during model creation</li> + <li>[KYLIN-1064] - restore disabled queries in KylinQueryTest.testVerifyQuery</li> + <li>[KYLIN-1065] - ODBC driver support tableau 9.1</li> + <li>[KYLIN-1069] - update tip for âPartition Columnâ on UI</li> + <li>[KYLIN-1081] - ./bin/find-hive-dependency.sh may not find hive-hcatalog-core.jar</li> + <li>[KYLIN-1095] - Update AdminLTE to latest version</li> + <li>[KYLIN-1099] - Support dictionary of cardinality over 10 millions</li> + <li>[KYLIN-1101] - Allow âYYYYMMDDâ as a date partition column</li> + <li>[KYLIN-1105] - Cache in AbstractRowKeyEncoder.createInstance() is useless</li> + <li>[KYLIN-1119] - refine find-hive-dependency.sh to correctly get hcatalog path</li> + <li>[KYLIN-1139] - Hive job not starting due to error âconflicting lock present for default mode EXCLUSIVE â</li> + <li>[KYLIN-1149] - When yarn return an incomplete job tracking URL, Kylin will fail to get job status</li> + <li>[KYLIN-1154] - Load job page is very slow when there are a lot of history job</li> + <li>[KYLIN-1157] - CubeMigrationCLI doesnât copy ACL</li> + <li>[KYLIN-1160] - Set default logger appender of log4j for JDBC</li> + <li>[KYLIN-1161] - Rest API /api/cubes?cubeName= is doing fuzzy match instead of exact match</li> + <li>[KYLIN-1162] - Enhance HadoopStatusGetter to be compatible with YARN-2605</li> + <li>[KYLIN-1166] - CubeMigrationCLI should disable and purge the cube in source store after be migrated</li> + <li>[KYLIN-1168] - Couldnât save cube after doing some modification, get âUpdate data model is not allowed! Please create a new cube if neededâ error</li> + <li>[KYLIN-1190] - Make memory budget per query configurable</li> +</ul> <p><strong>Bug</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-693] - Couldn't change a cube's name after it be created -* [KYLIN-930] - can't see realizations under each project at project list page -* [KYLIN-966] - When user creates a cube, if enter a name which already exists, Kylin will thrown expection on last step -* [KYLIN-1033] - Error when joining two sub-queries -* [KYLIN-1039] - Filter like (A or false) yields wrong result -* [KYLIN-1067] - Support get MapReduce Job status for ResourceManager HA Env -* [KYLIN-1070] - changing case in table name in model desc -* [KYLIN-1093] - Consolidate getCurrentHBaseConfiguration() and newHBaseConfiguration() in HadoopUtil -* [KYLIN-1098] - two "kylin.hbase.region.count.min" in conf/kylin.properties -* [KYLIN-1106] - Can not send email caused by Build Base Cuboid Data step failed -* [KYLIN-1108] - Return Type Empty When Measure-> Count In Cube Design -* [KYLIN-1120] - MapReduce job read local meta issue -* [KYLIN-1121] - ResourceTool download/upload does not work in binary package -* [KYLIN-1140] - Kylin's sample cube "kylin_sales_cube" couldn't be saved. -* [KYLIN-1148] - Edit project's name and cancel edit, project's name still modified -* [KYLIN-1152] - ResourceStore should read content and timestamp in one go -* [KYLIN-1155] - unit test with minicluster doesn't work on 1.x -* [KYLIN-1203] - Cannot save cube after correcting the configuration mistake -* [KYLIN-1205] - hbase RpcClient java.io.IOException: Unexpected closed connection -* [KYLIN-1216] - Can't parse DateFormat like 'YYYYMMDD' correctly in query -</code></pre> -</div> +<ul> + <li>[KYLIN-693] - Couldnât change a cubeâs name after it be created</li> + <li>[KYLIN-930] - canât see realizations under each project at project list page</li> + <li>[KYLIN-966] - When user creates a cube, if enter a name which already exists, Kylin will thrown expection on last step</li> + <li>[KYLIN-1033] - Error when joining two sub-queries</li> + <li>[KYLIN-1039] - Filter like (A or false) yields wrong result</li> + <li>[KYLIN-1067] - Support get MapReduce Job status for ResourceManager HA Env</li> + <li>[KYLIN-1070] - changing case in table name in model desc</li> + <li>[KYLIN-1093] - Consolidate getCurrentHBaseConfiguration() and newHBaseConfiguration() in HadoopUtil</li> + <li>[KYLIN-1098] - two âkylin.hbase.region.count.minâ in conf/kylin.properties</li> + <li>[KYLIN-1106] - Can not send email caused by Build Base Cuboid Data step failed</li> + <li>[KYLIN-1108] - Return Type Empty When Measure-> Count In Cube Design</li> + <li>[KYLIN-1120] - MapReduce job read local meta issue</li> + <li>[KYLIN-1121] - ResourceTool download/upload does not work in binary package</li> + <li>[KYLIN-1140] - Kylinâs sample cube âkylin_sales_cubeâ couldnât be saved.</li> + <li>[KYLIN-1148] - Edit projectâs name and cancel edit, projectâs name still modified</li> + <li>[KYLIN-1152] - ResourceStore should read content and timestamp in one go</li> + <li>[KYLIN-1155] - unit test with minicluster doesnât work on 1.x</li> + <li>[KYLIN-1203] - Cannot save cube after correcting the configuration mistake</li> + <li>[KYLIN-1205] - hbase RpcClient java.io.IOException: Unexpected closed connection</li> + <li>[KYLIN-1216] - Canât parse DateFormat like âYYYYMMDDâ correctly in query</li> +</ul> <p><strong>Task</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-1170] - Update website and status files to TLP -</code></pre> -</div> +<ul> + <li>[KYLIN-1170] - Update website and status files to TLP</li> +</ul> <h2 id="v111-incubating---2015-11-04">v1.1.1-incubating - 2015-11-04</h2> <p><em>Tag:</em> <a href="https://github.com/apache/kylin/tree/kylin-1.1.1-incubating";>kylin-1.1.1-incubating</a></p> <p><strong>Improvement</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-999] - License check and cleanup for release -</code></pre> -</div> +<ul> + <li>[KYLIN-999] - License check and cleanup for release</li> +</ul> <h2 id="v11-incubating---2015-10-25">v1.1-incubating - 2015-10-25</h2> <p><em>Tag:</em> <a href="https://github.com/apache/kylin/tree/kylin-1.1-incubating";>kylin-1.1-incubating</a></p> <p><strong>New Feature</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-222] - Web UI to Display CubeInstance Information -* [KYLIN-906] - cube retention -* [KYLIN-910] - Allow user to enter "retention range" in days on Cube UI -</code></pre> -</div> +<ul> + <li>[KYLIN-222] - Web UI to Display CubeInstance Information</li> + <li>[KYLIN-906] - cube retention</li> + <li>[KYLIN-910] - Allow user to enter âretention rangeâ in days on Cube UI</li> +</ul> <p><strong>Bug</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-457] - log4j error and dup lines in kylin.log -* [KYLIN-632] - "kylin.sh stop" doesn't check whether KYLIN_HOME was set -* [KYLIN-740] - Slowness with many IN() values -* [KYLIN-747] - bad query performance when IN clause contains a value doesn't exist in the dictionary -* [KYLIN-771] - query cache is not evicted when metadata changes -* [KYLIN-797] - Cuboid cache will cache massive invalid cuboid if existed many cubes which already be deleted -* [KYLIN-847] - "select * from fact" does not work on 0.7 branch -* [KYLIN-913] - Cannot find rowkey column XXX in cube CubeDesc -* [KYLIN-918] - Calcite throws "java.lang.Float cannot be cast to java.lang.Double" error while executing SQL -* [KYLIN-944] - update doc about how to consume kylin API in javascript -* [KYLIN-950] - Web UI "Jobs" tab view the job reduplicated -* [KYLIN-952] - User can trigger a Refresh job on an non-existing cube segment via REST API -* [KYLIN-958] - update cube data model may fail and leave metadata in inconsistent state -* [KYLIN-961] - Can't get cube source record count. -* [KYLIN-967] - Dump running queries on memory shortage -* [KYLIN-968] - CubeSegment.lastBuildJobID is null in new instance but used for rowkey_stats path -* [KYLIN-975] - change kylin.job.hive.database.for.intermediatetable cause job to fail -* [KYLIN-978] - GarbageCollectionStep dropped Hive Intermediate Table but didn't drop external hdfs path -* [KYLIN-982] - package.sh should grep out "Download*" messages when determining version -* [KYLIN-983] - Query sql offset keyword bug -* [KYLIN-985] - Don't suppoprt aggregation AVG while executing SQL -* [KYLIN-1001] - Kylin generates wrong HDFS path in creating intermediate table -* [KYLIN-1004] - Dictionary with '' value cause cube merge to fail -* [KYLIN-1005] - fail to acquire ZookeeperJobLock when hbase.zookeeper.property.clientPort is configured other than 2181 -* [KYLIN-1015] - Hive dependency jars appeared twice on job configuration -* [KYLIN-1020] - Although "kylin.query.scan.threshold" is set, it still be restricted to less than 4 million -* [KYLIN-1026] - Error message for git check is not correct in package.sh -</code></pre> -</div> +<ul> + <li>[KYLIN-457] - log4j error and dup lines in kylin.log</li> + <li>[KYLIN-632] - âkylin.sh stopâ doesnât check whether KYLIN_HOME was set</li> + <li>[KYLIN-740] - Slowness with many IN() values</li> + <li>[KYLIN-747] - bad query performance when IN clause contains a value doesnât exist in the dictionary</li> + <li>[KYLIN-771] - query cache is not evicted when metadata changes</li> + <li>[KYLIN-797] - Cuboid cache will cache massive invalid cuboid if existed many cubes which already be deleted</li> + <li>[KYLIN-847] - âselect * from factâ does not work on 0.7 branch</li> + <li>[KYLIN-913] - Cannot find rowkey column XXX in cube CubeDesc</li> + <li>[KYLIN-918] - Calcite throws âjava.lang.Float cannot be cast to java.lang.Doubleâ error while executing SQL</li> + <li>[KYLIN-944] - update doc about how to consume kylin API in javascript</li> + <li>[KYLIN-950] - Web UI âJobsâ tab view the job reduplicated</li> + <li>[KYLIN-952] - User can trigger a Refresh job on an non-existing cube segment via REST API</li> + <li>[KYLIN-958] - update cube data model may fail and leave metadata in inconsistent state</li> + <li>[KYLIN-961] - Canât get cube source record count.</li> + <li>[KYLIN-967] - Dump running queries on memory shortage</li> + <li>[KYLIN-968] - CubeSegment.lastBuildJobID is null in new instance but used for rowkey_stats path</li> + <li>[KYLIN-975] - change kylin.job.hive.database.for.intermediatetable cause job to fail</li> + <li>[KYLIN-978] - GarbageCollectionStep dropped Hive Intermediate Table but didnât drop external hdfs path</li> + <li>[KYLIN-982] - package.sh should grep out âDownload*â messages when determining version</li> + <li>[KYLIN-983] - Query sql offset keyword bug</li> + <li>[KYLIN-985] - Donât suppoprt aggregation AVG while executing SQL</li> + <li>[KYLIN-1001] - Kylin generates wrong HDFS path in creating intermediate table</li> + <li>[KYLIN-1004] - Dictionary with ââ value cause cube merge to fail</li> + <li>[KYLIN-1005] - fail to acquire ZookeeperJobLock when hbase.zookeeper.property.clientPort is configured other than 2181</li> + <li>[KYLIN-1015] - Hive dependency jars appeared twice on job configuration</li> + <li>[KYLIN-1020] - Although âkylin.query.scan.thresholdâ is set, it still be restricted to less than 4 million</li> + <li>[KYLIN-1026] - Error message for git check is not correct in package.sh</li> +</ul> <p><strong>Improvement</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-343] - Enable timeout on query -* [KYLIN-367] - automatically backup metadata everyday -* [KYLIN-589] - Cleanup Intermediate hive table after cube build -* [KYLIN-772] - Continue cube job when hive query return empty resultset -* [KYLIN-858] - add snappy compression support -* [KYLIN-882] - check access to kylin.hdfs.working.dir -* [KYLIN-895] - Add "retention_range" attribute for cube instance, and automatically drop the oldest segment when exceeds retention -* [KYLIN-901] - Add tool for cleanup Kylin metadata storage -* [KYLIN-956] - Allow users to configure hbase compression algorithm in kylin.properties -* [KYLIN-957] - Support HBase in a separate cluster -* [KYLIN-965] - Allow user to configure the region split size for cube -* [KYLIN-971] - kylin display timezone on UI -* [KYLIN-987] - Rename 0.7-staging and 0.8 branch -* [KYLIN-998] - Finish the hive intermediate table clean up job in org.apache.kylin.job.hadoop.cube.StorageCleanupJob -* [KYLIN-999] - License check and cleanup for release -* [KYLIN-1013] - Make hbase client configurations like timeout configurable -* [KYLIN-1025] - Save cube change is very slow -* [KYLIN-1034] - Faster bitmap indexes with Roaring bitmaps -* [KYLIN-1035] - Validate [Project] before create Cube on UI -* [KYLIN-1037] - Remove hardcoded "hdp.version" from regression tests -* [KYLIN-1047] - Upgrade to Calcite 1.4 -* [KYLIN-1048] - CPU and memory killer in Cuboid.findById() -* [KYLIN-1061] - "kylin.sh start" should check whether kylin has already been running -* [KYLIN-1048] - CPU and memory killer in Cuboid.findById() -* [KYLIN-1061] - "kylin.sh start" should check whether kylin has already been running -</code></pre> -</div> +<ul> + <li>[KYLIN-343] - Enable timeout on query</li> + <li>[KYLIN-367] - automatically backup metadata everyday</li> + <li>[KYLIN-589] - Cleanup Intermediate hive table after cube build</li> + <li>[KYLIN-772] - Continue cube job when hive query return empty resultset</li> + <li>[KYLIN-858] - add snappy compression support</li> + <li>[KYLIN-882] - check access to kylin.hdfs.working.dir</li> + <li>[KYLIN-895] - Add âretention_rangeâ attribute for cube instance, and automatically drop the oldest segment when exceeds retention</li> + <li>[KYLIN-901] - Add tool for cleanup Kylin metadata storage</li> + <li>[KYLIN-956] - Allow users to configure hbase compression algorithm in kylin.properties</li> + <li>[KYLIN-957] - Support HBase in a separate cluster</li> + <li>[KYLIN-965] - Allow user to configure the region split size for cube</li> + <li>[KYLIN-971] - kylin display timezone on UI</li> + <li>[KYLIN-987] - Rename 0.7-staging and 0.8 branch</li> + <li>[KYLIN-998] - Finish the hive intermediate table clean up job in org.apache.kylin.job.hadoop.cube.StorageCleanupJob</li> + <li>[KYLIN-999] - License check and cleanup for release</li> + <li>[KYLIN-1013] - Make hbase client configurations like timeout configurable</li> + <li>[KYLIN-1025] - Save cube change is very slow</li> + <li>[KYLIN-1034] - Faster bitmap indexes with Roaring bitmaps</li> + <li>[KYLIN-1035] - Validate [Project] before create Cube on UI</li> + <li>[KYLIN-1037] - Remove hardcoded âhdp.versionâ from regression tests</li> + <li>[KYLIN-1047] - Upgrade to Calcite 1.4</li> + <li>[KYLIN-1048] - CPU and memory killer in Cuboid.findById()</li> + <li>[KYLIN-1061] - âkylin.sh startâ should check whether kylin has already been running</li> + <li>[KYLIN-1048] - CPU and memory killer in Cuboid.findById()</li> + <li>[KYLIN-1061] - âkylin.sh startâ should check whether kylin has already been running</li> +</ul> <h2 id="v10-incubating---2015-09-06">v1.0-incubating - 2015-09-06</h2> <p><em>Tag:</em> <a href="https://github.com/apache/kylin/tree/kylin-1.0-incubating";>kylin-1.0-incubating</a></p> <p><strong>New Feature</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-591] - Leverage Zeppelin to interactive with Kylin -</code></pre> -</div> +<ul> + <li>[KYLIN-591] - Leverage Zeppelin to interactive with Kylin</li> +</ul> <p><strong>Bug</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-404] - Can't get cube source record size. -* [KYLIN-626] - JDBC error for float and double values -* [KYLIN-751] - Max on negative double values is not working -* [KYLIN-757] - Cache wasn't flushed in cluster mode -* [KYLIN-780] - Upgrade Calcite to 1.0 -* [KYLIN-805] - Drop useless Hive intermediate table and HBase tables in the last step of cube build/merge -* [KYLIN-889] - Support more than one HDFS files of lookup table -* [KYLIN-897] - Update CubeMigrationCLI to copy data model info -* [KYLIN-898] - "CUBOID_CACHE" in Cuboid.java never flushes -* [KYLIN-911] - NEW segments not DELETED when cancel BuildAndMerge Job -* [KYLIN-912] - $KYLIN_HOME/tomcat/temp folder takes much disk space after long run -* [KYLIN-914] - Scripts shebang should use /bin/bash -* [KYLIN-915] - appendDBName in CubeMetadataUpgrade will return null -* [KYLIN-921] - Dimension with all nulls cause BuildDimensionDictionary failed due to FileNotFoundException -* [KYLIN-923] - FetcherRunner will never run again if encountered exception during running -* [KYLIN-929] - can not sort cubes by [Source Records] at cubes list page -* [KYLIN-934] - Negative number in SUM result and Kylin results not matching exactly Hive results -* [KYLIN-935] - always loading when try to view the log of the sub-step of cube build job -* [KYLIN-936] - can not see job step log -* [KYLIN-940] - NPE when close the null resouce -* [KYLIN-945] - Kylin JDBC - Get Connection from DataSource results in NullPointerException -* [KYLIN-946] - [UI] refresh page show no results when Project selected as [--Select All--] -* [KYLIN-949] - Query cache doesn't work properly for prepareStatement queries -</code></pre> -</div> +<ul> + <li>[KYLIN-404] - Canât get cube source record size.</li> + <li>[KYLIN-626] - JDBC error for float and double values</li> + <li>[KYLIN-751] - Max on negative double values is not working</li> + <li>[KYLIN-757] - Cache wasnât flushed in cluster mode</li> + <li>[KYLIN-780] - Upgrade Calcite to 1.0</li> + <li>[KYLIN-805] - Drop useless Hive intermediate table and HBase tables in the last step of cube build/merge</li> + <li>[KYLIN-889] - Support more than one HDFS files of lookup table</li> + <li>[KYLIN-897] - Update CubeMigrationCLI to copy data model info</li> + <li>[KYLIN-898] - âCUBOID_CACHEâ in Cuboid.java never flushes</li> + <li>[KYLIN-911] - NEW segments not DELETED when cancel BuildAndMerge Job</li> + <li>[KYLIN-912] - $KYLIN_HOME/tomcat/temp folder takes much disk space after long run</li> + <li>[KYLIN-914] - Scripts shebang should use /bin/bash</li> + <li>[KYLIN-915] - appendDBName in CubeMetadataUpgrade will return null</li> + <li>[KYLIN-921] - Dimension with all nulls cause BuildDimensionDictionary failed due to FileNotFoundException</li> + <li>[KYLIN-923] - FetcherRunner will never run again if encountered exception during running</li> + <li>[KYLIN-929] - can not sort cubes by [Source Records] at cubes list page</li> + <li>[KYLIN-934] - Negative number in SUM result and Kylin results not matching exactly Hive results</li> + <li>[KYLIN-935] - always loading when try to view the log of the sub-step of cube build job</li> + <li>[KYLIN-936] - can not see job step log</li> + <li>[KYLIN-940] - NPE when close the null resouce</li> + <li>[KYLIN-945] - Kylin JDBC - Get Connection from DataSource results in NullPointerException</li> + <li>[KYLIN-946] - [UI] refresh page show no results when Project selected as [âSelect Allâ]</li> + <li>[KYLIN-949] - Query cache doesnât work properly for prepareStatement queries</li> +</ul> <p><strong>Improvement</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-568] - job support stop/suspend function so that users can manually resume a job -* [KYLIN-717] - optimize OLAPEnumerator.convertCurrentRow() -* [KYLIN-792] - kylin performance insight [dashboard] -* [KYLIN-838] - improve performance of job query -* [KYLIN-842] - Add version and commit id into binary package -* [KYLIN-844] - add backdoor toggles to control query behavior -* [KYLIN-857] - backport coprocessor improvement in 0.8 to 0.7 -* [KYLIN-866] - Confirm with user when he selects empty segments to merge -* [KYLIN-867] - Hybrid model for multiple realizations/cubes -* [KYLIN-880] - Kylin should change the default folder from /tmp to user configurable destination -* [KYLIN-881] - Upgrade Calcite to 1.3.0 -* [KYLIN-883] - Using configurable option for Hive intermediate tables created by Kylin job -* [KYLIN-893] - Remove the dependency on quartz and metrics -* [KYLIN-922] - Enforce same code style for both intellij and eclipse user -* [KYLIN-926] - Make sure Kylin leaves no garbage files in local OS and HDFS/HBASE -* [KYLIN-933] - friendly UI to use data model -* [KYLIN-938] - add friendly tip to page when rest request failed -</code></pre> -</div> +<ul> + <li>[KYLIN-568] - job support stop/suspend function so that users can manually resume a job</li> + <li>[KYLIN-717] - optimize OLAPEnumerator.convertCurrentRow()</li> + <li>[KYLIN-792] - kylin performance insight [dashboard]</li> + <li>[KYLIN-838] - improve performance of job query</li> + <li>[KYLIN-842] - Add version and commit id into binary package</li> + <li>[KYLIN-844] - add backdoor toggles to control query behavior</li> + <li>[KYLIN-857] - backport coprocessor improvement in 0.8 to 0.7</li> + <li>[KYLIN-866] - Confirm with user when he selects empty segments to merge</li> + <li>[KYLIN-867] - Hybrid model for multiple realizations/cubes</li> + <li>[KYLIN-880] - Kylin should change the default folder from /tmp to user configurable destination</li> + <li>[KYLIN-881] - Upgrade Calcite to 1.3.0</li> + <li>[KYLIN-883] - Using configurable option for Hive intermediate tables created by Kylin job</li> + <li>[KYLIN-893] - Remove the dependency on quartz and metrics</li> + <li>[KYLIN-922] - Enforce same code style for both intellij and eclipse user</li> + <li>[KYLIN-926] - Make sure Kylin leaves no garbage files in local OS and HDFS/HBASE</li> + <li>[KYLIN-933] - friendly UI to use data model</li> + <li>[KYLIN-938] - add friendly tip to page when rest request failed</li> +</ul> <p><strong>Task</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-884] - Restructure docs and website -* [KYLIN-907] - Improve Kylin community development experience -* [KYLIN-954] - Release v1.0 (formerly v0.7.3) -* [KYLIN-863] - create empty segment when there is no data in one single streaming batch -* [KYLIN-908] - Help community developer to setup develop/debug environment -* [KYLIN-931] - Port KYLIN-921 to 0.8 branch -</code></pre> -</div> +<ul> + <li>[KYLIN-884] - Restructure docs and website</li> + <li>[KYLIN-907] - Improve Kylin community development experience</li> + <li>[KYLIN-954] - Release v1.0 (formerly v0.7.3)</li> + <li>[KYLIN-863] - create empty segment when there is no data in one single streaming batch</li> + <li>[KYLIN-908] - Help community developer to setup develop/debug environment</li> + <li>[KYLIN-931] - Port KYLIN-921 to 0.8 branch</li> +</ul> <h2 id="v072-incubating---2015-07-21">v0.7.2-incubating - 2015-07-21</h2> <p><em>Tag:</em> <a href="https://github.com/apache/kylin/tree/kylin-0.7.2-incubating";>kylin-0.7.2-incubating</a></p> @@ -2201,61 +2374,61 @@ Critical bug fixes after v0.7.1 release, <p><strong>Bug</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-514] - Error message is not helpful to user when doing something in Jason Editor window -* [KYLIN-598] - Kylin detecting hive table delim failure -* [KYLIN-660] - Make configurable of dictionary cardinality cap -* [KYLIN-765] - When a cube job is failed, still be possible to submit a new job -* [KYLIN-814] - Duplicate columns error for subqueries on fact table -* [KYLIN-819] - Fix necessary ColumnMetaData order for Calcite (Optic) -* [KYLIN-824] - Cube Build fails if lookup table doesn't have any files under HDFS location -* [KYLIN-829] - Cube "Actions" shows "NA"; but after expand the "access" tab, the button shows up -* [KYLIN-830] - Cube merge failed after migrating from v0.6 to v0.7 -* [KYLIN-831] - Kylin report "Column 'ABC' not found in table 'TABLE' while executing SQL", when that column is FK but not define as a dimension -* [KYLIN-840] - HBase table compress not enabled even LZO is installed -* [KYLIN-848] - Couldn't resume or discard a cube job -* [KYLIN-849] - Couldn't query metrics on lookup table PK -* [KYLIN-865] - Cube has been built but couldn't query; In log it said "Realization 'CUBE.CUBE_NAME' defined under project PROJECT_NAME is not found -* [KYLIN-873] - cancel button does not work when [resume][discard] job -* [KYLIN-888] - "Jobs" page only shows 15 job at max, the "Load more" button was disappeared -</code></pre> -</div> +<ul> + <li>[KYLIN-514] - Error message is not helpful to user when doing something in Jason Editor window</li> + <li>[KYLIN-598] - Kylin detecting hive table delim failure</li> + <li>[KYLIN-660] - Make configurable of dictionary cardinality cap</li> + <li>[KYLIN-765] - When a cube job is failed, still be possible to submit a new job</li> + <li>[KYLIN-814] - Duplicate columns error for subqueries on fact table</li> + <li>[KYLIN-819] - Fix necessary ColumnMetaData order for Calcite (Optic)</li> + <li>[KYLIN-824] - Cube Build fails if lookup table doesnât have any files under HDFS location</li> + <li>[KYLIN-829] - Cube âActionsâ shows âNAâ; but after expand the âaccessâ tab, the button shows up</li> + <li>[KYLIN-830] - Cube merge failed after migrating from v0.6 to v0.7</li> + <li>[KYLIN-831] - Kylin report âColumn âABCâ not found in table âTABLEâ while executing SQLâ, when that column is FK but not define as a dimension</li> + <li>[KYLIN-840] - HBase table compress not enabled even LZO is installed</li> + <li>[KYLIN-848] - Couldnât resume or discard a cube job</li> + <li>[KYLIN-849] - Couldnât query metrics on lookup table PK</li> + <li>[KYLIN-865] - Cube has been built but couldnât query; In log it said âRealization âCUBE.CUBE_NAMEâ defined under project PROJECT_NAME is not found</li> + <li>[KYLIN-873] - cancel button does not work when [resume][discard] job</li> + <li>[KYLIN-888] - âJobsâ page only shows 15 job at max, the âLoad moreâ button was disappeared</li> +</ul> <p><strong>Improvement</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-159] - Metadata migrate tool -* [KYLIN-199] - Validation Rule: Unique value of Lookup table's key columns -* [KYLIN-207] - Support SQL pagination -* [KYLIN-209] - Merge tail small MR jobs into one -* [KYLIN-210] - Split heavy MR job to more small jobs -* [KYLIN-221] - Convert cleanup and GC to job -* [KYLIN-284] - add log for all Rest API Request -* [KYLIN-488] - Increase HDFS block size 1GB -* [KYLIN-600] - measure return type update -* [KYLIN-611] - Allow Implicit Joins -* [KYLIN-623] - update Kylin UI Style to latest AdminLTE -* [KYLIN-727] - Cube build in BuildCubeWithEngine does not cover incremental build/cube merge -* [KYLIN-752] - Improved IN clause performance -* [KYLIN-773] - performance is slow list jobs -* [KYLIN-839] - Optimize Snapshot table memory usage -</code></pre> -</div> +<ul> + <li>[KYLIN-159] - Metadata migrate tool</li> + <li>[KYLIN-199] - Validation Rule: Unique value of Lookup tableâs key columns</li> + <li>[KYLIN-207] - Support SQL pagination</li> + <li>[KYLIN-209] - Merge tail small MR jobs into one</li> + <li>[KYLIN-210] - Split heavy MR job to more small jobs</li> + <li>[KYLIN-221] - Convert cleanup and GC to job</li> + <li>[KYLIN-284] - add log for all Rest API Request</li> + <li>[KYLIN-488] - Increase HDFS block size 1GB</li> + <li>[KYLIN-600] - measure return type update</li> + <li>[KYLIN-611] - Allow Implicit Joins</li> + <li>[KYLIN-623] - update Kylin UI Style to latest AdminLTE</li> + <li>[KYLIN-727] - Cube build in BuildCubeWithEngine does not cover incremental build/cube merge</li> + <li>[KYLIN-752] - Improved IN clause performance</li> + <li>[KYLIN-773] - performance is slow list jobs</li> + <li>[KYLIN-839] - Optimize Snapshot table memory usage</li> +</ul> <p><strong>New Feature</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-211] - Bitmap Inverted Index -* [KYLIN-285] - Enhance alert program for whole system -* [KYLIN-467] - Validataion Rule: Check duplicate rows in lookup table -* [KYLIN-471] - Support "Copy" on grid result -</code></pre> -</div> +<ul> + <li>[KYLIN-211] - Bitmap Inverted Index</li> + <li>[KYLIN-285] - Enhance alert program for whole system</li> + <li>[KYLIN-467] - Validataion Rule: Check duplicate rows in lookup table</li> + <li>[KYLIN-471] - Support âCopyâ on grid result</li> +</ul> <p><strong>Task</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-7] - Enable maven checkstyle plugin -* [KYLIN-885] - Release v0.7.2 -* [KYLIN-812] - Upgrade to Calcite 0.9.2 -</code></pre> -</div> +<ul> + <li>[KYLIN-7] - Enable maven checkstyle plugin</li> + <li>[KYLIN-885] - Release v0.7.2</li> + <li>[KYLIN-812] - Upgrade to Calcite 0.9.2</li> +</ul> <h2 id="v071-incubating-first-apache-release---2015-06-10">v0.7.1-incubating (First Apache Release) - 2015-06-10</h2> <p><em>Tag:</em> <a href="https://github.com/apache/kylin/tree/kylin-0.7.1-incubating";>kylin-0.7.1-incubating</a></p> @@ -2276,130 +2449,130 @@ Critical bug fixes after v0.7.1 release, <p><strong>New Feature</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-327] - Binary distribution -* [KYLIN-368] - Move MailService to Common module -* [KYLIN-540] - Data model upgrade for legacy cube descs -* [KYLIN-576] - Refactor expansion rate expression -</code></pre> -</div> +<ul> + <li>[KYLIN-327] - Binary distribution</li> + <li>[KYLIN-368] - Move MailService to Common module</li> + <li>[KYLIN-540] - Data model upgrade for legacy cube descs</li> + <li>[KYLIN-576] - Refactor expansion rate expression</li> +</ul> <p><strong>Task</strong></p> -<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-361] - Rename package name with Apache Kylin -* [KYLIN-531] - Rename package name to org.apache.kylin -* [KYLIN-533] - Job Engine Refactoring -* [KYLIN-585] - Simplify deployment -* [KYLIN-586] - Add Apache License header in each source file -* [KYLIN-587] - Remove hard copy of javascript libraries -* [KYLIN-624] - Add dimension and metric info into DataModel
[... 218 lines stripped ...]
