Author: lidong
Date: Sat Dec 3 13:16:28 2016
New Revision: 1772467
URL: http://svn.apache.org/viewvc?rev=1772467&view=rev
Log:
add 160 release ntoes
Added:
kylin/site/blog/2016/12/
kylin/site/blog/2016/12/04/
kylin/site/blog/2016/12/04/release-v1.6.0/
kylin/site/blog/2016/12/04/release-v1.6.0/index.html
kylin/site/cn/blog/2016/12/
kylin/site/cn/blog/2016/12/04/
kylin/site/cn/blog/2016/12/04/release-v1.6.0/
kylin/site/cn/blog/2016/12/04/release-v1.6.0/index.html
Modified:
kylin/site/blog/index.html
kylin/site/feed.xml
Added: kylin/site/blog/2016/12/04/release-v1.6.0/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/blog/2016/12/04/release-v1.6.0/index.html?rev=1772467&view=auto
==============================================================================
--- kylin/site/blog/2016/12/04/release-v1.6.0/index.html (added)
+++ kylin/site/blog/2016/12/04/release-v1.6.0/index.html Sat Dec 3 13:16:28
2016
@@ -0,0 +1,287 @@
+<!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+<!doctype html>
+<html>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<head>
+ <meta charset="utf-8">
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta name="viewport" content="width=device-width, initial-scale=1">
+
+ <title>Apache Kylin | Apache Kylin v1.6.0 Release Announcement</title>
+ <meta name="description" content="The Apache Kylin community is pleased to
announce the release of Apache Kylin v1.6.0.">
+ <meta name="author" content="Apache Kylin">
+ <link rel="shortcut icon" href="fav.png" type="image/png">
+
+
+
+<link rel="stylesheet" href="/assets/css/animate.css">
+<!-- Bootstrap -->
+<link rel="stylesheet" href="/assets/css/bootstrap.min.css">
+
+<!-- Fonts -->
+<!-- <link rel="stylesheet"
href="http://fonts.googleapis.com/css?family=Alice|Open+Sans:400,300,700"> -->
+
+<!-- Icons -->
+<link rel="stylesheet" href="/assets/css/font-awesome.min.css">
+
+ <!-- Custom styles -->
+ <link rel="stylesheet" href="/assets/css/styles.css">
+ <link rel="stylesheet" href="/assets/css/docs.css">
+ <link rel="stylesheet" href="/assets/css/pygments.css">
+
+ <link rel="canonical"
href="http://kylin.apache.org/blog/2016/12/04/release-v1.6.0/";>
+ <link rel="alternate" type="application/rss+xml" title="Apache Kylin"
href="http://kylin.apache.org/feed.xml"; />
+
+<!--[if lt IE 9]> <script src="assets/js/html5shiv.js"></script> <![endif]-->
+<script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new
Date();a=s.createElement(o),
+
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+
+ //oringal tracker for kylin.io
+ ga('create', 'UA-55534813-1', 'auto');
+ //new tracker for kylin.apache.org
+ ga('create', 'UA-55534813-2', 'auto', {'name':'toplevel'});
+
+ ga('send', 'pageview');
+ ga('toplevel.send', 'pageview');
+
+
+</script>
+<script type="text/javascript" src="/assets/js/jquery-1.9.1.min.js"></script>
+<script type="text/javascript" src="/assets/js/nside.js"></script> </script>
+<script type="text/javascript" src="/assets/js/nnav.js"></script> </script>
+</head>
+
+ <body>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<header id="header" >
+
+ <div id="head" class="parallax" parallax-speed="3" >
+ <div id="logo" class="text-center"> <img class="img-circle"
id="circlelogo" src="/assets/images/kylin_logo.jpg"> <span class="title"
>Apache Kylinâ¢</span> <span class="tagline">Extreme OLAP Engine for Big
Data</span>
+ </div>
+ </div>
+
+
+ <!-- Main Menu -->
+ <nav class="navbar navbar-default" role="navigation" id="nav-wrapper">
+ <div class="container-fluid" id="nav">
+ <!--
+ <img class="img-circle" width="40px" height="40px" id="circlelogo"
src="/assets/images/kylin_logo.jpg">
+ -->
+ <!-- Brand and toggle get grouped for better mobile display -->
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle collapsed"
data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
+ <span class="sr-only">Toggle navigation</span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+
+ </div>
+
+ <!-- Collect the nav links, forms, and other content for toggling -->
+ <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
+ <ul class="nav navbar-nav">
+ <li><a href="/">Home</a></li>
+ <li><a href="/docs16" >Docs</a></li>
+ <li><a href="/download">Download</li>
+ <li><a href="/community" >Community</a></li>
+ <li><a href="/development" >Development</a></li>
+ <li><a href="/blog">Blog</li>
+ <li><a href="/cn" >ä¸æç</a></li>
+ <li><a href="https://twitter.com/apachekylin"; target="_blank"
class="fa fa-twitter fa-lg" title="Twitter: @ApacheKylin" ></a></li>
+ <li><a href="https://github.com/apache/kylin"; target="_blank"
class="fa fa-github-alt fa-lg" title="Github: apache/kylin" ></a></li>
+ <li><a href="https://www.facebook.com/kylinio"; target="_blank"
class="fa fa-facebook fa-lg" title="Facebook: kylin.io" ></a></li>
+ </ul>
+ </div><!-- /.navbar-collapse -->
+ </div><!-- /.container-fluid -->
+</nav>
+ </header>
+
+ <div class="page-content">
+ <header style=" padding:2em 0 0 0">
+ <div class="container" >
+ <h4 class="section-title"><span>Apache Kylinâ¢
Technical Blog</span></h4>
+ </div>
+ </div>
+
+ <div class="container">
+ <div>
+ <article class="post-content" >
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<div class="post" style=" padding:2em 4em 4em 4em">
+
+ <header class="post-header">
+ <h1 class="post-title">Apache Kylin v1.6.0 Release Announcement</h1>
+ <p class="post-meta" >Dec 4, 2016 ⢠Shaofeng Shi</p>
+ </header>
+
+ <article class="post-content" >
+ <p>The Apache Kylin community is pleased to announce the release of Apache
Kylin v1.6.0.</p>
+
+<p>Apache Kylin is an open source Distributed Analytics Engine designed to
provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop
supporting extremely large datasets.</p>
+
+<p>This is a major release after 1.5.4, with the reliable and scalable support
for using Apache Kafka as data source; this enables user to build cubes
directly from streaming data (without loading to Apache Hive), reducing the
data latency from days/hours to minutes.</p>
+
+<p>Apache Kylin 1.6.0 resolved 102 issues including bug fixes, improvements,
and new features. All of the changes can be found in the <a
href="https://kylin.apache.org/docs16/release_notes.html";>release notes</a>.</p>
+
+<h2 id="change-highlights">Change Highlights</h2>
+
+<ul>
+ <li>Scalable streaming cubing <a
href="https://issues.apache.org/jira/browse/KYLIN-1726";>KYLIN-1726</a></li>
+ <li>TopN counter merge performance improvement <a
href="https://issues.apache.org/jira/browse/KYLIN-1917";>KYLIN-1917</a></li>
+ <li>Support Embedded Structure JSON Message <a
href="https://issues.apache.org/jira/browse/KYLIN-1919";>KYLIN-1919</a></li>
+ <li>More robust approach to hive schema changes <a
href="https://issues.apache.org/jira/browse/KYLIN-2012";>KYLIN-2012</a></li>
+ <li>TimedJsonStreamParser should support other time format <a
href="https://issues.apache.org/jira/browse/KYLIN-2054";>KYLIN-2054</a></li>
+ <li>Add an encoder for Boolean type <a
href="https://issues.apache.org/jira/browse/KYLIN-2055";>KYLIN-2055</a></li>
+ <li>Allowe concurrent build/refresh/merge <a
href="https://issues.apache.org/jira/browse/KYLIN-2070";>KYLIN-2070</a></li>
+ <li>Support to change streaming configuration <a
href="https://issues.apache.org/jira/browse/KYLIN-2082";>KYLIN-2082</a></li>
+</ul>
+
+<p>To download Apache Kylin v1.6.0 source code or binary package, visit the <a
href="http://kylin.apache.org/download";>download</a> page.</p>
+
+<p><strong>Upgrade</strong></p>
+
+<p>Follow the <a href="/docs16/howto/howto_upgrade.html">upgrade guide</a>.</p>
+
+<p><strong>Support</strong></p>
+
+<p>Any issue or question,<br />
+open JIRA to Apache Kylin project: <a
href="https://issues.apache.org/jira/browse/KYLIN/";>https://issues.apache.org/jira/browse/KYLIN/</a><br
/>
+or<br />
+send mail to Apache Kylin dev mailing list: <a
href="mailto:dev@kylin.apache.org">dev@kylin.apache.org</a></p>
+
+<p><em>Great thanks to everyone who contributed!</em></p>
+
+ </article>
+
+</div>
+
+
+
+
+
+ </article>
+ </div>
+ </div>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<footer id="underfooter">
+ <div class="container">
+ <div class="row">
+ <div class="col-md-12 widget">
+ <div class="widget-body" style="text-align:center">
+ <a href="http://www.apache.org";>
+ <img id="asf-logo" alt="Apache Software Foundation"
src="/assets/images/feather-small.gif">
+ </a>
+
+ <div>
+ The contents of this website are © 2015 Apache
Software Foundation under the terms of the <a
+ href="http://www.apache.org/licenses/LICENSE-2.0";>
Apache License v2 </a>. Apache Kylin and
+ its logo are trademarks of the Apache Software
Foundation.
+ </div>
+
+ </div>
+ </div>
+ </div>
+ <!-- /row of widgets -->
+
+ </div>
+ <div></div>
+
+</footer>
+
+ <script src="/assets/js/jquery-1.9.1.min.js"></script>
+ <script src="/assets/js/bootstrap.min.js"></script>
+ <script src="/assets/js/main.js"></script>
+ </body>
+</html>
+
+
+
+
Modified: kylin/site/blog/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/blog/index.html?rev=1772467&r1=1772466&r2=1772467&view=diff
==============================================================================
--- kylin/site/blog/index.html (original)
+++ kylin/site/blog/index.html Sat Dec 3 13:16:28 2016
@@ -174,6 +174,18 @@
<li>
<h2 align="left" style="margin:0px">
+ <a class="post-link"
href="/cn/blog/2016/12/04/release-v1.6.0/">Apache Kylin v1.6.0
æ£å¼åå¸</a></h2><div align="left" class="post-meta">posted: Dec 4,
2016</div>
+
+ </li>
+
+ <li>
+ <h2 align="left" style="margin:0px">
+ <a class="post-link" href="/blog/2016/12/04/release-v1.6.0/">Apache
Kylin v1.6.0 Release Announcement</a></h2><div align="left"
class="post-meta">posted: Dec 4, 2016</div>
+
+ </li>
+
+ <li>
+ <h2 align="left" style="margin:0px">
<a class="post-link"
href="/blog/2016/11/28/intersect-count/">Retention Or Conversion Rate Analyze
in Apache Kylin</a></h2><div align="left" class="post-meta">posted: Nov 28,
2016</div>
</li>
@@ -234,13 +246,13 @@
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/blog/2016/05/26/release-v1.5.2/">Apache
Kylin v1.5.2 Release Announcement</a></h2><div align="left"
class="post-meta">posted: May 26, 2016</div>
+ <a class="post-link"
href="/cn/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2
æ£å¼åå¸</a></h2><div align="left" class="post-meta">posted: May 26,
2016</div>
</li>
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link"
href="/cn/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2
æ£å¼åå¸</a></h2><div align="left" class="post-meta">posted: May 26,
2016</div>
+ <a class="post-link" href="/blog/2016/05/26/release-v1.5.2/">Apache
Kylin v1.5.2 Release Announcement</a></h2><div align="left"
class="post-meta">posted: May 26, 2016</div>
</li>
@@ -276,13 +288,13 @@
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link"
href="/cn/blog/2016/03/16/release-v1.3.0/">Apache Kylin v1.3.0
æ£å¼åå¸</a></h2><div align="left" class="post-meta">posted: Mar 16,
2016</div>
+ <a class="post-link" href="/blog/2016/03/16/release-v1.3.0/">Apache
Kylin v1.3.0 Release Announcement</a></h2><div align="left"
class="post-meta">posted: Mar 16, 2016</div>
</li>
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/blog/2016/03/16/release-v1.3.0/">Apache
Kylin v1.3.0 Release Announcement</a></h2><div align="left"
class="post-meta">posted: Mar 16, 2016</div>
+ <a class="post-link"
href="/cn/blog/2016/03/16/release-v1.3.0/">Apache Kylin v1.3.0
æ£å¼åå¸</a></h2><div align="left" class="post-meta">posted: Mar 16,
2016</div>
</li>
@@ -300,13 +312,13 @@
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link"
href="/blog/2015/12/25/support-powerbi-tableau9/">Apache Kylin supports Tableau
9 and MS Excel, Power BI now</a></h2><div align="left"
class="post-meta">posted: Dec 25, 2015</div>
+ <a class="post-link"
href="/cn/blog/2015/12/25/support-powerbi-tableau9/">Apache Kylinå¢å
对Tableau 9å微软Excel, Power BIçæ¯æ</a></h2><div align="left"
class="post-meta">posted: Dec 25, 2015</div>
</li>
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link"
href="/cn/blog/2015/12/25/support-powerbi-tableau9/">Apache Kylinå¢å
对Tableau 9å微软Excel, Power BIçæ¯æ</a></h2><div align="left"
class="post-meta">posted: Dec 25, 2015</div>
+ <a class="post-link"
href="/blog/2015/12/25/support-powerbi-tableau9/">Apache Kylin supports Tableau
9 and MS Excel, Power BI now</a></h2><div align="left"
class="post-meta">posted: Dec 25, 2015</div>
</li>
Added: kylin/site/cn/blog/2016/12/04/release-v1.6.0/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/cn/blog/2016/12/04/release-v1.6.0/index.html?rev=1772467&view=auto
==============================================================================
--- kylin/site/cn/blog/2016/12/04/release-v1.6.0/index.html (added)
+++ kylin/site/cn/blog/2016/12/04/release-v1.6.0/index.html Sat Dec 3 13:16:28
2016
@@ -0,0 +1,285 @@
+<!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+<!doctype html>
+<html>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<head>
+ <meta charset="utf-8">
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta name="viewport" content="width=device-width, initial-scale=1">
+
+ <title>Apache Kylin | Apache Kylin v1.6.0 æ£å¼åå¸</title>
+ <meta name="description" content="Apache Kylin社åºé常é«å
´å®£å¸Apache
Kylin v1.6.0æ£å¼åå¸ã">
+ <meta name="author" content="Apache Kylin">
+ <link rel="shortcut icon" href="fav.png" type="image/png">
+
+
+
+<link rel="stylesheet" href="/assets/css/animate.css">
+<!-- Bootstrap -->
+<link rel="stylesheet" href="/assets/css/bootstrap.min.css">
+
+<!-- Fonts -->
+<!-- <link rel="stylesheet"
href="http://fonts.googleapis.com/css?family=Alice|Open+Sans:400,300,700"> -->
+
+<!-- Icons -->
+<link rel="stylesheet" href="/assets/css/font-awesome.min.css">
+
+ <!-- Custom styles -->
+ <link rel="stylesheet" href="/assets/css/styles.css">
+ <link rel="stylesheet" href="/assets/css/docs.css">
+ <link rel="stylesheet" href="/assets/css/pygments.css">
+
+ <link rel="canonical"
href="http://kylin.apache.org/cn/blog/2016/12/04/release-v1.6.0/";>
+ <link rel="alternate" type="application/rss+xml" title="Apache Kylin"
href="http://kylin.apache.org/feed.xml"; />
+
+<!--[if lt IE 9]> <script src="assets/js/html5shiv.js"></script> <![endif]-->
+<script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new
Date();a=s.createElement(o),
+
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+
+ //oringal tracker for kylin.io
+ ga('create', 'UA-55534813-1', 'auto');
+ //new tracker for kylin.apache.org
+ ga('create', 'UA-55534813-2', 'auto', {'name':'toplevel'});
+
+ ga('send', 'pageview');
+ ga('toplevel.send', 'pageview');
+
+
+</script>
+<script type="text/javascript" src="/assets/js/jquery-1.9.1.min.js"></script>
+<script type="text/javascript" src="/assets/js/nside.js"></script> </script>
+<script type="text/javascript" src="/assets/js/nnav.js"></script> </script>
+</head>
+
+ <body>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<header id="header" >
+
+ <div id="head" class="parallax" parallax-speed="3" >
+ <div id="logo" class="text-center"> <img class="img-circle"
id="circlelogo" src="/assets/images/kylin_logo.jpg"> <span class="title"
>Apache Kylinâ¢</span> <span class="tagline">Extreme OLAP Engine for Big
Data</span>
+ </div>
+ </div>
+
+
+ <!-- Main Menu -->
+ <nav class="navbar navbar-default" role="navigation" id="nav-wrapper">
+ <div class="container-fluid" id="nav">
+ <!--
+ <img class="img-circle" width="40px" height="40px" id="circlelogo"
src="/assets/images/kylin_logo.jpg">
+ -->
+ <!-- Brand and toggle get grouped for better mobile display -->
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle collapsed"
data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
+ <span class="sr-only">Toggle navigation</span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+
+ </div>
+
+ <!-- Collect the nav links, forms, and other content for toggling -->
+ <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
+ <ul class="nav navbar-nav">
+ <li><a href="/">Home</a></li>
+ <li><a href="/docs16" >Docs</a></li>
+ <li><a href="/download">Download</li>
+ <li><a href="/community" >Community</a></li>
+ <li><a href="/development" >Development</a></li>
+ <li><a href="/blog">Blog</li>
+ <li><a href="/cn" >ä¸æç</a></li>
+ <li><a href="https://twitter.com/apachekylin"; target="_blank"
class="fa fa-twitter fa-lg" title="Twitter: @ApacheKylin" ></a></li>
+ <li><a href="https://github.com/apache/kylin"; target="_blank"
class="fa fa-github-alt fa-lg" title="Github: apache/kylin" ></a></li>
+ <li><a href="https://www.facebook.com/kylinio"; target="_blank"
class="fa fa-facebook fa-lg" title="Facebook: kylin.io" ></a></li>
+ </ul>
+ </div><!-- /.navbar-collapse -->
+ </div><!-- /.container-fluid -->
+</nav>
+ </header>
+
+ <div class="page-content">
+ <header style=" padding:2em 0 0 0">
+ <div class="container" >
+ <h4 class="section-title"><span>Apache Kylinâ¢
Technical Blog</span></h4>
+ </div>
+ </div>
+
+ <div class="container">
+ <div>
+ <article class="post-content" >
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<div class="post" style=" padding:2em 4em 4em 4em">
+
+ <header class="post-header">
+ <h1 class="post-title">Apache Kylin v1.6.0 æ£å¼åå¸</h1>
+ <p class="post-meta" >Dec 4, 2016 ⢠Shaofeng Shi</p>
+ </header>
+
+ <article class="post-content" >
+ <p>Apache Kylin社åºé常é«å
´å®£å¸Apache Kylin
v1.6.0æ£å¼åå¸ã</p>
+
+<p>Apache
Kylinæ¯ä¸ä¸ªå¼æºçåå¸å¼åæå¼æï¼æä¾Hadoopä¹ä¸çSQLæ¥è¯¢æ¥å£åå¤ç»´åæï¼OLAPï¼è½åï¼æ¯æ对è¶
大è§æ¨¡æ°æ®è¿è¡ç§çº§æ¥è¯¢ã</p>
+
+<p>Apache Kylin v1.6.0带æ¥äºæ´å¯é æ´æäºç®¡ççä»Apache
Kafkaæµä¸ç´æ¥æ建Cubeçè½åï¼ä½¿å¾ç¨æ·å¯ä»¥å¨æ´å¤åºæ¯ä¸æ´èªç¶å°è¿è¡æ°æ®åæï¼ä½¿å¾æ°æ®ä»äº§çå°è¢«æ£ç´¢å°ç延è¿ï¼ä»ä»¥åçä¸å¤©ææ°å°æ¶ï¼éä½å°æ°åéã
Apache Kylin 1.6.0ä¿®å¤äº102个issueï¼å
æ¬ç¼ºé·ï¼æ¹è¿åæ°åè½ï¼è¯¦è§<a
href="https://kylin.apache.org/docs16/release_notes.html";>release notes</a>.</p>
+
+<h2 id="section">主è¦åå</h2>
+
+<ul>
+ <li>å¯ä¼¸ç¼©çæµå¼Cubeæ建 <a
href="https://issues.apache.org/jira/browse/KYLIN-1726";>KYLIN-1726</a></li>
+ <li>TopNæ§è½å¢å¼º <a
href="https://issues.apache.org/jira/browse/KYLIN-1917";>KYLIN-1917</a></li>
+ <li>æ¯æKafkaçåµå
¥æ ¼å¼çJSONæ¶æ¯ <a
href="https://issues.apache.org/jira/browse/KYLIN-1919";>KYLIN-1919</a></li>
+ <li>å¯é åæ¥hive表模å¼æ´æ¹ <a
href="https://issues.apache.org/jira/browse/KYLIN-2012";>KYLIN-2012</a></li>
+ <li>æ¯ææ´å¤Kafkaæ¶æ¯çæ¶é´æ³æ ¼å¼ <a
href="https://issues.apache.org/jira/browse/KYLIN-2054";>KYLIN-2054</a></li>
+ <li>å¢å Booleanç¼ç <a
href="https://issues.apache.org/jira/browse/KYLIN-2055";>KYLIN-2055</a></li>
+ <li>æ¯æå¤segment并è¡æ建ï¼å并ï¼å·æ° <a
href="https://issues.apache.org/jira/browse/KYLIN-2070";>KYLIN-2070</a></li>
+ <li>æ¯ææ´æ°æµå¼è¡¨æ¨¡å¼åé
ç½®çä¿®æ¹ <a
href="https://issues.apache.org/jira/browse/KYLIN-2082";>KYLIN-2082</a></li>
+</ul>
+
+<p>ä¸è½½Apache Kylin v1.6.0æºä»£ç åäºè¿å¶å®è£
å
ï¼è¯·è®¿é®<a
href="http://kylin.apache.org/cn/download/";>ä¸è½½</a>页é¢.</p>
+
+<p><strong>å级</strong></p>
+
+<p>åè§<a href="/docs16/howto/howto_upgrade.html">å级æå</a>.</p>
+
+<p><strong>æ¯æ</strong></p>
+
+<p>å级å使ç¨è¿ç¨ä¸æä»»ä½é®é¢ï¼è¯·ï¼<br />
+æ交è³KylinçJIRA: <a
href="https://issues.apache.org/jira/browse/KYLIN/";>https://issues.apache.org/jira/browse/KYLIN/</a><br
/>
+æè
<br />
+åéé®ä»¶å°Apache Kyliné®ä»¶å表: <a
href="mailto:dev@kylin.apache.org">dev@kylin.apache.org</a></p>
+
+<p><em>æè°¢æ¯ä¸ä½æåçåä¸åè´¡ç®!</em></p>
+
+ </article>
+
+</div>
+
+
+
+
+
+ </article>
+ </div>
+ </div>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<footer id="underfooter">
+ <div class="container">
+ <div class="row">
+ <div class="col-md-12 widget">
+ <div class="widget-body" style="text-align:center">
+ <a href="http://www.apache.org";>
+ <img id="asf-logo" alt="Apache Software Foundation"
src="/assets/images/feather-small.gif">
+ </a>
+
+ <div>
+ The contents of this website are © 2015 Apache
Software Foundation under the terms of the <a
+ href="http://www.apache.org/licenses/LICENSE-2.0";>
Apache License v2 </a>. Apache Kylin and
+ its logo are trademarks of the Apache Software
Foundation.
+ </div>
+
+ </div>
+ </div>
+ </div>
+ <!-- /row of widgets -->
+
+ </div>
+ <div></div>
+
+</footer>
+
+ <script src="/assets/js/jquery-1.9.1.min.js"></script>
+ <script src="/assets/js/bootstrap.min.js"></script>
+ <script src="/assets/js/main.js"></script>
+ </body>
+</html>
+
+
+
+
Modified: kylin/site/feed.xml
URL:
http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1772467&r1=1772466&r2=1772467&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Sat Dec 3 13:16:28 2016
@@ -19,11 +19,103 @@
<description>Apache Kylin Home</description>
<link>http://kylin.apache.org/</link>
<atom:link href="http://kylin.apache.org/feed.xml"; rel="self"
type="application/rss+xml"/>
- <pubDate>Wed, 30 Nov 2016 05:59:43 -0800</pubDate>
- <lastBuildDate>Wed, 30 Nov 2016 05:59:43 -0800</lastBuildDate>
+ <pubDate>Sat, 03 Dec 2016 13:12:45 -0800</pubDate>
+ <lastBuildDate>Sat, 03 Dec 2016 13:12:45 -0800</lastBuildDate>
<generator>Jekyll v2.5.3</generator>
<item>
+ <title>Apache Kylin v1.6.0 æ£å¼åå¸</title>
+ <description><p>Apache Kylin社åºé常é«å
´å®£å¸Apache Kylin
v1.6.0æ£å¼åå¸ã</p>
+
+<p>Apache
Kylinæ¯ä¸ä¸ªå¼æºçåå¸å¼åæå¼æï¼æä¾Hadoopä¹ä¸çSQLæ¥è¯¢æ¥å£åå¤ç»´åæï¼OLAPï¼è½åï¼æ¯æ对è¶
大è§æ¨¡æ°æ®è¿è¡ç§çº§æ¥è¯¢ã</p>
+
+<p>Apache Kylin v1.6.0带æ¥äºæ´å¯é æ´æäºç®¡ççä»Apache
Kafkaæµä¸ç´æ¥æ建Cubeçè½åï¼ä½¿å¾ç¨æ·å¯ä»¥å¨æ´å¤åºæ¯ä¸æ´èªç¶å°è¿è¡æ°æ®åæï¼ä½¿å¾æ°æ®ä»äº§çå°è¢«æ£ç´¢å°ç延è¿ï¼ä»ä»¥åçä¸å¤©ææ°å°æ¶ï¼éä½å°æ°åéã
Apache Kylin 1.6.0ä¿®å¤äº102个issueï¼å
æ¬ç¼ºé·ï¼æ¹è¿åæ°åè½ï¼è¯¦è§<a
href="https://kylin.apache.org/docs16/release_notes.html">release
notes</a>.</p>
+
+<h2 id="section">主è¦åå</h2>
+
+<ul>
+ <li>å¯ä¼¸ç¼©çæµå¼Cubeæ建 <a
href="https://issues.apache.org/jira/browse/KYLIN-1726">KYLIN-1726</a></li>
+ <li>TopNæ§è½å¢å¼º <a
href="https://issues.apache.org/jira/browse/KYLIN-1917">KYLIN-1917</a></li>
+ <li>æ¯æKafkaçåµå
¥æ ¼å¼çJSONæ¶æ¯ <a
href="https://issues.apache.org/jira/browse/KYLIN-1919">KYLIN-1919</a></li>
+ <li>å¯é åæ¥hive表模å¼æ´æ¹ <a
href="https://issues.apache.org/jira/browse/KYLIN-2012">KYLIN-2012</a></li>
+ <li>æ¯ææ´å¤Kafkaæ¶æ¯çæ¶é´æ³æ ¼å¼ <a
href="https://issues.apache.org/jira/browse/KYLIN-2054">KYLIN-2054</a></li>
+ <li>å¢å Booleanç¼ç <a
href="https://issues.apache.org/jira/browse/KYLIN-2055">KYLIN-2055</a></li>
+ <li>æ¯æå¤segment并è¡æ建ï¼å并ï¼å·æ° <a
href="https://issues.apache.org/jira/browse/KYLIN-2070">KYLIN-2070</a></li>
+ <li>æ¯ææ´æ°æµå¼è¡¨æ¨¡å¼åé
ç½®çä¿®æ¹ <a
href="https://issues.apache.org/jira/browse/KYLIN-2082">KYLIN-2082</a></li>
+</ul>
+
+<p>ä¸è½½Apache Kylin v1.6.0æºä»£ç åäºè¿å¶å®è£
å
ï¼è¯·è®¿é®<a
href="http://kylin.apache.org/cn/download/">ä¸è½½</a>页é¢.</p>
+
+<p><strong>å级</strong></p>
+
+<p>åè§<a
href="/docs16/howto/howto_upgrade.html">å级æå</a>.</p>
+
+<p><strong>æ¯æ</strong></p>
+
+<p>å级å使ç¨è¿ç¨ä¸æä»»ä½é®é¢ï¼è¯·ï¼<br />
+æ交è³KylinçJIRA: <a
href="https://issues.apache.org/jira/browse/KYLIN/">https://issues.apache.org/jira/browse/KYLIN/</a><br
/>
+æè
<br />
+åéé®ä»¶å°Apache Kyliné®ä»¶å表: <a
href="&#109;&#097;&#105;&#108;&#116;&#111;:&#100;&#101;&#118;&#064;&#107;&#121;&#108;&#105;&#110;&#046;&#097;&#112;&#097;&#099;&#104;&#101;&#046;&#111;&#114;&#103;">&#100;&#101;&#118;&#064;&#107;&#121;&#108;&#105;&#110;&#046;&#097;&#112;&#097;&#099;&#104;&#101;&#046;&#111;&#114;&#103;</a></p>
+
+<p><em>æè°¢æ¯ä¸ä½æåçåä¸åè´¡ç®!</em></p>
+</description>
+ <pubDate>Sun, 04 Dec 2016 13:00:00 -0800</pubDate>
+ <link>http://kylin.apache.org/cn/blog/2016/12/04/release-v1.6.0/</link>
+ <guid
isPermaLink="true">http://kylin.apache.org/cn/blog/2016/12/04/release-v1.6.0/</guid>
+
+
+ <category>blog</category>
+
+ </item>
+
+ <item>
+ <title>Apache Kylin v1.6.0 Release Announcement</title>
+ <description><p>The Apache Kylin community is pleased to
announce the release of Apache Kylin v1.6.0.</p>
+
+<p>Apache Kylin is an open source Distributed Analytics Engine designed
to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop
supporting extremely large datasets.</p>
+
+<p>This is a major release after 1.5.4, with the reliable and scalable
support for using Apache Kafka as data source; this enables user to build cubes
directly from streaming data (without loading to Apache Hive), reducing the
data latency from days/hours to minutes.</p>
+
+<p>Apache Kylin 1.6.0 resolved 102 issues including bug fixes,
improvements, and new features. All of the changes can be found in the <a
href="https://kylin.apache.org/docs16/release_notes.html">release
notes</a>.</p>
+
+<h2 id="change-highlights">Change Highlights</h2>
+
+<ul>
+ <li>Scalable streaming cubing <a
href="https://issues.apache.org/jira/browse/KYLIN-1726">KYLIN-1726</a></li>
+ <li>TopN counter merge performance improvement <a
href="https://issues.apache.org/jira/browse/KYLIN-1917">KYLIN-1917</a></li>
+ <li>Support Embedded Structure JSON Message <a
href="https://issues.apache.org/jira/browse/KYLIN-1919">KYLIN-1919</a></li>
+ <li>More robust approach to hive schema changes <a
href="https://issues.apache.org/jira/browse/KYLIN-2012">KYLIN-2012</a></li>
+ <li>TimedJsonStreamParser should support other time format <a
href="https://issues.apache.org/jira/browse/KYLIN-2054">KYLIN-2054</a></li>
+ <li>Add an encoder for Boolean type <a
href="https://issues.apache.org/jira/browse/KYLIN-2055">KYLIN-2055</a></li>
+ <li>Allowe concurrent build/refresh/merge <a
href="https://issues.apache.org/jira/browse/KYLIN-2070">KYLIN-2070</a></li>
+ <li>Support to change streaming configuration <a
href="https://issues.apache.org/jira/browse/KYLIN-2082">KYLIN-2082</a></li>
+</ul>
+
+<p>To download Apache Kylin v1.6.0 source code or binary package, visit
the <a
href="http://kylin.apache.org/download">download</a>
page.</p>
+
+<p><strong>Upgrade</strong></p>
+
+<p>Follow the <a
href="/docs16/howto/howto_upgrade.html">upgrade
guide</a>.</p>
+
+<p><strong>Support</strong></p>
+
+<p>Any issue or question,<br />
+open JIRA to Apache Kylin project: <a
href="https://issues.apache.org/jira/browse/KYLIN/">https://issues.apache.org/jira/browse/KYLIN/</a><br
/>
+or<br />
+send mail to Apache Kylin dev mailing list: <a
href="&#109;&#097;&#105;&#108;&#116;&#111;:&#100;&#101;&#118;&#064;&#107;&#121;&#108;&#105;&#110;&#046;&#097;&#112;&#097;&#099;&#104;&#101;&#046;&#111;&#114;&#103;">&#100;&#101;&#118;&#064;&#107;&#121;&#108;&#105;&#110;&#046;&#097;&#112;&#097;&#099;&#104;&#101;&#046;&#111;&#114;&#103;</a></p>
+
+<p><em>Great thanks to everyone who
contributed!</em></p>
+</description>
+ <pubDate>Sun, 04 Dec 2016 12:00:00 -0800</pubDate>
+ <link>http://kylin.apache.org/blog/2016/12/04/release-v1.6.0/</link>
+ <guid
isPermaLink="true">http://kylin.apache.org/blog/2016/12/04/release-v1.6.0/</guid>
+
+
+ <category>blog</category>
+
+ </item>
+
+ <item>
<title>Retention Or Conversion Rate Analyze in Apache Kylin</title>
<description><p>Since v.1.6.0</p>
@@ -628,245 +720,6 @@ send mail to Apache Kylin dev mailing li
<category>blog</category>
-
- </item>
-
- <item>
- <title>Deploy Apache Kylin with Standalone HBase Cluster</title>
- <description><h2
id="introduction">Introduction</h2>
-
-<p>Apache Kylin mainly use HBase to storage cube data. The performance
of HBase cluster impacts on the query performance of Kylin directly. In common
scenario, HBase is deployed with MR/Hive on one HDFS cluster, which makes that
the resouces HBase used is limited, and the MR job affects the performance of
HBase. These problems can be resolved with standalone HBase cluster, and Apache
Kylin has support this deploy mode for now.</p>
-
-<h2 id="enviroment-requirements">Enviroment
Requirements</h2>
-<p>To enable standalone HBase cluster supporting, check the basic
enviroments at first:</p>
-
-<ul>
- <li>Deploy the main cluster and hbase cluster, make sure both works
normally</li>
- <li>Make sure Kylin Server can access both clusters using hdfs shell
with fully qualifiered path</li>
- <li>Make sure Kylin Server can submit MR job to main cluster, and can
use hive shell to access data warehouse, make sure the configurations of hadoop
and hive points to main cluster</li>
- <li>Make sure Kylin Server can access hbase cluster using hbase shell,
make sure the configuration of hbase points to hbase cluster</li>
- <li>Make sure the job on main cluster can access hbase cluster
directly</li>
-</ul>
-
-<h2 id="configurations">Configurations</h2>
-<p>Update the config <code
class="highlighter-rouge">kylin.hbase.cluster.fs</code> in
kylin.properties, with a value as the Namenode address of HBase Cluster, like
<code
class="highlighter-rouge">hdfs://hbase-cluster-nn01.example.com:8020</code></p>
-
-<p>Notice that the value should keep consistent with the Namenode
address of <code
class="highlighter-rouge">root.dir</code> on HBase Master
node, to ensure bulkload into hbase.</p>
-
-<h2 id="enable-nn-ha">Enable NN HA</h2>
-<p>HDFS Namenode HA improved the availablity of cluster significantly,
and maybe the HBase cluster enabled it.<br />
-To enable NN HA on HBase cluster, set <code
class="highlighter-rouge">kylin.hbase.cluster.fs</code> as
NN-HA format path of HBase cluster in kylin.properties, like <code
class="highlighter-rouge">hdfs://hbase-cluster:8020</code>.</p>
-
-<p>Since the MR Job of cube building access both main cluster and hbase
cluster, exceptions may be threw during task running. The reason is task need
to access HBase cluster with NN-HA related configs, which usually not deployed
in the main cluster.</p>
-
-<p>These exceptions could be resolved by configs updating. In details,
merge NN-HA related configs of two clusters, including <code
class="highlighter-rouge">dfs.nameservices</code>, <code
class="highlighter-rouge">dfs.ha.namenodes.</code>, <code
class="highlighter-rouge">dfs.client.failover.proxy.provider.</code>
and other related. These configs should be updated into hdfs-site.xml in Kylin
Server and Resource Manager of main cluster, also be added into
kylin_job_conf.xml.</p>
-
-<p>Howerver, it may be difficult to update configs in production
environments. Hereâs another way which avoing configs updating:</p>
-
-<ul>
- <li>Update HBase client in Kylin Server with patch HBASE-14347, and
set <code
class="highlighter-rouge">hbase.use.dynamic.jar=false</code>
in hbase-site.xml</li>
- <li>Update Kylin Server with patch KYLIN-1910, and set <code
class="highlighter-rouge">kylin.hbase.cluster.hdfs.config.file=hbase.hdfs.xml</code>
in kylin.properties. The <code
class="highlighter-rouge">hbase.hdfs.xml</code> meaning the
hdfs-site.xml of HBase cluster, put it in the same dir of
kylin.properties</li>
- <li>Update Hadoop of Kylin Server and Resource Manager with patch
YARN-3021</li>
-</ul>
-
-<h2 id="troubleshooting">TroubleShooting</h2>
-
-<ul>
- <li>UnknownHostException occurs during Cube Building<br />
-It usually occurs with HBase HA nameservice config, please refer the above
section âEnable NN HAâ</li>
- <li>âError when open connection hbaseâ during Kylin Server
startup<br />
-HBase tries to mkdir tmp dirs on hdfs during connection setup, failed with
lack of NN-HA related configs, refer âEnable NN HAâ</li>
- <li>Failed to submit cube building job<br />
-HBase cluster path will be parsed during generate cube building job, failed
with lack of NN-HA related configs, refer âEnable NN HAâ</li>
- <li>Cube Building Step âConvert Cuboid Data to HFileâ failed<br
/>
-Usually occurred with Kerberos Authentication. Resource Manager tries to renew
all tokens when job submitting, the renew of HBase cluster token will be
failed, with lack of NN-HA related configs, refer âEnable NN HAâ</li>
- <li>HFile BulkLoading Stucks for long time<br />
-Check the regionserver log, there should be lots of error log, with WrongFS
exception. Make sure the namenode address in <code
class="highlighter-rouge">kylin.properites/kylin.hbase.cluster.fs</code>
and hbase master node <code
class="highlighter-rouge">hbase-site.xml/root.dir</code> is
same</li>
-</ul>
-</description>
- <pubDate>Fri, 10 Jun 2016 10:30:00 -0700</pubDate>
-
<link>http://kylin.apache.org/blog/2016/06/10/standalone-hbase-cluster/</link>
- <guid
isPermaLink="true">http://kylin.apache.org/blog/2016/06/10/standalone-hbase-cluster/</guid>
-
-
- <category>blog</category>
-
- </item>
-
- <item>
- <title>RAW measure in Apache Kylin</title>
- <description><h2
id="introduction">Introduction</h2>
-
-<blockquote>
- <p><code class="highlighter-rouge">RAW</code>
measure function is use to query the detail data on the measure column in
Kylin.</p>
-</blockquote>
-
-<p>Example data:</p>
-
-<table>
- <thead>
- <tr>
- <th style="text-align: left">DT</th>
- <th style="text-align: center">SITE_ID</th>
- <th style="text-align: center">SELLER_ID</th>
- <th style="text-align: center">ITEM_COUNT</th>
- </tr>
- </thead>
- <tbody>
- <tr>
- <td style="text-align: left">2016-05-01</td>
- <td style="text-align: center">0</td>
- <td style="text-align: center">SELLER-001</td>
- <td style="text-align: center">100</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-01</td>
- <td style="text-align: center">0</td>
- <td style="text-align: center">SELLER-002</td>
- <td style="text-align: center">200</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-02</td>
- <td style="text-align: center">1</td>
- <td style="text-align: center">SELLER-003</td>
- <td style="text-align: center">300</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-02</td>
- <td style="text-align: center">1</td>
- <td style="text-align: center">SELLER-004</td>
- <td style="text-align: center">400</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-03</td>
- <td style="text-align: center">2</td>
- <td style="text-align: center">SELLER-005</td>
- <td style="text-align: center">500</td>
- </tr>
- </tbody>
-</table>
-
-<p>We design the cube desc is the <code
class="highlighter-rouge">DT,SITE_ID</code> columns as
dimensions, and <code
class="highlighter-rouge">SUM(ITEM_COUNT)</code> as measure.
So, the base cuboid data will like this:</p>
-
-<table>
- <thead>
- <tr>
- <th style="text-align: left">Rowkey of base
cuboid</th>
- <th style="text-align: center">SUM(ITEM_COUNT)</th>
- </tr>
- </thead>
- <tbody>
- <tr>
- <td style="text-align: left">2016-05-01_0</td>
- <td style="text-align: center">300</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-02_1</td>
- <td style="text-align: center">700</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-03_2</td>
- <td style="text-align: center">500</td>
- </tr>
- </tbody>
-</table>
-
-<p>For the first row in the base cuboid data, Kylin can extract the
dimension column values <code
class="highlighter-rouge">2016-05-01,0</code> from the HBase
Rowkey, and in the measure cell will store the measure functionâs aggregated
results <code class="highlighter-rouge">300</code>, we
canât get the raw value <code
class="highlighter-rouge">100</code> and <code
class="highlighter-rouge">200</code> which before the
aggregation on the <code
class="highlighter-rouge">ITEM_COUNT</code> column.</p>
-
-<p>The RAW function is use to make the SQL:</p>
-
-<div class="highlighter-rouge"><pre
class="highlight"><code>SELECT DT,SITE_ID,ITEM_COUNT FROM
FACT_TABLE
-</code></pre>
-</div>
-
-<p>to return the correct result:</p>
-
-<table>
- <thead>
- <tr>
- <th style="text-align: left">DT</th>
- <th style="text-align: center">SITE_ID</th>
- <th style="text-align: center">ITEM_COUNT</th>
- </tr>
- </thead>
- <tbody>
- <tr>
- <td style="text-align: left">2016-05-01</td>
- <td style="text-align: center">0</td>
- <td style="text-align: center">100</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-01</td>
- <td style="text-align: center">0</td>
- <td style="text-align: center">200</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-02</td>
- <td style="text-align: center">1</td>
- <td style="text-align: center">300</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-02</td>
- <td style="text-align: center">1</td>
- <td style="text-align: center">400</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-03</td>
- <td style="text-align: center">2</td>
- <td style="text-align: center">500</td>
- </tr>
- </tbody>
-</table>
-
-<h2 id="how-to-use">How to use</h2>
-
-<ul>
- <li>Choose the Kylin version <code
class="highlighter-rouge">1.5.1+</code>.</li>
- <li>Like the above case, we can make the <code
class="highlighter-rouge">DT,SITE_ID</code> as dimensions,
and <code
class="highlighter-rouge">RAW(ITEM_COUNT)</code>as
measure.</li>
- <li>After the cube build, you can use the SQL to query the raw
data:</li>
-</ul>
-
-<div class="highlighter-rouge"><pre
class="highlight"><code>SELECT DT,SITE_ID,ITEM_COUNT FROM
FACT_TABLE WHERE SITE_ID = 0
-</code></pre>
-</div>
-
-<h2 id="optimize">Optimize</h2>
-
-<p>The column which define <code
class="highlighter-rouge">RAW</code> measure will be encoded
with dictionary by default. So, you must know you dataâs cardinality and
distribution characteristics.</p>
-
-<ul>
- <li>As far as possible to define the value uniform distribution column
to dimensions, this will make the measure cell value size more uniform and
avoid data skew.</li>
- <li>If choose the ultra high cardinality column to define <code
class="highlighter-rouge">RAW</code> measure, you can try
the following to avoid the dictionary build error:
- <ol>
- <li>Cut a big segment into several segments, if you were trying to
build a large data set at once;</li>
- <li>Set <code
class="highlighter-rouge">kylin.dictionary.max.cardinality</code>
in conf/kylin.properties to a bigger value (default is 5000000).</li>
- </ol>
- </li>
-</ul>
-
-<h2 id="to-be-improved">To be improved</h2>
-
-<ul>
- <li>Now, the maximum storage 1M values of <code
class="highlighter-rouge">RAW</code> measure in one cuboid.
If exceed 1M values, it will throw <code
class="highlighter-rouge">BufferOverflowException</code> in
the cube build. This will be optimized in the later release.</li>
- <li>Only dimension column can use in <code
class="highlighter-rouge">WHERE</code> condition, <code
class="highlighter-rouge">RAW</code> measure column is not
support.</li>
-</ul>
-
-<h2 id="implement">Implement</h2>
-
-<ul>
- <li>Custom one aggregation function RAW implement, the functionâs
return type depends on the column type.</li>
- <li>Make the RAW aggregation function to save the column raw data in
the base cuboid data.</li>
- <li>The HBase value cell will store the dictionary id of the raw data
to save space.</li>
- <li>The SQL which contains the RAW measure column will be routed to
the base cuboid query.</li>
- <li>Extract the raw data from base cuboid data with dimension values
to assemble into a complete row when query.</li>
-</ul>
-</description>
- <pubDate>Sun, 29 May 2016 17:30:00 -0700</pubDate>
-
<link>http://kylin.apache.org/blog/2016/05/29/raw-measure-in-kylin/</link>
- <guid
isPermaLink="true">http://kylin.apache.org/blog/2016/05/29/raw-measure-in-kylin/</guid>
-
-
- <category>blog</category>
</item>
