Author: lidong
Date: Thu Nov 1 14:08:38 2018
New Revision: 1845476
URL: http://svn.apache.org/viewvc?rev=1845476&view=rev
Log:
Update FAQ, update storage and metadata cleanup doc, add the online video
section
Modified:
kylin/site/cn/docs/howto/howto_backup_metadata.html
kylin/site/cn/docs/howto/howto_cleanup_storage.html
kylin/site/docs/gettingstarted/best_practices.html
kylin/site/docs/gettingstarted/faq.html
kylin/site/docs/howto/howto_backup_metadata.html
kylin/site/docs/howto/howto_cleanup_storage.html
kylin/site/feed.xml
Modified: kylin/site/cn/docs/howto/howto_backup_metadata.html
URL:
http://svn.apache.org/viewvc/kylin/site/cn/docs/howto/howto_backup_metadata.html?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/cn/docs/howto/howto_backup_metadata.html (original)
+++ kylin/site/cn/docs/howto/howto_backup_metadata.html Thu Nov 1 14:08:38 2018
@@ -221,15 +221,15 @@ mkdir /path/to/restore_new/cube</code></
<h2 id="metadata-store-">ä» metadata store æ¸
çæ ç¨çèµæº</h2>
<p>éçè¿è¡æ¶é´å¢é¿ï¼ç±»ä¼¼åå
¸ã表快ç
§çèµæºå徿²¡æç¨ï¼cube segmentè¢«ä¸¢å¼æè
åå¹¶äºï¼ï¼ä½æ¯å®ä»¬ä¾æ§å ç¨ç©ºé´ï¼ä½
å¯ä»¥è¿è¡å½ä»¤æ¥æ¾å°å¹¶æ¸
é¤å®ä»¬ï¼</p>
-<p>é¦å
ï¼è¿è¡ä¸ä¸ªæ£æ¥ï¼è¿æ¯å®å
¨çå
为å®ä¸ä¼æ¹åä»»ä½ä¸è¥¿ï¼</p>
+<p>é¦å
ï¼è¿è¡ä¸ä¸ªæ£æ¥ï¼è¿æ¯å®å
¨çå
为å®ä¸ä¼æ¹åä»»ä½ä¸è¥¿ï¼éè¿æ·»å ââjobThreshold
30(é»è®¤å¼ï¼æ¨å¯ä»¥æ¹ä¸ºä»»ä½æ°å)â
åæ°ï¼æ¨å¯ä»¥è®¾ç½®è¦ä¿çç metadata resource 天æ°ï¼</p>
-<div class="highlight"><pre><code class="language-groff"
data-lang="groff">./bin/metastore.sh clean</code></pre></div>
+<div class="highlight"><pre><code class="language-groff"
data-lang="groff">./bin/metastore.sh clean --jobThreshold 30</code></pre></div>
<p>å°è¦è¢«å é¤çèµæºä¼è¢«ååºæ¥ï¼</p>
<p>æ¥ä¸æ¥ï¼å¢å ââdelete trueâ åæ°æ¥æ¸
çè¿äºèµæºï¼å¨è¿ä¹åï¼ä½ åºè¯¥ç¡®ä¿å·²ç»å¤ä»½ metadata
storeï¼</p>
-<div class="highlight"><pre><code class="language-groff"
data-lang="groff">./bin/metastore.sh clean --delete true</code></pre></div>
+<div class="highlight"><pre><code class="language-groff"
data-lang="groff">./bin/metastore.sh clean --delete true --jobThreshold
30</code></pre></div>
</article>
Modified: kylin/site/cn/docs/howto/howto_cleanup_storage.html
URL:
http://svn.apache.org/viewvc/kylin/site/cn/docs/howto/howto_cleanup_storage.html?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/cn/docs/howto/howto_cleanup_storage.html (original)
+++ kylin/site/cn/docs/howto/howto_cleanup_storage.html Thu Nov 1 14:08:38 2018
@@ -166,7 +166,7 @@ var _hmt = _hmt || [];
<div id="pjax">
<h1
class="post-title">æ¸
çåå¨</h1>
<article
class="post-content" >
-
<p>Kylinå¨æå»ºcubeæé´ä¼å¨HDFSä¸çæä¸é´æä»¶ï¼é¤æ¤ä¹å¤ï¼å½æ¸
ç/å
é¤/åå¹¶cubeæ¶ï¼ä¸äºHBase表å¯è½è¢«éçå¨HBaseå´ä»¥ååä¹ä¸ä¼è¢«æ¥è¯¢ï¼è½ç¶Kylinå·²ç»å¼å§åèªå¨åçåå¾åæ¶ï¼ä½ä¸ä¸å®è½è¦çå°ææçæ
åµï¼ä½ å¯ä»¥å®æå离线çå卿¸
çï¼</p>
+ <p>Kylin å¨æå»º cube
æé´ä¼å¨ HDFS ä¸çæä¸é´æä»¶ï¼é¤æ¤ä¹å¤ï¼å½æ¸
ç/å
é¤/åå¹¶ cube æ¶ï¼ä¸äº HBase 表å¯è½è¢«éçå¨ HBase
å´ä»¥ååä¹ä¸ä¼è¢«æ¥è¯¢ï¼è½ç¶ Kylin
å·²ç»å¼å§åèªå¨åçåå¾åæ¶ï¼ä½ä¸ä¸å®è½è¦çå°ææçæ
åµï¼ä½ å¯ä»¥å®æå离线çå卿¸
çï¼</p>
<p>æ¥éª¤ï¼<br />
1. æ£æ¥åªäºèµæºå¯ä»¥æ¸
çï¼è¿ä¸æ¥ä¸ä¼å é¤ä»»ä½ä¸è¥¿ï¼</p>
@@ -174,12 +174,17 @@ var _hmt = _hmt || [];
<div class="highlight"><pre><code class="language-groff"
data-lang="groff">export KYLIN_HOME=/path/to/kylin_home
${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --delete
false</code></pre></div>
-<p>请å°è¿éç (version) æ¿æ¢ä¸ºä½ å®è£
çKylin jarçæ¬ã<br />
+<p>请å°è¿éç (version) æ¿æ¢ä¸ºä½ å®è£
ç Kylin jar çæ¬ã<br />
2. ä½
å¯ä»¥æ½æ¥ä¸ä¸¤ä¸ªèµæºæ¥æ£æ¥å®ä»¬æ¯å¦å·²ç»æ²¡æè¢«å¼ç¨äºï¼ç¶åå
ä¸ââdelete trueâé项è¿è¡æ¸
çã</p>
<div class="highlight"><pre><code class="language-groff"
data-lang="groff">${KYLIN_HOME}/bin/kylin.sh
org.apache.kylin.tool.StorageCleanupJob --delete true</code></pre></div>
-<p>宿åï¼ä¸é´HDFSä¸çä¸é´æä»¶åHTableä¼è¢«ç§»é¤ã</p>
+<p>宿åï¼Hive éçä¸é´è¡¨, HDFS ä¸çä¸é´æä»¶å HBase ä¸ç
HTables é½ä¼è¢«ç§»é¤ã<br />
+3. å¦ææ¨æ³è¦å 餿æèµæºï¼å¯æ·»å ââforce trueâ
é项ï¼</p>
+
+<div class="highlight"><pre><code class="language-groff"
data-lang="groff">${KYLIN_HOME}/bin/kylin.sh
org.apache.kylin.tool.StorageCleanupJob --force true --delete
true</code></pre></div>
+
+<p>宿åï¼Hive 䏿æçä¸é´è¡¨, HDFS 䏿æçä¸é´æä»¶å
HBase ä¸ç HTables é½ä¼è¢«ç§»é¤ã</p>
</article>
</div>
Modified: kylin/site/docs/gettingstarted/best_practices.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/gettingstarted/best_practices.html?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/docs/gettingstarted/best_practices.html (original)
+++ kylin/site/docs/gettingstarted/best_practices.html Thu Nov 1 14:08:38 2018
@@ -6047,6 +6047,26 @@ var _hmt = _hmt || [];
</li>
</ul>
+<p><strong>Here are online tutorials for self-studying Kylin:</strong></p>
+
+<ul>
+ <li>
+ <p>Free Kylin tutorial (registration needed), from the core developers, in
Chinese:<br />
+<a
href="https://www.chinahadoop.cn/search?q=kylin">https://www.chinahadoop.cn/search?q=kylin</a></p>
+ </li>
+ <li>
+ <p>A paid Kylin tutorial on Udemy, in English:<br />
+<a
href="https://www.udemy.com/apache-kylin-implementing-olap-on-the-hadoop-platform">https://www.udemy.com/apache-kylin-implementing-olap-on-the-hadoop-platform</a></p>
+ </li>
+ <li>
+ <p>Tutorial of Kylin on Tableau, in Spanish: <br />
+<a
href="https://www.youtube.com/watch?v=k6fBw8yA1NI">https://www.youtube.com/watch?v=k6fBw8yA1NI</a></p>
+ </li>
+</ul>
+
+<p>Besides, there is also some video of Kylin on the conferences; You can
search for them on Youtube:<br />
+<a
href="https://www.youtube.com/results?search_query=Apache+Kylin">https://www.youtube.com/results?search_query=Apache+Kylin</a></p>
+
</article>
</div>
</div>
Modified: kylin/site/docs/gettingstarted/faq.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/gettingstarted/faq.html?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/docs/gettingstarted/faq.html (original)
+++ kylin/site/docs/gettingstarted/faq.html Thu Nov 1 14:08:38 2018
@@ -6215,6 +6215,12 @@ var _hmt = _hmt || [];
<p>If you can accept the absence of new dimensions for historical data, you
can build the new cube since the end time of the old cube. And then create a
hybrid model over the old and new cube.</p>
+<h4
id="how-to-solve-the-data-security-problem-of-tableau-connection-client">How to
solve the data security problem of Tableau connection client?</h4>
+
+<ul>
+ <li>Kylinâs ACL control can solve this problem. Different analysts have
the authority to work on different projects for Kylin. When you create a Kylin
ODBC DSN, you can map different links to different analyst accounts.</li>
+</ul>
+
<h4
id="the-query-result-is-not-exactly-matched-with-that-in-hive-whats-the-possible-reason">The
query result is not exactly matched with that in Hive, whatâs the possible
reason?</h4>
<ul>
Modified: kylin/site/docs/howto/howto_backup_metadata.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/howto/howto_backup_metadata.html?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/docs/howto/howto_backup_metadata.html (original)
+++ kylin/site/docs/howto/howto_backup_metadata.html Thu Nov 1 14:08:38 2018
@@ -6071,15 +6071,15 @@ mkdir /path/to/restore_new/cube</code></
<h2 id="cleanup-unused-resources-from-metadata-store">Cleanup unused resources
from metadata store</h2>
<p>As time goes on, some resources like dictionary, table snapshots became
useless (as the cube segment be dropped or merged), but they still take space
there; You can run command to find and cleanup them from metadata store:</p>
-<p>Firstly, run a check, this is safe as it will not change anything:</p>
+<p>Firstly, run a check, this is safe as it will not change anything, you can
set the number of days to keep metadata resource by adding the
ââjobThreshold 30(default, you can change to any number)â option:</p>
-<div class="highlight"><pre><code class="language-groff"
data-lang="groff">./bin/metastore.sh clean</code></pre></div>
+<div class="highlight"><pre><code class="language-groff"
data-lang="groff">./bin/metastore.sh clean --jobThreshold 30</code></pre></div>
<p>The resources that will be dropped will be listed;</p>
<p>Next, add the ââdelete trueâ parameter to cleanup those resources;
before this, make sure you have made a backup of the metadata store;</p>
-<div class="highlight"><pre><code class="language-groff"
data-lang="groff">./bin/metastore.sh clean --delete true</code></pre></div>
+<div class="highlight"><pre><code class="language-groff"
data-lang="groff">./bin/metastore.sh clean --delete true --jobThreshold
30</code></pre></div>
</article>
Modified: kylin/site/docs/howto/howto_cleanup_storage.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/howto/howto_cleanup_storage.html?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/docs/howto/howto_cleanup_storage.html (original)
+++ kylin/site/docs/howto/howto_cleanup_storage.html Thu Nov 1 14:08:38 2018
@@ -6029,7 +6029,12 @@ ${KYLIN_HOME}/bin/kylin.sh org.apache.ky
<div class="highlight"><pre><code class="language-groff"
data-lang="groff">${KYLIN_HOME}/bin/kylin.sh
org.apache.kylin.tool.StorageCleanupJob --delete true</code></pre></div>
-<p>On finish, the intermediate HDFS location and HTables should be dropped;</p>
+<p>On finish, the intermediate Hive tables, HDFS location and HTables should
be dropped;<br />
+3. If you want to delete all resources, then add the ââforce trueâ
option to start the cleanup:</p>
+
+<div class="highlight"><pre><code class="language-groff"
data-lang="groff">${KYLIN_HOME}/bin/kylin.sh
org.apache.kylin.tool.StorageCleanupJob --force true --delete
true</code></pre></div>
+
+<p>On finish, all the intermediate Hive tables, HDFS location and HTables
should be dropped;</p>
</article>
</div>
Modified: kylin/site/feed.xml
URL:
http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Thu Nov 1 14:08:38 2018
@@ -19,8 +19,8 @@
<description>Apache Kylin Home</description>
<link>http://kylin.apache.org/</link>
<atom:link href="http://kylin.apache.org/feed.xml" rel="self"
type="application/rss+xml"/>
- <pubDate>Mon, 29 Oct 2018 23:21:00 -0700</pubDate>
- <lastBuildDate>Mon, 29 Oct 2018 23:21:00 -0700</lastBuildDate>
+ <pubDate>Thu, 01 Nov 2018 06:59:23 -0700</pubDate>
+ <lastBuildDate>Thu, 01 Nov 2018 06:59:23 -0700</lastBuildDate>
<generator>Jekyll v2.5.3</generator>
<item>