Author: lidong Date: Thu Nov 1 14:08:38 2018 New Revision: 1845476 URL: http://svn.apache.org/viewvc?rev=1845476&view=rev Log: Update FAQ, update storage and metadata cleanup doc, add the online video section
Modified: kylin/site/cn/docs/howto/howto_backup_metadata.html kylin/site/cn/docs/howto/howto_cleanup_storage.html kylin/site/docs/gettingstarted/best_practices.html kylin/site/docs/gettingstarted/faq.html kylin/site/docs/howto/howto_backup_metadata.html kylin/site/docs/howto/howto_cleanup_storage.html kylin/site/feed.xml Modified: kylin/site/cn/docs/howto/howto_backup_metadata.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/howto/howto_backup_metadata.html?rev=1845476&r1=1845475&r2=1845476&view=diff ============================================================================== --- kylin/site/cn/docs/howto/howto_backup_metadata.html (original) +++ kylin/site/cn/docs/howto/howto_backup_metadata.html Thu Nov 1 14:08:38 2018 @@ -221,15 +221,15 @@ mkdir /path/to/restore_new/cube</code></ <h2 id="metadata-store-">ä» metadata store æ¸ çæ ç¨çèµæº</h2> <p>éçè¿è¡æ¶é´å¢é¿ï¼ç±»ä¼¼åå ¸ãè¡¨å¿«ç §çèµæºåå¾æ²¡æç¨ï¼cube segment被丢å¼æè å并äºï¼ï¼ä½æ¯å®ä»¬ä¾æ§å ç¨ç©ºé´ï¼ä½ å¯ä»¥è¿è¡å½ä»¤æ¥æ¾å°å¹¶æ¸ é¤å®ä»¬ï¼</p> -<p>é¦å ï¼è¿è¡ä¸ä¸ªæ£æ¥ï¼è¿æ¯å®å ¨çå 为å®ä¸ä¼æ¹åä»»ä½ä¸è¥¿ï¼</p> +<p>é¦å ï¼è¿è¡ä¸ä¸ªæ£æ¥ï¼è¿æ¯å®å ¨çå 为å®ä¸ä¼æ¹åä»»ä½ä¸è¥¿ï¼éè¿æ·»å ââjobThreshold 30(é»è®¤å¼ï¼æ¨å¯ä»¥æ¹ä¸ºä»»ä½æ°å)â åæ°ï¼æ¨å¯ä»¥è®¾ç½®è¦ä¿çç metadata resource 天æ°ï¼</p> -<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean</code></pre></div> +<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean --jobThreshold 30</code></pre></div> <p>å°è¦è¢«å é¤çèµæºä¼è¢«ååºæ¥ï¼</p> <p>æ¥ä¸æ¥ï¼å¢å ââdelete trueâ åæ°æ¥æ¸ çè¿äºèµæºï¼å¨è¿ä¹åï¼ä½ åºè¯¥ç¡®ä¿å·²ç»å¤ä»½ metadata storeï¼</p> -<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean --delete true</code></pre></div> +<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean --delete true --jobThreshold 30</code></pre></div> </article> Modified: kylin/site/cn/docs/howto/howto_cleanup_storage.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/howto/howto_cleanup_storage.html?rev=1845476&r1=1845475&r2=1845476&view=diff ============================================================================== --- kylin/site/cn/docs/howto/howto_cleanup_storage.html (original) +++ kylin/site/cn/docs/howto/howto_cleanup_storage.html Thu Nov 1 14:08:38 2018 @@ -166,7 +166,7 @@ var _hmt = _hmt || []; <div id="pjax"> <h1 class="post-title">æ¸ çåå¨</h1> <article class="post-content" > - <p>Kylinå¨æ建cubeæé´ä¼å¨HDFSä¸çæä¸é´æ件ï¼é¤æ¤ä¹å¤ï¼å½æ¸ ç/å é¤/å并cubeæ¶ï¼ä¸äºHBase表å¯è½è¢«éçå¨HBaseå´ä»¥ååä¹ä¸ä¼è¢«æ¥è¯¢ï¼è½ç¶Kylinå·²ç»å¼å§åèªå¨åçåå¾åæ¶ï¼ä½ä¸ä¸å®è½è¦çå°ææçæ åµï¼ä½ å¯ä»¥å®æå离线çåå¨æ¸ çï¼</p> + <p>Kylin å¨æ建 cube æé´ä¼å¨ HDFS ä¸çæä¸é´æ件ï¼é¤æ¤ä¹å¤ï¼å½æ¸ ç/å é¤/å并 cube æ¶ï¼ä¸äº HBase 表å¯è½è¢«éçå¨ HBase å´ä»¥ååä¹ä¸ä¼è¢«æ¥è¯¢ï¼è½ç¶ Kylin å·²ç»å¼å§åèªå¨åçåå¾åæ¶ï¼ä½ä¸ä¸å®è½è¦çå°ææçæ åµï¼ä½ å¯ä»¥å®æå离线çåå¨æ¸ çï¼</p> <p>æ¥éª¤ï¼<br /> 1. æ£æ¥åªäºèµæºå¯ä»¥æ¸ çï¼è¿ä¸æ¥ä¸ä¼å é¤ä»»ä½ä¸è¥¿ï¼</p> @@ -174,12 +174,17 @@ var _hmt = _hmt || []; <div class="highlight"><pre><code class="language-groff" data-lang="groff">export KYLIN_HOME=/path/to/kylin_home ${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --delete false</code></pre></div> -<p>请å°è¿éç (version) æ¿æ¢ä¸ºä½ å®è£ çKylin jarçæ¬ã<br /> +<p>请å°è¿éç (version) æ¿æ¢ä¸ºä½ å®è£ ç Kylin jar çæ¬ã<br /> 2. ä½ å¯ä»¥æ½æ¥ä¸ä¸¤ä¸ªèµæºæ¥æ£æ¥å®ä»¬æ¯å¦å·²ç»æ²¡æ被å¼ç¨äºï¼ç¶åå ä¸ââdelete trueâé项è¿è¡æ¸ çã</p> <div class="highlight"><pre><code class="language-groff" data-lang="groff">${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --delete true</code></pre></div> -<p>å®æåï¼ä¸é´HDFSä¸çä¸é´æ件åHTableä¼è¢«ç§»é¤ã</p> +<p>å®æåï¼Hive éçä¸é´è¡¨, HDFS ä¸çä¸é´æ件å HBase ä¸ç HTables é½ä¼è¢«ç§»é¤ã<br /> +3. å¦ææ¨æ³è¦å é¤ææèµæºï¼å¯æ·»å ââforce trueâ é项ï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --force true --delete true</code></pre></div> + +<p>å®æåï¼Hive ä¸ææçä¸é´è¡¨, HDFS ä¸ææçä¸é´æ件å HBase ä¸ç HTables é½ä¼è¢«ç§»é¤ã</p> </article> </div> Modified: kylin/site/docs/gettingstarted/best_practices.html URL: http://svn.apache.org/viewvc/kylin/site/docs/gettingstarted/best_practices.html?rev=1845476&r1=1845475&r2=1845476&view=diff ============================================================================== --- kylin/site/docs/gettingstarted/best_practices.html (original) +++ kylin/site/docs/gettingstarted/best_practices.html Thu Nov 1 14:08:38 2018 @@ -6047,6 +6047,26 @@ var _hmt = _hmt || []; </li> </ul> +<p><strong>Here are online tutorials for self-studying Kylin:</strong></p> + +<ul> + <li> + <p>Free Kylin tutorial (registration needed), from the core developers, in Chinese:<br /> +<a href="https://www.chinahadoop.cn/search?q=kylin">https://www.chinahadoop.cn/search?q=kylin</a></p> + </li> + <li> + <p>A paid Kylin tutorial on Udemy, in English:<br /> +<a href="https://www.udemy.com/apache-kylin-implementing-olap-on-the-hadoop-platform">https://www.udemy.com/apache-kylin-implementing-olap-on-the-hadoop-platform</a></p> + </li> + <li> + <p>Tutorial of Kylin on Tableau, in Spanish: <br /> +<a href="https://www.youtube.com/watch?v=k6fBw8yA1NI">https://www.youtube.com/watch?v=k6fBw8yA1NI</a></p> + </li> +</ul> + +<p>Besides, there is also some video of Kylin on the conferences; You can search for them on Youtube:<br /> +<a href="https://www.youtube.com/results?search_query=Apache+Kylin">https://www.youtube.com/results?search_query=Apache+Kylin</a></p> + </article> </div> </div> Modified: kylin/site/docs/gettingstarted/faq.html URL: http://svn.apache.org/viewvc/kylin/site/docs/gettingstarted/faq.html?rev=1845476&r1=1845475&r2=1845476&view=diff ============================================================================== --- kylin/site/docs/gettingstarted/faq.html (original) +++ kylin/site/docs/gettingstarted/faq.html Thu Nov 1 14:08:38 2018 @@ -6215,6 +6215,12 @@ var _hmt = _hmt || []; <p>If you can accept the absence of new dimensions for historical data, you can build the new cube since the end time of the old cube. And then create a hybrid model over the old and new cube.</p> +<h4 id="how-to-solve-the-data-security-problem-of-tableau-connection-client">How to solve the data security problem of Tableau connection client?</h4> + +<ul> + <li>Kylinâs ACL control can solve this problem. Different analysts have the authority to work on different projects for Kylin. When you create a Kylin ODBC DSN, you can map different links to different analyst accounts.</li> +</ul> + <h4 id="the-query-result-is-not-exactly-matched-with-that-in-hive-whats-the-possible-reason">The query result is not exactly matched with that in Hive, whatâs the possible reason?</h4> <ul> Modified: kylin/site/docs/howto/howto_backup_metadata.html URL: http://svn.apache.org/viewvc/kylin/site/docs/howto/howto_backup_metadata.html?rev=1845476&r1=1845475&r2=1845476&view=diff ============================================================================== --- kylin/site/docs/howto/howto_backup_metadata.html (original) +++ kylin/site/docs/howto/howto_backup_metadata.html Thu Nov 1 14:08:38 2018 @@ -6071,15 +6071,15 @@ mkdir /path/to/restore_new/cube</code></ <h2 id="cleanup-unused-resources-from-metadata-store">Cleanup unused resources from metadata store</h2> <p>As time goes on, some resources like dictionary, table snapshots became useless (as the cube segment be dropped or merged), but they still take space there; You can run command to find and cleanup them from metadata store:</p> -<p>Firstly, run a check, this is safe as it will not change anything:</p> +<p>Firstly, run a check, this is safe as it will not change anything, you can set the number of days to keep metadata resource by adding the ââjobThreshold 30(default, you can change to any number)â option:</p> -<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean</code></pre></div> +<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean --jobThreshold 30</code></pre></div> <p>The resources that will be dropped will be listed;</p> <p>Next, add the ââdelete trueâ parameter to cleanup those resources; before this, make sure you have made a backup of the metadata store;</p> -<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean --delete true</code></pre></div> +<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean --delete true --jobThreshold 30</code></pre></div> </article> Modified: kylin/site/docs/howto/howto_cleanup_storage.html URL: http://svn.apache.org/viewvc/kylin/site/docs/howto/howto_cleanup_storage.html?rev=1845476&r1=1845475&r2=1845476&view=diff ============================================================================== --- kylin/site/docs/howto/howto_cleanup_storage.html (original) +++ kylin/site/docs/howto/howto_cleanup_storage.html Thu Nov 1 14:08:38 2018 @@ -6029,7 +6029,12 @@ ${KYLIN_HOME}/bin/kylin.sh org.apache.ky <div class="highlight"><pre><code class="language-groff" data-lang="groff">${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --delete true</code></pre></div> -<p>On finish, the intermediate HDFS location and HTables should be dropped;</p> +<p>On finish, the intermediate Hive tables, HDFS location and HTables should be dropped;<br /> +3. If you want to delete all resources, then add the ââforce trueâ option to start the cleanup:</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --force true --delete true</code></pre></div> + +<p>On finish, all the intermediate Hive tables, HDFS location and HTables should be dropped;</p> </article> </div> Modified: kylin/site/feed.xml URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1845476&r1=1845475&r2=1845476&view=diff ============================================================================== --- kylin/site/feed.xml (original) +++ kylin/site/feed.xml Thu Nov 1 14:08:38 2018 @@ -19,8 +19,8 @@ <description>Apache Kylin Home</description> <link>http://kylin.apache.org/</link> <atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/> - <pubDate>Mon, 29 Oct 2018 23:21:00 -0700</pubDate> - <lastBuildDate>Mon, 29 Oct 2018 23:21:00 -0700</lastBuildDate> + <pubDate>Thu, 01 Nov 2018 06:59:23 -0700</pubDate> + <lastBuildDate>Thu, 01 Nov 2018 06:59:23 -0700</lastBuildDate> <generator>Jekyll v2.5.3</generator> <item>