Repository: drill-site Updated Branches: refs/heads/asf-site 89db86a48 -> 36b5428e1
edits to title levels in docs Project: http://git-wip-us.apache.org/repos/asf/drill-site/repo Commit: http://git-wip-us.apache.org/repos/asf/drill-site/commit/36b5428e Tree: http://git-wip-us.apache.org/repos/asf/drill-site/tree/36b5428e Diff: http://git-wip-us.apache.org/repos/asf/drill-site/diff/36b5428e Branch: refs/heads/asf-site Commit: 36b5428e1b8ce499267b78d1459c69b422d00525 Parents: 89db86a Author: Bridget Bevens <[email protected]> Authored: Wed Feb 7 18:39:27 2018 -0800 Committer: Bridget Bevens <[email protected]> Committed: Wed Feb 7 18:39:27 2018 -0800 ---------------------------------------------------------------------- .../index.html | 12 +++---- docs/configuring-user-security/index.html | 15 ++++----- docs/drill-default-input-format/index.html | 4 +-- .../index.html | 14 ++++----- docs/opentsdb-storage-plugin/index.html | 33 ++++++++++++++------ docs/rdbms-storage-plugin/index.html | 16 +++++----- docs/s3-storage-plugin/index.html | 8 ++--- feed.xml | 4 +-- 8 files changed, 61 insertions(+), 45 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/drill-site/blob/36b5428e/docs/analyzing-highly-dynamic-datasets/index.html ---------------------------------------------------------------------- diff --git a/docs/analyzing-highly-dynamic-datasets/index.html b/docs/analyzing-highly-dynamic-datasets/index.html index 2b46015..3ef969b 100644 --- a/docs/analyzing-highly-dynamic-datasets/index.html +++ b/docs/analyzing-highly-dynamic-datasets/index.html @@ -1147,7 +1147,7 @@ </div> - Dec 16, 2017 + Feb 8, 2018 <link href="/css/docpage.css" rel="stylesheet" type="text/css"> @@ -1171,7 +1171,7 @@ } </code></pre></div> <p>It is worth repeating the comment at the bottom of this snippet:</p> -<div class="highlight"><pre><code class="language-text" data-lang="text"> # if there was no checkin for a hour-day block it will not be in the dataset. +<div class="highlight"><pre><code class="language-text" data-lang="text"> If there was no checkin for a hour-day block it will not be in the dataset. </code></pre></div> <p>The element names that you see in the <code>checkin_info</code> are unknown upfront and can vary for every row. The data, although simple, is highly dynamic data. To analyze the data there is no need to first represent this dataset in a flattened relational structure, as you would using any other SQL on Hadoop technology.</p> @@ -1250,7 +1250,7 @@ tar -xvf apache-drill-1.12.0.tar <p>On the output of flattened data, you use standard SQL functionality such as filters , aggregates, and sort. Letâs see a few examples.</p> -<h3 id="get-the-total-number-of-check-ins-recorded-in-the-yelp-dataset">Get the total number of check-ins recorded in the Yelp dataset</h3> +<p><strong>Get the total number of check-ins recorded in the Yelp dataset</strong></p> <div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> SELECT SUM(checkintbl.checkins.`value`) AS TotalCheckins FROM ( . . . . . . . . . . . > SELECT FLATTEN(KVGEN(checkin_info)) checkins FROM dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_checkin.json` ) checkintbl . . . . . . . . . . . > ; @@ -1260,7 +1260,7 @@ tar -xvf apache-drill-1.12.0.tar | 4713811 | +---------------+ </code></pre></div> -<h3 id="get-the-number-of-check-ins-specifically-for-sunday-midnights">Get the number of check-ins specifically for Sunday midnights</h3> +<p><strong>Get the number of check-ins specifically for Sunday midnights</strong></p> <div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> SELECT SUM(checkintbl.checkins.`value`) AS SundayMidnightCheckins FROM ( . . . . . . . . . . . > SELECT FLATTEN(KVGEN(checkin_info)) checkins FROM dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_checkin.json` ) checkintbl WHERE checkintbl.checkins.key='23-0'; +------------------------+ @@ -1269,7 +1269,7 @@ tar -xvf apache-drill-1.12.0.tar | 8575 | +------------------------+ </code></pre></div> -<h3 id="get-the-number-of-check-ins-per-day-of-the-week">Get the number of check-ins per day of the week</h3> +<p><strong>Get the number of check-ins per day of the week</strong> </p> <div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> SELECT `right`(checkintbl.checkins.key,1) WeekDay,sum(checkintbl.checkins.`value`) TotalCheckins from ( . . . . . . . . . . . > select flatten(kvgen(checkin_info)) checkins FROM dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_checkin.json` ) checkintbl GROUP BY `right`(checkintbl.checkins.key,1) ORDER BY TotalCheckins; +------------+---------------+ @@ -1284,7 +1284,7 @@ tar -xvf apache-drill-1.12.0.tar | 5 | 937201 | +------------+---------------+ </code></pre></div> -<h3 id="get-the-number-of-check-ins-per-hour-of-the-day">Get the number of check-ins per hour of the day</h3> +<p><strong>Get the number of check-ins per hour of the day</strong></p> <div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> SELECT SUBSTR(checkintbl.checkins.key,1,strpos(checkintbl.checkins.key,'-')-1) AS HourOfTheDay ,SUM(checkintbl.checkins.`value`) TotalCheckins FROM ( . . . . . . . . . . . > SELECT FLATTEN(KVGEN(checkin_info)) checkins FROM dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_checkin.json` ) checkintbl GROUP BY SUBSTR(checkintbl.checkins.key,1,strpos(checkintbl.checkins.key,'-')-1) ORDER BY TotalCheckins; +--------------+---------------+ http://git-wip-us.apache.org/repos/asf/drill-site/blob/36b5428e/docs/configuring-user-security/index.html ---------------------------------------------------------------------- diff --git a/docs/configuring-user-security/index.html b/docs/configuring-user-security/index.html index 62337d6..9bf514c 100644 --- a/docs/configuring-user-security/index.html +++ b/docs/configuring-user-security/index.html @@ -1149,13 +1149,13 @@ </div> - May 17, 2017 + Feb 8, 2018 <link href="/css/docpage.css" rel="stylesheet" type="text/css"> <div class="int_text" align="left"> - <h3 id="authentication">Authentication</h3> + <h2 id="authentication">Authentication</h2> <p>Authentication is the process of establishing confidence of authenticity. A Drill client user is authenticated when a drillbit process running in a Drill cluster confirms the identity it is presented with. Drill supports several authentication mechanisms through which users can prove their identity before accessing cluster data: </p> @@ -1167,7 +1167,7 @@ <p>These authentication options are available through JDBC and ODBC interfaces. </p> -<h3 id="encryption">Encryption</h3> +<h2 id="encryption">Encryption</h2> <p>Drill 1.11 introduces client-to-drillbit encryption for over-the-wire security using the Kerberos to:</p> @@ -1181,13 +1181,14 @@ <div class="admonition note"> <p class="first admonition-title">Note</p> <p class="last">The Plain mechanism does not support encryption. </p> -</div> +</div> + -<h4 id="cipher-strength">Cipher Strength</h4> +<p><strong>Cipher Strength</strong></p> <p>By default, the highest security level is negotiated during the SASL handshake for each client-to-drillbit connection so that the AES-256 ciper is used when supported by key distribution center (KDC) encryption types. See <a href="http://web.mit.edu/kerberos/krb5-1.13/doc/admin/enctypes.html%5D(http://web.mit.edu/kerberos/krb5-1.13/doc/admin/enctypes.html"; title="Encryption Types">Encryption Types</a> in the MIT Kerberos documentation for details about specific combinations of cipher algorithms. </p> -<h4 id="client-compatibility">Client Compatibility</h4> +<p><strong>Client Compatibility</strong> </p> <p>The following table shows Drill client version compatibility with secure Drill clusters enabled with encryption. Drill 1.10 clients and lower do not support encryption and will not be allowed to connect to a drillbit with encryption enabled. </p> @@ -1195,7 +1196,7 @@ <p>See <em>Client Encryption</em> in <a href="/docs/server-communication-paths/#configuring-kerberos-security#client-encryption">Configuring Kerberos Security</a> for the client connection string parameter, <code>sasl_encrypt</code> usage information.</p> -<h3 id="impersonation">Impersonation</h3> +<h2 id="impersonation">Impersonation</h2> <p>Enabling both user impersonation and authentication is recommended to restrict access to data and improve security. When user impersonation is enabled, Drill executes the client requests as the authenticated user. Otherwise, Drill executes client requests as the user that started the drillbit process. </p> http://git-wip-us.apache.org/repos/asf/drill-site/blob/36b5428e/docs/drill-default-input-format/index.html ---------------------------------------------------------------------- diff --git a/docs/drill-default-input-format/index.html b/docs/drill-default-input-format/index.html index 8baf273..bce72c7 100644 --- a/docs/drill-default-input-format/index.html +++ b/docs/drill-default-input-format/index.html @@ -1149,7 +1149,7 @@ </div> - + Feb 8, 2018 <link href="/css/docpage.css" rel="stylesheet" type="text/css"> @@ -1186,7 +1186,7 @@ Drill supports. Currently, Drill supports the following input types:</p> <li>In the Configuration area, locate the workspace, and change the <code>defaultInputFormat</code> attribute to any of the supported file types.</li> </ol> -<h3 id="example-of-defining-a-default-input-format">Example of Defining a Default Input Format</h3> +<h2 id="example-of-defining-a-default-input-format">Example of Defining a Default Input Format</h2> <div class="highlight"><pre><code class="language-text" data-lang="text">{ "type": "file", "enabled": true, http://git-wip-us.apache.org/repos/asf/drill-site/blob/36b5428e/docs/lesson-1-learn-about-the-data-set/index.html ---------------------------------------------------------------------- diff --git a/docs/lesson-1-learn-about-the-data-set/index.html b/docs/lesson-1-learn-about-the-data-set/index.html index 74eee66..a9807de 100644 --- a/docs/lesson-1-learn-about-the-data-set/index.html +++ b/docs/lesson-1-learn-about-the-data-set/index.html @@ -1149,7 +1149,7 @@ </div> - + Feb 8, 2018 <link href="/css/docpage.css" rel="stylesheet" type="text/css"> @@ -1426,7 +1426,7 @@ setup beyond the definition of a workspace.</p> <h3 id="query-nested-clickstream-data">Query nested clickstream data</h3> -<h4 id="set-the-workspace-to-dfs.clicks:">Set the workspace to dfs.clicks:</h4> +<h3 id="set-the-workspace-to-dfs.clicks:">Set the workspace to dfs.clicks:</h3> <div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:> use dfs.clicks; +-------+-----------------------------------------+ | ok | summary | @@ -1447,7 +1447,7 @@ location specified in the workspace. For example:</p> relative to this path. The clicks directory referred to in the following query is directly below the nested directory.</p> -<h4 id="select-2-rows-from-the-clicks.json-file:">Select 2 rows from the clicks.json file:</h4> +<h3 id="select-2-rows-from-the-clicks.json-file:">Select 2 rows from the clicks.json file:</h3> <div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:> select * from `clicks/clicks.json` limit 2; +-----------+-------------+-----------+---------------------------------------------------+-------------------------------------------+ | trans_id | date | time | user_info | trans_info | @@ -1465,7 +1465,7 @@ to refer to a file in a local or distributed file system.</p> path. This is necessary whenever the file path contains Drill reserved words or characters.</p> -<h4 id="select-2-rows-from-the-campaign.json-file:">Select 2 rows from the campaign.json file:</h4> +<h3 id="select-2-rows-from-the-campaign.json-file:">Select 2 rows from the campaign.json file:</h3> <div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:> select * from `clicks/clicks.campaign.json` limit 2; +-----------+-------------+-----------+---------------------------------------------------+---------------------+----------------------------------------+ | trans_id | date | time | user_info | ad_info | trans_info | @@ -1499,7 +1499,7 @@ for that month. The total number of records in all log files is 48000.</p> are many of these files, but you can use Drill to query them all as a single data source, or to query a subset of the files.</p> -<h4 id="set-the-workspace-to-dfs.logs:">Set the workspace to dfs.logs:</h4> +<h3 id="set-the-workspace-to-dfs.logs:">Set the workspace to dfs.logs:</h3> <div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:> use dfs.logs; +-------+---------------------------------------+ | ok | summary | @@ -1508,7 +1508,7 @@ data source, or to query a subset of the files.</p> +-------+---------------------------------------+ 1 row selected </code></pre></div> -<h4 id="select-2-rows-from-the-logs-directory:">Select 2 rows from the logs directory:</h4> +<h3 id="select-2-rows-from-the-logs-directory:">Select 2 rows from the logs directory:</h3> <div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:> select * from logs limit 2; +-------+-------+-----------+-------------+-----------+----------+---------+--------+----------+-----------+----------+-------------+ | dir0 | dir1 | trans_id | date | time | cust_id | device | state | camp_id | keywords | prod_id | purch_flag | @@ -1527,7 +1527,7 @@ directory path on the file system.</p> subdirectories below the logs directory. In Lesson 3, you will do more complex queries that leverage these dynamic variables.</p> -<h4 id="find-the-total-number-of-rows-in-the-logs-directory-(all-files):">Find the total number of rows in the logs directory (all files):</h4> +<h3 id="find-the-total-number-of-rows-in-the-logs-directory-(all-files):">Find the total number of rows in the logs directory (all files):</h3> <div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:> select count(*) from logs; +---------+ | EXPR$0 | http://git-wip-us.apache.org/repos/asf/drill-site/blob/36b5428e/docs/opentsdb-storage-plugin/index.html ---------------------------------------------------------------------- diff --git a/docs/opentsdb-storage-plugin/index.html b/docs/opentsdb-storage-plugin/index.html index cdcbb5b..56b6d90 100644 --- a/docs/opentsdb-storage-plugin/index.html +++ b/docs/opentsdb-storage-plugin/index.html @@ -1147,7 +1147,7 @@ </div> - Feb 6, 2018 + Feb 8, 2018 <link href="/css/docpage.css" rel="stylesheet" type="text/css"> @@ -1161,9 +1161,9 @@ <h2 id="enabling-the-opentsdb-storage-plugin">Enabling the OpenTSDB Storage Plugin</h2> -<p>To enable the OpenTSDB storage plugin, enter the following URL in the address bar of your browser to access the Storage page in the Drill Web Console: -http://<drill-node-ip-address>:8047/storage/</p> - +<p>To enable the OpenTSDB storage plugin, enter the following URL in the address bar of your browser to access the Storage page in the Drill Web Console: </p> +<div class="highlight"><pre><code class="language-text" data-lang="text"> http://<drill-node-ip-address>:8047/storage/ +</code></pre></div> <p>In the Disabled Storage Plugins section, click <strong>Enable</strong> next to OpenTSDB. OpenTSDB moves to the Enabled Storage Plugins section. Click <strong>Update</strong> to see the default configuration:</p> <div class="highlight"><pre><code class="language-text" data-lang="text"> { "type": "openTSDB", @@ -1211,11 +1211,26 @@ Click <strong>Update</strong> if you edit the configuration and then click <stro <h3 id="optional-request-parameters">Optional Request Parameters</h3> -<p>The following table lists optional request parameters:<br> -| <strong>Name</strong> | <strong>Data Type</strong> | <strong>Description</strong> | -|------------|-----------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| -| downsample | string | An optional downsampling function to reduce the amount of data returned. | -| end | string, integer | An end time for the query. If not supplied, the TSD assumes the local system time on the server. If this parameter is not specified, null is sent to the database in this field, but in this case the database assumes the local system time on the server. | </p> +<p>The following table lists optional request parameters: </p> + +<table><thead> +<tr> +<th><strong>Name</strong></th> +<th><strong>Data Type</strong></th> +<th><strong>Description</strong></th> +</tr> +</thead><tbody> +<tr> +<td>downsample</td> +<td>string</td> +<td>An optional downsampling function to reduce the amount of data returned.</td> +</tr> +<tr> +<td>end</td> +<td>string, integer</td> +<td>An end time for the query. If not supplied, the TSD assumes the local system time on the server. If this parameter is not specified, null is sent to the database in this field, but in this case the database assumes the local system time on the server.</td> +</tr> +</tbody></table> <h3 id="supported-aggregators">Supported Aggregators</h3> http://git-wip-us.apache.org/repos/asf/drill-site/blob/36b5428e/docs/rdbms-storage-plugin/index.html ---------------------------------------------------------------------- diff --git a/docs/rdbms-storage-plugin/index.html b/docs/rdbms-storage-plugin/index.html index dc1cc1a..8cff5ff 100644 --- a/docs/rdbms-storage-plugin/index.html +++ b/docs/rdbms-storage-plugin/index.html @@ -1147,7 +1147,7 @@ </div> - Jul 25, 2017 + Feb 8, 2018 <link href="/css/docpage.css" rel="stylesheet" type="text/css"> @@ -1157,7 +1157,7 @@ <p>As with any source, Drill supports joins within and between all systems. Drill additionally has powerful pushdown capabilities with RDBMS sources. This includes support to push down join, where, group by, intersect and other SQL operations into a particular RDBMS source (as appropriate).</p> -<h3 id="using-the-rdbms-storage-plugin">Using the RDBMS Storage Plugin</h3> +<h2 id="using-the-rdbms-storage-plugin">Using the RDBMS Storage Plugin</h2> <p>Drill is designed to work with any relational datastore that provides a JDBC driver. Drill is actively tested with Postgres, MySQL, Oracle, MSSQL and Apache Derby. For each system, you will follow three basic steps for setup:</p> @@ -1168,7 +1168,7 @@ <li>Add a new storage configuration to Drill through the Web Console. Example configurations for <a href="#Example-Oracle-Configuration">Oracle</a>, <a href="#Example-SQL-Server-Configuration">SQL Server</a>, <a href="#Example-MySQL-Configuration">MySQL</a> and <a href="#Example-Postgres-Configuration">Postgres</a> are provided below.</li> </ol> -<h2 id="example:-working-with-mysql">Example: Working with MySQL</h2> +<p><strong>Example: Working with MySQL</strong></p> <p>Drill communicates with MySQL through the JDBC driver using the configuration that you specify in the Web Console or through the <a href="/docs/plugin-configuration-basics/#storage-plugin-rest-api">REST API</a>. </p> @@ -1216,7 +1216,7 @@ Each configuration registered with Drill must have a distinct name. Names are ca </code></pre></div> <h2 id="example-configurations">Example Configurations</h2> -<h3 id="example-oracle-configuration">Example Oracle Configuration</h3> +<p><strong>Example Oracle Configuration</strong></p> <p>Download and install Oracle's Thin <a href="http://www.oracle.com/technetwork/database/features/jdbc/default-2280470.html";>ojdbc7.12.1.0.2.jar</a> driver and copy it to all nodes in your cluster.</p> <div class="highlight"><pre><code class="language-text" data-lang="text">{ @@ -1226,7 +1226,7 @@ Each configuration registered with Drill must have a distinct name. Names are ca url:"jdbc:oracle:thin:user/[email protected]:1521/ORCL" } </code></pre></div> -<h3 id="example-sql-server-configuration">Example SQL Server Configuration</h3> +<p><strong>Example SQL Server Configuration</strong></p> <p>For SQL Server, Drill has been tested with Microsoft's <a href="https://www.microsoft.com/en-US/download/details.aspx?id=11774";>sqljdbc41.4.2.6420.100.jar</a> driver. Copy this jar file to all Drillbits. </p> @@ -1243,7 +1243,7 @@ Each configuration registered with Drill must have a distinct name. Names are ca password:"password" } </code></pre></div> -<h3 id="example-mysql-configuration">Example MySQL Configuration</h3> +<p><strong>Example MySQL Configuration</strong></p> <p>For MySQL, Drill has been tested with MySQL's <a href="http://dev.mysql.com/downloads/connector/j/";>mysql-connector-java-5.1.37-bin.jar</a> driver. Copy this to all nodes.</p> <div class="highlight"><pre><code class="language-text" data-lang="text">{ @@ -1253,9 +1253,9 @@ Each configuration registered with Drill must have a distinct name. Names are ca url:"jdbc:mysql://1.2.3.4", username:"user", password:"password" -} +} </code></pre></div> -<h3 id="example-postgres-configuration">Example Postgres Configuration</h3> +<p><strong>Example Postgres Configuration</strong></p> <p>For Postgres, Drill has been tested with Postgres's <a href="http://central.maven.org/maven2/org/postgresql/postgresql/";>9.1-901-1.jdbc4</a> driver (any recent driver should work). Copy this driver file to all nodes.</p> http://git-wip-us.apache.org/repos/asf/drill-site/blob/36b5428e/docs/s3-storage-plugin/index.html ---------------------------------------------------------------------- diff --git a/docs/s3-storage-plugin/index.html b/docs/s3-storage-plugin/index.html index 6dcb754..732260e 100644 --- a/docs/s3-storage-plugin/index.html +++ b/docs/s3-storage-plugin/index.html @@ -1147,7 +1147,7 @@ </div> - + Feb 8, 2018 <link href="/css/docpage.css" rel="stylesheet" type="text/css"> @@ -1161,7 +1161,7 @@ <p>There are two simple steps to follow: (1) provide your AWS credentials (2) configure S3 storage plugin with S3 bucket</p> -<h4 id="(1)-aws-credentials">(1) AWS credentials</h4> +<p><strong>(1) AWS credentials</strong></p> <p>To enable Drill's S3a support, edit the file conf/core-site.xml in your Drill install directory, replacing the text ENTER_YOUR_ACESSKEY and ENTER_YOUR_SECRETKEY with your AWS credentials.</p> <div class="highlight"><pre><code class="language-text" data-lang="text"><configuration> @@ -1178,7 +1178,7 @@ </configuration> </code></pre></div> -<h4 id="(2)-configure-s3-storage-plugin">(2) Configure S3 Storage Plugin</h4> +<p><strong>(2) Configure S3 Storage Plugin</strong></p> <p>Enable S3 storage plugin if you already have one configured or you can add a new plugin by following these steps:</p> @@ -1192,7 +1192,7 @@ <p>You should now be able to talk to data stored on S3 using the S3a library.</p> -<h2 id="example-s3-storage-plugin">Example S3 Storage Plugin</h2> +<p><strong>Example S3 Storage Plugin</strong></p> <div class="highlight"><pre><code class="language-text" data-lang="text">{ "type": "file", "enabled": true, http://git-wip-us.apache.org/repos/asf/drill-site/blob/36b5428e/feed.xml ---------------------------------------------------------------------- diff --git a/feed.xml b/feed.xml index 5952a08..af7a909 100644 --- a/feed.xml +++ b/feed.xml @@ -6,8 +6,8 @@ </description> <link>/</link> <atom:link href="/feed.xml" rel="self" type="application/rss+xml"/> - <pubDate>Wed, 07 Feb 2018 16:46:46 -0800</pubDate> - <lastBuildDate>Wed, 07 Feb 2018 16:46:46 -0800</lastBuildDate> + <pubDate>Wed, 07 Feb 2018 18:35:47 -0800</pubDate> + <lastBuildDate>Wed, 07 Feb 2018 18:35:47 -0800</lastBuildDate> <generator>Jekyll v2.5.2</generator> <item>
