This is an automated email from the ASF dual-hosted git repository.
bridgetb pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/drill-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new f0475b4 updates for maprdb format plugin options, rn update
f0475b4 is described below
commit f0475b4ec016f0671bbcc30735278c45515db753
Author: Bridget Bevens <[email protected]>
AuthorDate: Fri May 24 15:57:26 2019 -0700
updates for maprdb format plugin options, rn update
---
docs/apache-drill-1-16-0-release-notes/index.html | 2 +
docs/data-type-conversion/index.html | 45 ++++++++++++++++++++---
docs/mapr-db-format/index.html | 6 ++-
docs/refresh-table-metadata/index.html | 7 +++-
docs/running-drill-on-docker/index.html | 14 +++----
feed.xml | 4 +-
6 files changed, 60 insertions(+), 18 deletions(-)
diff --git a/docs/apache-drill-1-16-0-release-notes/index.html
b/docs/apache-drill-1-16-0-release-notes/index.html
index cc8fe3e..01a5af3 100644
--- a/docs/apache-drill-1-16-0-release-notes/index.html
+++ b/docs/apache-drill-1-16-0-release-notes/index.html
@@ -1342,6 +1342,8 @@
<li>Ability to query Hive views, like querying Hive tables in a hive schema,
for example <code>SELECT * FROM hive.</code>hive_view`; (<a
href="https://issues.apache.org/jira/browse/DRILL-540";>DRILL-540</a>)</li>
<li><a href="/docs/configuring-the-drill-shell/">Upgrade to SQLLine 1.7</a>
changes the default prompt to <code>apache drill (schema_name)></code> or
you can define a custom prompt using the command <code>!set prompt
<new-prompt></code>. (<a
href="https://issues.apache.org/jira/browse/DRILL-6989";>DRILL-6989</a>) </li>
<li>Calcite updated to version 1.18.0 (<a
href="https://issues.apache.org/jira/browse/DRILL-6862";>DRILL-6862</a>)<br></li>
+<li>A new maprdb format plugin option,
<code>readTimestampWithZoneOffset</code>, converts timestamp values from UTC to
local time zone when values are read from MapR Database. This option is
disabled by default. (<a
href="https://issues.apache.org/jira/browse/DRILL-6969";>DRILL-6969</a>)<br></li>
+<li>A new Drill configuration option,
<code>store.hive.maprdb_json.read_timestamp_with_timezone_offset</code>,
enables Drill to read timestamp values with a timezone offset when using the
hive plugin with the Drill native MaprDB JSON reader enabled. This option is
disabled by default. (<a
href="https://issues.apache.org/jira/browse/DRILL-6969";>DRILL-6969</a>)<br></li>
<li>Several Drill Web UI improvements, including:
<ul>
diff --git a/docs/data-type-conversion/index.html
b/docs/data-type-conversion/index.html
index d7c317b..b544ffc 100644
--- a/docs/data-type-conversion/index.html
+++ b/docs/data-type-conversion/index.html
@@ -1320,7 +1320,7 @@
</div>
- Feb 19, 2019
+ May 24, 2019
<link href="/css/docpage.css" rel="stylesheet" type="text/css">
@@ -1335,7 +1335,7 @@
<li><a href="/docs/data-type-conversion/#other-data-type-conversions">Other
Data Type Conversions</a><br></li>
</ul>
-<p><strong>Note:</strong> Starting in Drill 1.15, all cast and data type
conversion functions return null for an empty string ('') when the
<code>drill.exec.functions.cast_empty_string_to_null</code> option is enabled,
for example: </p>
+<p>Starting in Drill 1.15, all cast and data type conversion functions return
null for an empty string ('') when the
<code>drill.exec.functions.cast_empty_string_to_null</code> option is enabled,
for example: </p>
<div class="highlight"><pre><code class="language-text"
data-lang="text">SELECT CAST('' AS DATE), TO_TIMESTAMP('',
'yyyy-MM-dd HH:mm:ss') FROM (VALUES(2));
+---------+---------+
| EXPR$0 | EXPR$1 |
@@ -2348,11 +2348,46 @@ FROM (VALUES(1));
+------------------------+---------+
| 2015-03-30 20:49:00.0 | UTC |
+------------------------+---------+
-1 row selected (0.148 seconds)
+1 row selected (0.148 seconds)
</code></pre></div>
+<h2 id="enabling-time-zone-offset">Enabling Time Zone Offset</h2>
+
+<p>Starting in Drill 1.16, the
<code>store.hive.maprdb_json.read_timestamp_with_timezone_offset</code> option
enables Drill to read timestamp values with a timezone offset when using the
hive plugin with the Drill native MaprDB JSON reader enabled through the
<code>store.hive.maprdb_json.optimize_scan_with_native_reader option</code>.
The <code>store.hive.maprdb_json.read_timestamp_with_timezone_offset</code>
option is disabled (set to 'false') by default. You can enable this op
[...]
+
+<p><strong>Important</strong><br>
+Internally, Drill stores timestamp values in UTC format, for example
2018-01-01T20:12:12.123Z. When you enable the timezone offset option, select on
a table returns different timestamp values. If you filter on timestamp values
when this option is enabled, you must include the new timestamp value in the
filter condition. </p>
+
+<p>For example, look at the timestamp values when the
<code>store.hive.maprdb_json.read_timestamp_with_timezone_offset</code> option
is disabled (set to 'false'): </p>
+<div class="highlight"><pre><code class="language-text"
data-lang="text">select * from dfs.`/tmp/timestamp`;
+-------------------------------------------------------
+_id datestring datetimestamp
+-------------------------------------------------------
+1 2018-01-01 12:12:12.123 2018-01-01 20:12:12.123
+2 9999-12-31 23:59:59.999 10000-01-01 07:59:59.999
+-------------------------------------------------------
+</code></pre></div>
+<p>When the option is enabled (set to 'true'), you can see the
difference in the timestamp values returned: </p>
+<div class="highlight"><pre><code class="language-text"
data-lang="text">select * from dfs.`/tmp/timestamp`;
+------------------------------------------------------
+_id datestring datetimestamp
+------------------------------------------------------
+1 2018-01-01 12:12:12.123 2018-01-01 12:12:12.123
+2 9999-12-31 23:59:59.999 9999-12-31 23:59:59.999
+------------------------------------------------------
+</code></pre></div>
+<p>When the option is enabled, queries that filter on timestamp values must
include the new timestamp value in the filter condition, as shown: </p>
+<div class="highlight"><pre><code class="language-text"
data-lang="text">select * from dfs.`/tmp/timestamp` where
datetimestamp=timestamp '2018-01-01 12:12:12.123';
+------------------------------------------------------
+_id datestring datetimestamp
+------------------------------------------------------
+1 2018-01-01 12:12:12.123 2018-01-01 12:12:12.123
+------------------------------------------------------
+</code></pre></div>
+<p>Notice that the WHERE clause uses the <code>2018-01-01 12:12:12.123</code>
format versus the <code>2018-01-01 20:12:12.123</code> format.</p>
+
<h2 id="time-zone-limitation">Time Zone Limitation</h2>
-<p>Currently Drill does not support conversion of a date, time, or timestamp
from one time zone to another. Queries of data associated with a time zone can
return inconsistent results or an error. For more information, see the <a
href="http://www.openkb.info/2015/05/understanding-drills-timestamp-and.html#.VUzhotpVhHw";>"Understanding
Drill's Timestamp and Timezone"</a> blog. The Drill time zone is
based on the operating system time zone unless you override it. To work aroun
[...]
+<p>Drill does not support conversion of a date, time, or timestamp from one
time zone to another. Queries of data associated with a time zone can return
inconsistent results or an error. For more information, see the <a
href="http://www.openkb.info/2015/05/understanding-drills-timestamp-and.html#.VUzhotpVhHw";>"Understanding
Drill's Timestamp and Timezone"</a> blog. The Drill time zone is
based on the operating system time zone unless you override it. To work around
the limi [...]
<ol>
<li><p>Take a look at the Drill time zone configuration by running the
TIMEOFDAY function or by querying the system.options table. This TIMEOFDAY
function returns the local date and time with time zone information. </p>
@@ -2391,7 +2426,7 @@ FROM (VALUES(1));
+------------------------+-----------+
| 2015-03-30 20:49:00.0 | UTC |
+------------------------+-----------+
-1 row selected (0.097 seconds)
+1 row selected (0.097 seconds)
</code></pre></div>
<!-- DRILL-448 Support timestamp with time zone -->
diff --git a/docs/mapr-db-format/index.html b/docs/mapr-db-format/index.html
index bbd9eff..51beca9 100644
--- a/docs/mapr-db-format/index.html
+++ b/docs/mapr-db-format/index.html
@@ -1318,7 +1318,7 @@
</div>
- Jun 26, 2018
+ May 24, 2019
<link href="/css/docpage.css" rel="stylesheet" type="text/css">
@@ -1335,7 +1335,9 @@
<p><strong>Example</strong> </p>
<div class="highlight"><pre><code class="language-text" data-lang="text">
SELECT * FROM mfs.`/users/max/mytable`;
</code></pre></div>
-<p><strong>Note:</strong> Starting in Drill 1.14, the MapR Drill installation
package includes a hive-maprdb-json-handler, which enables you to create Hive
external tables from MapR-DB JSON tables and then query the tables using the
Hive schema. Drill can use the native Drill reader to read the Hive external
tables. The native Drill reader enables Drill to perform faster reads of data
and apply filter pushdown optimizations. The hive-maprdb-json-handler is not
included in the Apache Dril [...]
+<p>Starting in Drill 1.14, the MapR Drill installation package includes a
hive-maprdb-json-handler, which enables you to create Hive external tables from
MapR-DB JSON tables and then query the tables using the Hive schema. Drill can
use the native Drill reader to read the Hive external tables. The native Drill
reader enables Drill to perform faster reads of data and apply filter pushdown
optimizations. The hive-maprdb-json-handler is not included in the Apache Drill
installation package. </p>
+
+<p>Starting in Drill 1.16, you can include the
<code>readTimestampWithZoneOffset</code> option in the maprdb format plugin
configuration. When enabled (set to 'true'), Drill converts timestamp
values from UTC to local time zone when reading the values from MapR Database.
The option is disabled by default and does not impact the
<code>store.hive.maprdb_json.read_timestamp_with_timezone_offset</code>
setting. </p>
diff --git a/docs/refresh-table-metadata/index.html
b/docs/refresh-table-metadata/index.html
index 4ed3e5c..2031eb7 100644
--- a/docs/refresh-table-metadata/index.html
+++ b/docs/refresh-table-metadata/index.html
@@ -1320,7 +1320,7 @@
</div>
- Apr 30, 2019
+ May 24, 2019
<link href="/css/docpage.css" rel="stylesheet" type="text/css">
@@ -1407,7 +1407,10 @@ Sets the number of row groups that a table can have. You
can increase the thresh
<h2 id="limitations">Limitations</h2>
-<p>Currently, Drill does not support runtime rowgroup pruning. </p>
+<ul>
+<li>Drill does not support runtime rowgroup pruning.<br></li>
+<li>REFRESH TABLE METADATA does not count null values for decimal, varchar,
and interval data types.</li>
+</ul>
<h2 id="examples">Examples</h2>
diff --git a/docs/running-drill-on-docker/index.html
b/docs/running-drill-on-docker/index.html
index e465f38..f07b082 100644
--- a/docs/running-drill-on-docker/index.html
+++ b/docs/running-drill-on-docker/index.html
@@ -1320,15 +1320,15 @@
</div>
- May 2, 2019
+ May 24, 2019
<link href="/css/docpage.css" rel="stylesheet" type="text/css">
<div class="int_text" align="left">
- <p>Starting in Drill 1.14, you can run Drill in a <a
href="https://www.docker.com/what-container#/package_software";>Docker
container</a>. Running Drill in a container is the simplest way to start using
Drill; all you need is the Docker client installed on your machine. You simply
run a Docker command, and your Docker client downloads the Drill Docker image
from the apache-drill repository on <a
href="https://docs.docker.com/docker-hub/";>Docker Hub</a> and then brings up a
contain [...]
+ <p>Starting in Drill 1.14, you can run Drill in a <a
href="https://www.docker.com/what-container#/package_software";>Docker
container</a>. Running Drill in a container is the simplest way to start using
Drill; all you need is the Docker client installed on your machine. You simply
run a Docker command, and your Docker client downloads the Drill Docker image
from the apache-drill repository on <a
href="https://docs.docker.com/docker-hub/";>Docker Hub</a> and brings up a
container wi [...]
-<p><strong>Note:</strong> Currently, you can only run Drill in embedded mode
in a Docker container. Embedded mode is when a single instance of Drill runs on
a node or in a container. You do not have to perform any configuration tasks
when Drill runs in embedded mode. </p>
+<p>Currently, you can only run Drill in embedded mode in a Docker container.
Embedded mode is when a single instance of Drill runs on a node or in a
container. You do not have to perform any configuration tasks when Drill runs
in embedded mode. </p>
<h2 id="prerequisite">Prerequisite</h2>
@@ -1372,7 +1372,7 @@
</tr>
<tr>
<td><code>drill/apache-drill:<version></code></td>
-<td>The Docker Hub repository and tag. In the following example,
<code>drill/apache-drill</code> is the repository and <code>1.15.0</code>
is the tag: <code>drill/apache-drill:1.16.0</code> The tag correlates
with the version of Drill. When a new version of Drill is available, you can
use the new version as the tag.</td>
+<td>The Docker Hub repository and tag. In the following example,
<code>drill/apache-drill</code> is the repository and <code>1.16.0</code>
is the tag: <code>drill/apache-drill:1.16.0</code> The tag correlates
with the version of Drill. When a new version of Drill is available, you can
use the new version as the tag.</td>
</tr>
<tr>
<td><code>bin/bash</code></td>
@@ -1382,13 +1382,13 @@
<h3 id="running-the-drill-docker-container-in-foreground-mode">Running the
Drill Docker Container in Foreground Mode</h3>
-<p>Open a terminal window (Command Prompt or PowerShell, but not PowerShell
ISE) and then issue the following command and opitons to connect to SQLLine
(the Drill shell): </p>
+<p>Open a terminal window (Command Prompt or PowerShell, but not PowerShell
ISE) and then issue the following command and options to connect to SQLLine
(the Drill shell): </p>
<div class="highlight"><pre><code class="language-text" data-lang="text">
docker run -i --name drill-1.16.0 -p 8047:8047 -t drill/apache-drill:1.16.0
/bin/bash
</code></pre></div>
<p>When you issue the docker run command, the Drill process starts in a
container. SQLLine prints a message, and the prompt appears: </p>
<div class="highlight"><pre><code class="language-text" data-lang="text">
Jun 29, 2018 3:28:21 AM org.glassfish.jersey.server.ApplicationHandler
initialize
INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29
01:25:26...
- apache drill 1.15.0
+ apache drill 1.16.0
"json ain't no thang"
0: jdbc:drill:zk=local>
</code></pre></div>
@@ -1409,7 +1409,7 @@
$ /opt/drill/bin/drill-localhost
</code></pre></div>
<p>After you issue the commands, the Drill process starts in a container.
SQLLine prints a message, and the prompt appears: </p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">
apache drill 1.15.0
+<div class="highlight"><pre><code class="language-text" data-lang="text">
apache drill 1.16.0
"json ain't no thang"
0: jdbc:drill:drillbit=localhost>
</code></pre></div>
diff --git a/feed.xml b/feed.xml
index c38cf45..1cfdec8 100644
--- a/feed.xml
+++ b/feed.xml
@@ -6,8 +6,8 @@
</description>
<link>/</link>
<atom:link href="/feed.xml" rel="self" type="application/rss+xml"/>
- <pubDate>Tue, 07 May 2019 16:52:47 -0700</pubDate>
- <lastBuildDate>Tue, 07 May 2019 16:52:47 -0700</lastBuildDate>
+ <pubDate>Fri, 24 May 2019 15:54:55 -0700</pubDate>
+ <lastBuildDate>Fri, 24 May 2019 15:54:55 -0700</lastBuildDate>
<generator>Jekyll v2.5.2</generator>
<item>
