[
https://issues.apache.org/jira/browse/DRILL-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522841#comment-16522841
]
Bridget Bevens commented on DRILL-6454:
---------------------------------------
Hi [~vitalii],
I have a couple of doc questions regarding this JIRA.
1) Do we want to document the
*store.hive.parquet.optimize_scan_with_native_readers* option or wait until
Drill 1.15 to tell users that the name has changed from
*store.hive.optimize_scan_with_native_readers* to
*store.hive.parquet.optimize_scan_with_native_readers*?
2) Do we need to document this new option?
*store.hive.maprdb_json.optimize_scan_with_native_reader*
If yes, is this option disabled by default?
What does the option do?
Example Description:
When you enable the *store.hive.maprdb_json.optimize_scan_with_native_reader*
option, Drill uses the native Drill reader to read Hive external tables that
were created from MapR-DB JSON tables. The native Drill reader enables Drill to
perform faster reads of data and filter pushdown optimizations.
Thanks,
Bridget
> Native MapR DB plugin support for Hive MapR-DB json table
> ---------------------------------------------------------
>
> Key: DRILL-6454
> URL: https://issues.apache.org/jira/browse/DRILL-6454
> Project: Apache Drill
> Issue Type: New Feature
> Components: Storage - Hive, Storage - MapRDB
> Affects Versions: 1.13.0
> Reporter: Vitalii Diravka
> Assignee: Vitalii Diravka
> Priority: Major
> Labels: doc-impacting, ready-to-commit
> Fix For: 1.14.0
>
>
> Hive can create and query MapR-DB tables via maprdb-json-handler:
> [https://maprdocs.mapr.com/home/Hive/ConnectingToMapR-DB.html]
> The aim of this Jira to implement Drill native reader for Hive MapR-DB tables
> (similar to parquet).
> Design proposal is:
> - to use JsonTableGroupScan instead of HiveScan;
> - to add storage planning rule to convert HiveScan to MapRDBGroupScan;
> - to add system/session option to enable using of this native reader;
> - native reader can be used only for Drill build with mapr profile (there is
> no reason to leverage it for default profile);
>
> *For documentation:*
> two new options were added:
> store.hive.parquet.optimize_scan_with_native_reader: false,
> store.hive.maprdb_json.optimize_scan_with_native_reader: false,
> store.hive.parquet.optimize_scan_with_native_reader is new option used
> instead of store.hive.optimize_scan_with_native_readers. The latter is
> deprecated and will be removed in 1.15.
> (https://issues.apache.org/jira/browse/DRILL-6527).
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
