[ 
https://issues.apache.org/jira/browse/DRILL-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16526408#comment-16526408
 ] 

Vitalii Diravka commented on DRILL-6454:
----------------------------------------

[~bbevens]

This Hive MapR-DB JSON native reader isn't faster in some cases yet.
Could you please edit the doc in the following manner:
{quote}
A new option, store.hive.maprdb_json.optimize_scan_with_native_reader, enables 
Drill to use the native Drill reader to read the Hive MapR-DB Json tables [1]. 
When you enable this option, Drill performs faster reads of the data in most 
cases and applies filter pushdown optimizations.

1. https://maprdocs.mapr.com/60/Hive/ConnectingToMapR-DB.html
{quote}


Regarding the store.hive.parquet.optimize_scan_with_native_reader option, it 
will be deprecated starting from Drill 1.14 and will be removed in Drill 1.15

Thanks

> Native MapR DB plugin support for Hive MapR-DB json table
> ---------------------------------------------------------
>
>                 Key: DRILL-6454
>                 URL: https://issues.apache.org/jira/browse/DRILL-6454
>             Project: Apache Drill
>          Issue Type: New Feature
>          Components: Storage - Hive, Storage - MapRDB
>    Affects Versions: 1.13.0
>            Reporter: Vitalii Diravka
>            Assignee: Vitalii Diravka
>            Priority: Major
>              Labels: doc-complete, ready-to-commit
>             Fix For: 1.14.0
>
>
> Hive can create and query MapR-DB tables via maprdb-json-handler:
>  [https://maprdocs.mapr.com/home/Hive/ConnectingToMapR-DB.html]
> The aim of this Jira to implement Drill native reader for Hive MapR-DB tables 
> (similar to parquet).
> Design proposal is:
>  - to use JsonTableGroupScan instead of HiveScan;
>  - to add storage planning rule to convert HiveScan to MapRDBGroupScan;
>  - to add system/session option to enable using of this native reader;
>  - native reader can be used only for Drill build with mapr profile (there is 
> no reason to leverage it for default profile);
>  
> *For documentation:*
> two new options were added:
> store.hive.parquet.optimize_scan_with_native_reader: false,
> store.hive.maprdb_json.optimize_scan_with_native_reader: false,
> store.hive.parquet.optimize_scan_with_native_reader is new option used 
> instead of store.hive.optimize_scan_with_native_readers. The latter is 
> deprecated and will be removed in 1.15.
> (https://issues.apache.org/jira/browse/DRILL-6527).
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to