[
https://issues.apache.org/jira/browse/DRILL-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16355736#comment-16355736
]
ASF GitHub Bot commented on DRILL-5978:
---------------------------------------
Github user vdiravka commented on a diff in the pull request:
https://github.com/apache/drill/pull/1111#discussion_r166679633
--- Diff: contrib/storage-hive/hive-exec-shade/pom.xml ---
@@ -39,23 +39,28 @@
<groupId>log4j</groupId>
</exclusion>
<exclusion>
- <groupId>commons-codec</groupId>
- <artifactId>commons-codec</artifactId>
- </exclusion>
- <exclusion>
- <artifactId>calcite-avatica</artifactId>
- <groupId>org.apache.calcite</groupId>
+ <groupId>org.json</groupId>
+ <artifactId>json</artifactId>
</exclusion>
</exclusions>
</dependency>
+ <dependency>
+ <groupId>org.apache.parquet</groupId>
+ <artifactId>parquet-column</artifactId>
+ <version>${parquet.version}</version>
--- End diff --
Hive parquet dependencies cause an issues in Drill. So relocating is
decision.
But in this case one Drill test
[DRILL-3938](https://github.com/apache/drill/pull/1111/files#diff-0f8deff45b06e709ba2ae35f96274076R395)
is failed, because Parquet 1.8.0 version started to prohibit empty
struct/groups on MessageType level
[PARQUET-278](https://issues.apache.org/jira/browse/PARQUET-278).
But from 1.8.1 version it is
[allowed](https://github.com/apache/parquet-mr/pull/263/files#diff-1ae59a3502695f53cb2d0371e1116c63L92)
again - [PARQUET-363](https://issues.apache.org/jira/browse/PARQUET-363).
So Drill parquet-column version without throwing an Exception solves the
issue.
For Hive2.3 it can be changed.
> Upgrade Hive libraries to 2.1.1 version.
> ----------------------------------------
>
> Key: DRILL-5978
> URL: https://issues.apache.org/jira/browse/DRILL-5978
> Project: Apache Drill
> Issue Type: Improvement
> Components: Storage - Hive
> Affects Versions: 1.11.0
> Reporter: Vitalii Diravka
> Assignee: Vitalii Diravka
> Priority: Major
> Labels: doc-impacting
> Fix For: 1.13.0
>
>
> Currently Drill uses [Hive version 1.2.1
> libraries|https://github.com/apache/drill/blob/master/pom.xml#L53] to perform
> queries on Hive. This version of library can be used for Hive1.x versions and
> Hive2.x versions too, but some features of Hive2.x are broken (for example
> using of ORC transactional tables). To fix that it will be good to update
> drill-hive library version to 2.1 or newer.
> Tasks which should be done:
> - resolving dependency conflicts;
> - investigating backward compatibility of newer drill-hive library with older
> Hive versions (1.x);
> - updating drill-hive version for
> [MapR|https://github.com/apache/drill/blob/master/pom.xml#L1777] profile too.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
