[
https://issues.apache.org/jira/browse/GOBBLIN-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
William Lo updated GOBBLIN-1318:
--------------------------------
Description:
HiveOutputFormat in org.apache.hadoop.hive.ql.io, does not have
`parquet/hadoop/api/WriteSupport` , causing `HiveWritableHdfsDataWriter` to
break.
In https://issues.apache.org/jira/browse/HIVE-11096 the fix is added in version
2.0
Attempts to resolve this by using hive-exec 2.0.0 results in
`java.lang.IncompatibleClassChangeError` and other compile time issues, so for
now the solution will be to disable the integration test in
`WriterOutputFormatIntegrationTest.parquetOutputFormatTest()`
was:
HiveOutputFormat in org.apache.hadoop.hive.ql.io, does not have
`parquet/hadoop/api/WriteSupport` , causing `HiveWritableHdfsDataWriter` to
break.
In https://issues.apache.org/jira/browse/HIVE-11096 the fix is added in version
2.0
Attempts to resolve this by using hive 2.0.0 results in
`java.lang.IncompatibleClassChangeError`, so for now the solution will be to
disable the integration test in
`WriterOutputFormatIntegrationTest.parquetOutputFormatTest()`
> Apache Parquet breaks HiveWriteAbleHdfsDataWriter
> -------------------------------------------------
>
> Key: GOBBLIN-1318
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1318
> Project: Apache Gobblin
> Issue Type: Bug
> Components: gobblin-core
> Affects Versions: 0.15.0
> Reporter: William Lo
> Assignee: Abhishek Tiwari
> Priority: Major
>
> HiveOutputFormat in org.apache.hadoop.hive.ql.io, does not have
> `parquet/hadoop/api/WriteSupport` , causing `HiveWritableHdfsDataWriter` to
> break.
> In https://issues.apache.org/jira/browse/HIVE-11096 the fix is added in
> version 2.0
> Attempts to resolve this by using hive-exec 2.0.0 results in
> `java.lang.IncompatibleClassChangeError` and other compile time issues, so
> for now the solution will be to disable the integration test in
> `WriterOutputFormatIntegrationTest.parquetOutputFormatTest()`
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
