[
https://issues.apache.org/jira/browse/FLINK-18678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163199#comment-17163199
]
Rui Li commented on FLINK-18678:
--------------------------------
I think we should investigate whether some orc shim methods can be consolidated
in order to be more tolerant. If that's not possible, we should at least update
our doc to clarify when/how user should set hive version.
> Hive connector fails to create vector orc reader if user specifies incorrect
> hive version
> -----------------------------------------------------------------------------------------
>
> Key: FLINK-18678
> URL: https://issues.apache.org/jira/browse/FLINK-18678
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Hive, Formats (JSON, Avro, Parquet, ORC,
> SequenceFile)
> Affects Versions: 1.11.1
> Reporter: Rui Li
> Priority: Major
>
> Issue reported by user. User's Hive deployment is 2.1.1 and uses
> {{flink-sql-connector-hive-2.2.0_2.11-1.11.0.jar}} in Flink lib. If user
> specifies Hive version as 2.1.1, then creating vectorized orc reader fails
> with exception:
> {noformat}
> java.lang.ClassCastException: org.apache.hadoop.hive.ql.io.orc.ReaderImpl
> cannot be cast to org.apache.orc.Reader
> at org.apache.flink.orc.shim.OrcShimV200.createReader(OrcShimV200.java:63)
> ~[flink-sql-connector-hive-2.2.0_2.11-1.11.0.jar:1.11.0]
> at
> org.apache.flink.orc.shim.OrcShimV200.createRecordReader(OrcShimV200.java:98)
> ~[flink-sql-connector-hive-2.2.0_2.11-1.11.0.jar:1.11.0]
> at org.apache.flink.orc.OrcSplitReader.<init>(OrcSplitReader.java:73)
> ~[flink-sql-connector-hive-2.2.0_2.11-1.11.0.jar:1.11.0]
> at
> org.apache.flink.orc.OrcColumnarRowSplitReader.<init>(OrcColumnarRowSplitReader.java:54)
> ~[flink-sql-connector-hive-2.2.0_2.11-1.11.0.jar:1.11.0]
> at
> org.apache.flink.orc.OrcSplitReaderUtil.genPartColumnarRowReader(OrcSplitReaderUtil.java:91)
> ~[flink-sql-connector-hive-2.2.0_2.11-1.11.0.jar:1.11.0]
> ......
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
