[
https://issues.apache.org/jira/browse/FLINK-23074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17621456#comment-17621456
]
Kai Chen commented on FLINK-23074:
----------------------------------
[~luoyuxia] After this change, the version of
org.apache.flink.hive.shaded.parquet has been changed to the parqeut-hadoop
version used by FLINK(for example, parquet-hadoop-1.12.2 in flink-1.15). I
found this issue when i met zstd-jni not found problem(since
parquet-hadoop-1.12 using zstd-jni-1.4.9-1 and we did not include
zstd-jni-1.4.9-1 in our classpath).
Now i have included zstd-jni-1.4.9-1 in our classpath and everything is ok now.
But i am still wondering the reason of this change. Maybe relates to some
vulnerabilities?
> There is a class conflict between flink-connector-hive and flink-parquet
> ------------------------------------------------------------------------
>
> Key: FLINK-23074
> URL: https://issues.apache.org/jira/browse/FLINK-23074
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Hive
> Affects Versions: 1.13.1, 1.12.4
> Reporter: Luning Wang
> Assignee: Luning Wang
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.14.0, 1.12.5, 1.13.2
>
> Attachments: E8C394D1-F970-4825-82CD-3EFA74C65B27.png,
> image-2021-06-23-17-26-32-559.png, image-2021-07-01-18-23-47-105.png,
> image-2021-07-01-18-40-00-991.png, image-2021-07-01-18-40-31-729.png,
> screenshot-1.png, screenshot-3.png, screenshot-4.png, screenshot-5.png,
> screenshot-6.png
>
>
> flink-connector-hive 2.3.6 include parquet-hadoop 1.8.1 version but
> flink-parquet include 1.11.1.
> org.apache.parquet.hadoop.example.GroupWriteSupport
> is different.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
