[
https://issues.apache.org/jira/browse/FLINK-20292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yun Gao updated FLINK-20292:
----------------------------
Description:
When testing the Flink 1.12 in a standalone mode cluster, I found that if the
user job jar contains both _flink-avro_ and _flink-parquet/flink-orc_, the
FileSystemTableSink would not be able to load the corresponding format factory
correctly. But if only one format is dependent it works.
The test project located in [here|https://github.com/gaoyunhaii/flink1.12test]
and the test class is
[FileCompactionTest|https://github.com/gaoyunhaii/flink1.12test/blob/main/src/main/java/FileCompactionTest.java].
The conflict does not seem to affect the local runner, but only has problem
when submitted to the standalone cluster.
If the problem did exists, we might need to fix it or give user some tips about
the conflicts.
was:
When testing the Flink 1.12 in a standalone mode cluster, I found that if the
user job jar contains both _flink-avro_ and _flink-parquet/flink-orc_, the
FileSystemTableSink would not be able to load the corresponding format factory
correctly. But if only one format is dependent it works.
The test project located in [here|https://github.com/gaoyunhaii/flink1.12test]
and the test class is
[FileCompactionTest|https://github.com/gaoyunhaii/flink1.12test/blob/main/src/main/java/FileCompactionTest.java].
The conflict does not seem to affect the local runner, but only has problem
when submitted to the standalone cluster.
> Avro format conflicts with Parquet and Orc
> ------------------------------------------
>
> Key: FLINK-20292
> URL: https://issues.apache.org/jira/browse/FLINK-20292
> Project: Flink
> Issue Type: Bug
> Reporter: Yun Gao
> Priority: Critical
> Fix For: 1.12.0
>
>
> When testing the Flink 1.12 in a standalone mode cluster, I found that if the
> user job jar contains both _flink-avro_ and _flink-parquet/flink-orc_, the
> FileSystemTableSink would not be able to load the corresponding format
> factory correctly. But if only one format is dependent it works.
> The test project located in
> [here|https://github.com/gaoyunhaii/flink1.12test] and the test class is
> [FileCompactionTest|https://github.com/gaoyunhaii/flink1.12test/blob/main/src/main/java/FileCompactionTest.java].
> The conflict does not seem to affect the local runner, but only has problem
> when submitted to the standalone cluster.
> If the problem did exists, we might need to fix it or give user some tips
> about the conflicts.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
