[
https://issues.apache.org/jira/browse/FLINK-27777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Small Wong updated FLINK-27777:
-------------------------------
Description:
After set {*}table.exec.hive.fallback-mapred-writer=false{*}, then sink hive by
native parquet&orc writer, but can not get the *`parquet.compression`* of
`{*}formatConf{*}` in class `{*}HiveTableSink{*}`.
There is no field `parquet.compression` in `jobConf` or
`sd.getSerdeInfo().getParameters()`. And `parquet.compression` just exists in
`{*}hive table properties{*}`.
!image-2022-05-25-20-53-20-412.png!
!image-2022-05-25-20-57-13-241.png!
was:
after set table.exec.hive.fallback-mapred-writer=false, then sink hive by
native parquet&orc writer, but can not get the `parquet.compression` of
`formatConf` in class `HiveTableSink`.
There is no field `parquet.compression` in `jobConf` or
`sd.getSerdeInfo().getParameters()`. And `parquet.compression` just exists in
`hive table properties`.
!image-2022-05-25-20-53-20-412.png!
!image-2022-05-25-20-57-13-241.png!
> Can not get the parquet.compression when using native parquet&orc writer to
> sink hive
> -------------------------------------------------------------------------------------
>
> Key: FLINK-27777
> URL: https://issues.apache.org/jira/browse/FLINK-27777
> Project: Flink
> Issue Type: Bug
> Reporter: Small Wong
> Priority: Major
> Attachments: image-2022-05-25-20-53-20-412.png,
> image-2022-05-25-20-57-13-241.png
>
>
> After set {*}table.exec.hive.fallback-mapred-writer=false{*}, then sink hive
> by native parquet&orc writer, but can not get the *`parquet.compression`* of
> `{*}formatConf{*}` in class `{*}HiveTableSink{*}`.
> There is no field `parquet.compression` in `jobConf` or
> `sd.getSerdeInfo().getParameters()`. And `parquet.compression` just exists
> in `{*}hive table properties{*}`.
>
> !image-2022-05-25-20-53-20-412.png!
> !image-2022-05-25-20-57-13-241.png!
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
