[
https://issues.apache.org/jira/browse/FLINK-27777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Small Wong updated FLINK-27777:
-------------------------------
Description:
after set table.exec.hive.fallback-mapred-writer=false, then sink hive by
native parquet&orc writer, but can not get the `parquet.compression` of
`formatConf` in class `HiveTableSink`.
There is no field `parquet.compression` in `jobConf` or
`sd.getSerdeInfo().getParameters()`. And `parquet.compression` just exists in
`hive table properties`.
!image-2022-05-25-20-53-20-412.png!
!image-2022-05-25-20-57-13-241.png!
was:
after set table.exec.hive.fallback-mapred-writer=false, then sink hive by
native parquet&orc writer, but can not get the `parquet.compression` of
`formatConf` in class `HiveTableSink`. There is no field `parquet.compression`
in `jobConf` or `sd.getSerdeInfo().getParameters()`. And `parquet.compression`
just exists in `hive table properties`.
!image-2022-05-25-20-53-20-412.png!
!image-2022-05-25-20-57-13-241.png!
> Can not get the parquet.compression when using native parquet&orc writer to
> sink hive
> -------------------------------------------------------------------------------------
>
> Key: FLINK-27777
> URL: https://issues.apache.org/jira/browse/FLINK-27777
> Project: Flink
> Issue Type: Bug
> Reporter: Small Wong
> Priority: Major
> Attachments: image-2022-05-25-20-53-20-412.png,
> image-2022-05-25-20-57-13-241.png
>
>
> after set table.exec.hive.fallback-mapred-writer=false, then sink hive by
> native parquet&orc writer, but can not get the `parquet.compression` of
> `formatConf` in class `HiveTableSink`.
> There is no field `parquet.compression` in `jobConf` or
> `sd.getSerdeInfo().getParameters()`. And `parquet.compression` just exists
> in `hive table properties`.
>
> !image-2022-05-25-20-53-20-412.png!
> !image-2022-05-25-20-57-13-241.png!
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
