[
https://issues.apache.org/jira/browse/HIVE-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damien Carol updated HIVE-12498:
--------------------------------
Description:
OrcRecordUpdater does not honor the
OrcRecordUpdater.OrcOptions.tableProperties() setting.
It would need to translate the specified tableProperties (as listed in
OrcTableProperties enum) to the properties that OrcWriter internally
understands (listed in HiveConf.ConfVars).
This is needed for multiple clients.. like Streaming API and Compactor.
{code:java}
Properties orcTblProps = .. // get Orc Table Properties from MetaStore;
AcidOutputFormat.Options updaterOptions = new
OrcRecordUpdater.OrcOptions(conf)
.inspector(..)
.bucket(..)
.minimumTransactionId(..)
.maximumTransactionId(..)
.tableProperties(orcTblProps); // <<==
OrcOutputFormat orcOutput = new ...
orcOutput.getRecordUpdater(partitionPath, updaterOptions );
{code}
was:
OrcRecordUpdater does not honor the
OrcRecordUpdater.OrcOptions.tableProperties() setting.
It would need to translate the specified tableProperties (as listed in
OrcTableProperties enum) to the properties that OrcWriter internally
understands (listed in HiveConf.ConfVars).
This is needed for multiple clients.. like Streaming API and Compactor.
{noformat}
Properties orcTblProps = .. // get Orc Table Properties from MetaStore;
AcidOutputFormat.Options updaterOptions = new
OrcRecordUpdater.OrcOptions(conf)
.inspector(..)
.bucket(..)
.minimumTransactionId(..)
.maximumTransactionId(..)
.tableProperties(orcTblProps); // <<==
OrcOutputFormat orcOutput = new ...
orcOutput.getRecordUpdater(partitionPath, updaterOptions );
{noformat}
> ACID: Setting OrcRecordUpdater.OrcOptions.tableProperties() has no effect
> -------------------------------------------------------------------------
>
> Key: HIVE-12498
> URL: https://issues.apache.org/jira/browse/HIVE-12498
> Project: Hive
> Issue Type: Bug
> Affects Versions: 1.3.0, 2.0.0
> Reporter: Prasanth Jayachandran
> Assignee: Prasanth Jayachandran
> Labels: ACID, ORC
> Attachments: HIVE-12498.1.patch
>
>
> OrcRecordUpdater does not honor the
> OrcRecordUpdater.OrcOptions.tableProperties() setting.
> It would need to translate the specified tableProperties (as listed in
> OrcTableProperties enum) to the properties that OrcWriter internally
> understands (listed in HiveConf.ConfVars).
> This is needed for multiple clients.. like Streaming API and Compactor.
> {code:java}
> Properties orcTblProps = .. // get Orc Table Properties from MetaStore;
> AcidOutputFormat.Options updaterOptions = new
> OrcRecordUpdater.OrcOptions(conf)
> .inspector(..)
> .bucket(..)
> .minimumTransactionId(..)
> .maximumTransactionId(..)
>
> .tableProperties(orcTblProps); // <<==
> OrcOutputFormat orcOutput = new ...
> orcOutput.getRecordUpdater(partitionPath, updaterOptions );
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
