This is an automated email from the ASF dual-hosted git repository.
ayushsaxena pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git
The following commit(s) were added to refs/heads/master by this push:
new d17bd5bf12e HIVE-26556: ADDENDUM: Iceberg: Properties set in
HiveIcebergSerde are not propagated to jobconf. (#3667). (Ayush Saxena,
reviewed by Adam Szita)
d17bd5bf12e is described below
commit d17bd5bf12e62563cc35016dbb4445c89333d9a3
Author: Ayush Saxena <[email protected]>
AuthorDate: Mon Oct 17 16:06:10 2022 +0530
HIVE-26556: ADDENDUM: Iceberg: Properties set in HiveIcebergSerde are not
propagated to jobconf. (#3667). (Ayush Saxena, reviewed by Adam Szita)
---
.../src/main/java/org/apache/iceberg/mr/hive/HiveIcebergSerDe.java | 5 ++---
1 file changed, 2 insertions(+), 3 deletions(-)
diff --git
a/iceberg/iceberg-handler/src/main/java/org/apache/iceberg/mr/hive/HiveIcebergSerDe.java
b/iceberg/iceberg-handler/src/main/java/org/apache/iceberg/mr/hive/HiveIcebergSerDe.java
index ed076cdc472..f9f01e3b2f0 100644
---
a/iceberg/iceberg-handler/src/main/java/org/apache/iceberg/mr/hive/HiveIcebergSerDe.java
+++
b/iceberg/iceberg-handler/src/main/java/org/apache/iceberg/mr/hive/HiveIcebergSerDe.java
@@ -137,9 +137,8 @@ public class HiveIcebergSerDe extends AbstractSerDe {
// Currently ClusteredWriter is used which requires that records are
ordered by partition keys.
// Here we ensure that SortedDynPartitionOptimizer will kick in and do the
sorting.
// TODO: remove once we have both Fanout and ClusteredWriter available:
HIVE-25948
-
jobConf.put(HiveConf.ConfVars.HIVEOPTSORTDYNAMICPARTITIONTHRESHOLD.varname,
"1");
- jobConf.put(HiveConf.ConfVars.DYNAMICPARTITIONINGMODE.varname,
"nonstrict");
-
+ HiveConf.setIntVar(configuration,
HiveConf.ConfVars.HIVEOPTSORTDYNAMICPARTITIONTHRESHOLD, 1);
+ HiveConf.setVar(configuration, HiveConf.ConfVars.DYNAMICPARTITIONINGMODE,
"nonstrict");
try {
this.inspector = IcebergObjectInspector.create(projectedSchema);
} catch (Exception e) {
