[
https://issues.apache.org/jira/browse/HIVE-25161?focusedWorklogId=604128&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-604128
]
ASF GitHub Bot logged work on HIVE-25161:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 31/May/21 13:40
Start Date: 31/May/21 13:40
Worklog Time Spent: 10m
Work Description: marton-bod commented on a change in pull request #2316:
URL: https://github.com/apache/hive/pull/2316#discussion_r642497632
##########
File path:
iceberg/iceberg-handler/src/main/java/org/apache/iceberg/mr/hive/HiveIcebergSerDe.java
##########
@@ -151,7 +152,23 @@ public void initialize(@Nullable Configuration
configuration, Properties serDePr
private void createTableForCTAS(Configuration configuration, Properties
serDeProperties) {
serDeProperties.setProperty(TableProperties.ENGINE_HIVE_ENABLED, "true");
serDeProperties.setProperty(InputFormatConfig.TABLE_SCHEMA,
SchemaParser.toJson(tableSchema));
+
+ // build partition spec, if any
+ if (serDeProperties.getProperty(serdeConstants.LIST_PARTITION_COLUMNS) !=
null) {
+ String[] partCols =
serDeProperties.getProperty(serdeConstants.LIST_PARTITION_COLUMNS).split(",");
Review comment:
After some digging, it seems that column names can indeed contain `,`.
If they do, Hive will use a different delimiter. I've fixed the serDe code to
take that into account.
However, right now Iceberg tables do not handle having column names with a
comma very well (those tables can be created but can't be read back), so that
is something that should be addressed in a separate PR. I've filed a jira for
that.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 604128)
Time Spent: 5h 50m (was: 5h 40m)
> Implement CTAS for partitioned Iceberg tables
> ---------------------------------------------
>
> Key: HIVE-25161
> URL: https://issues.apache.org/jira/browse/HIVE-25161
> Project: Hive
> Issue Type: New Feature
> Reporter: Marton Bod
> Assignee: Marton Bod
> Priority: Major
> Labels: pull-request-available
> Time Spent: 5h 50m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
