[
https://issues.apache.org/jira/browse/HIVE-19211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16446508#comment-16446508
]
Eugene Koifman commented on HIVE-19211:
---------------------------------------
isDynamicPartitionWrite is not sufficient - it's just a small optimization. For
SQL Insert with DP, TxnHandler.addDynamicPartitions() is called to let Acid
know all partitions added so that it can update the metadata. This won't
happen for streaming ingest. If you already have a read lock on the table,
perhaps calling addDynamicPartitions (it's available via thrift) right before
commit() is a better option.
> New streaming ingest API and support for dynamic partitioning
> -------------------------------------------------------------
>
> Key: HIVE-19211
> URL: https://issues.apache.org/jira/browse/HIVE-19211
> Project: Hive
> Issue Type: Sub-task
> Components: Streaming
> Affects Versions: 3.0.0, 3.1.0
> Reporter: Prasanth Jayachandran
> Assignee: Prasanth Jayachandran
> Priority: Major
> Attachments: HIVE-19211.1.patch, HIVE-19211.2.patch,
> HIVE-19211.3.patch, HIVE-19211.4.patch
>
>
> - New streaming API under new hive sub-module
> - Dynamic partitioning support
> - Auto-rollover transactions
> - Automatic heartbeating
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
