[
https://issues.apache.org/jira/browse/HIVE-23018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17071555#comment-17071555
]
Vihang Karajgaonkar edited comment on HIVE-23018 at 3/31/20, 7:48 AM:
----------------------------------------------------------------------
Patch merged into master. Attached the branch-3 patch. Verified that its
working as expected and the build is clean. Merged into branch-3 as well
was (Author: vihangk1):
Patch merged into master. Attached the branch-3 patch. Verified that its
working as expected and the build is clean. Merged into branch-3 as well.
* [|https://issues.apache.org/jira/secure/AddComment!default.jspa?id=13238334]
> Provide a bulk API to fire multiple insert events
> -------------------------------------------------
>
> Key: HIVE-23018
> URL: https://issues.apache.org/jira/browse/HIVE-23018
> Project: Hive
> Issue Type: Improvement
> Reporter: Vihang Karajgaonkar
> Assignee: Vihang Karajgaonkar
> Priority: Major
> Attachments: HIVE-23018.01.patch, HIVE-23018.02.patch,
> HIVE-23018.03.patch, HIVE-23018.04.patch, HIVE-23018.05.branch-3.patch
>
>
> Metastore provides a API to fire a listener event (currently only supports
> INSERT event). The problem with that API is that it only takes in one
> partition at a time. A typical query may insert data into multiple partitions
> at a time. In such a case query engines like HS2 or Impala will have to issue
> multiple RPCs to metastore sequentially to fire these events. This can show
> up as a slowdown to the user if the query engines do not return the prompt to
> the user until all the events are fired (In case of HS2 and Impala). It would
> be great if we have bulk API which takes in multiple partitions for a table
> so that metastore can generate many such events in one RPC.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
