Vihang Karajgaonkar created HIVE-23018:
------------------------------------------
Summary: Provide a bulk API to fire multiple listener events
Key: HIVE-23018
URL: https://issues.apache.org/jira/browse/HIVE-23018
Project: Hive
Issue Type: Improvement
Reporter: Vihang Karajgaonkar
Assignee: Vihang Karajgaonkar
Metastore provides a API to fire a listener event (currently only supports
INSERT event). The problem with that API is that it only takes in one partition
at a time. A typical query may insert data into multiple partitions at a time.
In such a case query engines like HS2 or Impala will have to issue multiple
RPCs to metastore sequentially to fire these events. This can show up as a
slowdown to the user if the query engines do not return the prompt to the user
until all the events are fired (In case of HS2 and Impala). It would be great
if we have bulk API which takes in multiple partitions for a table so that
metastore can generate many such events in one RPC.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)