[
https://issues.apache.org/jira/browse/IMPALA-8579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918568#comment-16918568
]
ASF subversion and git services commented on IMPALA-8579:
---------------------------------------------------------
Commit 08ecb6d28cd7794a654f66fe41bb8ae727bc1a3e in impala's branch
refs/heads/master from Anurag Mantripragada
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=08ecb6d ]
IMPALA-8579: Ignore trivial alter table/partition events.
Hive generates certain trivial alter events for eg: change only
"transient_lastDdlTime". This is seen in the alter events
accompanying an INSERT event. MetastoreEventProcessor should ignore
such events as these trivial properties are not used by Impala
and they cause unnecessary invalidates/refreshes. This change will
also potentially reduce the likelihood of IMPALA-8877 as back to back
invalidates after INSERT operations are avoided.
Testing:
Added tests respectively to testPartitionEvents() and
testAlterTableEvent() in MetastoreEventProcessorTest class.
Change-Id: I01a59d5170accc014f76f14eb526d96ddcf61f76
Reviewed-on: http://gerrit.cloudera.org:8080/14145
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Ignore trivial alter events
> ---------------------------
>
> Key: IMPALA-8579
> URL: https://issues.apache.org/jira/browse/IMPALA-8579
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Vihang Karajgaonkar
> Assignee: Anurag Mantripragada
> Priority: Major
> Labels: catalog-v2
>
> Certain alter table and alter partition events are actually just to update
> the {{lastaccesstime}}. We should ignore such alter events to avoid
> unnecessary refresh/invalidates.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
