Sai Hemanth Gantasala has uploaded this change for review. ( http://gerrit.cloudera.org:8080/20485
Change subject: IMPALA-10949: Improve batching logic of partition events ...................................................................... IMPALA-10949: Improve batching logic of partition events Currently the batching logic for partitions evaluates self-event check by looking at the event id of the last event in the batch. This patch improves the batching logic by evaluating table's lastSyncEventId to the current event's event id and decide whether to batch the event or not. This way we can have fewer batch sizes and avoid self events if any, beforehand. Testing: Added an end-to-end test to verfiy the batch size for ALTER_PARTITION batch events. Change-Id: I4e79510739347cbe669719a9e4cb9cabd5daa7d3 --- M fe/src/main/java/org/apache/impala/catalog/events/MetastoreEvents.java M tests/custom_cluster/test_events_custom_configs.py 2 files changed, 46 insertions(+), 0 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/85/20485/1 -- To view, visit http://gerrit.cloudera.org:8080/20485 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I4e79510739347cbe669719a9e4cb9cabd5daa7d3 Gerrit-Change-Number: 20485 Gerrit-PatchSet: 1 Gerrit-Owner: Sai Hemanth Gantasala <[email protected]>
