Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/8238 )
Change subject: IMPALA-4524: Batch ALTER TABLE...ADD PARTITION calls. ...................................................................... IMPALA-4524: Batch ALTER TABLE...ADD PARTITION calls. This commit allows users to add more than 500 (=MAX_PARTITION_UPDATES_PER_RPC) partitions in a single ALTER TABLE command. We batch the operations against Hive into groups of 500. I tested this manually, creating 1002 partitions and observing the expected 3 API calls against the Hive Metastore in the log. I can confirm that there is coverage of this in some existing tests. A new, simple, test has been added that confirms that creating 502 partitions works. Change-Id: I95f8221ff08c0f126f951f7d37ff5e57985f855f Reviewed-on: http://gerrit.cloudera.org:8080/8238 Reviewed-by: Alex Behm <[email protected]> Tested-by: Impala Public Jenkins --- M fe/src/main/java/org/apache/impala/analysis/AlterTableAddPartitionStmt.java M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java M fe/src/test/java/org/apache/impala/analysis/AnalyzeDDLTest.java M tests/metadata/test_ddl.py 4 files changed, 45 insertions(+), 48 deletions(-) Approvals: Alex Behm: Looks good to me, approved Impala Public Jenkins: Verified -- To view, visit http://gerrit.cloudera.org:8080/8238 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I95f8221ff08c0f126f951f7d37ff5e57985f855f Gerrit-Change-Number: 8238 Gerrit-PatchSet: 10 Gerrit-Owner: Philip Zeyliger <[email protected]> Gerrit-Reviewer: Alex Behm <[email protected]> Gerrit-Reviewer: Dimitris Tsirogiannis <[email protected]> Gerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Philip Zeyliger <[email protected]>
