Fang-Yu Rao has uploaded this change for review. ( http://gerrit.cloudera.org:8080/14576
Change subject: IMPALA-9047: Bump CDP_BUILD_NUMBER to 1471450 ...................................................................... IMPALA-9047: Bump CDP_BUILD_NUMBER to 1471450 This patch bumps CDP_BUILD_NUMBER to 1471450. Some test cases would fail due to this change. Specifically, some Ranger related E2E tests and FE tests would fail when we are using a newer version of Ranger (i.e., ranger-2.0.0.7.0.2.0-50 instead of ranger-1.2.0.7.1.0.0-33) due to the changes to the default Ranger policies described at https://issues.apache.org/jira/browse/RANGER-2536. To address this issue, this patch temporarily disables those affected Ranger tests. Specifically, the affected tests in the following test files are disabled for now. 1. test_authorized_proxy.py 2. test_ranger.py 3. AuthorizationStmtTest.java 4. RangerAuditLogTest.java Moreover, two HMS related E2E tests in test_hms_integration.py fail when we are using a newer version of Hive (i.e., hive-3.1.2000.7.0.2.0-50 instead of hive-2.1.1 by setting USE_CDP_HIVE to true when building Impala). To address this issue, this patch temporarily skips those tests. On the other hand, HIVE-22046 added 'engine' column to TAB_COL_STATS and PART_COL_STATS HMS tables. The new column is used to differentiate among column stats computed by different engines. The related HMS API calls were changed accordingly. Part of this patch is Step 4 in a series of steps to coordinate the introduction of HMS API changes to Hive3 and Impala. For more information see IMPALA-8842 part 1. Step 4 replaces *V2 calls with *. The *V2 names were introduced temporarily and will be removed from the HMS API in the near future. Testing: - This patch passes the affected Ranger tests listed above on a local machine. - E2E tests were added to make sure that column statistics are differentiated by engine for partitioned and non-partitioned tables. The tests are executed for transactional and non-transactional tables. Change-Id: I962423cf202ad632b5817669500b3e3479f1a454 --- M bin/impala-config.sh M fe/src/compat-hive-3/java/org/apache/impala/compat/MetastoreShim.java M fe/src/test/java/org/apache/impala/authorization/AuthorizationStmtTest.java M fe/src/test/java/org/apache/impala/authorization/ranger/RangerAuditLogTest.java M tests/authorization/test_authorized_proxy.py M tests/authorization/test_ranger.py M tests/common/skip.py M tests/metadata/test_hms_integration.py 8 files changed, 227 insertions(+), 10 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/76/14576/1 -- To view, visit http://gerrit.cloudera.org:8080/14576 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I962423cf202ad632b5817669500b3e3479f1a454 Gerrit-Change-Number: 14576 Gerrit-PatchSet: 1 Gerrit-Owner: Fang-Yu Rao <[email protected]> Gerrit-Reviewer: Fang-Yu Rao <[email protected]> Gerrit-Reviewer: Joe McDonnell <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]>
