[
https://issues.apache.org/jira/browse/IMPALA-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965170#comment-16965170
]
ASF subversion and git services commented on IMPALA-9047:
---------------------------------------------------------
Commit 476e1b12e79c83674ec5cd0983e30e9d47c65e8f in impala's branch
refs/heads/master from Fang-Yu Rao
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=476e1b1 ]
IMPALA-9047: Bump CDP_BUILD_NUMBER to 1471450
This patch bumps CDP_BUILD_NUMBER to 1471450. The new GBN upgrades
Ranger from 1.2 to 2.0, which includes the change to the default Ranger
policies described in https://issues.apache.org/jira/browse/RANGER-2536.
Some of the Ranger tests fail, because they assume the older behavior.
To address this issue, this patch temporarily disables those affected
Ranger tests. Specifically, the affected tests in the following test
files are disabled for now.
1. test_authorized_proxy.py
2. test_ranger.py
3. AuthorizationStmtTest.java
4. RangerAuditLogTest.java
IMPALA-8842 part 2: (Hive3) Use 'engine' field in HMS stat API
The new CDP GBN includes the fix for HIVE-22046. HIVE-22046 added
'engine' column to TAB_COL_STATS and PART_COL_STATS HMS tables. The new
column is used to differentiate among column stats computed by
different engines. The related HMS API calls were changed accordingly.
Part of this patch is Step 4 in a series of steps to coordinate the
introduction of HMS API changes to Hive3 and Impala. For more
information see IMPALA-8842 part 1. Step 4 replaces *V2 calls with *.
The *V2 names were introduced temporarily and will be removed from the
HMS API in the near future.
Testing:
- This patch passes the affected Ranger tests listed above on a local
machine.
- E2E tests were added to make sure that column statistics are
differentiated by engine for partitioned and non-partitioned tables.
The tests are executed for transactional and non-transactional tables.
Change-Id: I962423cf202ad632b5817669500b3e3479f1a454
Reviewed-on: http://gerrit.cloudera.org:8080/14576
Reviewed-by: Joe McDonnell <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Some Ranger related test cases fail when using a newer version of Ranger
> -------------------------------------------------------------------------
>
> Key: IMPALA-9047
> URL: https://issues.apache.org/jira/browse/IMPALA-9047
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Fang-Yu Rao
> Assignee: Fang-Yu Rao
> Priority: Major
> Attachments: Ranger_policy_after_cdp_number_bump.png,
> Ranger_policy_before_cdp_number_bump.png
>
>
> Some Ranger related E2E tests and FE tests would fail when we are using a
> newer version of Ranger (e.g., {{ranger-2.0.0.7.0.2.0-98}} instead of
> {{ranger-1.2.0.7.1.0.0-33}}) due to the changes to the default Ranger
> policies described at https://issues.apache.org/jira/browse/RANGER-2536. In
> the attachment the screenshots of the policies of "\{{all - database, table,
> column}}" before and after using the newer Ranger are also provided.
> Some operations which were not authorized previously could now be authorized
> successfully because of the changes. In this regard, we also have to change
> the test cases in at least 4 files of Impala's E2E tests and FE tests, which
> are listed in the following.
> # test_authorized_proxy.py
> # test_ranger.py
> # AuthorizationStmtTest.java
> # RangerAuditLogTest.java
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
