[
https://issues.apache.org/jira/browse/IMPALA-8369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16838932#comment-16838932
]
ASF subversion and git services commented on IMPALA-8369:
---------------------------------------------------------
Commit eedff62f7c5d4c07354d0d7aaa4a40c7e4a8fbbd in impala's branch
refs/heads/master from Vihang Karajgaonkar
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=eedff62 ]
IMPALA-8369 [Test fixes] More test fixes when running against Hive-3
This test fixes CatalogTest, FrontendTest, CatalogObjectTofromThriftTest
by breaking some tests into the ones which are not expected to work on
Hive-3 and then skipping it. It does this by adding a util method in
TestUtils which returns if the environment variable
IMPALA_HIVE_MAJOR_VERSION is >= 3. If this condition is true, it skips
certain tests which use hive_idx_tbl (not supported in data-load against
Hive-3). If it is less than 3 the tests are not skipped so we keep the
test coverage on Hive-2 setups.
Also, fixes the TestCaseLoaderTest which instantiates a embedded HMS
instance. This requires some configuration changes for the embedded
standalone mode as well as adding datanucleus JDO as a test dependency.
Additionally, this patch also fixes test_show_create_table which was
failing on Hive-3 setups due to the additional parameter
bucketing_version available from Hive-3.
Testing Done:
1. Ran the tests when mini-cluster is deployed with USE_CDP_HIVE=true
and made sure that the tests work (or are skipped as expected)
2. Ran the same tests with USE_CDP_HIVE=false to make sure they still
work against HMS-2
Change-Id: If05f74efc481e2b0d26a9c4f6e58cef38605d72c
Reviewed-on: http://gerrit.cloudera.org:8080/13276
Reviewed-by: Zoltan Borok-Nagy <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Todd Lipcon <[email protected]>
> Impala should be able to interoperate with Hive 3.1.0
> -----------------------------------------------------
>
> Key: IMPALA-8369
> URL: https://issues.apache.org/jira/browse/IMPALA-8369
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Vihang Karajgaonkar
> Assignee: Vihang Karajgaonkar
> Priority: Major
> Labels: impala-acid
>
> Currently, Impala only works with Hive 2.1.1. Since Hive 3.1.0 has been
> released for a while it would be good to add support for Hive 3.1.0 (HMS
> 3.1.0). This patch will focus on ability to connect to HMS 3.1.0 and run
> existing tests. It will not focus on adding support for newer features like
> ACID in Hive 3.1.0 which can be taken up as separate JIRA.
> It would be good to make changes to Impala source code such that it can work
> with both Hive 2.1.0 and Hive 3.1.0 without the need to create a separate
> branch. However, this should be a aspirational goal. If we hit a blocker we
> should investigate alternative approaches.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
