[
https://issues.apache.org/jira/browse/IMPALA-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16816407#comment-16816407
]
radford nguyen commented on IMPALA-8389:
----------------------------------------
This issue was fixed in the following commit, but the commit message
erroneously referenced IMPALA-8363.
Commit f998d64767c074216e75a552b36ecf44ff295d07 in impala's branch
refs/heads/master from Radford Nguyen
[ [https://gitbox.apache.org/repos/asf?p=impala.git;h=f998d64] ]
IMPALA-8363: Fix E2E start with impala_log_dir
This commit fixes the `CustomClusterTestSuite` to wait for the
correct number of executors when `impala_log_dir` is specified
in the test decorator. Previously, the default value of 3
was always used, regardless of `cluster_size`.
Testing:
- Manual verification using tests/authorization/test_ranger.py
with custom `impala_log_dir` and `cluster_size` arguments.
Failed before changes, passed after changes
- Ran all original E2E tests
Change-Id: I4f46f40474b4b380abe88647a37e8e4d2231d745
Reviewed-on: [http://gerrit.cloudera.org:8080/12935]
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> e2e custom cluster testsuite does not respect cluster_size when
> impala_log_dir present
> --------------------------------------------------------------------------------------
>
> Key: IMPALA-8389
> URL: https://issues.apache.org/jira/browse/IMPALA-8389
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 3.2.0
> Reporter: radford nguyen
> Assignee: radford nguyen
> Priority: Minor
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> h3. Brief
> CustomClusterTestSuite always waits for 3 daemons on startup instead of
> {{cluster_size}} daemons when {{impala_log_dir}} is specified.
> h3. Description
> The {{@CustomClusterTestSuite.withArgs}} decorator allows a user to specify a
> custom cluster size for the test case being decorated. However, when this
> option is specified in conjunction with {{impala_log_dir}}, it will fail to
> wait for the correct number of daemons if any value other than
> {{DEFAULT_CLUSTER_SIZE}} is used.
> The root cause is the difference in how the cluster is started with and
> without {{impala_log_dir}}:
> [https://github.com/apache/impala/blob/3.2.0/tests/common/custom_cluster_test_suite.py#L147]
> h3. To Reproduce:
> * add {{cluster_size=5}} to decorator of test_grant_revoke in
> tests/authorization/test_ranger.py
> * $ impala-py.test tests/authorization/test_ranger.py
> * observe pass
> * add {{impala_log_dir=whatev}} to decorator of test_grant_revoke
> * $ impala-py.test tests/authorization/test_ranger.py
> * observe fail during cluster startup:
> ** 2019-04-04 14:25:54,140 INFO MainThread: Waiting for
> num_known_live_backends=3. Current value: 5
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
