[
https://issues.apache.org/jira/browse/PHOENIX-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15404389#comment-15404389
]
Loknath Priyatham Teja Singamsetty commented on PHOENIX-3115:
--------------------------------------------------------------
Written E2E tests for async secondary index PhoenixMRJobSubmitter workflows.
However there are multiple issues during execution of the same.
Fixed:
- In PhoenixMRJobSubmitter, DriverManager.getConnection("jdbc:phoenix:" +
zkQuorum) fails without returning connection, as the zkQuorum is localhost for
unit test run. The ideal connection url string should contain the zk client
port as well if zkQuorum doesn't have it. Made the necessary changes to fix the
same.
- Some of the unit tests which require mr process, doesn't have
serverProps.put(QueryServices.ASYNC_INDEX_AUTO_BUILD_ATTRIB,
Boolean.toString(false)); Added the same.
- Another error "connection loss to /yarn-leader-election" because of
PhoenixMRJobSubmitter always expecting RM in HA mode. Refactored
PhoenixMRJobSubmitter to consider scenarios where RM is non-HA (as per test
setup)
Unresolved:
- Our test env for test cases which uses MapReduceMiniCluster setup is not able
to get job details from mapreduce job history web app address with the help of
HttpURLConnection. This needs some research on how the yarn config has to be
setup. Tried couple of default and customized configs here but wasn't
successful.
> Create e2e workflow test for async secondary mr based index building
> ---------------------------------------------------------------------
>
> Key: PHOENIX-3115
> URL: https://issues.apache.org/jira/browse/PHOENIX-3115
> Project: Phoenix
> Issue Type: Test
> Reporter: Loknath Priyatham Teja Singamsetty
> Assignee: Loknath Priyatham Teja Singamsetty
>
> Need for e2e workflow test for async secondary mr based index building
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)