[ 
https://issues.apache.org/jira/browse/HIVE-20405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16595859#comment-16595859
 ] 

slim bouguerra commented on HIVE-20405:
---------------------------------------

I can see from the logs that the default batch size for miniDruidTests is 5 
(grep for  qFileTest.miniDruid.batchSize) at 
http://104.198.109.242/logs/PreCommit-HIVE-Build-13517/execution.txt
This leads to running multiple tests setups for Druid tests, that causes issue 
if each batch is trying to startup a Druid Cluster. I think a short fix can be 
to increase the batch size to something like 50, this will ensure that only one 
Druid Cluster is used.
{code}
QFileTestBatch [batchId=192, size=5, driver=TestMiniDruidCliDriver, 
queryFilesProperty=qfile, 
name=192-TestMiniDruidCliDriver-druidmini_test_ts.q-druidmini_mv.q-druid_timestamptz2.q-and-2-more,
 tests=[druidmini_test_ts.q, druidmini_mv.q, druid_timestamptz2.q, 
druidmini_extractTime.q, druidmini_floorTime.q], isParallel=true, 
moduleName=itests/qtest]

2018-08-29 00:08:31,293 DEBUG [TestExecutor] ExecutionPhase.execute:98 PBatch: 
QFileTestBatch [batchId=193, size=5, driver=TestMiniDruidCliDriver, 
queryFilesProperty=qfile, 
name=193-TestMiniDruidCliDriver-druidmini_dynamic_partition.q-druidmini_expressions.q-druidmini_test_alter.q-and-2-more,
 tests=[druidmini_dynamic_partition.q, druidmini_expressions.q, 
druidmini_test_alter.q, druidmini_test1.q, druidmini_test_insert.q], 
isParallel=true, moduleName=itests/qtest]
2018-08-29 00:08:31,293 DEBUG [TestExecutor] ExecutionPhase.execute:98 PBatch: 
QFileTestBatch [batchId=194, size=3, driver=TestMiniDruidCliDriver, 
queryFilesProperty=qfile, 
name=194-TestMiniDruidCliDriver-druidmini_masking.q-druidmini_joins.q-druid_timestamptz.q,
 tests=[druidmini_masking.q, druidmini_joins.q, druid_timestamptz.q], 
isParallel=true, moduleName=itests/qtest]
{code}

> Run all druid tests in one batch
> --------------------------------
>
>                 Key: HIVE-20405
>                 URL: https://issues.apache.org/jira/browse/HIVE-20405
>             Project: Hive
>          Issue Type: Test
>          Components: Testing Infrastructure
>            Reporter: Vineet Garg
>            Assignee: Nishant Bangarwa
>            Priority: Major
>
> Running druid tests in parallel could cause issues so all of the tests should 
> be run in one batch.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to