[
https://issues.apache.org/jira/browse/HIVE-15414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15742728#comment-15742728
]
Vihang Karajgaonkar commented on HIVE-15414:
--------------------------------------------
Thanks [~pvary]. I think you may be right but I thought of checking it either
ways in the hope that it might improve the run time further :)
[~spena] Based on these logs on the latest run:
2016-12-12 17:21:30,903 INFO [HostExecutor 46] LocalCommand.<init>:45 Starting
LocalCommandId=205113: ssh -v -i /home/hiveptest/.ssh/hive-ptest-user-key -l
hiveptest 104.154.105.18 'bash
/home/hiveptest/104.154.105.18-hiveptest-0/scratch/hiveptest-84-TestNegativeCliDriver-nopart_insert.q-input41.q-having1.q-and-771-more.sh'
2016-12-12 17:33:28,341 INFO [HostExecutor 46]
LocalCommand.awaitProcessCompletion:67 Finished LocalCommandId=205113.
ElapsedTime(ms)=717437
2016-12-12 17:33:28,341 INFO [HostExecutor 46]
HostExecutor.executeTestBatch:261 Completed executing tests for batch
[84-TestNegativeCliDriver-nopart_insert.q-input41.q-having1.q-and-771-more] on
host 104.154.105.18. ElapsedTime(ms)=717437
It takes about ~700 sec.
I did a quick search of the logs and it looks like most other batches take
between 200-300 sec so we may see some benefits if we reduce the limit from
1000 to 400 so that the tests are divided into 2 batches.
> Fix batchSize for TestNegativeCliDriver
> ---------------------------------------
>
> Key: HIVE-15414
> URL: https://issues.apache.org/jira/browse/HIVE-15414
> Project: Hive
> Issue Type: Sub-task
> Reporter: Vihang Karajgaonkar
> Assignee: Vihang Karajgaonkar
> Priority: Minor
>
> While analyzing the console output of pre-commit console logs, I noticed that
> TestNegativeCliDriver batchSize ~770 qfiles which doesn't look right.
> 2016-12-09 22:23:58,945 DEBUG [TestExecutor] ExecutionPhase.execute:96
> PBatch: QFileTestBatch [batchId=84, size=774, driver=TestNegativeCliDriver,
> queryFilesProperty=qfile,
> name=84-TestNegativeCliDriver-nopart_insert.q-input41.q-having1.q-and-771-more..
>
> I think {{qFileTest.clientNegative.batchSize = 1000}} in
> {{test-configuration2.properties}} is probably the reason.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
