[
https://issues.apache.org/jira/browse/HIVE-15414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755766#comment-15755766
]
Vihang Karajgaonkar commented on HIVE-15414:
--------------------------------------------
Hi [~spena] I checked the results on couple of the latest pre-commit runs. Each
batch of TestNegativeCliDriver now takes between ~400-470 sec which is about
~250-300 sec faster for this batch when compared to before.
[pre-commit-2614 | https://builds.apache.org/job/PreCommit-HIVE-Build/2614/]
{noformat}
2016-12-16 19:22:08,193 INFO [HostExecutor 26] LocalCommand.<init>:45 Starting
LocalCommandId=273266: ssh -v -i /home/hiveptest/.ssh/hive-ptest-user-key -l
hiveptest 107.178.216.213 'bash
/home/hiveptest/107.178.216.213-hiveptest-1/scratch/hiveptest-84-TestNegativeCliDriver-nopart_insert.q-insert_into_with_schema.q-input41.q-and-397-more.sh'
2016-12-16 19:22:08,924 INFO [HostExecutor 39] LocalCommand.<init>:45 Starting
LocalCommandId=273268: ssh -v -i /home/hiveptest/.ssh/hive-ptest-user-key -l
hiveptest 104.154.143.187 'bash
/home/hiveptest/104.154.143.187-hiveptest-0/scratch/hiveptest-85-TestNegativeCliDriver-udf_array_contains_wrong2.q-udf_invalid.q-authorization_rolehierarchy_privs.q-and-374-more.sh'
2016-12-16 19:29:02,702 INFO [HostExecutor 39]
LocalCommand.awaitProcessCompletion:67 Finished LocalCommandId=273268.
ElapsedTime(ms)=413777
2016-12-16 19:30:00,510 INFO [HostExecutor 26]
LocalCommand.awaitProcessCompletion:67 Finished LocalCommandId=273266.
ElapsedTime(ms)=472316
{noformat}
[pre-commit-2613 | https://builds.apache.org/job/PreCommit-HIVE-Build/2613/]
{noformat}
2016-12-16 18:36:15,845 INFO [HostExecutor 36] LocalCommand.<init>:45 Starting
LocalCommandId=272258: ssh -v -i /home/hiveptest/.ssh/hive-ptest-user-key -l
hiveptest 35.184.12.165 'bash
/home/hiveptest/35.184.12.165-hiveptest-1/scratch/hiveptest-84-TestNegativeCliDriver-nopart_insert.q-insert_into_with_schema.q-input41.q-and-397-more.sh'
2016-12-16 18:36:16,066 INFO [HostExecutor 13] LocalCommand.<init>:45 Starting
LocalCommandId=272259: ssh -v -i /home/hiveptest/.ssh/hive-ptest-user-key -l
hiveptest 104.154.143.187 'bash
/home/hiveptest/104.154.143.187-hiveptest-0/scratch/hiveptest-85-TestNegativeCliDriver-udf_array_contains_wrong2.q-udf_invalid.q-authorization_rolehierarchy_privs.q-and-370-more.sh'
2016-12-16 18:43:29,647 INFO [HostExecutor 36]
HostExecutor.executeTestBatch:261 Completed executing tests for batch
[84-TestNegativeCliDriver-nopart_insert.q-insert_into_with_schema.q-input41.q-and-397-more]
on host 35.184.12.165. ElapsedTime(ms)=433802
2016-12-16 18:42:53,365 INFO [HostExecutor 13]
HostExecutor.executeTestBatch:261 Completed executing tests for batch
[85-TestNegativeCliDriver-udf_array_contains_wrong2.q-udf_invalid.q-authorization_rolehierarchy_privs.q-and-370-more]
on host 104.154.143.187. ElapsedTime(ms)=397299
{noformat}
> Fix batchSize for TestNegativeCliDriver
> ---------------------------------------
>
> Key: HIVE-15414
> URL: https://issues.apache.org/jira/browse/HIVE-15414
> Project: Hive
> Issue Type: Sub-task
> Reporter: Vihang Karajgaonkar
> Assignee: Vihang Karajgaonkar
> Priority: Minor
>
> While analyzing the console output of pre-commit console logs, I noticed that
> TestNegativeCliDriver batchSize ~770 qfiles which doesn't look right.
> 2016-12-09 22:23:58,945 DEBUG [TestExecutor] ExecutionPhase.execute:96
> PBatch: QFileTestBatch [batchId=84, size=774, driver=TestNegativeCliDriver,
> queryFilesProperty=qfile,
> name=84-TestNegativeCliDriver-nopart_insert.q-input41.q-having1.q-and-771-more..
>
> I think {{qFileTest.clientNegative.batchSize = 1000}} in
> {{test-configuration2.properties}} is probably the reason.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
