[
https://issues.apache.org/jira/browse/HIVE-21823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858891#comment-16858891
]
Hive QA commented on HIVE-21823:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12971160/HIVE-21823.4.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 16 failed/errored test(s), 16050 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.common.metrics.metrics2.TestCodahaleMetrics.testFileReporting
(batchId=296)
org.apache.hadoop.hive.metastore.TestObjectStore.catalogs (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDatabaseOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDeprecatedConfigIsOverwritten
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDirectSQLDropParitionsCleanup
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDirectSQLDropPartitionsCacheCrossSession
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testDirectSqlErrorMetrics
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testEmptyTrustStoreProps
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testMasterKeyOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testMaxEventResponse
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testPartitionOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testQueryCloseOnError
(batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testRoleOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testTableOps (batchId=232)
org.apache.hadoop.hive.metastore.TestObjectStore.testUseSSLProperty
(batchId=232)
org.apache.hadoop.hive.ql.util.TestUpgradeTool.testPostUpgrade (batchId=297)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17475/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17475/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17475/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 16 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12971160 - PreCommit-HIVE-Build
> New metrics to get the average queue length / free executor number for a
> given time window
> ------------------------------------------------------------------------------------------
>
> Key: HIVE-21823
> URL: https://issues.apache.org/jira/browse/HIVE-21823
> Project: Hive
> Issue Type: Sub-task
> Components: llap
> Reporter: Peter Vary
> Assignee: Peter Vary
> Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-21823.2.patch, HIVE-21823.3.patch,
> HIVE-21823.4.patch, HIVE-21823.patch
>
> Time Spent: 2h 40m
> Remaining Estimate: 0h
>
> We need to calculate the average queue size / free executor size for a window
> to have good data for making routing decisions.
> Interesting things to consider:
> * The time gap between arriving request can be different, so simple average
> is not enough to have correct data
> * We need to have 2 parameters
> ** Time window length
> ** Maximum data point numbers - so we will not collect "infinite" amount of
> data at high load
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
