[
https://issues.apache.org/jira/browse/HIVE-21823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Vary updated HIVE-21823:
------------------------------
Status: Patch Available (was: Open)
The patch contains the following changes:
* Created TimedAverageMetrics to calculate average value above time.
* Added 2 configurations to set the size of the time window:
** LLAP_DAEMON_METRICS_AVERAGE_DATA_SIZE - the number of data points to retain
** LLAP_DAEMON_METRICS_AVERAGE_TIME_WINDOW - the time window to calculate the
average
* Added new metrics to the {{LlapDaemonExecutorMetrics}}
> New metrics to get the average queue length / free executor number for a
> given time window
> ------------------------------------------------------------------------------------------
>
> Key: HIVE-21823
> URL: https://issues.apache.org/jira/browse/HIVE-21823
> Project: Hive
> Issue Type: Sub-task
> Components: llap
> Reporter: Peter Vary
> Assignee: Peter Vary
> Priority: Major
> Attachments: HIVE-21823.patch
>
>
> We need to calculate the average queue size / free executor size for a window
> to have good data for making routing decisions.
> Interesting things to consider:
> * The time gap between arriving request can be different, so simple average
> is not enough to have correct data
> * We need to have 2 parameters
> ** Time window length
> ** Maximum data point numbers - so we will not collect "infinite" amount of
> data at high load
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
