[
https://issues.apache.org/jira/browse/KYLIN-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhong Yanghong updated KYLIN-2725:
----------------------------------
Description:
System cubes are the basis of dashboard & cube planner. Dashboard & cube
planner can query on system cubes to fetch required data. Currently, we design
five system cubes. The details are as follows:
* *METRICS_QUERY*
** Dimension
HOST, PROJECT, REALIZATION, REALIZATION_TYPE, QUERY_TYPE, EXCEPTION,
*TIME_DIMENSIONS*
** Measure
COUNT,
MIN & MAX & SUM & PERCENTILE of QUERY_TIME_COST,
MAX & SUM of CALCITE_COUNT_RETURN,
MAX & SUM of STORAGE_COUNT_RETURN,
MAX & SUM of CALCITE_COUNT_AGGREGATE_FILTER,
COUNT_DISTINCT(hll) of QUERY_HASH_CODE
* *METRICS_QUERY_CUBE*
** Dimension
CUBE_NAME, SEGMENT_NAME, CUBOID_SOURCE, CUBOID_TARGET, IF_MATCH,
IF_SUCCESS, *TIME_DIMENSIONS*
** Measure
COUNT,
SUM of WEIGHT_PER_HIT,
MAX & SUM of STORAGE_CALL_COUNT,
MAX & SUM of STORAGE_CALL_TIME_SUM,
MAX & SUM of STORAGE_CALL_TIME_MAX,
MAX & SUM of STORAGE_COUNT_SKIP,
MAX & SUM of STORAGE_COUNT_SCAN,
MAX & SUM of STORAGE_COUNT_RETURN,
MAX & SUM of STORAGE_COUNT_AGGREGATE_FILTER
MAX & SUM of STORAGE_COUNT_AGGREGATE
* *METRICS_QUERY_RPC*
** Dimension
HOST, PROJECT, REALIZATION, RPC_SERVER, EXCEPTION, *TIME_DIMENSIONS*
** Measure
COUNT,
MAX & SUM & PERCENTILE of CALL_TIME,
MAX & SUM of COUNT_RETURN,
MAX & SUM of COUNT_SCAN,
MAX & SUM of COUNT_SKIP,
MAX & SUM of COUNT_AGGREGATE_FILTER,
MAX & SUM of COUNT_AGGREGATE
* *METRICS_JOB*
** Dimension
PROJECT, CUBE_NAME, JOB_TYPE, CUBING_TYPE, *TIME_DIMENSIONS*
** Measure
COUNT,
MIN & MAX & SUM & PERCENTILE of DURATION,
MIN & MAX & SUM of TABLE_SIZE,
MIN & MAX & SUM of CUBE_SIZE,
MIN & MAX & SUM of PER_BYTES_TIME_COST,
MIN & MAX & SUM of WAIT_RESOURCE_TIME,
MAX & SUM of STEP_DURATION_DISTINCT_COLUMNS,
MAX & SUM of STEP_DURATION_DICTIONARY,
MAX & SUM of STEP_DURATION_INMEM_CUBING,
MAX & SUM of STEP_DURATION_HFILE_CONVERT
* *METRICS_JOB_EXCEPTION*
** Dimension
PROJECT, CUBE_NAME, JOB_TYPE, CUBING_TYPE, EXCEPTION, *TIME_DIMENSIONS*
** Measure
COUNT
* *TIME_DIMENSIONS*
KYEAR_BEGIN_DATE, KMONTH_BEGIN_DATE, KWEEK_BEGIN_DATE, KDAY_DATE,
KTIME_HOUR, KTIME_MINUTE
was:
System cubes are the basis of dashboard & cube planner. Dashboard & cube
planner can query on system cubes to fetch required data. Currently, we design
five system cubes. The details are as follows:
* *METRICS_QUERY*
** Dimension
HOST, PROJECT, REALIZATION, REALIZATION_TYPE, QUERY_TYPE, EXCEPTION,
*TIME_DIMENSIONS*
** Measure
COUNT,
MIN & MAX & SUM & PERCENTILE of QUERY_TIME_COST,
MAX & SUM of CALCITE_COUNT_RETURN,
MAX & SUM of STORAGE_COUNT_RETURN,
MAX & SUM of CALCITE_COUNT_AGGREGATE_FILTER,
COUNT_DISTINCT(hll) of QUERY_HASH_CODE
* *METRICS_QUERY_CUBE*
** Dimension
CUBE_NAME, SEGMENT_NAME, CUBOID_SOURCE, CUBOID_TARGET, IF_MATCH,
IF_SUCCESS, *TIME_DIMENSIONS*
** Measure
COUNT,
SUM of WEIGHT_PER_HIT,
MAX & SUM of STORAGE_CALL_COUNT,
MAX & SUM of STORAGE_CALL_TIME_SUM,
MAX & SUM of STORAGE_CALL_TIME_MAX,
MAX & SUM of STORAGE_COUNT_SKIP,
MAX & SUM of STORAGE_COUNT_SCAN,
MAX & SUM of STORAGE_COUNT_RETURN,
MAX & SUM of STORAGE_COUNT_AGGREGATE_FILTER
MAX & SUM of STORAGE_COUNT_AGGREGATE
* *METRICS_QUERY_RPC*
** Dimension
HOST, PROJECT, REALIZATION, RPC_SERVER, EXCEPTION, *TIME_DIMENSIONS*
** Measure
COUNT,
MAX & SUM & PERCENTILE of CALL_TIME,
MAX & SUM of COUNT_RETURN,
MAX & SUM of COUNT_SCAN,
MAX & SUM of COUNT_SKIP,
MAX & SUM of COUNT_AGGREGATE_FILTER,
MAX & SUM of COUNT_AGGREGATE
* *METRICS_JOB*
** Dimension
PROJECT, CUBE_NAME, JOB_TYPE, CUBING_TYPE, *TIME_DIMENSIONS*
** Measure
COUNT,
MIN & MAX & SUM & PERCENTILE of DURATION,
MIN & MAX & SUM of TABLE_SIZE,
MIN & MAX & SUM of CUBE_SIZE,
MIN & MAX & SUM of PER_BYTES_TIME_COST,
MIN & MAX & SUM of WAIT_RESOURCE_TIME,
MAX & SUM of STEP_DURATION_DISTINCT_COLUMNS,
MAX & SUM of STEP_DURATION_DICTIONARY,
MAX & SUM of STEP_DURATION_INMEM_CUBING,
MAX & SUM of STEP_DURATION_HFILE_CONVERT
* *METRICS_JOB_EXCEPTION*
** Dimension
PROJECT, CUBE_NAME, JOB_TYPE, CUBING_TYPE, EXCEPTION, *TIME_DIMENSIONS*
** Measure
COUNT
> Introduce a tool for creating system cubes relating to query & job metrics
> --------------------------------------------------------------------------
>
> Key: KYLIN-2725
> URL: https://issues.apache.org/jira/browse/KYLIN-2725
> Project: Kylin
> Issue Type: Sub-task
> Affects Versions: v2.0.0
> Reporter: Zhong Yanghong
> Assignee: Zhong Yanghong
>
> System cubes are the basis of dashboard & cube planner. Dashboard & cube
> planner can query on system cubes to fetch required data. Currently, we
> design five system cubes. The details are as follows:
> * *METRICS_QUERY*
> ** Dimension
> HOST, PROJECT, REALIZATION, REALIZATION_TYPE, QUERY_TYPE, EXCEPTION,
> *TIME_DIMENSIONS*
> ** Measure
> COUNT,
> MIN & MAX & SUM & PERCENTILE of QUERY_TIME_COST,
> MAX & SUM of CALCITE_COUNT_RETURN,
> MAX & SUM of STORAGE_COUNT_RETURN,
> MAX & SUM of CALCITE_COUNT_AGGREGATE_FILTER,
> COUNT_DISTINCT(hll) of QUERY_HASH_CODE
> * *METRICS_QUERY_CUBE*
> ** Dimension
> CUBE_NAME, SEGMENT_NAME, CUBOID_SOURCE, CUBOID_TARGET, IF_MATCH,
> IF_SUCCESS, *TIME_DIMENSIONS*
> ** Measure
> COUNT,
> SUM of WEIGHT_PER_HIT,
> MAX & SUM of STORAGE_CALL_COUNT,
> MAX & SUM of STORAGE_CALL_TIME_SUM,
> MAX & SUM of STORAGE_CALL_TIME_MAX,
> MAX & SUM of STORAGE_COUNT_SKIP,
> MAX & SUM of STORAGE_COUNT_SCAN,
> MAX & SUM of STORAGE_COUNT_RETURN,
> MAX & SUM of STORAGE_COUNT_AGGREGATE_FILTER
> MAX & SUM of STORAGE_COUNT_AGGREGATE
> * *METRICS_QUERY_RPC*
> ** Dimension
> HOST, PROJECT, REALIZATION, RPC_SERVER, EXCEPTION, *TIME_DIMENSIONS*
> ** Measure
> COUNT,
> MAX & SUM & PERCENTILE of CALL_TIME,
> MAX & SUM of COUNT_RETURN,
> MAX & SUM of COUNT_SCAN,
> MAX & SUM of COUNT_SKIP,
> MAX & SUM of COUNT_AGGREGATE_FILTER,
> MAX & SUM of COUNT_AGGREGATE
> * *METRICS_JOB*
> ** Dimension
> PROJECT, CUBE_NAME, JOB_TYPE, CUBING_TYPE, *TIME_DIMENSIONS*
> ** Measure
> COUNT,
> MIN & MAX & SUM & PERCENTILE of DURATION,
> MIN & MAX & SUM of TABLE_SIZE,
> MIN & MAX & SUM of CUBE_SIZE,
> MIN & MAX & SUM of PER_BYTES_TIME_COST,
> MIN & MAX & SUM of WAIT_RESOURCE_TIME,
> MAX & SUM of STEP_DURATION_DISTINCT_COLUMNS,
> MAX & SUM of STEP_DURATION_DICTIONARY,
> MAX & SUM of STEP_DURATION_INMEM_CUBING,
> MAX & SUM of STEP_DURATION_HFILE_CONVERT
> * *METRICS_JOB_EXCEPTION*
> ** Dimension
> PROJECT, CUBE_NAME, JOB_TYPE, CUBING_TYPE, EXCEPTION, *TIME_DIMENSIONS*
> ** Measure
> COUNT
> * *TIME_DIMENSIONS*
> KYEAR_BEGIN_DATE, KMONTH_BEGIN_DATE, KWEEK_BEGIN_DATE, KDAY_DATE,
> KTIME_HOUR, KTIME_MINUTE
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
