[ 
https://issues.apache.org/jira/browse/KYLIN-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhong Yanghong updated KYLIN-2725:
----------------------------------
    Description: 
System cubes are the basis of dashboard & cube planner. Dashboard & cube 
planner can query on system cubes to fetch required data. Currently, we design 
five system cubes. The details are as follows:
* *METRICS_QUERY*
** Dimension
    USER, HOST, PROJECT, REALIZATION, REALIZATION_TYPE, QUERY_TYPE, EXCEPTION, 
*TIME_DIMENSIONS*
** Measure
    COUNT, 
    MIN & MAX & SUM & PERCENTILE of QUERY_TIME_COST,
    MAX & SUM of CALCITE_COUNT_RETURN,
    MAX & SUM of STORAGE_COUNT_RETURN,
    MAX & SUM of CALCITE_COUNT_AGGREGATE_FILTER,
    COUNT_DISTINCT(hll) of QUERY_HASH_CODE

* *METRICS_QUERY_CUBE*
** Dimension
    CUBE_NAME, SEGMENT_NAME, CUBOID_SOURCE, CUBOID_TARGET, IF_MATCH, 
IF_SUCCESS, *TIME_DIMENSIONS*
** Measure
    COUNT,
    SUM of WEIGHT_PER_HIT,
    MAX & SUM of STORAGE_CALL_COUNT,
    MAX & SUM of STORAGE_CALL_TIME_SUM,
    MAX & SUM of STORAGE_CALL_TIME_MAX,
    MAX & SUM of STORAGE_COUNT_SKIP,
    MAX & SUM of STORAGE_COUNT_SCAN,
    MAX & SUM of STORAGE_COUNT_RETURN,
    MAX & SUM of STORAGE_COUNT_AGGREGATE_FILTER
    MAX & SUM of STORAGE_COUNT_AGGREGATE

* *METRICS_QUERY_RPC*
** Dimension
    HOST, PROJECT, REALIZATION, RPC_SERVER, EXCEPTION, *TIME_DIMENSIONS*
** Measure
    COUNT,
    MAX & SUM & PERCENTILE of CALL_TIME,
    MAX & SUM of COUNT_RETURN,
    MAX & SUM of COUNT_SCAN,
    MAX & SUM of COUNT_SKIP,
    MAX & SUM of COUNT_AGGREGATE_FILTER,
    MAX & SUM of COUNT_AGGREGATE

* *METRICS_JOB*
** Dimension
    USER, PROJECT, CUBE_NAME, JOB_TYPE, CUBING_TYPE, *TIME_DIMENSIONS*
** Measure
    COUNT, 
    MIN & MAX & SUM & PERCENTILE of DURATION,
    MIN & MAX & SUM of TABLE_SIZE,
    MIN & MAX & SUM of CUBE_SIZE,
    MIN & MAX & SUM of PER_BYTES_TIME_COST,
    MIN & MAX & SUM of WAIT_RESOURCE_TIME,
    MAX & SUM of STEP_DURATION_DISTINCT_COLUMNS,
    MAX & SUM of STEP_DURATION_DICTIONARY,
    MAX & SUM of STEP_DURATION_INMEM_CUBING,
    MAX & SUM of STEP_DURATION_HFILE_CONVERT

* *METRICS_JOB_EXCEPTION*
** Dimension
    USER, PROJECT, CUBE_NAME, JOB_TYPE, CUBING_TYPE, EXCEPTION, 
*TIME_DIMENSIONS*
** Measure
    COUNT

* *TIME_DIMENSIONS*
    KYEAR_BEGIN_DATE, KMONTH_BEGIN_DATE, KWEEK_BEGIN_DATE, KDAY_DATE, 
KTIME_HOUR, KTIME_MINUTE

  was:
System cubes are the basis of dashboard & cube planner. Dashboard & cube 
planner can query on system cubes to fetch required data. Currently, we design 
five system cubes. The details are as follows:
* *METRICS_QUERY*
** Dimension
    HOST, PROJECT, REALIZATION, REALIZATION_TYPE, QUERY_TYPE, EXCEPTION, 
*TIME_DIMENSIONS*
** Measure
    COUNT, 
    MIN & MAX & SUM & PERCENTILE of QUERY_TIME_COST,
    MAX & SUM of CALCITE_COUNT_RETURN,
    MAX & SUM of STORAGE_COUNT_RETURN,
    MAX & SUM of CALCITE_COUNT_AGGREGATE_FILTER,
    COUNT_DISTINCT(hll) of QUERY_HASH_CODE

* *METRICS_QUERY_CUBE*
** Dimension
    CUBE_NAME, SEGMENT_NAME, CUBOID_SOURCE, CUBOID_TARGET, IF_MATCH, 
IF_SUCCESS, *TIME_DIMENSIONS*
** Measure
    COUNT,
    SUM of WEIGHT_PER_HIT,
    MAX & SUM of STORAGE_CALL_COUNT,
    MAX & SUM of STORAGE_CALL_TIME_SUM,
    MAX & SUM of STORAGE_CALL_TIME_MAX,
    MAX & SUM of STORAGE_COUNT_SKIP,
    MAX & SUM of STORAGE_COUNT_SCAN,
    MAX & SUM of STORAGE_COUNT_RETURN,
    MAX & SUM of STORAGE_COUNT_AGGREGATE_FILTER
    MAX & SUM of STORAGE_COUNT_AGGREGATE

* *METRICS_QUERY_RPC*
** Dimension
    HOST, PROJECT, REALIZATION, RPC_SERVER, EXCEPTION, *TIME_DIMENSIONS*
** Measure
    COUNT,
    MAX & SUM & PERCENTILE of CALL_TIME,
    MAX & SUM of COUNT_RETURN,
    MAX & SUM of COUNT_SCAN,
    MAX & SUM of COUNT_SKIP,
    MAX & SUM of COUNT_AGGREGATE_FILTER,
    MAX & SUM of COUNT_AGGREGATE

* *METRICS_JOB*
** Dimension
    PROJECT, CUBE_NAME, JOB_TYPE, CUBING_TYPE, *TIME_DIMENSIONS*
** Measure
    COUNT, 
    MIN & MAX & SUM & PERCENTILE of DURATION,
    MIN & MAX & SUM of TABLE_SIZE,
    MIN & MAX & SUM of CUBE_SIZE,
    MIN & MAX & SUM of PER_BYTES_TIME_COST,
    MIN & MAX & SUM of WAIT_RESOURCE_TIME,
    MAX & SUM of STEP_DURATION_DISTINCT_COLUMNS,
    MAX & SUM of STEP_DURATION_DICTIONARY,
    MAX & SUM of STEP_DURATION_INMEM_CUBING,
    MAX & SUM of STEP_DURATION_HFILE_CONVERT

* *METRICS_JOB_EXCEPTION*
** Dimension
    PROJECT, CUBE_NAME, JOB_TYPE, CUBING_TYPE, EXCEPTION, *TIME_DIMENSIONS*
** Measure
    COUNT

* *TIME_DIMENSIONS*
    KYEAR_BEGIN_DATE, KMONTH_BEGIN_DATE, KWEEK_BEGIN_DATE, KDAY_DATE, 
KTIME_HOUR, KTIME_MINUTE


> Introduce a tool for creating system cubes relating to query & job metrics
> --------------------------------------------------------------------------
>
>                 Key: KYLIN-2725
>                 URL: https://issues.apache.org/jira/browse/KYLIN-2725
>             Project: Kylin
>          Issue Type: Sub-task
>    Affects Versions: v2.2.0
>            Reporter: Zhong Yanghong
>            Assignee: Zhong Yanghong
>
> System cubes are the basis of dashboard & cube planner. Dashboard & cube 
> planner can query on system cubes to fetch required data. Currently, we 
> design five system cubes. The details are as follows:
> * *METRICS_QUERY*
> ** Dimension
>     USER, HOST, PROJECT, REALIZATION, REALIZATION_TYPE, QUERY_TYPE, 
> EXCEPTION, *TIME_DIMENSIONS*
> ** Measure
>     COUNT, 
>     MIN & MAX & SUM & PERCENTILE of QUERY_TIME_COST,
>     MAX & SUM of CALCITE_COUNT_RETURN,
>     MAX & SUM of STORAGE_COUNT_RETURN,
>     MAX & SUM of CALCITE_COUNT_AGGREGATE_FILTER,
>     COUNT_DISTINCT(hll) of QUERY_HASH_CODE
> * *METRICS_QUERY_CUBE*
> ** Dimension
>     CUBE_NAME, SEGMENT_NAME, CUBOID_SOURCE, CUBOID_TARGET, IF_MATCH, 
> IF_SUCCESS, *TIME_DIMENSIONS*
> ** Measure
>     COUNT,
>     SUM of WEIGHT_PER_HIT,
>     MAX & SUM of STORAGE_CALL_COUNT,
>     MAX & SUM of STORAGE_CALL_TIME_SUM,
>     MAX & SUM of STORAGE_CALL_TIME_MAX,
>     MAX & SUM of STORAGE_COUNT_SKIP,
>     MAX & SUM of STORAGE_COUNT_SCAN,
>     MAX & SUM of STORAGE_COUNT_RETURN,
>     MAX & SUM of STORAGE_COUNT_AGGREGATE_FILTER
>     MAX & SUM of STORAGE_COUNT_AGGREGATE
> * *METRICS_QUERY_RPC*
> ** Dimension
>     HOST, PROJECT, REALIZATION, RPC_SERVER, EXCEPTION, *TIME_DIMENSIONS*
> ** Measure
>     COUNT,
>     MAX & SUM & PERCENTILE of CALL_TIME,
>     MAX & SUM of COUNT_RETURN,
>     MAX & SUM of COUNT_SCAN,
>     MAX & SUM of COUNT_SKIP,
>     MAX & SUM of COUNT_AGGREGATE_FILTER,
>     MAX & SUM of COUNT_AGGREGATE
> * *METRICS_JOB*
> ** Dimension
>     USER, PROJECT, CUBE_NAME, JOB_TYPE, CUBING_TYPE, *TIME_DIMENSIONS*
> ** Measure
>     COUNT, 
>     MIN & MAX & SUM & PERCENTILE of DURATION,
>     MIN & MAX & SUM of TABLE_SIZE,
>     MIN & MAX & SUM of CUBE_SIZE,
>     MIN & MAX & SUM of PER_BYTES_TIME_COST,
>     MIN & MAX & SUM of WAIT_RESOURCE_TIME,
>     MAX & SUM of STEP_DURATION_DISTINCT_COLUMNS,
>     MAX & SUM of STEP_DURATION_DICTIONARY,
>     MAX & SUM of STEP_DURATION_INMEM_CUBING,
>     MAX & SUM of STEP_DURATION_HFILE_CONVERT
> * *METRICS_JOB_EXCEPTION*
> ** Dimension
>     USER, PROJECT, CUBE_NAME, JOB_TYPE, CUBING_TYPE, EXCEPTION, 
> *TIME_DIMENSIONS*
> ** Measure
>     COUNT
> * *TIME_DIMENSIONS*
>     KYEAR_BEGIN_DATE, KMONTH_BEGIN_DATE, KWEEK_BEGIN_DATE, KDAY_DATE, 
> KTIME_HOUR, KTIME_MINUTE



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to