[
https://issues.apache.org/jira/browse/FLINK-24891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Echo Lee updated FLINK-24891:
-----------------------------
Description:
Sometimes, we don’t care some label keys, such as host, tm_id, etc. At the same
time, we can make the label very short.
So we need to support filtering some labels, such as the introduction of
similar *filterLabelKeys* parameters, the value can be multiple, separated by
semicolons, For example,
configuration.setString("metrics.reporter.promgateway.filterLabelKeys",
"host;tm_id;task_attempt_id;job_id;job_name")
Before adding parameters:
{+}host{+}{*}={*}"" instance="" job="task_test3"
{+}job_id{+}{*}={*}"4dc230ce97e6bebd559d96956ca21e2e"
{+}job_name{+}{*}={*}"insert_into_default_catalog_default_database_print"
subtask_index="2"
{+}task_attempt_id{+}{*}={*}"92b5b1dba2679749d56aa298cd3b35d5"
task_attempt_num="0" task_id="cbc357ccb763df2852fee8c4fc7d55f2"
task_name="Source:{_}TableSourceScan_table{_}{_}{{_}}default_catalog{_}{{_}}default_database{_}{{_}}datagen_t{{_}}{_}{_}{{_}}fields{_}{{_}}value1{_}{{_}}value2{{_}}{_}__{_}{{_}}Calc_select{_}{{_}}value1{_}{{_}}value2{_}{{_}}CAST{{_}}{_}_{_}{{_}}AS_value3{{_}}{_}__{_}{{_}}Sink:{_}Sink_table{_}{_}default_catalog_default_database_print{_}{_}{{_}}fields{_}{{_}}value1{_}{{_}}value2{_}{{_}}value3{{_}}{_}"
{+}tm_id{+}{*}={*}"0d8f1b33_1dd4_4f62_878d_dbf498c203d3"
After adding parameters:
instance="" job="task_id" subtask_index="2" task_attempt_num="0"
task_id="cbc357ccb763df2852fee8c4fc7d55f2"
task_name="Source:{_}TableSourceScan_table{_}{_}{{_}}default_catalog{_}{{_}}default_database{_}{{_}}datagen_t{{_}}{_}{_}{{_}}fields{_}{{_}}value1{_}{{_}}value2{{_}}{_}__{_}{{_}}Calc_select{_}{{_}}value1{_}{{_}}value2{_}{{_}}CAST{{_}}{_}_{_}{{_}}AS_value3{{_}}{_}__{_}{{_}}Sink:{_}Sink_table{_}{_}default_catalog_default_database_print{_}{_}{{_}}fields{_}{{_}}value1{_}{{_}}value2{_}{{_}}value3{{_}}{_}"
was:
Sometimes, we don’t care some label keys, such as host, tm_id, etc. At the same
time, we can make the label very short.
So we need to support filtering some labels, such as the introduction of
similar *filterLabelKeys* parameters, the value can be multiple, separated by
semicolons, For example,
configuration.setString("metrics.reporter.promgateway.filterLabelKeys",
"host;tm_id;task_attempt_id;job_id;job_name")
Before adding parameters:
{*}host={*}"" instance="" job="task_test3"
{*}job_id={*}"4dc230ce97e6bebd559d96956ca21e2e"
{*}job_name={*}"insert_into_default_catalog_default_database_print"
subtask_index="2" {*}task_attempt_id={*}"92b5b1dba2679749d56aa298cd3b35d5"
task_attempt_num="0" task_id="cbc357ccb763df2852fee8c4fc7d55f2"
task_name="Source:{_}TableSourceScan_table{_}_{_}default_catalog{_}{_}default_database{_}{_}datagen_t{_}__{_}fields{_}{_}value1{_}{_}value2{_}____{_}Calc_select{_}{_}value1{_}{_}value2{_}{_}CAST{_}___{_}AS_value3{_}____{_}Sink:_Sink_table{_}{_}default_catalog_default_database_print{_}_{_}fields{_}{_}value1{_}{_}value2{_}{_}value3{_}_"
{*}tm_id={*}"0d8f1b33_1dd4_4f62_878d_dbf498c203d3"
After adding parameters:
instance="" job="task_id" subtask_index="2" task_attempt_num="0"
task_id="cbc357ccb763df2852fee8c4fc7d55f2"
task_name="Source:{_}TableSourceScan_table{_}_{_}default_catalog{_}{_}default_database{_}{_}datagen_t{_}__{_}fields{_}{_}value1{_}{_}value2{_}____{_}Calc_select{_}{_}value1{_}{_}value2{_}{_}CAST{_}___{_}AS_value3{_}____{_}Sink:_Sink_table{_}{_}default_catalog_default_database_print{_}_{_}fields{_}{_}value1{_}{_}value2{_}{_}value3{_}_"
> PrometheusPushGatewayReporter support filter label keys
> -------------------------------------------------------
>
> Key: FLINK-24891
> URL: https://issues.apache.org/jira/browse/FLINK-24891
> Project: Flink
> Issue Type: New Feature
> Components: Runtime / Metrics
> Affects Versions: 1.14.0
> Reporter: Echo Lee
> Priority: Major
> Fix For: 1.15.0
>
>
> Sometimes, we don’t care some label keys, such as host, tm_id, etc. At the
> same time, we can make the label very short.
> So we need to support filtering some labels, such as the introduction of
> similar *filterLabelKeys* parameters, the value can be multiple, separated by
> semicolons, For example,
> configuration.setString("metrics.reporter.promgateway.filterLabelKeys",
> "host;tm_id;task_attempt_id;job_id;job_name")
>
> Before adding parameters:
> {+}host{+}{*}={*}"" instance="" job="task_test3"
> {+}job_id{+}{*}={*}"4dc230ce97e6bebd559d96956ca21e2e"
> {+}job_name{+}{*}={*}"insert_into_default_catalog_default_database_print"
> subtask_index="2"
> {+}task_attempt_id{+}{*}={*}"92b5b1dba2679749d56aa298cd3b35d5"
> task_attempt_num="0" task_id="cbc357ccb763df2852fee8c4fc7d55f2"
>
> task_name="Source:{_}TableSourceScan_table{_}{_}{{_}}default_catalog{_}{{_}}default_database{_}{{_}}datagen_t{{_}}{_}{_}{{_}}fields{_}{{_}}value1{_}{{_}}value2{{_}}{_}__{_}{{_}}Calc_select{_}{{_}}value1{_}{{_}}value2{_}{{_}}CAST{{_}}{_}_{_}{{_}}AS_value3{{_}}{_}__{_}{{_}}Sink:{_}Sink_table{_}{_}default_catalog_default_database_print{_}{_}{{_}}fields{_}{{_}}value1{_}{{_}}value2{_}{{_}}value3{{_}}{_}"
> {+}tm_id{+}{*}={*}"0d8f1b33_1dd4_4f62_878d_dbf498c203d3"
>
> After adding parameters:
> instance="" job="task_id" subtask_index="2" task_attempt_num="0"
> task_id="cbc357ccb763df2852fee8c4fc7d55f2"
>
> task_name="Source:{_}TableSourceScan_table{_}{_}{{_}}default_catalog{_}{{_}}default_database{_}{{_}}datagen_t{{_}}{_}{_}{{_}}fields{_}{{_}}value1{_}{{_}}value2{{_}}{_}__{_}{{_}}Calc_select{_}{{_}}value1{_}{{_}}value2{_}{{_}}CAST{{_}}{_}_{_}{{_}}AS_value3{{_}}{_}__{_}{{_}}Sink:{_}Sink_table{_}{_}default_catalog_default_database_print{_}{_}{{_}}fields{_}{{_}}value1{_}{{_}}value2{_}{{_}}value3{{_}}{_}"
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
