[jira] [Comment Edited] (FLINK-20367) Show the in-use config of job to users
[ https://issues.apache.org/jira/browse/FLINK-20367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265925#comment-17265925 ] Robert Metzger edited comment on FLINK-20367 at 2/12/21, 11:06 AM: --- The effective configuration is not only shown in the logs, also in the Web UI. Is that sufficient for your use-case, or do you want access to the effective configuration also in your user code? (for example through a method like RuntimeContext.getTaskManagerConfiguration()) If so, what exactly is your use-case? Also, if we are going to do this, we need to consider that all configuration parameters, including security-related authentication tokens etc. are accessible. was (Author: rmetzger): The effective configuration is not only shown in the logs, also in the Web UI. Is that sufficient for your use-case, or do you want access to the effective configuration also in your user code? (for example through a method like RuntimeContext.getTaskManagerConfiguration()) If so, what exactly is your use-case? Also, if we are going to do this, we need to consider that all configuration parameters, including security-related authentication tokens etc. > Show the in-use config of job to users > -- > > Key: FLINK-20367 > URL: https://issues.apache.org/jira/browse/FLINK-20367 > Project: Flink > Issue Type: Improvement > Components: Runtime / Configuration, Runtime / Coordination >Reporter: zlzhang0122 >Priority: Major > Labels: usability > > Now the config can be set from global cluster configuration and single job > code , since we can't absolutely sure that which config is in-use except we > check it in the start-up log. I think maybe we can show the in-use config of > job to users and this can be helpful! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (FLINK-20367) Show the in-use config of job to users
[ https://issues.apache.org/jira/browse/FLINK-20367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265925#comment-17265925 ] Robert Metzger edited comment on FLINK-20367 at 1/15/21, 11:06 AM: --- The effective configuration is not only shown in the logs, also in the Web UI. Is that sufficient for your use-case, or do you want access to the effective configuration also in your user code? (for example through a method like RuntimeContext.getTaskManagerConfiguration()) If so, what exactly is your use-case? Also, if we are going to do this, we need to consider that all configuration parameters, including security-related authentication tokens etc. was (Author: rmetzger): The effective configuration is not only shown in the logs, also in the Web UI. Is that sufficient for your use-case, or do you want access to the effective configuration also in your user code? If so, what exactly is your use-case? Also, if we are going to do this, we need to consider that all configuration parameters, including security-related authentication tokens etc. > Show the in-use config of job to users > -- > > Key: FLINK-20367 > URL: https://issues.apache.org/jira/browse/FLINK-20367 > Project: Flink > Issue Type: Improvement > Components: Runtime / Configuration, Runtime / Coordination >Reporter: zlzhang0122 >Priority: Major > Labels: usability > > Now the config can be set from global cluster configuration and single job > code , since we can't absolutely sure that which config is in-use except we > check it in the start-up log. I think maybe we can show the in-use config of > job to users and this can be helpful! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (FLINK-20367) Show the in-use config of job to users
[
https://issues.apache.org/jira/browse/FLINK-20367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239161#comment-17239161
]
Matthias edited comment on FLINK-20367 at 11/26/20, 10:07 AM:
--
[~zlzhang0122] -could you specify what configuration parameters you miss in the
response of the {{/jobmanager/config}} endpoint?-
Ok, reading through your message again, you're referring to parameters that are
changed per-job and, therefore, overwrite the cluster's default values (like
{{parallelism}}). Could you verify that?
was (Author: mapohl):
[~zlzhang0122] -could you specify what configuration parameters you miss in the
response of the {{/jobmanager/config}} endpoint?-
Ok, reading through your message again, you're referring to parameters that are
changed per-job and, therefore, overwrite the cluster's default values (like
`parallelism`). Could you verify that?
> Show the in-use config of job to users
> --
>
> Key: FLINK-20367
> URL: https://issues.apache.org/jira/browse/FLINK-20367
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Configuration
>Reporter: zlzhang0122
>Priority: Critical
> Labels: usability
>
> Now the config can be set from global cluster configuration and single job
> code , since we can't absolutely sure that which config is in-use except we
> check it in the start-up log. I think maybe we can show the in-use config of
> job to users and this can be helpful!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (FLINK-20367) Show the in-use config of job to users
[
https://issues.apache.org/jira/browse/FLINK-20367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239161#comment-17239161
]
Matthias edited comment on FLINK-20367 at 11/26/20, 10:07 AM:
--
[~zlzhang0122] -could you specify what configuration parameters you miss in the
response of the {{/jobmanager/config}} endpoint?-
Ok, reading through your message again, you're referring to parameters that are
changed per-job and, therefore, overwrite the cluster's default values (like
`parallelism`). Could you verify that?
was (Author: mapohl):
[~zlzhang0122] could you specify what configuration parameters you miss in the
response of the \{{/jobmanager/config}} endpoint?
> Show the in-use config of job to users
> --
>
> Key: FLINK-20367
> URL: https://issues.apache.org/jira/browse/FLINK-20367
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Configuration
>Reporter: zlzhang0122
>Priority: Critical
> Labels: usability
>
> Now the config can be set from global cluster configuration and single job
> code , since we can't absolutely sure that which config is in-use except we
> check it in the start-up log. I think maybe we can show the in-use config of
> job to users and this can be helpful!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (FLINK-20367) Show the in-use config of job to users
[
https://issues.apache.org/jira/browse/FLINK-20367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239161#comment-17239161
]
Matthias edited comment on FLINK-20367 at 11/26/20, 10:04 AM:
--
[~zlzhang0122] could you specify what configuration parameters you miss in the
response of the \{{/jobmanager/config}} endpoint?
was (Author: mapohl):
[~zlzhang0122] could you specify what configuration parameters you miss in the
response of the `/jobmanager/config` endpoint?
> Show the in-use config of job to users
> --
>
> Key: FLINK-20367
> URL: https://issues.apache.org/jira/browse/FLINK-20367
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Configuration
>Reporter: zlzhang0122
>Priority: Critical
> Labels: usability
>
> Now the config can be set from global cluster configuration and single job
> code , since we can't absolutely sure that which config is in-use except we
> check it in the start-up log. I think maybe we can show the in-use config of
> job to users and this can be helpful!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
