[
https://issues.apache.org/jira/browse/SPARK-24761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24761:
------------------------------------
Assignee: Apache Spark
> Check modifiability of config parameters
> ----------------------------------------
>
> Key: SPARK-24761
> URL: https://issues.apache.org/jira/browse/SPARK-24761
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.3.1
> Reporter: Maxim Gekk
> Assignee: Apache Spark
> Priority: Minor
>
> Our customers and support team continuously face to the situation when
> setting a config parameter via *spark.conf.set()* does not may any effects.
> It is not clear from parameter's name is it static parameter or one of the
> parameter that can be set at runtime for current session state. It would be
> useful to have a method of *RuntimeConfig* which could tell to an user - does
> the given parameter may effect on the current behavior if he/she change it in
> the spark-shell or running notebook. The method can have the following
> signature:
> {code:scala}
> def isModifiable(key: String): Boolean
> {code}
> Any config parameter can be checked by using the syntax like this:
> {code:scala}
> scala>
> spark.conf.isModifiable("spark.sql.sources.schemaStringLengthThreshold")
> res0: Boolean = false
> {code}
> or for Spark Core parameter:
> {code:scala}
> scala> spark.conf.isModifiable("spark.task.cpus")
> res1: Boolean = false
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
