[ https://issues.apache.org/jira/browse/SPARK-24761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-24761: ------------------------------------ Assignee: (was: Apache Spark) > Check modifiability of config parameters > ---------------------------------------- > > Key: SPARK-24761 > URL: https://issues.apache.org/jira/browse/SPARK-24761 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 2.3.1 > Reporter: Maxim Gekk > Priority: Minor > > Our customers and support team continuously face to the situation when > setting a config parameter via *spark.conf.set()* does not may any effects. > It is not clear from parameter's name is it static parameter or one of the > parameter that can be set at runtime for current session state. It would be > useful to have a method of *RuntimeConfig* which could tell to an user - does > the given parameter may effect on the current behavior if he/she change it in > the spark-shell or running notebook. The method can have the following > signature: > {code:scala} > def isModifiable(key: String): Boolean > {code} > Any config parameter can be checked by using the syntax like this: > {code:scala} > scala> > spark.conf.isModifiable("spark.sql.sources.schemaStringLengthThreshold") > res0: Boolean = false > {code} > or for Spark Core parameter: > {code:scala} > scala> spark.conf.isModifiable("spark.task.cpus") > res1: Boolean = false > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org