A-little-bit-of-data opened a new issue, #6536: URL: https://github.com/apache/kyuubi/issues/6536
### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) ### Search before asking - [X] I have searched in the [issues](https://github.com/apache/kyuubi/issues?q=is%3Aissue) and found no similar issues. ### Describe the bug When kyuubi-defaults.conf is modified and spark is started again, the new configuration is not loaded When kyuubi-defaults.conf is configured as follows，The spark task started on k8s still reads the old configuration. ___trino___.spark.executor.instances=2 ___trino___.spark.driver.cores=1 ___trino___.spark.executor.cores=2 ___trino___.spark.kubernetes.driver.limit.cores=2 ___trino___.spark.kubernetes.executor.limit.cores=3 ___trino___.spark.driver.memory=1g ___trino___.spark.executor.memory=2g ___trino___.spark.executor.instances=2 ___trino___.spark.driver.cores=1 ___trino___.spark.executor.cores=2 ___trino___.spark.kubernetes.driver.limit.cores=2 ___trino___.spark.kubernetes.executor.limit.cores=4 ___trino___.spark.driver.memory=1g ___trino___.spark.executor.memory=4g The spark.kyuubi.kubernetes.spark.cleanupTerminatedDriverPod.kind=ALL parameter is configured, but after completion, the spark driver pod still exists and the status is completed. It needs to be manually deleted. ### Affects Version(s) 1.9.1 ### Kyuubi Server Log Output ```logtalk /opt/kyuubi/externals/spark-3.5.1-bin-hadoop3/bin/spark-submit \ --class org.apache.kyuubi.engine.spark.SparkSQLEngine \ --conf spark.hive.server2.thrift.resultset.default.fetch.size=1000 \ --conf spark.kyuubi.client.version=1.9.1 \ --conf spark.kyuubi.engine.engineLog.path=/opt/kyuubi/work/trino/kyuubi-spark-sql-engine.log.2 \ --conf spark.kyuubi.engine.share.level=USER \ --conf spark.kyuubi.engine.submit.time=1721112987920 \ --conf spark.kyuubi.engine.type=SPARK_SQL \ --conf spark.kyuubi.frontend.connection.url.use.hostname=false \ --conf spark.kyuubi.frontend.protocols=REST,THRIFT_BINARY \ --conf spark.kyuubi.ha.engine.ref.id=9653cc02-df96-4691-82b9-3452c5c2cdc4 \ --conf spark.kyuubi.ha.namespace=/kyuubi_1.9.1_USER_SPARK_SQL/trino/default \ --conf spark.kyuubi.ha.zookeeper.session.timeout=600000 \ --conf spark.kyuubi.kubernetes.spark.cleanupTerminatedDriverPod.kind=ALL \ --conf spark.kyuubi.kubernetes.terminatedApplicationRetainPeriod=PT1M \ --conf spark.kyuubi.metrics.enabled=true \ --conf spark.kyuubi.metrics.reporters= \ --conf spark.kyuubi.session.engine.check.interval=PT1M \ --conf spark.kyuubi.session.engine.idle.timeout=PT2M \ --conf spark.kyuubi.session.real.user=trino \ --conf spark.app.name=trino \ --conf spark.driver.cores=1 \ --conf spark.driver.memory=1g \ --conf spark.executor.cores=2 \ --conf spark.executor.instances=2 \ --conf spark.executor.memory=2g \ --conf spark.kubernetes.driver.label.kyuubi-unique-tag=9653cc02-df96-4691-82b9-3452c5c2cdc4 \ --conf spark.kubernetes.driver.limit.cores=2 \ --conf spark.kubernetes.driver.pod.name=kyuubi-trino-9653cc02-df96-4691-82b9-3452c5c2cdc4-driver \ --conf spark.kubernetes.executor.limit.cores=3 \ --conf spark.kubernetes.executor.podNamePrefix=kyuubi-trino-9653cc02-df96-4691-82b9-3452c5c2cdc4 \ --conf spark.user=trino \ --conf spark.kubernetes.driverEnv.SPARK_USER_NAME=trino \ --conf spark.executorEnv.SPARK_USER_NAME=trino \ --proxy-user trino /opt/kyuubi/externals/engines/spark/kyuubi-spark-sql-engine_2.12-1.9.1.jar /opt/kyuubi/externals/spark-3.5.1-bin-hadoop3/bin/spark-submit \ --class org.apache.kyuubi.engine.spark.SparkSQLEngine \ --conf spark.hive.server2.thrift.resultset.default.fetch.size=1000 \ --conf spark.kyuubi.client.version=1.9.1 \ --conf spark.kyuubi.engine.engineLog.path=/opt/kyuubi/work/trino/kyuubi-spark-sql-engine.log.3 \ --conf spark.kyuubi.engine.share.level=USER \ --conf spark.kyuubi.engine.submit.time=1721114348590 \ --conf spark.kyuubi.engine.type=SPARK_SQL \ --conf spark.kyuubi.frontend.connection.url.use.hostname=false \ --conf spark.kyuubi.frontend.protocols=REST,THRIFT_BINARY \ --conf spark.kyuubi.ha.engine.ref.id=f93fdc9d-402b-4d9c-ba6e-7f01a4451f19 \ --conf spark.kyuubi.ha.namespace=/kyuubi_1.9.1_USER_SPARK_SQL/trino/default \ --conf spark.kyuubi.ha.zookeeper.session.timeout=600000 \ --conf spark.kyuubi.kubernetes.spark.cleanupTerminatedDriverPod.kind=ALL \ --conf spark.kyuubi.kubernetes.terminatedApplicationRetainPeriod=PT1M \ --conf spark.kyuubi.metrics.enabled=true \ --conf spark.kyuubi.metrics.reporters= \ --conf spark.kyuubi.session.engine.check.interval=PT1M \ --conf spark.kyuubi.session.engine.idle.timeout=PT2M \ --conf spark.kyuubi.session.real.user=trino \ --conf spark.app.name=trino \ --conf spark.driver.cores=1 \ --conf spark.driver.memory=1g \ --conf spark.executor.cores=2 \ --conf spark.executor.instances=2 \ --conf spark.executor.memory=2g \ --conf spark.kubernetes.driver.label.kyuubi-unique-tag=f93fdc9d-402b-4d9c-ba6e-7f01a4451f19 \ --conf spark.kubernetes.driver.limit.cores=2 \ --conf spark.kubernetes.driver.pod.name=kyuubi-trino-f93fdc9d-402b-4d9c-ba6e-7f01a4451f19-driver \ --conf spark.kubernetes.executor.limit.cores=3 \ --conf spark.kubernetes.executor.podNamePrefix=kyuubi-trino-f93fdc9d-402b-4d9c-ba6e-7f01a4451f19 \ --conf spark.user=trino \ --conf spark.kubernetes.driverEnv.SPARK_USER_NAME=trino \ --conf spark.executorEnv.SPARK_USER_NAME=trino \ --proxy-user trino /opt/kyuubi/externals/engines/spark/kyuubi-spark-sql-engine_2.12-1.9.1.jar ``` ### Kyuubi Engine Log Output _No response_ ### Kyuubi Server Configurations _No response_ ### Kyuubi Engine Configurations _No response_ ### Additional context _No response_ ### Are you willing to submit PR? - [ ] Yes. I would be willing to submit a PR with guidance from the Kyuubi community to fix. - [X] No. I cannot submit a PR at this time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@kyuubi.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: notifications-unsubscr...@kyuubi.apache.org For additional commands, e-mail: notifications-h...@kyuubi.apache.org
