vontman opened a new issue, #6569: URL: https://github.com/apache/kyuubi/issues/6569
### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) ### Search before asking - [X] I have searched in the [issues](https://github.com/apache/kyuubi/issues?q=is%3Aissue) and found no similar issues. ### Describe the bug ## How to reproduce Using kyuubi + spark + hive - On opening the first connection (where the spark SQL engine is submitted) with session properties like `jdbc:hive2://localhost:10009/?spark.abc=123` - If we execute `SET spark.abc;` in that connection we correctly get `123`  - On opening any other connection afterwards without any session properties like `jdbc:hive2://localhost:10009`  - If we execute `SET spark.abc;` we get `123`, although we haven't set this session property for this connection.  ## Initial Analysis - On opening the first connection, Kyuubi submits a spark application for SQL Engine - On looking at the submission parameters, it looks like Kyuubi includes the sessions configs in the spark configs  - By debugging Kyuubi code, it looks like the session configs are added to the configs in starting the engine in getOrCreate!    ### Affects Version(s) 1.7.1,1.9.2 ### Kyuubi Server Log Output ```logtalk 2024-07-29 14:57:28.804 INFO main org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client environment:java.library.path=/Users/omar.abdelbaset/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:. 2024-07-29 14:57:28.804 INFO main org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/var/folders/b3/xv1h8kxd3bq7y_hxpzwb1j600000gp/T/ 2024-07-29 14:57:28.804 INFO main org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client environment:java.compiler=<NA> 2024-07-29 14:57:28.804 INFO main org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client environment:os.name=Mac OS X 2024-07-29 14:57:28.804 INFO main org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client environment:os.arch=aarch64 2024-07-29 14:57:28.804 INFO main org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client environment:os.version=13.5.2 2024-07-29 14:57:28.804 INFO main org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client environment:user.name=omar.abdelbaset 2024-07-29 14:57:28.804 INFO main org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client environment:user.home=/Users/omar.abdelbaset 2024-07-29 14:57:28.804 INFO main org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client environment:user.dir=/Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin 2024-07-29 14:57:28.804 INFO main org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Initiating client connection, connectString=172.16.16.87:2181 sessionTimeout=60000 watcher=org.apache.kyuubi.shaded.curator.ConnectionState@422b8438 2024-07-29 14:57:28.812 INFO main-SendThread(172.16.16.87:2181) org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Opening socket connection to server 172.16.16.87/172.16.16.87:2181. Will not attempt to authenticate using SASL (unknown error) 2024-07-29 14:57:28.812 INFO main org.apache.kyuubi.ha.client.KyuubiServiceDiscovery: Service[KyuubiServiceDiscovery] is initialized. 2024-07-29 14:57:28.812 INFO main org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Service[KyuubiTBinaryFrontend] is initialized. 2024-07-29 14:57:28.815 INFO main-SendThread(172.16.16.87:2181) org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Socket connection established to 172.16.16.87/172.16.16.87:2181, initiating session 2024-07-29 14:57:28.815 INFO NIOServerCxn.Factory:/172.16.16.87:2181 org.apache.kyuubi.shaded.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection from /172.16.16.87:53641 2024-07-29 14:57:28.816 INFO main org.apache.kyuubi.server.KyuubiRestFrontendService: Service[KyuubiRestFrontendService] is initialized. 2024-07-29 14:57:28.816 INFO main org.apache.kyuubi.server.KyuubiServer: Service[KyuubiServer] is initialized. 2024-07-29 14:57:28.817 INFO NIOServerCxn.Factory:/172.16.16.87:2181 org.apache.kyuubi.shaded.zookeeper.server.ZooKeeperServer: Client attempting to establish new session at /172.16.16.87:53641 2024-07-29 14:57:28.818 INFO main org.apache.kyuubi.server.KinitAuxiliaryService: Service[KinitAuxiliaryService] is started. 2024-07-29 14:57:28.818 INFO main org.apache.kyuubi.server.PeriodicGCService: Service[PeriodicGCService] is started. 2024-07-29 14:57:28.819 INFO SyncThread:0 org.apache.kyuubi.shaded.zookeeper.server.persistence.FileTxnLog: Creating new log file: log.1 2024-07-29 14:57:28.819 INFO main org.eclipse.jetty.server.Server: jetty-9.4.54.v20240208; built: 2024-02-08T19:42:39.027Z; git: cef3fbd6d736a21e7d541a5db490381d95a2047d; jvm 1.8.0_332-b09 2024-07-29 14:57:28.824 INFO SyncThread:0 org.apache.kyuubi.shaded.zookeeper.server.ZooKeeperServer: Established session 0x1002a05dcbf0000 with negotiated timeout 60000 for client /172.16.16.87:53641 2024-07-29 14:57:28.824 INFO main-SendThread(172.16.16.87:2181) org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Session establishment complete on server 172.16.16.87/172.16.16.87:2181, sessionid = 0x1002a05dcbf0000, negotiated timeout = 60000 2024-07-29 14:57:28.828 INFO main-EventThread org.apache.kyuubi.shaded.curator.framework.state.ConnectionStateManager: State change: CONNECTED 2024-07-29 14:57:28.829 INFO Curator-ConnectionStateManager-0 org.apache.kyuubi.ha.client.zookeeper.ZookeeperDiscoveryClient: Zookeeper client connection state changed to: CONNECTED 2024-07-29 14:57:28.840 INFO main org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@451882b2{/,null,AVAILABLE} 2024-07-29 14:57:28.845 INFO main org.eclipse.jetty.server.AbstractConnector: Started ServerConnector@62f4ff3b{HTTP/1.1, (http/1.1)}{0.0.0.0:10019} 2024-07-29 14:57:28.846 INFO main org.eclipse.jetty.server.Server: Started @4700ms 2024-07-29 14:57:28.846 INFO main org.apache.kyuubi.metrics.PrometheusReporterService: Prometheus metrics HTTP server has started at http://172.16.16.87:10019/. 2024-07-29 14:57:28.846 INFO main org.apache.kyuubi.metrics.PrometheusReporterService: Service[PrometheusReporterService] is started. 2024-07-29 14:57:28.846 INFO main org.apache.kyuubi.metrics.MetricsSystem: Service[MetricsSystem] is started. 2024-07-29 14:57:28.848 INFO main org.apache.kyuubi.engine.KyuubiApplicationManager: Service[KyuubiApplicationManager] is started. 2024-07-29 14:57:28.848 INFO main org.apache.kyuubi.credentials.HadoopCredentialsManager: Service[HadoopCredentialsManager] is started. 2024-07-29 14:57:28.848 INFO main org.apache.kyuubi.server.metadata.MetadataManager: Service[MetadataManager] is started. 2024-07-29 14:57:28.849 INFO main org.apache.kyuubi.operation.KyuubiOperationManager: Service[KyuubiOperationManager] is started. 2024-07-29 14:57:28.849 INFO main org.apache.kyuubi.session.KyuubiSessionManager: Service[KyuubiSessionManager] is started. 2024-07-29 14:57:28.849 INFO main org.apache.kyuubi.server.KyuubiServer: Service[KyuubiBackendService] is started. 2024-07-29 14:57:28.849 INFO KyuubiTBinaryFrontend: Thread-41 org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Starting and exposing JDBC connection at: jdbc:hive2://localhost:10009/ 2024-07-29 14:57:28.877 INFO main org.apache.kyuubi.ha.client.zookeeper.ZookeeperDiscoveryClient: Created a /kyuubi/serverUri=localhost:10009;version=1.9.2;sequence=0000000000 on ZooKeeper for KyuubiServer uri: localhost:10009 2024-07-29 14:57:28.877 INFO main org.apache.kyuubi.ha.client.KyuubiServiceDiscovery: Registered KyuubiServiceDiscovery in namespace kyuubi. 2024-07-29 14:57:28.878 INFO main org.apache.kyuubi.ha.client.KyuubiServiceDiscovery: Service[KyuubiServiceDiscovery] is started. 2024-07-29 14:57:28.878 INFO main org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Service[KyuubiTBinaryFrontend] is started. 2024-07-29 14:57:28.878 INFO main org.eclipse.jetty.server.Server: jetty-9.4.54.v20240208; built: 2024-02-08T19:42:39.027Z; git: cef3fbd6d736a21e7d541a5db490381d95a2047d; jvm 1.8.0_332-b09 2024-07-29 14:57:28.878 INFO main org.eclipse.jetty.server.Server: Started @4733ms 2024-07-29 14:57:28.879 INFO main org.eclipse.jetty.server.AbstractConnector: Started ServerConnector@466e91bb{HTTP/1.1, (http/1.1)}{localhost:10099} 2024-07-29 14:57:28.914 INFO main org.apache.kyuubi.server.http.authentication.AuthenticationFilter: Add authentication handler BasicAuthenticationHandler for scheme BASIC 2024-07-29 14:57:29.350 INFO main org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@10f19647{/api,null,AVAILABLE} 2024-07-29 14:57:29.500 INFO main org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@54336976{/engine-ui,null,AVAILABLE} 2024-07-29 14:57:29.500 INFO main org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@5eabff6b{/,null,AVAILABLE} 2024-07-29 14:57:29.503 INFO main org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@664632e9{/ui,null,AVAILABLE} 2024-07-29 14:57:29.522 INFO main org.apache.kyuubi.server.KyuubiRestFrontendService: Service[KyuubiRestFrontendService] is started. 2024-07-29 14:57:29.522 INFO main org.apache.kyuubi.server.KyuubiRestFrontendService: Exposing REST endpoint at: http://localhost:10099 2024-07-29 14:57:29.522 INFO main org.apache.kyuubi.server.KyuubiServer: Service[KyuubiServer] is started. 2024-07-29 14:57:29.526 INFO main org.apache.kyuubi.Utils: Loading Kyuubi properties from /Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin/conf/kyuubi-defaults.conf 2024-07-29 14:57:40.947 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V10 2024-07-29 14:57:40.951 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 org.apache.kyuubi.session.KyuubiSessionManager: Opening session for anonymous@127.0.0.1 2024-07-29 14:57:40.966 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 org.apache.kyuubi.operation.log.OperationLog: Creating operation log file /Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin/work/server_operation_logs/f4485708-0330-4761-b798-c08446d69c57/057fec04-a811-49a2-b444-b8870295cb99 2024-07-29 14:57:40.967 INFO KyuubiSessionManager-exec-pool: Thread-56 org.apache.kyuubi.operation.LaunchEngine: Processing anonymous's query[057fec04-a811-49a2-b444-b8870295cb99]: PENDING_STATE -> RUNNING_STATE, statement: LaunchEngine 2024-07-29 14:57:40.968 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 org.apache.kyuubi.session.KyuubiSessionManager: anonymous's KyuubiSessionImpl with SessionHandle [f4485708-0330-4761-b798-c08446d69c57] is opened, current opening sessions 1 2024-07-29 14:57:40.970 INFO KyuubiSessionManager-exec-pool: Thread-56 org.apache.kyuubi.shaded.curator.framework.imps.CuratorFrameworkImpl: Starting 2024-07-29 14:57:40.970 INFO KyuubiSessionManager-exec-pool: Thread-56 org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Initiating client connection, connectString=172.16.16.87:2181 sessionTimeout=60000 watcher=org.apache.kyuubi.shaded.curator.ConnectionState@6f18edbd 2024-07-29 14:57:40.972 INFO KyuubiSessionManager-exec-pool: Thread-56-SendThread(172.16.16.87:2181) org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Opening socket connection to server 172.16.16.87/172.16.16.87:2181. Will not attempt to authenticate using SASL (unknown error) 2024-07-29 14:57:40.976 INFO KyuubiSessionManager-exec-pool: Thread-56-SendThread(172.16.16.87:2181) org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Socket connection established to 172.16.16.87/172.16.16.87:2181, initiating session 2024-07-29 14:57:40.976 INFO NIOServerCxn.Factory:/172.16.16.87:2181 org.apache.kyuubi.shaded.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection from /172.16.16.87:53648 2024-07-29 14:57:40.976 INFO NIOServerCxn.Factory:/172.16.16.87:2181 org.apache.kyuubi.shaded.zookeeper.server.ZooKeeperServer: Client attempting to establish new session at /172.16.16.87:53648 2024-07-29 14:57:40.977 INFO SyncThread:0 org.apache.kyuubi.shaded.zookeeper.server.ZooKeeperServer: Established session 0x1002a05dcbf0001 with negotiated timeout 60000 for client /172.16.16.87:53648 2024-07-29 14:57:40.977 INFO KyuubiSessionManager-exec-pool: Thread-56-SendThread(172.16.16.87:2181) org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Session establishment complete on server 172.16.16.87/172.16.16.87:2181, sessionid = 0x1002a05dcbf0001, negotiated timeout = 60000 2024-07-29 14:57:40.977 INFO KyuubiSessionManager-exec-pool: Thread-56-EventThread org.apache.kyuubi.shaded.curator.framework.state.ConnectionStateManager: State change: CONNECTED 2024-07-29 14:57:40.985 INFO ProcessThread(sid:0 cport:2181): org.apache.kyuubi.shaded.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x1002a05dcbf0001 type:create cxid:0x2 zxid:0x5 txntype:-1 reqpath:n/a Error Path:/kyuubi_1.9.2_SERVER_SPARK_SQL_lock/omar.abdelbaset/default/locks Error:KeeperErrorCode = NoNode for /kyuubi_1.9.2_SERVER_SPARK_SQL_lock/omar.abdelbaset/default/locks 2024-07-29 14:57:40.986 WARN KyuubiSessionManager-exec-pool: Thread-56 org.apache.kyuubi.shaded.curator.utils.ZKPaths: The version of ZooKeeper being used doesn't support Container nodes. CreateMode.PERSISTENT will be used instead. 2024-07-29 14:57:40.994 INFO ProcessThread(sid:0 cport:2181): org.apache.kyuubi.shaded.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x1002a05dcbf0001 type:create cxid:0xd zxid:0xb txntype:-1 reqpath:n/a Error Path:/kyuubi_1.9.2_SERVER_SPARK_SQL_lock/omar.abdelbaset/default/leases Error:KeeperErrorCode = NoNode for /kyuubi_1.9.2_SERVER_SPARK_SQL_lock/omar.abdelbaset/default/leases 2024-07-29 14:57:41.021 INFO KyuubiSessionManager-exec-pool: Thread-56 org.apache.kyuubi.engine.ProcBuilder: Logging to /Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin/work/omar.abdelbaset/kyuubi-spark-sql-engine.log.0 2024-07-29 14:57:41.024 INFO KyuubiSessionManager-exec-pool: Thread-56 org.apache.kyuubi.engine.EngineRef: Launching engine: /Users/omar.abdelbaset/Downloads/incorta-docker-v1.2-rtu/binaries/inx-downloads/spark-3.4.1-INX-1.1.0-bin-3.4.1-INX-1.1.0/spark-3.4.1-INX-1.1.0-bin-3.4.1-INX-1.1.0/bin/spark-submit \ --class org.apache.kyuubi.engine.spark.SparkSQLEngine \ --conf spark.hive.merge.mapfiles=true; \ --conf spark.hive.merge.mapredfiles=true; \ --conf spark.hive.merge.size.per.task=128000000; \ --conf spark.hive.merge.smallfiles.avgsize=128000000; \ --conf spark.hive.merge.sparkfiles=true; \ --conf spark.hive.merge.tezfiles=true; \ --conf spark.hive.server2.thrift.resultset.default.fetch.size=1000 \ --conf spark.kyuubi.client.ipAddress=172.16.16.87 \ --conf spark.kyuubi.client.version=1.9.2 \ --conf spark.kyuubi.engine.engineLog.path=/Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin/work/omar.abdelbaset/kyuubi-spark-sql-engine.log.0 \ --conf spark.kyuubi.engine.share.level=SERVER \ --conf spark.kyuubi.engine.submit.time=1722257861001 \ --conf spark.kyuubi.ha.addresses=172.16.16.87:2181 \ --conf spark.kyuubi.ha.engine.ref.id=f4485708-0330-4761-b798-c08446d69c57 \ --conf spark.kyuubi.ha.namespace=/kyuubi_1.9.2_SERVER_SPARK_SQL/omar.abdelbaset/default \ --conf spark.kyuubi.ha.zookeeper.auth.type=NONE \ --conf spark.kyuubi.server.ipAddress=127.0.0.1 \ --conf spark.kyuubi.session.connection.url=localhost:10009 \ --conf spark.kyuubi.session.real.user=anonymous \ --conf spark.kyuubi.spark.metastore.db.ConnectionDriverName=com.mysql.jdbc.Driver \ --conf spark.kyuubi.spark.metastore.db.ConnectionPassword=U32cyQ4Wusx0lVMgUmBXGQ== \ --conf spark.kyuubi.spark.metastore.db.ConnectionURL=jdbc:mysql://localhost:23306/ms_db_docker_cluster_demo_9 \ --conf spark.kyuubi.spark.metastore.db.ConnectionUserName=root \ --conf spark.abc=123 \ --conf spark.app.name=kyuubi_SERVER_SPARK_SQL_omar.abdelbaset_default_f4485708-0330-4761-b798-c08446d69c57 \ --conf spark.cores.max=2 \ --conf spark.driver.cores=1 \ --conf spark.driver.extraJavaOptions=-agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=5009 \ --conf spark.driver.memory=1g \ --conf spark.eventLog.enabled=false \ --conf spark.executor.cores=1 \ --conf spark.executor.memory=1g \ --conf spark.kubernetes.driver.label.kyuubi-unique-tag=f4485708-0330-4761-b798-c08446d69c57 \ --conf spark.master=spark://localhost:27077 \ --conf spark.port.maxRetries=100 \ --conf spark.sql.adaptive.enabled=true \ --conf spark.sql.ansi.enabled=true \ --conf spark.sql.catalogImplementation=hive \ --conf spark.yarn.tags=KYUUBI,f4485708-0330-4761-b798-c08446d69c57 \ --proxy-user omar.abdelbaset /Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin/externals/engines/spark/kyuubi-spark-sql-engine_2.12-1.9.2.jar 2024-07-29 14:57:56.696 INFO NIOServerCxn.Factory:/172.16.16.87:2181 org.apache.kyuubi.shaded.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection from /172.16.16.87:53666 2024-07-29 14:57:56.698 INFO NIOServerCxn.Factory:/172.16.16.87:2181 org.apache.kyuubi.shaded.zookeeper.server.ZooKeeperServer: Client attempting to establish new session at /172.16.16.87:53666 2024-07-29 14:57:56.699 INFO SyncThread:0 org.apache.kyuubi.shaded.zookeeper.server.ZooKeeperServer: Established session 0x1002a05dcbf0002 with negotiated timeout 60000 for client /172.16.16.87:53666 2024-07-29 14:57:56.731 INFO ProcessThread(sid:0 cport:2181): org.apache.kyuubi.shaded.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x1002a05dcbf0002 type:create cxid:0x1 zxid:0x10 txntype:-1 reqpath:n/a Error Path:/kyuubi_1.9.2_SERVER_SPARK_SQL/omar.abdelbaset Error:KeeperErrorCode = NoNode for /kyuubi_1.9.2_SERVER_SPARK_SQL/omar.abdelbaset 2024-07-29 14:57:57.101 INFO KyuubiSessionManager-exec-pool: Thread-56 org.apache.kyuubi.ha.client.zookeeper.ZookeeperDiscoveryClient: Get service instance:172.16.16.87:53665 engine id:app-20240729125745-0006 and version:1.9.2 under /kyuubi_1.9.2_SERVER_SPARK_SQL/omar.abdelbaset/default 2024-07-29 14:57:57.270 INFO KyuubiSessionManager-exec-pool: Thread-56 org.apache.kyuubi.session.KyuubiSessionImpl: [anonymous:172.16.16.87] SessionHandle [f4485708-0330-4761-b798-c08446d69c57] - Connected to engine [172.16.16.87:53665]/[app-20240729125745-0006] with SessionHandle [f4485708-0330-4761-b798-c08446d69c57]] 2024-07-29 14:57:57.271 INFO Curator-Framework-0 org.apache.kyuubi.shaded.curator.framework.imps.CuratorFrameworkImpl: backgroundOperationsLoop exiting 2024-07-29 14:57:57.274 INFO ProcessThread(sid:0 cport:2181): org.apache.kyuubi.shaded.zookeeper.server.PrepRequestProcessor: Processed session termination for sessionid: 0x1002a05dcbf0001 2024-07-29 14:57:57.275 INFO KyuubiSessionManager-exec-pool: Thread-56 org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Session: 0x1002a05dcbf0001 closed 2024-07-29 14:57:57.275 INFO KyuubiSessionManager-exec-pool: Thread-56-EventThread org.apache.kyuubi.shaded.zookeeper.ClientCnxn: EventThread shut down for session: 0x1002a05dcbf0001 2024-07-29 14:57:57.275 INFO NIOServerCxn.Factory:/172.16.16.87:2181 org.apache.kyuubi.shaded.zookeeper.server.NIOServerCnxn: Closed socket connection for client /172.16.16.87:53648 which had sessionid 0x1002a05dcbf0001 2024-07-29 14:57:57.277 INFO KyuubiSessionManager-exec-pool: Thread-56 org.apache.kyuubi.operation.LaunchEngine: Processing anonymous's query[057fec04-a811-49a2-b444-b8870295cb99]: RUNNING_STATE -> FINISHED_STATE, time taken: 16.308 seconds 2024-07-29 14:57:57.295 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 org.apache.kyuubi.session.KyuubiSessionImpl: [anonymous:172.16.16.87] SessionHandle [f4485708-0330-4761-b798-c08446d69c57] - Starting to wait the launch engine operation finished 2024-07-29 14:57:57.295 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 org.apache.kyuubi.session.KyuubiSessionImpl: [anonymous:172.16.16.87] SessionHandle [f4485708-0330-4761-b798-c08446d69c57] - Engine has been launched, elapsed time: 0 s 2024-07-29 14:58:12.030 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 org.apache.kyuubi.operation.log.OperationLog: Creating operation log file /Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin/work/server_operation_logs/f4485708-0330-4761-b798-c08446d69c57/c1fc9d85-69a8-4ef7-aab1-8902a9422077 2024-07-29 14:58:12.067 INFO KyuubiSessionManager-exec-pool: Thread-63 org.apache.kyuubi.operation.ExecuteStatement: Processing anonymous's query[c1fc9d85-69a8-4ef7-aab1-8902a9422077]: PENDING_STATE -> RUNNING_STATE, statement: set spark.abc 2024-07-29 14:58:12.163 INFO KyuubiSessionManager-exec-pool: Thread-63 org.apache.kyuubi.operation.ExecuteStatement: Query[c1fc9d85-69a8-4ef7-aab1-8902a9422077] in FINISHED_STATE 2024-07-29 14:58:12.163 INFO KyuubiSessionManager-exec-pool: Thread-63 org.apache.kyuubi.operation.ExecuteStatement: Processing anonymous's query[c1fc9d85-69a8-4ef7-aab1-8902a9422077]: RUNNING_STATE -> FINISHED_STATE, time taken: 0.095 seconds 2024-07-29 14:58:12.273 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 org.apache.kyuubi.operation.ExecuteStatement: Processing anonymous's query[c1fc9d85-69a8-4ef7-aab1-8902a9422077]: FINISHED_STATE -> CLOSED_STATE, time taken: 0.205 seconds 2024-07-29 14:58:12.287 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 org.apache.kyuubi.client.KyuubiSyncThriftClient: TCloseOperationReq(operationHandle:TOperationHandle(operationId:THandleIdentifier(guid:C1 FC 9D 85 69 A8 4E F7 AA B1 89 02 A9 42 20 77, secret:C2 EE 5B 97 3E A0 41 FC AC 16 9B D7 08 ED 8F 38), operationType:EXECUTE_STATEMENT, hasResultSet:true)) succeed on engine side ``` ### Kyuubi Engine Log Output _No response_ ### Kyuubi Server Configurations ```yaml kyuubi.frontend.bind.host=localhost kyuubi.engine.share.level=SERVER spark.master=spark://localhost:7077 kyuubi.authentication.custom.class=org.apache.kyuubi.service.authentication.CustomAuthenticationProviderImpl kyuubi.spark.metastore.db.ConnectionURL=jdbc:mysql://localhost:23306/ms_db spark.sql.catalogImplementation=hive ``` ### Kyuubi Engine Configurations _No response_ ### Additional context _No response_ ### Are you willing to submit PR? - [X] Yes. I would be willing to submit a PR with guidance from the Kyuubi community to fix. - [ ] No. I cannot submit a PR at this time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: notifications-unsubscr...@kyuubi.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: notifications-unsubscr...@kyuubi.apache.org For additional commands, e-mail: notifications-h...@kyuubi.apache.org