vontman opened a new issue, #6569:
URL: https://github.com/apache/kyuubi/issues/6569

   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   
   
   ### Search before asking
   
   - [X] I have searched in the 
[issues](https://github.com/apache/kyuubi/issues?q=is%3Aissue) and found no 
similar issues.
   
   
   ### Describe the bug
   
   
   
   ## How to reproduce
   Using kyuubi + spark + hive
   
   - On opening the first connection (where the spark SQL engine is submitted) 
with session properties like `jdbc:hive2://localhost:10009/?spark.abc=123`
   - If we execute `SET spark.abc;` in that connection we correctly get `123`
   
![image](https://github.com/user-attachments/assets/f9eb78b4-ac48-478c-b031-da011b40af30)
   
   
   - On opening any other connection afterwards without any session properties 
like `jdbc:hive2://localhost:10009`
   
![image](https://github.com/user-attachments/assets/f3d6a425-88b2-487c-8732-f3de40462300)
   
   - If we execute `SET spark.abc;` we get `123`, although we haven't set this 
session property for this connection.
   
![image](https://github.com/user-attachments/assets/f3d6a425-88b2-487c-8732-f3de40462300)
   
   
   ## Initial Analysis
   - On opening the first connection, Kyuubi submits a spark application for 
SQL Engine
   - On looking at the submission parameters, it looks like Kyuubi includes the 
sessions configs in the spark configs
   
![image](https://github.com/user-attachments/assets/6a24c21e-7c69-441d-9833-ba45bdbd1326)
   
   
   - By debugging Kyuubi code, it looks like the session configs are added to 
the configs in starting the engine in getOrCreate!
   
![image](https://github.com/user-attachments/assets/626f26ad-6113-4e7e-b3cd-186b7144b688)
   
![image](https://github.com/user-attachments/assets/6668421c-522e-437d-9ff9-3251ca5d951b)
   
![image](https://github.com/user-attachments/assets/6aef4ab9-e2d8-4bd7-9bb6-3c165511be10)
   
   
   
   
   
   
   ### Affects Version(s)
   
   1.7.1,1.9.2
   
   ### Kyuubi Server Log Output
   
   ```logtalk
   2024-07-29 14:57:28.804 INFO main 
org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client 
environment:java.library.path=/Users/omar.abdelbaset/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
   2024-07-29 14:57:28.804 INFO main 
org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client 
environment:java.io.tmpdir=/var/folders/b3/xv1h8kxd3bq7y_hxpzwb1j600000gp/T/
   2024-07-29 14:57:28.804 INFO main 
org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client 
environment:java.compiler=<NA>
   2024-07-29 14:57:28.804 INFO main 
org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client environment:os.name=Mac OS 
X
   2024-07-29 14:57:28.804 INFO main 
org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client environment:os.arch=aarch64
   2024-07-29 14:57:28.804 INFO main 
org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client 
environment:os.version=13.5.2
   2024-07-29 14:57:28.804 INFO main 
org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client 
environment:user.name=omar.abdelbaset
   2024-07-29 14:57:28.804 INFO main 
org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client 
environment:user.home=/Users/omar.abdelbaset
   2024-07-29 14:57:28.804 INFO main 
org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Client 
environment:user.dir=/Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin
   2024-07-29 14:57:28.804 INFO main 
org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Initiating client connection, 
connectString=172.16.16.87:2181 sessionTimeout=60000 
watcher=org.apache.kyuubi.shaded.curator.ConnectionState@422b8438
   2024-07-29 14:57:28.812 INFO main-SendThread(172.16.16.87:2181) 
org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Opening socket connection to 
server 172.16.16.87/172.16.16.87:2181. Will not attempt to authenticate using 
SASL (unknown error)
   2024-07-29 14:57:28.812 INFO main 
org.apache.kyuubi.ha.client.KyuubiServiceDiscovery: 
Service[KyuubiServiceDiscovery] is initialized.
   2024-07-29 14:57:28.812 INFO main 
org.apache.kyuubi.server.KyuubiTBinaryFrontendService: 
Service[KyuubiTBinaryFrontend] is initialized.
   2024-07-29 14:57:28.815 INFO main-SendThread(172.16.16.87:2181) 
org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Socket connection established to 
172.16.16.87/172.16.16.87:2181, initiating session
   2024-07-29 14:57:28.815 INFO NIOServerCxn.Factory:/172.16.16.87:2181 
org.apache.kyuubi.shaded.zookeeper.server.NIOServerCnxnFactory: Accepted socket 
connection from /172.16.16.87:53641
   2024-07-29 14:57:28.816 INFO main 
org.apache.kyuubi.server.KyuubiRestFrontendService: 
Service[KyuubiRestFrontendService] is initialized.
   2024-07-29 14:57:28.816 INFO main org.apache.kyuubi.server.KyuubiServer: 
Service[KyuubiServer] is initialized.
   2024-07-29 14:57:28.817 INFO NIOServerCxn.Factory:/172.16.16.87:2181 
org.apache.kyuubi.shaded.zookeeper.server.ZooKeeperServer: Client attempting to 
establish new session at /172.16.16.87:53641
   2024-07-29 14:57:28.818 INFO main 
org.apache.kyuubi.server.KinitAuxiliaryService: Service[KinitAuxiliaryService] 
is started.
   2024-07-29 14:57:28.818 INFO main 
org.apache.kyuubi.server.PeriodicGCService: Service[PeriodicGCService] is 
started.
   2024-07-29 14:57:28.819 INFO SyncThread:0 
org.apache.kyuubi.shaded.zookeeper.server.persistence.FileTxnLog: Creating new 
log file: log.1
   2024-07-29 14:57:28.819 INFO main org.eclipse.jetty.server.Server: 
jetty-9.4.54.v20240208; built: 2024-02-08T19:42:39.027Z; git: 
cef3fbd6d736a21e7d541a5db490381d95a2047d; jvm 1.8.0_332-b09
   2024-07-29 14:57:28.824 INFO SyncThread:0 
org.apache.kyuubi.shaded.zookeeper.server.ZooKeeperServer: Established session 
0x1002a05dcbf0000 with negotiated timeout 60000 for client /172.16.16.87:53641
   2024-07-29 14:57:28.824 INFO main-SendThread(172.16.16.87:2181) 
org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Session establishment complete 
on server 172.16.16.87/172.16.16.87:2181, sessionid = 0x1002a05dcbf0000, 
negotiated timeout = 60000
   2024-07-29 14:57:28.828 INFO main-EventThread 
org.apache.kyuubi.shaded.curator.framework.state.ConnectionStateManager: State 
change: CONNECTED
   2024-07-29 14:57:28.829 INFO Curator-ConnectionStateManager-0 
org.apache.kyuubi.ha.client.zookeeper.ZookeeperDiscoveryClient: Zookeeper 
client connection state changed to: CONNECTED
   2024-07-29 14:57:28.840 INFO main 
org.eclipse.jetty.server.handler.ContextHandler: Started 
o.e.j.s.ServletContextHandler@451882b2{/,null,AVAILABLE}
   2024-07-29 14:57:28.845 INFO main 
org.eclipse.jetty.server.AbstractConnector: Started 
ServerConnector@62f4ff3b{HTTP/1.1, (http/1.1)}{0.0.0.0:10019}
   2024-07-29 14:57:28.846 INFO main org.eclipse.jetty.server.Server: Started 
@4700ms
   2024-07-29 14:57:28.846 INFO main 
org.apache.kyuubi.metrics.PrometheusReporterService: Prometheus metrics HTTP 
server has started at http://172.16.16.87:10019/.
   2024-07-29 14:57:28.846 INFO main 
org.apache.kyuubi.metrics.PrometheusReporterService: 
Service[PrometheusReporterService] is started.
   2024-07-29 14:57:28.846 INFO main org.apache.kyuubi.metrics.MetricsSystem: 
Service[MetricsSystem] is started.
   2024-07-29 14:57:28.848 INFO main 
org.apache.kyuubi.engine.KyuubiApplicationManager: 
Service[KyuubiApplicationManager] is started.
   2024-07-29 14:57:28.848 INFO main 
org.apache.kyuubi.credentials.HadoopCredentialsManager: 
Service[HadoopCredentialsManager] is started.
   2024-07-29 14:57:28.848 INFO main 
org.apache.kyuubi.server.metadata.MetadataManager: Service[MetadataManager] is 
started.
   2024-07-29 14:57:28.849 INFO main 
org.apache.kyuubi.operation.KyuubiOperationManager: 
Service[KyuubiOperationManager] is started.
   2024-07-29 14:57:28.849 INFO main 
org.apache.kyuubi.session.KyuubiSessionManager: Service[KyuubiSessionManager] 
is started.
   2024-07-29 14:57:28.849 INFO main org.apache.kyuubi.server.KyuubiServer: 
Service[KyuubiBackendService] is started.
   2024-07-29 14:57:28.849 INFO KyuubiTBinaryFrontend: Thread-41 
org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Starting and exposing 
JDBC connection at: jdbc:hive2://localhost:10009/
   2024-07-29 14:57:28.877 INFO main 
org.apache.kyuubi.ha.client.zookeeper.ZookeeperDiscoveryClient: Created a 
/kyuubi/serverUri=localhost:10009;version=1.9.2;sequence=0000000000 on 
ZooKeeper for KyuubiServer uri: localhost:10009
   2024-07-29 14:57:28.877 INFO main 
org.apache.kyuubi.ha.client.KyuubiServiceDiscovery: Registered 
KyuubiServiceDiscovery in namespace kyuubi.
   2024-07-29 14:57:28.878 INFO main 
org.apache.kyuubi.ha.client.KyuubiServiceDiscovery: 
Service[KyuubiServiceDiscovery] is started.
   2024-07-29 14:57:28.878 INFO main 
org.apache.kyuubi.server.KyuubiTBinaryFrontendService: 
Service[KyuubiTBinaryFrontend] is started.
   2024-07-29 14:57:28.878 INFO main org.eclipse.jetty.server.Server: 
jetty-9.4.54.v20240208; built: 2024-02-08T19:42:39.027Z; git: 
cef3fbd6d736a21e7d541a5db490381d95a2047d; jvm 1.8.0_332-b09
   2024-07-29 14:57:28.878 INFO main org.eclipse.jetty.server.Server: Started 
@4733ms
   2024-07-29 14:57:28.879 INFO main 
org.eclipse.jetty.server.AbstractConnector: Started 
ServerConnector@466e91bb{HTTP/1.1, (http/1.1)}{localhost:10099}
   2024-07-29 14:57:28.914 INFO main 
org.apache.kyuubi.server.http.authentication.AuthenticationFilter: Add 
authentication handler BasicAuthenticationHandler for scheme BASIC
   2024-07-29 14:57:29.350 INFO main 
org.eclipse.jetty.server.handler.ContextHandler: Started 
o.e.j.s.ServletContextHandler@10f19647{/api,null,AVAILABLE}
   2024-07-29 14:57:29.500 INFO main 
org.eclipse.jetty.server.handler.ContextHandler: Started 
o.e.j.s.ServletContextHandler@54336976{/engine-ui,null,AVAILABLE}
   2024-07-29 14:57:29.500 INFO main 
org.eclipse.jetty.server.handler.ContextHandler: Started 
o.e.j.s.ServletContextHandler@5eabff6b{/,null,AVAILABLE}
   2024-07-29 14:57:29.503 INFO main 
org.eclipse.jetty.server.handler.ContextHandler: Started 
o.e.j.s.ServletContextHandler@664632e9{/ui,null,AVAILABLE}
   2024-07-29 14:57:29.522 INFO main 
org.apache.kyuubi.server.KyuubiRestFrontendService: 
Service[KyuubiRestFrontendService] is started.
   2024-07-29 14:57:29.522 INFO main 
org.apache.kyuubi.server.KyuubiRestFrontendService: Exposing REST endpoint at: 
http://localhost:10099
   2024-07-29 14:57:29.522 INFO main org.apache.kyuubi.server.KyuubiServer: 
Service[KyuubiServer] is started.
   2024-07-29 14:57:29.526 INFO main org.apache.kyuubi.Utils: Loading Kyuubi 
properties from 
/Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin/conf/kyuubi-defaults.conf
   2024-07-29 14:57:40.947 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 
org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Client protocol version: 
HIVE_CLI_SERVICE_PROTOCOL_V10
   2024-07-29 14:57:40.951 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 
org.apache.kyuubi.session.KyuubiSessionManager: Opening session for 
anonymous@127.0.0.1
   2024-07-29 14:57:40.966 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 
org.apache.kyuubi.operation.log.OperationLog: Creating operation log file 
/Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin/work/server_operation_logs/f4485708-0330-4761-b798-c08446d69c57/057fec04-a811-49a2-b444-b8870295cb99
   2024-07-29 14:57:40.967 INFO KyuubiSessionManager-exec-pool: Thread-56 
org.apache.kyuubi.operation.LaunchEngine: Processing anonymous's 
query[057fec04-a811-49a2-b444-b8870295cb99]: PENDING_STATE -> RUNNING_STATE, 
statement:
   LaunchEngine
   2024-07-29 14:57:40.968 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 
org.apache.kyuubi.session.KyuubiSessionManager: anonymous's KyuubiSessionImpl 
with SessionHandle [f4485708-0330-4761-b798-c08446d69c57] is opened, current 
opening sessions 1
   2024-07-29 14:57:40.970 INFO KyuubiSessionManager-exec-pool: Thread-56 
org.apache.kyuubi.shaded.curator.framework.imps.CuratorFrameworkImpl: Starting
   2024-07-29 14:57:40.970 INFO KyuubiSessionManager-exec-pool: Thread-56 
org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Initiating client connection, 
connectString=172.16.16.87:2181 sessionTimeout=60000 
watcher=org.apache.kyuubi.shaded.curator.ConnectionState@6f18edbd
   2024-07-29 14:57:40.972 INFO KyuubiSessionManager-exec-pool: 
Thread-56-SendThread(172.16.16.87:2181) 
org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Opening socket connection to 
server 172.16.16.87/172.16.16.87:2181. Will not attempt to authenticate using 
SASL (unknown error)
   2024-07-29 14:57:40.976 INFO KyuubiSessionManager-exec-pool: 
Thread-56-SendThread(172.16.16.87:2181) 
org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Socket connection established to 
172.16.16.87/172.16.16.87:2181, initiating session
   2024-07-29 14:57:40.976 INFO NIOServerCxn.Factory:/172.16.16.87:2181 
org.apache.kyuubi.shaded.zookeeper.server.NIOServerCnxnFactory: Accepted socket 
connection from /172.16.16.87:53648
   2024-07-29 14:57:40.976 INFO NIOServerCxn.Factory:/172.16.16.87:2181 
org.apache.kyuubi.shaded.zookeeper.server.ZooKeeperServer: Client attempting to 
establish new session at /172.16.16.87:53648
   2024-07-29 14:57:40.977 INFO SyncThread:0 
org.apache.kyuubi.shaded.zookeeper.server.ZooKeeperServer: Established session 
0x1002a05dcbf0001 with negotiated timeout 60000 for client /172.16.16.87:53648
   2024-07-29 14:57:40.977 INFO KyuubiSessionManager-exec-pool: 
Thread-56-SendThread(172.16.16.87:2181) 
org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Session establishment complete 
on server 172.16.16.87/172.16.16.87:2181, sessionid = 0x1002a05dcbf0001, 
negotiated timeout = 60000
   2024-07-29 14:57:40.977 INFO KyuubiSessionManager-exec-pool: 
Thread-56-EventThread 
org.apache.kyuubi.shaded.curator.framework.state.ConnectionStateManager: State 
change: CONNECTED
   2024-07-29 14:57:40.985 INFO ProcessThread(sid:0 cport:2181): 
org.apache.kyuubi.shaded.zookeeper.server.PrepRequestProcessor: Got user-level 
KeeperException when processing sessionid:0x1002a05dcbf0001 type:create 
cxid:0x2 zxid:0x5 txntype:-1 reqpath:n/a Error 
Path:/kyuubi_1.9.2_SERVER_SPARK_SQL_lock/omar.abdelbaset/default/locks 
Error:KeeperErrorCode = NoNode for 
/kyuubi_1.9.2_SERVER_SPARK_SQL_lock/omar.abdelbaset/default/locks
   2024-07-29 14:57:40.986 WARN KyuubiSessionManager-exec-pool: Thread-56 
org.apache.kyuubi.shaded.curator.utils.ZKPaths: The version of ZooKeeper being 
used doesn't support Container nodes. CreateMode.PERSISTENT will be used 
instead.
   2024-07-29 14:57:40.994 INFO ProcessThread(sid:0 cport:2181): 
org.apache.kyuubi.shaded.zookeeper.server.PrepRequestProcessor: Got user-level 
KeeperException when processing sessionid:0x1002a05dcbf0001 type:create 
cxid:0xd zxid:0xb txntype:-1 reqpath:n/a Error 
Path:/kyuubi_1.9.2_SERVER_SPARK_SQL_lock/omar.abdelbaset/default/leases 
Error:KeeperErrorCode = NoNode for 
/kyuubi_1.9.2_SERVER_SPARK_SQL_lock/omar.abdelbaset/default/leases
   2024-07-29 14:57:41.021 INFO KyuubiSessionManager-exec-pool: Thread-56 
org.apache.kyuubi.engine.ProcBuilder: Logging to 
/Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin/work/omar.abdelbaset/kyuubi-spark-sql-engine.log.0
   2024-07-29 14:57:41.024 INFO KyuubiSessionManager-exec-pool: Thread-56 
org.apache.kyuubi.engine.EngineRef: Launching engine:
   
/Users/omar.abdelbaset/Downloads/incorta-docker-v1.2-rtu/binaries/inx-downloads/spark-3.4.1-INX-1.1.0-bin-3.4.1-INX-1.1.0/spark-3.4.1-INX-1.1.0-bin-3.4.1-INX-1.1.0/bin/spark-submit
 \
        --class org.apache.kyuubi.engine.spark.SparkSQLEngine \
        --conf spark.hive.merge.mapfiles=true; \
        --conf spark.hive.merge.mapredfiles=true; \
        --conf spark.hive.merge.size.per.task=128000000; \
        --conf spark.hive.merge.smallfiles.avgsize=128000000; \
        --conf spark.hive.merge.sparkfiles=true; \
        --conf spark.hive.merge.tezfiles=true; \
        --conf spark.hive.server2.thrift.resultset.default.fetch.size=1000 \
        --conf spark.kyuubi.client.ipAddress=172.16.16.87 \
        --conf spark.kyuubi.client.version=1.9.2 \
        --conf 
spark.kyuubi.engine.engineLog.path=/Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin/work/omar.abdelbaset/kyuubi-spark-sql-engine.log.0
 \
        --conf spark.kyuubi.engine.share.level=SERVER \
        --conf spark.kyuubi.engine.submit.time=1722257861001 \
        --conf spark.kyuubi.ha.addresses=172.16.16.87:2181 \
        --conf 
spark.kyuubi.ha.engine.ref.id=f4485708-0330-4761-b798-c08446d69c57 \
        --conf 
spark.kyuubi.ha.namespace=/kyuubi_1.9.2_SERVER_SPARK_SQL/omar.abdelbaset/default
 \
        --conf spark.kyuubi.ha.zookeeper.auth.type=NONE \
        --conf spark.kyuubi.server.ipAddress=127.0.0.1 \
        --conf spark.kyuubi.session.connection.url=localhost:10009 \
        --conf spark.kyuubi.session.real.user=anonymous \
        --conf 
spark.kyuubi.spark.metastore.db.ConnectionDriverName=com.mysql.jdbc.Driver \
        --conf 
spark.kyuubi.spark.metastore.db.ConnectionPassword=U32cyQ4Wusx0lVMgUmBXGQ== \
        --conf 
spark.kyuubi.spark.metastore.db.ConnectionURL=jdbc:mysql://localhost:23306/ms_db_docker_cluster_demo_9
 \
        --conf spark.kyuubi.spark.metastore.db.ConnectionUserName=root \
        --conf spark.abc=123 \
        --conf 
spark.app.name=kyuubi_SERVER_SPARK_SQL_omar.abdelbaset_default_f4485708-0330-4761-b798-c08446d69c57
 \
        --conf spark.cores.max=2 \
        --conf spark.driver.cores=1 \
        --conf 
spark.driver.extraJavaOptions=-agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=5009
 \
        --conf spark.driver.memory=1g \
        --conf spark.eventLog.enabled=false \
        --conf spark.executor.cores=1 \
        --conf spark.executor.memory=1g \
        --conf 
spark.kubernetes.driver.label.kyuubi-unique-tag=f4485708-0330-4761-b798-c08446d69c57
 \
        --conf spark.master=spark://localhost:27077 \
        --conf spark.port.maxRetries=100 \
        --conf spark.sql.adaptive.enabled=true \
        --conf spark.sql.ansi.enabled=true \
        --conf spark.sql.catalogImplementation=hive \
        --conf spark.yarn.tags=KYUUBI,f4485708-0330-4761-b798-c08446d69c57 \
        --proxy-user omar.abdelbaset 
/Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin/externals/engines/spark/kyuubi-spark-sql-engine_2.12-1.9.2.jar
   2024-07-29 14:57:56.696 INFO NIOServerCxn.Factory:/172.16.16.87:2181 
org.apache.kyuubi.shaded.zookeeper.server.NIOServerCnxnFactory: Accepted socket 
connection from /172.16.16.87:53666
   2024-07-29 14:57:56.698 INFO NIOServerCxn.Factory:/172.16.16.87:2181 
org.apache.kyuubi.shaded.zookeeper.server.ZooKeeperServer: Client attempting to 
establish new session at /172.16.16.87:53666
   2024-07-29 14:57:56.699 INFO SyncThread:0 
org.apache.kyuubi.shaded.zookeeper.server.ZooKeeperServer: Established session 
0x1002a05dcbf0002 with negotiated timeout 60000 for client /172.16.16.87:53666
   2024-07-29 14:57:56.731 INFO ProcessThread(sid:0 cport:2181): 
org.apache.kyuubi.shaded.zookeeper.server.PrepRequestProcessor: Got user-level 
KeeperException when processing sessionid:0x1002a05dcbf0002 type:create 
cxid:0x1 zxid:0x10 txntype:-1 reqpath:n/a Error 
Path:/kyuubi_1.9.2_SERVER_SPARK_SQL/omar.abdelbaset Error:KeeperErrorCode = 
NoNode for /kyuubi_1.9.2_SERVER_SPARK_SQL/omar.abdelbaset
   2024-07-29 14:57:57.101 INFO KyuubiSessionManager-exec-pool: Thread-56 
org.apache.kyuubi.ha.client.zookeeper.ZookeeperDiscoveryClient: Get service 
instance:172.16.16.87:53665 engine id:app-20240729125745-0006 and version:1.9.2 
under /kyuubi_1.9.2_SERVER_SPARK_SQL/omar.abdelbaset/default
   2024-07-29 14:57:57.270 INFO KyuubiSessionManager-exec-pool: Thread-56 
org.apache.kyuubi.session.KyuubiSessionImpl: [anonymous:172.16.16.87] 
SessionHandle [f4485708-0330-4761-b798-c08446d69c57] - Connected to engine 
[172.16.16.87:53665]/[app-20240729125745-0006] with SessionHandle 
[f4485708-0330-4761-b798-c08446d69c57]]
   2024-07-29 14:57:57.271 INFO Curator-Framework-0 
org.apache.kyuubi.shaded.curator.framework.imps.CuratorFrameworkImpl: 
backgroundOperationsLoop exiting
   2024-07-29 14:57:57.274 INFO ProcessThread(sid:0 cport:2181): 
org.apache.kyuubi.shaded.zookeeper.server.PrepRequestProcessor: Processed 
session termination for sessionid: 0x1002a05dcbf0001
   2024-07-29 14:57:57.275 INFO KyuubiSessionManager-exec-pool: Thread-56 
org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Session: 0x1002a05dcbf0001 closed
   2024-07-29 14:57:57.275 INFO KyuubiSessionManager-exec-pool: 
Thread-56-EventThread org.apache.kyuubi.shaded.zookeeper.ClientCnxn: 
EventThread shut down for session: 0x1002a05dcbf0001
   2024-07-29 14:57:57.275 INFO NIOServerCxn.Factory:/172.16.16.87:2181 
org.apache.kyuubi.shaded.zookeeper.server.NIOServerCnxn: Closed socket 
connection for client /172.16.16.87:53648 which had sessionid 0x1002a05dcbf0001
   2024-07-29 14:57:57.277 INFO KyuubiSessionManager-exec-pool: Thread-56 
org.apache.kyuubi.operation.LaunchEngine: Processing anonymous's 
query[057fec04-a811-49a2-b444-b8870295cb99]: RUNNING_STATE -> FINISHED_STATE, 
time taken: 16.308 seconds
   2024-07-29 14:57:57.295 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 
org.apache.kyuubi.session.KyuubiSessionImpl: [anonymous:172.16.16.87] 
SessionHandle [f4485708-0330-4761-b798-c08446d69c57] - Starting to wait the 
launch engine operation finished
   2024-07-29 14:57:57.295 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 
org.apache.kyuubi.session.KyuubiSessionImpl: [anonymous:172.16.16.87] 
SessionHandle [f4485708-0330-4761-b798-c08446d69c57] - Engine has been 
launched, elapsed time: 0 s
   2024-07-29 14:58:12.030 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 
org.apache.kyuubi.operation.log.OperationLog: Creating operation log file 
/Users/omar.abdelbaset/workplace/testing-kyuubi/apache-kyuubi-1.9.2-bin/work/server_operation_logs/f4485708-0330-4761-b798-c08446d69c57/c1fc9d85-69a8-4ef7-aab1-8902a9422077
   2024-07-29 14:58:12.067 INFO KyuubiSessionManager-exec-pool: Thread-63 
org.apache.kyuubi.operation.ExecuteStatement: Processing anonymous's 
query[c1fc9d85-69a8-4ef7-aab1-8902a9422077]: PENDING_STATE -> RUNNING_STATE, 
statement:
   set spark.abc
   2024-07-29 14:58:12.163 INFO KyuubiSessionManager-exec-pool: Thread-63 
org.apache.kyuubi.operation.ExecuteStatement: 
Query[c1fc9d85-69a8-4ef7-aab1-8902a9422077] in FINISHED_STATE
   2024-07-29 14:58:12.163 INFO KyuubiSessionManager-exec-pool: Thread-63 
org.apache.kyuubi.operation.ExecuteStatement: Processing anonymous's 
query[c1fc9d85-69a8-4ef7-aab1-8902a9422077]: RUNNING_STATE -> FINISHED_STATE, 
time taken: 0.095 seconds
   2024-07-29 14:58:12.273 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 
org.apache.kyuubi.operation.ExecuteStatement: Processing anonymous's 
query[c1fc9d85-69a8-4ef7-aab1-8902a9422077]: FINISHED_STATE -> CLOSED_STATE, 
time taken: 0.205 seconds
   2024-07-29 14:58:12.287 INFO KyuubiTBinaryFrontendHandler-Pool: Thread-55 
org.apache.kyuubi.client.KyuubiSyncThriftClient: 
TCloseOperationReq(operationHandle:TOperationHandle(operationId:THandleIdentifier(guid:C1
 FC 9D 85 69 A8 4E F7 AA B1 89 02 A9 42 20 77, secret:C2 EE 5B 97 3E A0 41 FC 
AC 16 9B D7 08 ED 8F 38), operationType:EXECUTE_STATEMENT, hasResultSet:true)) 
succeed on engine side
   ```
   
   
   ### Kyuubi Engine Log Output
   
   _No response_
   
   ### Kyuubi Server Configurations
   
   ```yaml
   kyuubi.frontend.bind.host=localhost
   kyuubi.engine.share.level=SERVER
   spark.master=spark://localhost:7077
   
kyuubi.authentication.custom.class=org.apache.kyuubi.service.authentication.CustomAuthenticationProviderImpl
   kyuubi.spark.metastore.db.ConnectionURL=jdbc:mysql://localhost:23306/ms_db
   spark.sql.catalogImplementation=hive
   ```
   
   
   ### Kyuubi Engine Configurations
   
   _No response_
   
   ### Additional context
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes. I would be willing to submit a PR with guidance from the Kyuubi 
community to fix.
   - [ ] No. I cannot submit a PR at this time.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscr...@kyuubi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscr...@kyuubi.apache.org
For additional commands, e-mail: notifications-h...@kyuubi.apache.org

Reply via email to