pan3793 commented on issue #5040: URL: https://github.com/apache/kyuubi/issues/5040#issuecomment-1630016638
Some of the information is not accurate, but it shows patience at least, some of the following analyses are based on my guessing. > beeline -u "jdbc:hive2://vm23:32121/" What is the `vm23:32121`, where is your Kyuubi Server running? It looks like a virtual machine address, but you claim deploying Kyuubi on K8s. > `... --app-id spark-application-1688714736039 ...` This Application ID pattern is not Spark on K8s, it should be like `spark-bd4729b7dc6c4fa99e2482b3ee4a6598` instead ``` + exec /usr/bin/tini -s -- /usr/local/openjdk-11/bin/java -Dspark.driver.port=34030 -Xms1024m -Xmx1024m -cp '/opt/spark/conf::/opt/spark/jars/*:' org.apache.spark.executor.CoarseGrainedExecutorBackend --driver-url spark://CoarseGrainedScheduler@kyuubi-bd8f56ddb-59jn5:34030 --executor-id 6 --cores 1 --app-id spark-application-1688714736039 --hostname 10.244.125.214 --resourceProfileId 0 Caused by: java.net.UnknownHostException: kyuubi-bd8f56ddb-59jn5 ``` so your driver is running at `kyuubi-bd8f56ddb-59jn5` and one of your executors is running at `10.244.125.214`, and the latter can not access the former, it's a network issue related to DNS. what's the network topology of your setup? > Kyuubi Server Log Output > ``` > 23/07/07 07:28:33 INFO ... > > 2023-07-07 08:22:12.730 INFO ... > ``` Is all content from one output? the timestamp pattern is different. > Kyuubi Engine Log Output This should be the Spark driver's log, but your provided looks like a Spark executor's log. > `spark.kubernetes.container.image=kyuubi:v1.7.1` This should point to a Spark image, not Kyuubi image. Kyuubi is not a wrapper of Spark, it is another service that can leverage your existing computing engine setup, if you choose Spark on K8s as your Kyuubi engine, it supposes you have basic knowledge of Spark and Kubernetes. https://spark.apache.org/docs/latest/running-on-kubernetes.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
