Re: [start-connect-server.sh] connecting with org.apache.spark.deploy.worker.Worker

ok great is sorted out Mich Talebzadeh, Architect | Data Science | Financial Crime | Forensic Analysis | GDPR view my Linkedin profile On Fri, 24 Jan 2025 at 15:27, Andrew Petersen wrote: > Thank you Mich > > It seems like the r

Re: [start-connect-server.sh] connecting with org.apache.spark.deploy.worker.Worker

Well 1. Spark Connect workers don't directly connect to the Spark Connect server. 2. Client applications use the Spark Connect API to interact with the Spark cluster through the server. 3. I suggest focusing on developing client applications that leverage the Spark Connect API.

[start-connect-server.sh] connecting with org.apache.spark.deploy.worker.Worker

Hello Spark community I am trying to connect a worker to the connect server. Following the documentation, I am able to get the spark-connect server to run in the simple one node way. Am I correct to assume that the spark-connect server can work with spark workers? If so, how do I connect a spar