damccorm opened a new issue, #20866: URL: https://github.com/apache/beam/issues/20866
User reported that worker endpoints are unset when attempting to start a worker in a worker pool using Kubernetes. https://stackoverflow.com/questions/66498209/how-to-configure-beam-python-sdk-with-spark-in-a-kubernetes-environment Starting worker with command ['/opt/apache/beam/boot', '\--id=1-1', '\--logging_endpoint=', '\--artifact_endpoint=', '\--provision_endpoint=', '\--control_endpoint='] These endpoints are expected to be set to use localhost and some random allocated port. The server is started here: https://github.com/apache/beam/blob/b101064f18e71adb81c8fe6ba7beae53e9b13b08/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/control/DefaultJobBundleFactory.java#L672-L697 And the StartWorkerRequest is constructed here: https://github.com/apache/beam/blob/master/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/environment/ExternalEnvironmentFactory.java Imported from Jira [BEAM-11957](https://issues.apache.org/jira/browse/BEAM-11957). Original Jira may contain additional context. Reported by: ibzib. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
