Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/19717
@foxish the headless service should be created by the submission client
because of permissioning. Our design allows for different sets of credentials
to be used for first submitting the application and creating all dependent
resources, and then the driver can use a different set of credentials for
requesting for pods. One can envision a use case where we want to make the
driver's credentials only have permission to create pods, and not services,
while the submission client can create said service. But moving the headless
service creation into the scheduler means that the driver needs to have
permission to create that service.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]