Hi everyone,
While we were building the Spark on Kubernetes integration, we realized that some of the abstractions we introduced for building the driver application in spark-submit, and building executor pods in the scheduler backend, could be improved for better readability and clarity. We received feedback in this pull request in particular. In response to this feedback, we’ve put together a design document that proposes a possible refactor to address the given feedback. You may comment on the proposed design at this link: https://docs.google.com/document/d/1XPLh3E2JJ7yeJSDLZWXh_lUcjZ1P0dy9QeUEyxIlfak/edit# I hope that we can have a productive discussion and continue improving the Kubernetes integration further. Thanks, -Matt Cheah
smime.p7s
Description: S/MIME cryptographic signature
