Hi, We have started using Spark on Kubernetes and in most cases, our all jobs use AWS S3 to read/write data. We are setting up the aws key and secret using these properties:
spark.kubernetes.driver.secretKeyRef.[EnvName] spark.kubernetes.executor.secretKeyRef.[EnvName] But, we already have *kube2Iam* set up on our kubernetes cluster and we want to use it. In deployment, if we add a kube2Iam *annotation *it will use that role out of the box. The format of kube2iam is *iam.amazonaws.com/role <http://iam.amazonaws.com/role>: <any role>* But, I can't set up this annotation using below config, spark.kubernetes.driver.annotation.[AnnotationName] Eg. spark.kubernetes.driver.annotation.*iam.amazonaws.com/role <http://iam.amazonaws.com/role> = <any role> * Does anyone have any thought, how can we use kube2iam with Spark on kubernetes? Regards, Chandu
