koertkuipers commented on issue #22598: [SPARK-25501][SS] Add kafka delegation token support. URL: https://github.com/apache/spark/pull/22598#issuecomment-499921801 we just upgraded our dev cluster from SASL_PLAINTEXT to SASL_SSL but something is wrong with the certificates (or with kafkas hostname resolution? not sure yet). so as a workaround i temporarily need to set: `ssl.endpoint.identification.algorithm = ""` (blank, which disables hostname verification) i know how to do this in spark structured streaming for kafka in general. but its not clear how i do this for the kafka token provider. i can see the kafka admin client being created: ``` 2019-06-07 10:17:06 INFO admin.AdminClientConfig: AdminClientConfig values: <redacted> ssl.endpoint.identification.algorithm = https <redacted> ``` how i can generally change any of these settings? is there a key like `--conf spark.kafka.ssl.endpoint.identification.algorithm = ""` that i can use? or perhaps per kafka cluster, like `--conf spark.kafka.clusters.<cluster>.ssl.endpoint.identification.algorithm=""` in future i could see how there are other settings in this kafka admin clients configuration that i would like to change as well, so i am looking for a general way to update it in a deployment. thanks!
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
