koertkuipers commented on issue #22598: [SPARK-25501][SS] Add kafka delegation token support. URL: https://github.com/apache/spark/pull/22598#issuecomment-487165883 > this is exciting to me. > > i tested it on a kafka 2.2.0 cluster that uses gssapi/kerberos for authentication, by enabling token support in kafka. to be specific in server.properties i changed: > > ``` > - sasl.enabled.mechanisms=GSSAPI > + sasl.enabled.mechanisms=GSSAPI,SCRAM-SHA-256,SCRAM-SHA-512 > + delegation.token.master.key=somesecret > ``` > > note that i kept `sasl.mechanism.inter.broker.protocol=GSSAPI` > > i could see my spark structured streaming job obtain kafka token successfully. after that i ran into some issues in driver that seemed kafka specific. i added comments here: > > https://issues.apache.org/jira/browse/KAFKA-7631 after adding the scram login module to my broker jaas configs (so brokers have both kerberos and scram) the kafka specific issue was resolved. so now everything works. i will be doing long running tests over next few days/weeks. thanks again.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
