viirya commented on pull request #29729: URL: https://github.com/apache/spark/pull/29729#issuecomment-717629594
Because I don't handle the operation of Kafka cluster, I don't have clear idea how hard to change from group.id based authorization to topic based one from Kafka infra perspective. As I learn recently from our Kafka infra, seems we are using group.id based authorization. So I feel this is a radical change and we don't have other option instead of switching authorization method in Kafka infra. This might be a hurdle for some users to adopt new Spark version 3.1.0 in near future. cc @dbtsai @dongjoon-hyun ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
