srowen commented on issue #24270: [SPARK-27343][KAFKA][SS]Avoid hardcoded for spark-sql-kafka-0-10 URL: https://github.com/apache/spark/pull/24270#issuecomment-488341435 @gaborgsomogyi do you have any other comments besides the one above and the two at https://github.com/apache/spark/pull/24270#discussion_r274827760 ? What's the action for the one above, prefix the keys with "spark.sql."? The Kafka configs start with "spark.kafka." _except_ for "spark.sql.kafkaConsumerCache.capacity" which sort of looks like an error. That config isn't documented anywhere, but this was noticed and brought up at https://issues.apache.org/jira/browse/SPARK-25466 and https://github.com/apache/spark/pull/22138 proposes to keep the spark.sql. prefix I think. I don't know if we want to change it here, but seems like we want to move away from spark.sql. prefixes here if anything?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
