Github user zouzias commented on the issue:
https://github.com/apache/spark/pull/23103
@koeninger, I will make the doc changes asap. FYI, I plan to make changes
on file `structured-streaming-kafka-integration.md` seems the most relevant doc
for this diff
Github user zouzias commented on the issue:
https://github.com/apache/spark/pull/23103
cc @koeninger
Preliminary PR, todos:
* Decide on input parameter name for prefix consumer group, i.e.,
`streaming.group_id.prefix`.
* Document the above parameter in Spark SS
GitHub user zouzias opened a pull request:
https://github.com/apache/spark/pull/23103
[SPARK-26121] init commit
## What changes were proposed in this pull request?
Allow the Spark Structured Streaming user to specify the prefix of the
consumer group (group.id), compared
Github user zouzias commented on a diff in the pull request:
https://github.com/apache/spark/pull/23103#discussion_r235478048
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
---
@@ -538,6 +538,17 @@ private[kafka010] object
Github user zouzias commented on a diff in the pull request:
https://github.com/apache/spark/pull/23103#discussion_r235478266
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
---
@@ -538,6 +538,17 @@ private[kafka010] object
Github user zouzias commented on a diff in the pull request:
https://github.com/apache/spark/pull/23103#discussion_r235627877
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
---
@@ -538,6 +538,17 @@ private[kafka010] object
