Github user gaborgsomogyi commented on a diff in the pull request:
https://github.com/apache/spark/pull/20703#discussion_r171665564
--- Diff: docs/structured-streaming-kafka-integration.md ---
@@ -376,6 +383,8 @@ The following configurations are optional:
</tr>
</table>
+If you would like to disable the caching for Kafka consumers, you can set
`spark.streaming.kafka.consumer.cache.enabled` to `false`. Disabling the cache
may be needed to workaround the problem described in SPARK-19185. This property
may be removed in later versions of Spark, once SPARK-19185 is resolved.
--- End diff --
This is the description in dstreams and I've made it consistent by copying
it. Should we remove it then from dstreams as well? Maybe I'm too optimistic
but considering this as a work-around as it's stated in the descriptions.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
