Github user liyintang commented on the pull request:
https://github.com/apache/spark/pull/11921#issuecomment-200896260
@koeninger ,
Just curious, do we have a jira to discuss how exactly caching the result
of a transformation of KafkaRDD ? If there are multiple
transformations/actions on a KafkaStream, and Spark is caching the result
instead of raw input, does it mean Spark needs to fetch multiple times from
Kafka for the same data? If so, this may be a problem if the Kafka cluster is
network bound.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
