Github user mateiz commented on the pull request:
https://github.com/apache/spark/pull/1499#issuecomment-49949660
No, we only read one value at a time. If you're doing something like
groupByKey, the combine function may create an ArrayBuffer or stuff like that,
but that's only for the key actively being read. As soon as one stream moves on
to the next key, we read the first key-value pair in it but stop reading others.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
