Reuven Lax created BEAM-6756: -------------------------------- Summary: Support lazy iterables in schemas Key: BEAM-6756 URL: https://issues.apache.org/jira/browse/BEAM-6756 Project: Beam Issue Type: Sub-task Components: sdk-java-core Reporter: Reuven Lax Assignee: Reuven Lax
The iterables returned by GroupByKey and CoGroupByKey are lazy; this allows a runner to page data into memory if the full iterable is too large. We currently don't support this in Schemas, so the Schema Group and CoGroup transforms materialize all data into memory. We should add support for this. -- This message was sent by Atlassian JIRA (v7.6.3#76005)