Jason Gauci created CRUNCH-320:
----------------------------------
Summary: Materialize several PObject & PCollection objects in
parallel (deferred materialization)
Key: CRUNCH-320
URL: https://issues.apache.org/jira/browse/CRUNCH-320
Project: Crunch
Issue Type: Improvement
Components: Core
Reporter: Jason Gauci
Assignee: Josh Wills
Currently, Crunch blocks and materializes PCollections (through
foo.materialize()) and PObjects (through foo.getValue()) on demand, but it
would be a significant performance improvement if we could mark several of
these objects as to be materialized, and then materialize all of them in
parallel as part of a pipeline.run() call.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
