Sam Rohde created BEAM-10603:
--------------------------------
Summary: Large Source Recording for Interarctive Runner
Key: BEAM-10603
URL: https://issues.apache.org/jira/browse/BEAM-10603
Project: Beam
Issue Type: Improvement
Components: runner-py-interactive
Reporter: Sam Rohde
Assignee: Sam Rohde
This changes the Interactive Runner to create a long-running background caching
job that is decoupled from the user pipeline. When a user invokes a collect()
or show(), it will read from the cache to compute the requested PCollections.
Previously, the user would have to wait for the cache to be fully written to.
This allows for the user to start experimenting immediately.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)