Victor Chen created BEAM-13734:
----------------------------------
Summary: Support cache directories that use GCS buckets
Key: BEAM-13734
URL: https://issues.apache.org/jira/browse/BEAM-13734
Project: Beam
Issue Type: New Feature
Components: runner-py-interactive
Reporter: Victor Chen
Assignee: Victor Chen
* A continuation of
[[BEAM-13685]|https://issues.apache.org/jira/browse/BEAM-13685]
* Modified interactive_environment.py to support caching to a bucket on GCS
for batch processing pipelines
** If a specified bucket does not exist, the interactive_environment will
attempt to create one under the given name
* Cached files will be stored under a directory represented by id(pipeline).
** Example cached path: gs://my-gcs-bucket/cache/dir/id(pipeline)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
