Thomas Weise created BEAM-8815:
----------------------------------

             Summary: Portable pipeline execution without artifact staging
                 Key: BEAM-8815
                 URL: https://issues.apache.org/jira/browse/BEAM-8815
             Project: Beam
          Issue Type: Task
          Components: runner-core, runner-flink
    Affects Versions: 2.17.0
            Reporter: Thomas Weise


The default artifact staging implementation relies on a distributed filesystem. 
A directory and manifest will be created even when artifact staging isn't used, 
and the container boot code will fail retrieving artifacts, even though there 
are non. In a containerized environment it is common to package artifacts into 
containers. It should be possible to run the pipeline w/o a distributed 
filesystem. 

[https://lists.apache.org/thread.html/1b0d545955a80688ea19f227ad943683747b17beb45368ad0908fd21@%3Cdev.beam.apache.org%3E]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to