dandy10 commented on pull request #13723: URL: https://github.com/apache/beam/pull/13723#issuecomment-763880323
@ConverJens forgive the silly question, but when you say you cloned the repo, do you mean that you cloned my fork and checked out this branch locally? I've just successfully rerun a pipeline from this branch (installing into a clean virtual environment) which requires setting a custom s3_endpoint, using the direct runner with multi_processing so I think it should work as is. Perhaps you could place a print statement into your sdk_worker_main.py to verify if the PIPELINE_OPTIONS environment variable is set, and the expected options are present? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
