tvalentyn commented on code in PR #32752:
URL: https://github.com/apache/beam/pull/32752#discussion_r1797274927
##########
sdks/python/container/boot.go:
##########
@@ -189,7 +189,12 @@ func launchSDKProcess() error {
fmtErr := fmt.Errorf("failed to retrieve staged files: %v", err)
// Send error message to logging service before returning up
the call stack
logger.Errorf(ctx, fmtErr.Error())
- return fmtErr
+ // No need to fail the job if
submission_environment_dependencies.txt cannot be loaded
+ if strings.Contains(fmtErr.Error(),
"submission_environment_dependencies.txt") {
Review Comment:
I think we should instead root cause what happens with materialization hare.
as mentioned on GH issue, there is a workaround we can recommend now to skip
staging submission environment. It is possible that all materialization is
broken. does supplying --extra_package / --save_main_session work?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
