AnandInguva commented on code in PR #28360: URL: https://github.com/apache/beam/pull/28360#discussion_r1319012697
########## website/www/site/content/en/documentation/sdks/python-pipeline-dependencies.md: ########## @@ -224,8 +224,9 @@ Use a constraint file to ensure that Beam dependencies in the launch environment The launch environment translates the pipeline graph into a [runner-independent representation](https://github.com/apache/beam/blob/master/model/pipeline/src/main/proto/org/apache/beam/model/pipeline/v1/beam_runner_api.proto). This process involves serializing (or pickling) the code of the transforms. The serialized content is deserialized on the workers. If the runtime worker environment significantly differs from the launch environment, runtime errors might occur for the following reasons: +* The Apache Beam version must match in the submission and runtime environments. Python major.minor versions must match as well. Otherwise, the pipeline might fail with errors like `Pipeline construction environment and pipeline runtime environment are not compatible`. On older SDK versions, the error might be reported as `SystemError: unknown opcode`. Review Comment: IIRC, if python versions are not same, dataflow used to fail with dill errors. Is this the one dill output as error? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
