[
https://issues.apache.org/jira/browse/BEAM-11935?focusedWorklogId=571576&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-571576
]
ASF GitHub Bot logged work on BEAM-11935:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 25/Mar/21 00:28
Start Date: 25/Mar/21 00:28
Worklog Time Spent: 10m
Work Description: chamikaramj commented on a change in pull request
#14189:
URL: https://github.com/apache/beam/pull/14189#discussion_r600961166
##########
File path: sdks/python/apache_beam/runners/dataflow/internal/apiclient.py
##########
@@ -740,6 +720,28 @@ def _apply_sdk_environment_overrides(
new_payload.container_image = new_container_image
environment.payload = new_payload.SerializeToString()
+ # De-dup environments that use Java SDK by Docker container image since
+ # currently running multiple Java SDK Harnesses with Dataflow could result
+ # in dependency conflicts.
+ # TODDO(BEAM-9455): remove following restriction when Dataflow supports
+ # environment specific dependency provisioning.
+ container_url_to_env_map = dict()
+ container_url_to_env_id_map = dict()
+ for transform in proto_pipeline.components.transforms.values():
+ environment_id = transform.environment_id
+ if not environment_id:
+ continue
+ environment = proto_pipeline.components.environments[environment_id]
+ docker_payload = proto_utils.parse_Bytes(
+ environment.payload, beam_runner_api_pb2.DockerPayload)
+ image = docker_payload.container_image
+ if is_beam_java_container_name(image):
Review comment:
Ah, sorry didn't notice your comment above. Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 571576)
Time Spent: 5h 40m (was: 5.5h)
> Update Dataflow requests to include the environment ID
> ------------------------------------------------------
>
> Key: BEAM-11935
> URL: https://issues.apache.org/jira/browse/BEAM-11935
> Project: Beam
> Issue Type: Bug
> Components: cross-language, runner-dataflow
> Reporter: Chamikara Madhusanka Jayalath
> Assignee: Chamikara Madhusanka Jayalath
> Priority: P2
> Time Spent: 5h 40m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
