[
https://issues.apache.org/jira/browse/BEAM-14071?focusedWorklogId=741276&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-741276
]
ASF GitHub Bot logged work on BEAM-14071:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 14/Mar/22 21:38
Start Date: 14/Mar/22 21:38
Worklog Time Spent: 10m
Work Description: VictorPlusC commented on a change in pull request
#17044:
URL: https://github.com/apache/beam/pull/17044#discussion_r826402130
##########
File path:
sdks/python/apache_beam/runners/interactive/dataproc/dataproc_cluster_manager.py
##########
@@ -167,8 +166,7 @@ def create_flink_cluster(self) -> None:
},
'gce_cluster_config': {
'metadata': {
- 'flink-start-yarn-session': 'true',
- 'PIP_PACKAGES': 'apache-beam[gcp]=={}'.format(beam_version)
Review comment:
Yes, it appears that we do not need to install the Python SDK on the
cluster node as long as we specify which Python version to use in the
PipelineOptions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 741276)
Time Spent: 2h 10m (was: 2h)
> Enabling Flink on Dataproc for Interactive Beam
> -----------------------------------------------
>
> Key: BEAM-14071
> URL: https://issues.apache.org/jira/browse/BEAM-14071
> Project: Beam
> Issue Type: New Feature
> Components: runner-py-interactive
> Reporter: Victor Chen
> Assignee: Victor Chen
> Priority: P2
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> - Enables full support for Interactive Beam to create a Dataproc cluster when
> the underlying runner is a FlinkRunner
> - Sets the Interactive Environment clusters instance to the Interactive Beam
> global instance of clusters
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
