[
https://issues.apache.org/jira/browse/BEAM-14071?focusedWorklogId=745296&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-745296
]
ASF GitHub Bot logged work on BEAM-14071:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 21/Mar/22 17:48
Start Date: 21/Mar/22 17:48
Worklog Time Spent: 10m
Work Description: KevinGG commented on a change in pull request #17044:
URL: https://github.com/apache/beam/pull/17044#discussion_r831386605
##########
File path:
sdks/python/apache_beam/runners/interactive/dataproc/dataproc_cluster_manager.py
##########
@@ -25,9 +25,9 @@
from typing import Tuple
from apache_beam.options.pipeline_options import PipelineOptions
+from apache_beam.runners.interactive import interactive_beam as ib
Review comment:
Could you please use the ie.current_env().clusters instead of
ib.clusters in interactive internal modules? This could avoid the dependency on
interactive_beam modules and avoid potential dependency loop in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 745296)
Time Spent: 12h 40m (was: 12.5h)
> Enabling Flink on Dataproc for Interactive Beam
> -----------------------------------------------
>
> Key: BEAM-14071
> URL: https://issues.apache.org/jira/browse/BEAM-14071
> Project: Beam
> Issue Type: New Feature
> Components: runner-py-interactive
> Reporter: Victor Chen
> Assignee: Victor Chen
> Priority: P2
> Time Spent: 12h 40m
> Remaining Estimate: 0h
>
> - Completes the package integration support from [[BEAM-13973] Link Dataproc
> Flink master URLs to the InteractiveRunner when FlinkRunner is used
> #16904|https://github.com/apache/beam/pull/16904]
> - Enables full support for Interactive Beam to create a Dataproc cluster
> when the underlying runner is a FlinkRunner
> - Sets the Interactive Environment clusters instance to the Interactive Beam
> global instance of clusters
> - Moves all constants related to Dataproc clusters into ib.clusters
> - Fixes an issue with checking for the recording size of a pipeline run that
> uses a GCS cache_root
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
