[
https://issues.apache.org/jira/browse/BEAM-14130?focusedWorklogId=750656&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-750656
]
ASF GitHub Bot logged work on BEAM-14130:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 31/Mar/22 00:59
Start Date: 31/Mar/22 00:59
Worklog Time Spent: 10m
Work Description: VictorPlusC commented on a change in pull request
#17127:
URL: https://github.com/apache/beam/pull/17127#discussion_r839082028
##########
File path: sdks/python/apache_beam/runners/interactive/interactive_beam.py
##########
@@ -443,6 +448,31 @@ def cleanup(
self.master_urls_to_pipelines.clear()
self.master_urls_to_dashboards.clear()
+ def delete_cluster(self, id: str):
+ """Deletes the cluster with the given obfuscated identifier from the
+ Interactive Environment, as well as from Dataproc. Additionally, unassigns
+ the 'flink_master' pipeline option for all impacted pipelines.
+ """
+ clusters_data = ie.current_env().inspector.get_cluster_data()
+ pipelines = [
+ ie.current_env().pipeline_id_to_pipeline(pid)
+ for pid in clusters_data[id]['pipelines']
+ ]
+ for p in pipelines:
+ ie.current_env().clusters.cleanup(p)
+ p.options.view_as(FlinkRunnerOptions).flink_master = '[auto]'
+
+ def set_default_cluster(self, id: str):
Review comment:
Similarly with delete_cluster(), I've now implemented this. Thanks.
##########
File path: sdks/python/apache_beam/runners/interactive/interactive_beam.py
##########
@@ -443,6 +448,31 @@ def cleanup(
self.master_urls_to_pipelines.clear()
self.master_urls_to_dashboards.clear()
+ def delete_cluster(self, id: str):
+ """Deletes the cluster with the given obfuscated identifier from the
+ Interactive Environment, as well as from Dataproc. Additionally, unassigns
+ the 'flink_master' pipeline option for all impacted pipelines.
+ """
+ clusters_data = ie.current_env().inspector.get_cluster_data()
+ pipelines = [
+ ie.current_env().pipeline_id_to_pipeline(pid)
+ for pid in clusters_data[id]['pipelines']
+ ]
+ for p in pipelines:
+ ie.current_env().clusters.cleanup(p)
+ p.options.view_as(FlinkRunnerOptions).flink_master = '[auto]'
+
+ def set_default_cluster(self, id: str):
Review comment:
Similarly to delete_cluster(), I've now implemented this. Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 750656)
Time Spent: 41h 20m (was: 41h 10m)
> Implement Jupyterlab extension for managing Dataproc clusters
> -------------------------------------------------------------
>
> Key: BEAM-14130
> URL: https://issues.apache.org/jira/browse/BEAM-14130
> Project: Beam
> Issue Type: New Feature
> Components: runner-py-interactive
> Reporter: Victor Chen
> Assignee: Victor Chen
> Priority: P2
> Time Spent: 41h 20m
> Remaining Estimate: 0h
>
> - Adds an additional option under the Interactive Beam Jupyterlab extension
> to enable users to manage Interactive Beam clusters
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
