[
https://issues.apache.org/jira/browse/BEAM-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ning Kang updated BEAM-8457:
----------------------------
Fix Version/s: (was: 2.17.0)
2.18.0
Description:
Dataflow needs the capability to tell how many Dataflow jobs are launched from
the Notebook environment.
We are doing it by checking if the current execution path is with ipython and
if the ipython kernel is connected to a notebook frontend.
was:
Dataflow needs the capability to tell how many Dataflow jobs are launched from
the Notebook environment, i.e., the Interactive Runner.
# Change the pipeline.run() API to allow supply a runner and an option
parameter so that a pipeline initially bundled w/ an interactive runner can be
directly run by other runners from notebook.
# Implicitly add the necessary source information through user labels when the
user does p.run(runner=DataflowRunner()).
> Instrument Dataflow jobs that are launched from Notebooks
> ---------------------------------------------------------
>
> Key: BEAM-8457
> URL: https://issues.apache.org/jira/browse/BEAM-8457
> Project: Beam
> Issue Type: Improvement
> Components: runner-py-interactive
> Reporter: Ning Kang
> Assignee: Ning Kang
> Priority: Major
> Fix For: 2.18.0
>
> Time Spent: 9h 40m
> Remaining Estimate: 0h
>
> Dataflow needs the capability to tell how many Dataflow jobs are launched
> from the Notebook environment.
> We are doing it by checking if the current execution path is with ipython and
> if the ipython kernel is connected to a notebook frontend.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
