[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888645#comment-16888645 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888633#comment-16888633 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888655#comment-16888655 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888667#comment-16888667 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888656#comment-16888656 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888666#comment-16888666 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888661#comment-16888661 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888648#comment-16888648 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888663#comment-16888663 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888660#comment-16888660 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888664#comment-16888664 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888650#comment-16888650 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888668#comment-16888668 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888659#comment-16888659 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888647#comment-16888647 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888636#comment-16888636 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888652#comment-16888652 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888657#comment-16888657 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888662#comment-16888662 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888658#comment-16888658 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888654#comment-16888654 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888649#comment-16888649 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888665#comment-16888665 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888632#comment-16888632 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888643#comment-16888643 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888653#comment-16888653 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888635#comment-16888635 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888642#comment-16888642 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888651#comment-16888651 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888646#comment-16888646 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888638#comment-16888638 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888634#comment-16888634 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888639#comment-16888639 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888641#comment-16888641 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888640#comment-16888640 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888637#comment-16888637 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888644#comment-16888644 ] ASF subversion and git services commented on AIRFLOW-3791: -- Commit 1598b0ae8abc9918a55905dd7bbbc041f6c6692f in airflow's branch refs/heads/master from Chaim Turkel [ https://gitbox.apache.org/repos/asf?p=airflow.git;h=1598b0a ] AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs (#4633) * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * AIRFLOW-3791: Dataflow Support to check if job is already running before starting java job In case dataflow creates more than one job, we need to track all jobs for status * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update airflow/contrib/hooks/gcp_dataflow_hook.py Co-Authored-By: Fokko Driesprong * Update gcp_dataflow_hook.py * Update dataflow_operator.py * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow change default for check if running * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name * Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow into AIRFLOW-3791_Dataflow merge redundant code of _get_job_id_from_name > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888631#comment-16888631 ] ASF GitHub Bot commented on AIRFLOW-3791: - Fokko commented on pull request #4633: AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs URL: https://github.com/apache/airflow/pull/4633 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: gcp >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827863#comment-16827863 ] Chaim commented on AIRFLOW-3791: how can i get my pull request to go in? > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: Dataflow >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.4 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[
https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757049#comment-16757049
]
ASF GitHub Bot commented on AIRFLOW-3791:
-
chaimt commented on pull request #4633: AIRFLOW-3791: Dataflow
URL: https://github.com/apache/airflow/pull/4633
Support to check if job is already running before starting java job
In case dataflow creates more than one job, we need to track all jobs for
status
Make sure you have checked _all_ steps below.
### Jira
- [ ] https://issues.apache.org/jira/browse/AIRFLOW-3791
Support to check if job is already running before starting java job
In case dataflow creates more than one job, we need to track all jobs for
status
- [ ] Here are some details about my PR, including screenshots of any UI
changes:
### Tests
- [ ] My PR adds the following unit tests __OR__ does not need testing for
this extremely good reason:
### Commits
- [ ] My commits all reference Jira issues in their subject lines, and I
have squashed multiple commits if they address the same issue. In addition, my
commits follow the guidelines from "[How to write a good git commit
message](http://chris.beams.io/posts/git-commit/)":
1. Subject is separated from body by a blank line
1. Subject is limited to 50 characters (not including Jira issue reference)
1. Subject does not end with a period
1. Subject uses the imperative mood ("add", not "adding")
1. Body wraps at 72 characters
1. Body explains "what" and "why", not "how"
### Documentation
- [ ] In case of new functionality, my PR adds documentation that describes
how to use it.
- When adding new operators/hooks/sensors, the autoclass documentation
generation needs to be added.
- All the public functions and the classes in the PR contain docstrings
that explain what it does
### Code Quality
- [ ] Passes `flake8`
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Multiple jobs in run & check if already running
> ---
>
> Key: AIRFLOW-3791
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3791
> Project: Apache Airflow
> Issue Type: Improvement
> Components: Dataflow
>Affects Versions: 1.10.2
>Reporter: Chaim
>Assignee: Chaim
>Priority: Major
> Fix For: 1.10.3
>
>
> # Support to check if job is already running before starting java job
> # In case dataflow creates more than one job, we need to track all jobs for
> status
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16756203#comment-16756203 ] ASF GitHub Bot commented on AIRFLOW-3791: - chaimt commented on pull request #4622: AIRFLOW-3791: URL: https://github.com/apache/airflow/pull/4622 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: Dataflow >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.3 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[
https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16756159#comment-16756159
]
ASF GitHub Bot commented on AIRFLOW-3791:
-
chaimt commented on pull request #4622: AIRFLOW-3791:
URL: https://github.com/apache/airflow/pull/4622
Support to check if job is already running before starting java job
In case dataflow creates more than one job, we need to track all jobs for
status
Make sure you have checked _all_ steps below.
### AIRFLOW-3791
### Description
AIRFLOW-3791
### Tests
- [ test_check_job_running_exec]
- [ test_check_job_not_running_exec]
- [ test_check_multiple_job_exec]
### Commits
- [ ] My commits all reference Jira issues in their subject lines, and I
have squashed multiple commits if they address the same issue. In addition, my
commits follow the guidelines from "[How to write a good git commit
message](http://chris.beams.io/posts/git-commit/)":
1. Subject is separated from body by a blank line
1. Subject is limited to 50 characters (not including Jira issue reference)
1. Subject does not end with a period
1. Subject uses the imperative mood ("add", not "adding")
1. Body wraps at 72 characters
1. Body explains "what" and "why", not "how"
### Documentation
- [ ] In case of new functionality, my PR adds documentation that describes
how to use it.
- When adding new operators/hooks/sensors, the autoclass documentation
generation needs to be added.
- All the public functions and the classes in the PR contain docstrings
that explain what it does
### Code Quality
- [ ] Passes `flake8`
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Multiple jobs in run & check if already running
> ---
>
> Key: AIRFLOW-3791
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3791
> Project: Apache Airflow
> Issue Type: Improvement
> Components: Dataflow
>Affects Versions: 1.10.2
>Reporter: Chaim
>Assignee: Chaim
>Priority: Major
> Fix For: 1.10.3
>
>
> # Support to check if job is already running before starting java job
> # In case dataflow creates more than one job, we need to track all jobs for
> status
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[ https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16756157#comment-16756157 ] ASF GitHub Bot commented on AIRFLOW-3791: - chaimt commented on pull request #4621: AIRFLOW-3791: URL: https://github.com/apache/airflow/pull/4621 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Multiple jobs in run & check if already running > --- > > Key: AIRFLOW-3791 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3791 > Project: Apache Airflow > Issue Type: Improvement > Components: Dataflow >Affects Versions: 1.10.2 >Reporter: Chaim >Assignee: Chaim >Priority: Major > Fix For: 1.10.3 > > > # Support to check if job is already running before starting java job > # In case dataflow creates more than one job, we need to track all jobs for > status -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (AIRFLOW-3791) Multiple jobs in run & check if already running
[
https://issues.apache.org/jira/browse/AIRFLOW-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16756134#comment-16756134
]
ASF GitHub Bot commented on AIRFLOW-3791:
-
chaimt commented on pull request #4621: AIRFLOW-3791:
URL: https://github.com/apache/airflow/pull/4621
Support to check if job is already running before starting java job
In case dataflow creates more than one job, we need to track all jobs for
status
Make sure you have checked _all_ steps below.
### Jira
- [ ] My PR addresses the following [Airflow
Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and references
them in the PR title. For example, "\[AIRFLOW-XXX\] My Airflow PR"
- https://issues.apache.org/jira/browse/AIRFLOW-XXX
- In case you are fixing a typo in the documentation you can prepend your
commit with \[AIRFLOW-XXX\], code changes always need a Jira issue.
### Description
- [ ] Here are some details about my PR, including screenshots of any UI
changes:
### Tests
- [ ] My PR adds the following unit tests __OR__ does not need testing for
this extremely good reason:
### Commits
- [ ] My commits all reference Jira issues in their subject lines, and I
have squashed multiple commits if they address the same issue. In addition, my
commits follow the guidelines from "[How to write a good git commit
message](http://chris.beams.io/posts/git-commit/)":
1. Subject is separated from body by a blank line
1. Subject is limited to 50 characters (not including Jira issue reference)
1. Subject does not end with a period
1. Subject uses the imperative mood ("add", not "adding")
1. Body wraps at 72 characters
1. Body explains "what" and "why", not "how"
### Documentation
- [ ] In case of new functionality, my PR adds documentation that describes
how to use it.
- When adding new operators/hooks/sensors, the autoclass documentation
generation needs to be added.
- All the public functions and the classes in the PR contain docstrings
that explain what it does
### Code Quality
- [ ] Passes `flake8`
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Multiple jobs in run & check if already running
> ---
>
> Key: AIRFLOW-3791
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3791
> Project: Apache Airflow
> Issue Type: Improvement
> Components: Dataflow
>Affects Versions: 1.10.2
>Reporter: Chaim
>Assignee: Chaim
>Priority: Major
> Fix For: 1.10.3
>
>
> # Support to check if job is already running before starting java job
> # In case dataflow creates more than one job, we need to track all jobs for
> status
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
