[jira] [Commented] (AIRFLOW-850) Airflow should support a general purpose PythonSensor

[ https://issues.apache.org/jira/browse/AIRFLOW-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726474#comment-16726474 ] ASF GitHub Bot commented on AIRFLOW-850: feng-tao closed pull request #2058: [AIRFLOW-850] Add a

[jira] [Commented] (AIRFLOW-850) Airflow should support a general purpose PythonSensor

[ https://issues.apache.org/jira/browse/AIRFLOW-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726472#comment-16726472 ] ASF GitHub Bot commented on AIRFLOW-850: feng-tao opened a new pull request #4349: [AIRFLOW-850]

[GitHub] feng-tao closed pull request #2058: [AIRFLOW-850] Add a PythonSensor

feng-tao closed pull request #2058: [AIRFLOW-850] Add a PythonSensor URL: https://github.com/apache/incubator-airflow/pull/2058 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign

[GitHub] feng-tao commented on issue #4349: [AIRFLOW-850] Add a PythonSensor

feng-tao commented on issue #4349: [AIRFLOW-850] Add a PythonSensor URL: https://github.com/apache/incubator-airflow/pull/4349#issuecomment-449275832 PTAL @ashb @Fokko , this is based on the stale pr (https://github.com/apache/incubator-airflow/pull/2058) which I think is a good

[GitHub] feng-tao opened a new pull request #4349: [AIRFLOW-850] Add a PythonSensor

feng-tao opened a new pull request #4349: [AIRFLOW-850] Add a PythonSensor URL: https://github.com/apache/incubator-airflow/pull/4349 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-3550) GKEClusterHook doesn't use gcp_conn_id

Wilson Lian created AIRFLOW-3550: Summary: GKEClusterHook doesn't use gcp_conn_id Key: AIRFLOW-3550 URL: https://issues.apache.org/jira/browse/AIRFLOW-3550 Project: Apache Airflow Issue

[GitHub] feng-tao commented on issue #2058: [AIRFLOW-850] Add a PythonSensor

feng-tao commented on issue #2058: [AIRFLOW-850] Add a PythonSensor URL: https://github.com/apache/incubator-airflow/pull/2058#issuecomment-449255719 I think this is a good addition. I will submit a new pr based on this one. cc @ashb @Fokko

[GitHub] codecov-io edited a comment on issue #4121: [AIRFLOW-2568] Azure Container Instances operator

codecov-io edited a comment on issue #4121: [AIRFLOW-2568] Azure Container Instances operator URL: https://github.com/apache/incubator-airflow/pull/4121#issuecomment-436818600 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4121?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #4121: [AIRFLOW-2568] Azure Container Instances operator

codecov-io edited a comment on issue #4121: [AIRFLOW-2568] Azure Container Instances operator URL: https://github.com/apache/incubator-airflow/pull/4121#issuecomment-436818600 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4121?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #4156: [AIRFLOW-3314] Changed auto inlets feature to work as described

codecov-io edited a comment on issue #4156: [AIRFLOW-3314] Changed auto inlets feature to work as described URL: https://github.com/apache/incubator-airflow/pull/4156#issuecomment-436867007 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4156?src=pr=h1) Report >

[GitHub] kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator

kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator URL: https://github.com/apache/incubator-airflow/pull/4293#discussion_r243454826 ## File path: airflow/contrib/hooks/azure_batchai_hook.py ## @@ -0,0 +1,100 @@ +# -*- coding:

[GitHub] kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator

kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator URL: https://github.com/apache/incubator-airflow/pull/4293#discussion_r243455914 ## File path: docs/integration.rst ## @@ -209,19 +209,24 @@ AzureDataLakeHook .. autoclass::

[GitHub] kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator

kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator URL: https://github.com/apache/incubator-airflow/pull/4293#discussion_r243454585 ## File path: airflow/contrib/example_dags/example_azure_batchai_dag.py ## @@ -0,0 +1,53 @@ +#

[GitHub] kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator

kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator URL: https://github.com/apache/incubator-airflow/pull/4293#discussion_r243455186 ## File path: airflow/contrib/hooks/azure_batchai_hook.py ## @@ -0,0 +1,100 @@ +# -*- coding:

[GitHub] kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator

kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator URL: https://github.com/apache/incubator-airflow/pull/4293#discussion_r243455716 ## File path: airflow/contrib/operators/azure_batchai_operator.py ## @@ -0,0 +1,190 @@ +# -*-

[GitHub] kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator

kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator URL: https://github.com/apache/incubator-airflow/pull/4293#discussion_r243455331 ## File path: airflow/contrib/operators/azure_batchai_operator.py ## @@ -0,0 +1,190 @@ +# -*-

[GitHub] kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator

kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator URL: https://github.com/apache/incubator-airflow/pull/4293#discussion_r243454673 ## File path: airflow/contrib/example_dags/example_azure_batchai_dag.py ## @@ -0,0 +1,53 @@ +#

[GitHub] kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator

kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator URL: https://github.com/apache/incubator-airflow/pull/4293#discussion_r243454203 ## File path: airflow/contrib/example_dags/example_azure_batchai_dag.py ## @@ -0,0 +1,53 @@ +#

[GitHub] kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator

kaxil commented on a change in pull request #4293: [AIRFLOW-3284] Add Azure Batch AI Operator URL: https://github.com/apache/incubator-airflow/pull/4293#discussion_r24346 ## File path: airflow/contrib/operators/azure_batchai_operator.py ## @@ -0,0 +1,190 @@ +# -*-

[GitHub] kaxil commented on a change in pull request #4331: [AIRFLOW-3531] Add gcs to gcs transfer operator.

kaxil commented on a change in pull request #4331: [AIRFLOW-3531] Add gcs to gcs transfer operator. URL: https://github.com/apache/incubator-airflow/pull/4331#discussion_r243453982 ## File path: airflow/contrib/operators/gcs_to_gcs_transfer_operator.py ## @@ -0,0 +1,127

[GitHub] kaxil commented on a change in pull request #4331: [AIRFLOW-3531] Add gcs to gcs transfer operator.

kaxil commented on a change in pull request #4331: [AIRFLOW-3531] Add gcs to gcs transfer operator. URL: https://github.com/apache/incubator-airflow/pull/4331#discussion_r243453826 ## File path: airflow/contrib/operators/gcs_to_gcs_transfer_operator.py ## @@ -0,0 +1,127

[GitHub] kaxil commented on a change in pull request #4331: [AIRFLOW-3531] Add gcs to gcs transfer operator.

kaxil commented on a change in pull request #4331: [AIRFLOW-3531] Add gcs to gcs transfer operator. URL: https://github.com/apache/incubator-airflow/pull/4331#discussion_r243453786 ## File path: airflow/contrib/operators/gcs_to_gcs_transfer_operator.py ## @@ -0,0 +1,127

[GitHub] kaxil commented on a change in pull request #4331: [AIRFLOW-3531] Add gcs to gcs transfer operator.

kaxil commented on a change in pull request #4331: [AIRFLOW-3531] Add gcs to gcs transfer operator. URL: https://github.com/apache/incubator-airflow/pull/4331#discussion_r243453633 ## File path: airflow/contrib/operators/gcs_to_gcs_transfer_operator.py ## @@ -0,0 +1,127

[GitHub] kaxil commented on a change in pull request #4298: [AIRFLOW-3478] Make sure that the session is closed

kaxil commented on a change in pull request #4298: [AIRFLOW-3478] Make sure that the session is closed URL: https://github.com/apache/incubator-airflow/pull/4298#discussion_r243452987 ## File path: airflow/bin/cli.py ## @@ -423,14 +418,11 @@ def unpause(args, dag=None):

[GitHub] kaxil commented on a change in pull request #4298: [AIRFLOW-3478] Make sure that the session is closed

kaxil commented on a change in pull request #4298: [AIRFLOW-3478] Make sure that the session is closed URL: https://github.com/apache/incubator-airflow/pull/4298#discussion_r243451884 ## File path: airflow/api/common/experimental/mark_tasks.py ## @@ -180,18 +180,15 @@ def

[GitHub] kaxil closed pull request #4327: Add Next Trucking as airflow user

kaxil closed pull request #4327: Add Next Trucking as airflow user URL: https://github.com/apache/incubator-airflow/pull/4327 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign

[GitHub] kaxil edited a comment on issue #4324: [AIRFLOW-3327] Add support for location in BigQueryHook

kaxil edited a comment on issue #4324: [AIRFLOW-3327] Add support for location in BigQueryHook URL: https://github.com/apache/incubator-airflow/pull/4324#issuecomment-448030130 cc @dsdinter @tswast This is an automated

[GitHub] jmcarp commented on issue #4225: [AIRFLOW-3383] Rotate fernet keys.

jmcarp commented on issue #4225: [AIRFLOW-3383] Rotate fernet keys. URL: https://github.com/apache/incubator-airflow/pull/4225#issuecomment-449148120 Merge conflicts resolved. Should be ready for another look @ashb. This is

[GitHub] c4milo opened a new pull request #4348: Update UPDATING.md

c4milo opened a new pull request #4348: Update UPDATING.md URL: https://github.com/apache/incubator-airflow/pull/4348 Add change in timezone used by default as breaking change. This is an automated message from the Apache Git

[GitHub] codecov-io edited a comment on issue #4225: [AIRFLOW-3383] Rotate fernet keys.

codecov-io edited a comment on issue #4225: [AIRFLOW-3383] Rotate fernet keys. URL: https://github.com/apache/incubator-airflow/pull/4225#issuecomment-441103479 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4225?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #4225: [AIRFLOW-3383] Rotate fernet keys.

codecov-io edited a comment on issue #4225: [AIRFLOW-3383] Rotate fernet keys. URL: https://github.com/apache/incubator-airflow/pull/4225#issuecomment-441103479 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4225?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #4225: [AIRFLOW-3383] Rotate fernet keys.

codecov-io edited a comment on issue #4225: [AIRFLOW-3383] Rotate fernet keys. URL: https://github.com/apache/incubator-airflow/pull/4225#issuecomment-441103479 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4225?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #4225: [AIRFLOW-3383] Rotate fernet keys.

codecov-io edited a comment on issue #4225: [AIRFLOW-3383] Rotate fernet keys. URL: https://github.com/apache/incubator-airflow/pull/4225#issuecomment-441103479 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4225?src=pr=h1) Report > Merging

[jira] [Created] (AIRFLOW-3549) Please don't log the content of the downloaded gcs file

joyce chan created AIRFLOW-3549: --- Summary: Please don't log the content of the downloaded gcs file Key: AIRFLOW-3549 URL: https://issues.apache.org/jira/browse/AIRFLOW-3549 Project: Apache Airflow

[jira] [Closed] (AIRFLOW-3549) Please don't log the content of the downloaded Google Storage file

[ https://issues.apache.org/jira/browse/AIRFLOW-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] joyce chan closed AIRFLOW-3549. --- Resolution: Fixed > Please don't log the content of the downloaded Google Storage file >

[jira] [Updated] (AIRFLOW-3549) Please don't log the content of the downloaded Google Storage file

[ https://issues.apache.org/jira/browse/AIRFLOW-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] joyce chan updated AIRFLOW-3549: Summary: Please don't log the content of the downloaded Google Storage file (was: Please don't

[jira] [Commented] (AIRFLOW-3445) MariaDB explicit_defaults_for_timestamp = 1 Does not work.

[ https://issues.apache.org/jira/browse/AIRFLOW-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726178#comment-16726178 ] Gerardo commented on AIRFLOW-3445: -- This has become a major problem for our team. We followed the

[jira] [Created] (AIRFLOW-3548) Tasks instances doesn't reuse mysql connection

Rami Darwish created AIRFLOW-3548: - Summary: Tasks instances doesn't reuse mysql connection Key: AIRFLOW-3548 URL: https://issues.apache.org/jira/browse/AIRFLOW-3548 Project: Apache Airflow

[GitHub] dwai1714 removed a comment on issue #4275: AIRFLOW-3437 Adding better json

dwai1714 removed a comment on issue #4275: AIRFLOW-3437 Adding better json URL: https://github.com/apache/incubator-airflow/pull/4275#issuecomment-449114906 @holdenk See this ? This is an automated message from the Apache

[GitHub] dwai1714 commented on issue #4275: AIRFLOW-3437 Adding better json

dwai1714 commented on issue #4275: AIRFLOW-3437 Adding better json URL: https://github.com/apache/incubator-airflow/pull/4275#issuecomment-449114906 @holdenk See this ? This is an automated message from the Apache Git

[GitHub] stale[bot] commented on issue #4132: [AIRFLOW-3298] Return None if user not found in session.

stale[bot] commented on issue #4132: [AIRFLOW-3298] Return None if user not found in session. URL: https://github.com/apache/incubator-airflow/pull/4132#issuecomment-449098226 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if

[GitHub] stale[bot] commented on issue #2632: [AIRFLOW-1642] Use scoped_session in alembic revision cc1e65623dc7

stale[bot] commented on issue #2632: [AIRFLOW-1642] Use scoped_session in alembic revision cc1e65623dc7 URL: https://github.com/apache/incubator-airflow/pull/2632#issuecomment-449098218 This issue has been automatically marked as stale because it has not had recent activity. It will be

[GitHub] stale[bot] commented on issue #2058: [AIRFLOW-850] Add a PythonSensor

stale[bot] commented on issue #2058: [AIRFLOW-850] Add a PythonSensor URL: https://github.com/apache/incubator-airflow/pull/2058#issuecomment-449098213 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity

[GitHub] stale[bot] commented on issue #4056: [AIRFLOW-3207] option to stop task pushing result to xcom

stale[bot] commented on issue #4056: [AIRFLOW-3207] option to stop task pushing result to xcom URL: https://github.com/apache/incubator-airflow/pull/4056#issuecomment-449098221 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if

[GitHub] ryw commented on a change in pull request #4303: [AIRFLOW-3370] Elasticsearch log task handler additional features

ryw commented on a change in pull request #4303: [AIRFLOW-3370] Elasticsearch log task handler additional features URL: https://github.com/apache/incubator-airflow/pull/4303#discussion_r243342628 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -588,6

[GitHub] ryw commented on issue #4303: [AIRFLOW-3370] Elasticsearch log task handler additional features

ryw commented on issue #4303: [AIRFLOW-3370] Elasticsearch log task handler additional features URL: https://github.com/apache/incubator-airflow/pull/4303#issuecomment-449062113 @KevinYang21 mind reviewing this? This is an

[jira] [Commented] (AIRFLOW-3163) Add set table description operator to BigQuery operators

[ https://issues.apache.org/jira/browse/AIRFLOW-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725931#comment-16725931 ] ASF GitHub Bot commented on AIRFLOW-3163: - stale[bot] closed pull request #4003: [AIRFLOW-3163]

[GitHub] stale[bot] closed pull request #4003: [AIRFLOW-3163] add operator to enable setting table description in BigQuery table

stale[bot] closed pull request #4003: [AIRFLOW-3163] add operator to enable setting table description in BigQuery table URL: https://github.com/apache/incubator-airflow/pull/4003 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed

[jira] [Resolved] (AIRFLOW-3426) Correct references to Python version tested (3.4 -> 3.5)

[ https://issues.apache.org/jira/browse/AIRFLOW-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryant Biggs resolved AIRFLOW-3426. --- Resolution: Fixed Merged as complete > Correct references to Python version tested (3.4

[jira] [Closed] (AIRFLOW-3426) Correct references to Python version tested (3.4 -> 3.5)

[ https://issues.apache.org/jira/browse/AIRFLOW-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryant Biggs closed AIRFLOW-3426. - > Correct references to Python version tested (3.4 -> 3.5) >

[jira] [Commented] (AIRFLOW-3426) Correct references to Python version tested (3.4 -> 3.5)

[ https://issues.apache.org/jira/browse/AIRFLOW-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725867#comment-16725867 ] jack commented on AIRFLOW-3426: --- This was merged. Ticket can be closed. > Correct references to Python

[GitHub] Fokko commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors

Fokko commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors URL: https://github.com/apache/incubator-airflow/pull/3596#issuecomment-448993725 I fully agree, @seelmann. My suggestion was to make it default for Airflow 2.0

[jira] [Commented] (AIRFLOW-2937) HttpHook doesn't respect the URI scheme when the connection is defined via Environment Variable

[ https://issues.apache.org/jira/browse/AIRFLOW-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725810#comment-16725810 ] ASF GitHub Bot commented on AIRFLOW-2937: - stale[bot] closed pull request #3783: [AIRFLOW-2937]

[jira] [Commented] (AIRFLOW-3458) Refactor: Move Connection out of models.py

[ https://issues.apache.org/jira/browse/AIRFLOW-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725802#comment-16725802 ] ASF GitHub Bot commented on AIRFLOW-3458: - Fokko closed pull request #4335: [AIRFLOW-3458] Move

[jira] [Closed] (AIRFLOW-3458) Refactor: Move Connection out of models.py

[ https://issues.apache.org/jira/browse/AIRFLOW-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong closed AIRFLOW-3458. - Resolution: Fixed > Refactor: Move Connection out of models.py >

[jira] [Commented] (AIRFLOW-3458) Refactor: Move Connection out of models.py

[ https://issues.apache.org/jira/browse/AIRFLOW-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725804#comment-16725804 ] Fokko Driesprong commented on AIRFLOW-3458: --- [~ashb] The models.py is huge, and needs to be

[jira] [Assigned] (AIRFLOW-3458) Refactor: Move Connection out of models.py

[ https://issues.apache.org/jira/browse/AIRFLOW-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong reassigned AIRFLOW-3458: - Assignee: Bas Harenslak > Refactor: Move Connection out of models.py >

[GitHub] Fokko commented on a change in pull request #4335: [AIRFLOW-3458] Move models.Connection into separate file

Fokko commented on a change in pull request #4335: [AIRFLOW-3458] Move models.Connection into separate file URL: https://github.com/apache/incubator-airflow/pull/4335#discussion_r243250913 ## File path: tests/contrib/hooks/test_azure_cosmos_hook.py ## @@ -1,202 +1,202 @@

[jira] [Updated] (AIRFLOW-3254) BigQueryGetDataOperator to support reading query from SQL file

[ https://issues.apache.org/jira/browse/AIRFLOW-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3254: -- Affects Version/s: (was: 1.10.0) 1.10.1 > BigQueryGetDataOperator to support

[jira] [Commented] (AIRFLOW-2143) Try number displays incorrect values in the web UI

[ https://issues.apache.org/jira/browse/AIRFLOW-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725686#comment-16725686 ] jack commented on AIRFLOW-2143: --- I see this also > Try number displays incorrect values in the web UI >

[jira] [Commented] (AIRFLOW-644) Issue with past runs when using starttime as datetime.now()

[ https://issues.apache.org/jira/browse/AIRFLOW-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725680#comment-16725680 ] jack commented on AIRFLOW-644: -- It's a bad practice to do 'start_date': datetime.now(),``` > Issue with

[jira] [Commented] (AIRFLOW-549) Scheduler child logs are created out of normal location

[ https://issues.apache.org/jira/browse/AIRFLOW-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725682#comment-16725682 ] jack commented on AIRFLOW-549: -- [~bolke] is this still an issue? > Scheduler child logs are created out of