[GitHub] [airflow] JonnyIncognito commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-18 Thread GitBox
JonnyIncognito commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#issuecomment-543808908 > @JonnyIncognito I'm a gcp-er don't have aws access. @jaketf I'm almost certainly going to write an operator that combines

[GitHub] [airflow] mingrammer opened a new pull request #6364: [AIRFLOW-5693] Support the "blocks" component for the Slack messages

2019-10-18 Thread GitBox
mingrammer opened a new pull request #6364: [AIRFLOW-5693] Support the "blocks" component for the Slack messages URL: https://github.com/apache/airflow/pull/6364 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Updated] (AIRFLOW-5693) Support the "blocks" component for the Slack messages

2019-10-18 Thread MinJae Kwon (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MinJae Kwon updated AIRFLOW-5693: - Description: Currently, the slack webhook hook does not support "blocks" component for the

[jira] [Updated] (AIRFLOW-5693) Support the "blocks" component for the Slack messages

2019-10-18 Thread MinJae Kwon (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MinJae Kwon updated AIRFLOW-5693: - Description: Currently, the slack webhook hook does not support "blocks" components for Slack

[jira] [Updated] (AIRFLOW-5694) Check for blinker when detecting Sentry packages

2019-10-18 Thread Marcus Levine (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcus Levine updated AIRFLOW-5694: --- Description: After upgrading to 1.10.6rc1 with `sentry-sdk` installed but not specifying

[jira] [Updated] (AIRFLOW-5694) Check for blinker when detecting Sentry packages

2019-10-18 Thread Marcus Levine (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcus Levine updated AIRFLOW-5694: --- Description: After upgrading to 1.10.6rc1 with `sentry-sdk` installed but not specifying

[GitHub] [airflow] marcusianlevine opened a new pull request #6365: [AIRFLOW-5694] Check for blinker in Sentry setup

2019-10-18 Thread GitBox
marcusianlevine opened a new pull request #6365: [AIRFLOW-5694] Check for blinker in Sentry setup URL: https://github.com/apache/airflow/pull/6365 ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and references them

[jira] [Updated] (AIRFLOW-5691) Rewrite Dataproc operators to use python library

2019-10-18 Thread Tomasz Urbaszek (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Urbaszek updated AIRFLOW-5691: - Affects Version/s: (was: 2.0.0) 1.10.5 > Rewrite Dataproc

[GitHub] [airflow] KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r336572034 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,185 @@ + .. Licensed

[GitHub] [airflow] kaxil merged pull request #6362: [AIRFLOW-5688] Merge alembic migrations

2019-10-18 Thread GitBox
kaxil merged pull request #6362: [AIRFLOW-5688] Merge alembic migrations URL: https://github.com/apache/airflow/pull/6362 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] ashb commented on a change in pull request #6295: [AIRFLOW-XXX] GSoD: Adding Task re-run documentation

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6295: [AIRFLOW-XXX] GSoD: Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r336581003 ## File path: docs/index.rst ## @@ -84,6 +84,7 @@ Content concepts scheduler

[jira] [Updated] (AIRFLOW-5693) Support "blocks" components for the Slack messages

2019-10-18 Thread MinJae Kwon (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MinJae Kwon updated AIRFLOW-5693: - Summary: Support "blocks" components for the Slack messages (was: Support "blocks" components

[jira] [Updated] (AIRFLOW-5693) Support "blocks" component for the Slack messages

2019-10-18 Thread MinJae Kwon (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MinJae Kwon updated AIRFLOW-5693: - Summary: Support "blocks" component for the Slack messages (was: Support "blocks" components

[jira] [Updated] (AIRFLOW-5693) Support the "blocks" component for the Slack messages

2019-10-18 Thread MinJae Kwon (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MinJae Kwon updated AIRFLOW-5693: - Summary: Support the "blocks" component for the Slack messages (was: Support "blocks"

[jira] [Updated] (AIRFLOW-5694) Check for blinker when detecting Sentry packages

2019-10-18 Thread Marcus Levine (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcus Levine updated AIRFLOW-5694: --- Description: {{After upgrading to 1.10.6rc1 with `sentry-sdk` installed but not specifying

[GitHub] [airflow] KKcorps commented on a change in pull request #6295: [AIRFLOW-XXX] GSoD: Adding Task re-run documentation

2019-10-18 Thread GitBox
KKcorps commented on a change in pull request #6295: [AIRFLOW-XXX] GSoD: Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r336570463 ## File path: docs/dag-run.rst ## @@ -0,0 +1,193 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r336572794 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,185 @@ + .. Licensed

[GitHub] [airflow] ashb commented on a change in pull request #6295: [AIRFLOW-XXX] GSoD: Adding Task re-run documentation

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6295: [AIRFLOW-XXX] GSoD: Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r336587858 ## File path: docs/dag-run.rst ## @@ -0,0 +1,189 @@ + .. Licensed to the Apache Software

[jira] [Updated] (AIRFLOW-5693) Support the "blocks" component for the Slack messages

2019-10-18 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5693: --- Fix Version/s: (was: 1.10.6) 1.10.7 > Support the "blocks"

[GitHub] [airflow] ashb commented on a change in pull request #6364: [AIRFLOW-5693] Support the "blocks" component for the Slack messages

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6364: [AIRFLOW-5693] Support the "blocks" component for the Slack messages URL: https://github.com/apache/airflow/pull/6364#discussion_r336591510 ## File path: tests/contrib/hooks/test_slack_webhook_hook.py ## @@ -35,6 +35,7 @@

[GitHub] [airflow] ashb commented on a change in pull request #6364: [AIRFLOW-5693] Support the "blocks" component for the Slack messages

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6364: [AIRFLOW-5693] Support the "blocks" component for the Slack messages URL: https://github.com/apache/airflow/pull/6364#discussion_r336595294 ## File path: tests/contrib/hooks/test_slack_webhook_hook.py ## @@ -35,6 +35,7 @@

[jira] [Created] (AIRFLOW-5694) Check for blinker when detecting Sentry packages

2019-10-18 Thread Marcus Levine (Jira)
Marcus Levine created AIRFLOW-5694: -- Summary: Check for blinker when detecting Sentry packages Key: AIRFLOW-5694 URL: https://issues.apache.org/jira/browse/AIRFLOW-5694 Project: Apache Airflow

[GitHub] [airflow] potiuk commented on issue #6356: [AIRFLOW-XXX] Changelog for 1.10.6 (rc1)

2019-10-18 Thread GitBox
potiuk commented on issue #6356: [AIRFLOW-XXX] Changelog for 1.10.6 (rc1) URL: https://github.com/apache/airflow/pull/6356#issuecomment-543782523 +OmerJog: It's also Python 3 compatibility changes. See discussion in

[jira] [Created] (AIRFLOW-5692) Retrofit Dataflow integration

2019-10-18 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5692: -- Summary: Retrofit Dataflow integration Key: AIRFLOW-5692 URL: https://issues.apache.org/jira/browse/AIRFLOW-5692 Project: Apache Airflow Issue Type:

[GitHub] [airflow] JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-18 Thread GitBox
JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r336552413 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] JonnyIncognito edited a comment on issue #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-18 Thread GitBox
JonnyIncognito edited a comment on issue #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#issuecomment-543808908 > @JonnyIncognito I'm a gcp-er don't have aws access. @jaketf I'm almost certainly going to write an operator that combines

[GitHub] [airflow] JonnyIncognito edited a comment on issue #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-18 Thread GitBox
JonnyIncognito edited a comment on issue #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#issuecomment-543808908 > @JonnyIncognito I'm a gcp-er don't have aws access. @jaketf I'm almost certainly going to write an operator that combines

[jira] [Created] (AIRFLOW-5693) Support slack blocks componentss

2019-10-18 Thread MinJae Kwon (Jira)
MinJae Kwon created AIRFLOW-5693: Summary: Support slack blocks componentss Key: AIRFLOW-5693 URL: https://issues.apache.org/jira/browse/AIRFLOW-5693 Project: Apache Airflow Issue Type:

[GitHub] [airflow] ashb commented on a change in pull request #6295: [AIRFLOW-XXX] GSoD: Adding Task re-run documentation

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6295: [AIRFLOW-XXX] GSoD: Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#discussion_r336583966 ## File path: docs/scheduler.rst ## @@ -32,161 +30,10 @@ Airflow production environment. To kick

[jira] [Commented] (AIRFLOW-5693) Support the "blocks" component for the Slack messages

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954813#comment-16954813 ] ASF GitHub Bot commented on AIRFLOW-5693: - mingrammer commented on pull request #6364:

[GitHub] [airflow] mingrammer commented on a change in pull request #6364: [AIRFLOW-5693] Support the "blocks" component for the Slack messages

2019-10-18 Thread GitBox
mingrammer commented on a change in pull request #6364: [AIRFLOW-5693] Support the "blocks" component for the Slack messages URL: https://github.com/apache/airflow/pull/6364#discussion_r336593052 ## File path: tests/contrib/hooks/test_slack_webhook_hook.py ## @@ -35,6

[jira] [Created] (AIRFLOW-5691) Rewrite Dataproc operators to use python library

2019-10-18 Thread Tomasz Urbaszek (Jira)
Tomasz Urbaszek created AIRFLOW-5691: Summary: Rewrite Dataproc operators to use python library Key: AIRFLOW-5691 URL: https://issues.apache.org/jira/browse/AIRFLOW-5691 Project: Apache Airflow

[airflow-site] branch aip-11 updated: Add case study page (#81)

2019-10-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a commit to branch aip-11 in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/aip-11 by this push: new dbb402c Add case study page (#81)

[GitHub] [airflow-site] mik-laj merged pull request #81: Add case study page

2019-10-18 Thread GitBox
mik-laj merged pull request #81: Add case study page URL: https://github.com/apache/airflow-site/pull/81 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] kaxil commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-18 Thread GitBox
kaxil commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-543821517 +1 for a flag instead of a new operator. This is

[jira] [Updated] (AIRFLOW-5693) Support "blocks" components for the Slack message

2019-10-18 Thread MinJae Kwon (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MinJae Kwon updated AIRFLOW-5693: - Summary: Support "blocks" components for the Slack message (was: Support blocks components

[jira] [Updated] (AIRFLOW-5693) Support blocks components for the Slack message

2019-10-18 Thread MinJae Kwon (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MinJae Kwon updated AIRFLOW-5693: - Summary: Support blocks components for the Slack message (was: Support slack blocks

[GitHub] [airflow] ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r336588731 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,185 @@ + .. Licensed to

[jira] [Commented] (AIRFLOW-5386) Move Google Dataproc to core

2019-10-18 Thread Prabhjot Singh Bharaj (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954735#comment-16954735 ] Prabhjot Singh Bharaj commented on AIRFLOW-5386: Which release is this being planned in

[jira] [Resolved] (AIRFLOW-5688) Merge alembic migrations

2019-10-18 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-5688. - Resolution: Fixed > Merge alembic migrations > > >

[GitHub] [airflow] ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r336589019 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,185 @@ + .. Licensed to

[GitHub] [airflow-site] kgabryje opened a new pull request #82: [WIP] accordion w icon, blogpost box, youtube section, features, principles

2019-10-18 Thread GitBox
kgabryje opened a new pull request #82: [WIP] accordion w icon, blogpost box, youtube section, features, principles URL: https://github.com/apache/airflow-site/pull/82 https://github.com/apache/airflow-site/issues/27 https://github.com/apache/airflow-site/issues/35

[jira] [Commented] (AIRFLOW-5694) Check for blinker when detecting Sentry packages

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954855#comment-16954855 ] ASF GitHub Bot commented on AIRFLOW-5694: - marcusianlevine commented on pull request #6365:

[GitHub] [airflow] codecov-io edited a comment on issue #6299: [AIRFLOW-5631] Change way of running GCP system tests

2019-10-18 Thread GitBox
codecov-io edited a comment on issue #6299: [AIRFLOW-5631] Change way of running GCP system tests URL: https://github.com/apache/airflow/pull/6299#issuecomment-540547492 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6299?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6299: [AIRFLOW-5631] Change way of running GCP system tests

2019-10-18 Thread GitBox
codecov-io edited a comment on issue #6299: [AIRFLOW-5631] Change way of running GCP system tests URL: https://github.com/apache/airflow/pull/6299#issuecomment-540547492 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6299?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6299: [AIRFLOW-5631] Change way of running GCP system tests

2019-10-18 Thread GitBox
codecov-io edited a comment on issue #6299: [AIRFLOW-5631] Change way of running GCP system tests URL: https://github.com/apache/airflow/pull/6299#issuecomment-540547492 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6299?src=pr=h1) Report > Merging

[GitHub] [airflow] potiuk merged pull request #6349: [AIRFLOW-XXX] Add logo info to readme

2019-10-18 Thread GitBox
potiuk merged pull request #6349: [AIRFLOW-XXX] Add logo info to readme URL: https://github.com/apache/airflow/pull/6349 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] potiuk commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme

2019-10-18 Thread GitBox
potiuk commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme URL: https://github.com/apache/airflow/pull/6349#issuecomment-543897037 Thanks @leahecole ! This is an automated message from the Apache Git Service. To

[jira] [Created] (AIRFLOW-5695) Cannot run a task from UI if its state is None

2019-10-18 Thread Ping Zhang (Jira)
Ping Zhang created AIRFLOW-5695: --- Summary: Cannot run a task from UI if its state is None Key: AIRFLOW-5695 URL: https://issues.apache.org/jira/browse/AIRFLOW-5695 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-5696) Add GoogleCloudStorageToSFTPOperator

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954925#comment-16954925 ] ASF GitHub Bot commented on AIRFLOW-5696: - TobKed commented on pull request #6366:

[GitHub] [airflow] TobKed opened a new pull request #6366: [AIRFLOW-5696] GoogleCloudStorageToSFTPOperator

2019-10-18 Thread GitBox
TobKed opened a new pull request #6366: [AIRFLOW-5696] GoogleCloudStorageToSFTPOperator URL: https://github.com/apache/airflow/pull/6366 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Comment Edited] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.

2019-10-18 Thread Tobiasz Kedzierski (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954489#comment-16954489 ] Tobiasz Kedzierski edited comment on AIRFLOW- at 10/18/19 7:30 PM:

[GitHub] [airflow] milton0825 commented on issue #5942: [AIRFLOW-5339] Fix infinite wait for Spark subprocess

2019-10-18 Thread GitBox
milton0825 commented on issue #5942: [AIRFLOW-5339] Fix infinite wait for Spark subprocess URL: https://github.com/apache/airflow/pull/5942#issuecomment-54390 Got it. I thought it would automatically resolve the Jira.

[jira] [Created] (AIRFLOW-5696) Add GoogleCloudStorageToSFTPOperator

2019-10-18 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-5696: --- Summary: Add GoogleCloudStorageToSFTPOperator Key: AIRFLOW-5696 URL: https://issues.apache.org/jira/browse/AIRFLOW-5696 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-5695) Cannot run a task from UI if its state is None

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954980#comment-16954980 ] ASF GitHub Bot commented on AIRFLOW-5695: - pingzh commented on pull request #6367:

[jira] [Resolved] (AIRFLOW-5299) Move SQLToGCS to core

2019-10-18 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-5299. Fix Version/s: 2.0.0 Resolution: Fixed > Move SQLToGCS to core >

[jira] [Resolved] (AIRFLOW-5294) Make GCP MLEngine pylint compatible

2019-10-18 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-5294. Fix Version/s: 2.0.0 Assignee: Tomasz Urbaszek Resolution: Fixed > Make

[jira] [Resolved] (AIRFLOW-5300) Move GcsToService operators to core

2019-10-18 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-5300. Fix Version/s: 2.0.0 Resolution: Fixed > Move GcsToService operators to core >

[GitHub] [airflow] mik-laj opened a new pull request #6369: [AIRFLOW-5699][part of AIRFLOW-5697][depends on AIRFLOW-5698] Add more tests for Dataflow integration

2019-10-18 Thread GitBox
mik-laj opened a new pull request #6369: [AIRFLOW-5699][part of AIRFLOW-5697][depends on AIRFLOW-5698] Add more tests for Dataflow integration URL: https://github.com/apache/airflow/pull/6369 This PR is one of a series that aims to improve this integration

[jira] [Updated] (AIRFLOW-5697) Retrofit Dataflow integration

2019-10-18 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-5697: --- Description: I have made many Dataflow patches that I would like to introduce {code:java}

[jira] [Closed] (AIRFLOW-5692) Retrofit Dataflow integration

2019-10-18 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-5692. -- Resolution: Duplicate > Retrofit Dataflow integration > - > >

[GitHub] [airflow] codecov-io commented on issue #6369: [AIRFLOW-5699][part of AIRFLOW-5697][depends on AIRFLOW-5698] Add more tests for Dataflow integration

2019-10-18 Thread GitBox
codecov-io commented on issue #6369: [AIRFLOW-5699][part of AIRFLOW-5697][depends on AIRFLOW-5698] Add more tests for Dataflow integration URL: https://github.com/apache/airflow/pull/6369#issuecomment-544034730 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6369?src=pr=h1) Report

[jira] [Created] (AIRFLOW-5700) KubeExecutor - Specify YAML template

2019-10-18 Thread F D (Jira)
F D created AIRFLOW-5700: Summary: KubeExecutor - Specify YAML template Key: AIRFLOW-5700 URL: https://issues.apache.org/jira/browse/AIRFLOW-5700 Project: Apache Airflow Issue Type: New Feature

[GitHub] [airflow] pingzh opened a new pull request #6367: [AIRFLOW-5695] use RUNNING_DEPS to check run from UI

2019-10-18 Thread GitBox
pingzh opened a new pull request #6367: [AIRFLOW-5695] use RUNNING_DEPS to check run from UI URL: https://github.com/apache/airflow/pull/6367 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Resolved] (AIRFLOW-5297) Move AdlsToGcs operator to core

2019-10-18 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-5297. Fix Version/s: 2.0.0 Assignee: Tomasz Urbaszek Resolution: Fixed > Move

[GitHub] [airflow] mik-laj opened a new pull request #6368: [AIRFLOW-5698][part of AIRFLOW-5697] Organize Dataflow tests

2019-10-18 Thread GitBox
mik-laj opened a new pull request #6368: [AIRFLOW-5698][part of AIRFLOW-5697] Organize Dataflow tests URL: https://github.com/apache/airflow/pull/6368 This PR is one of a series that aims to improve this integration https://issues.apache.org/jira/browse/AIRFLOW-5697 ---

[jira] [Resolved] (AIRFLOW-5298) Move FileToGcs to core

2019-10-18 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-5298. Fix Version/s: 2.0.0 Resolution: Fixed > Move FileToGcs to core >

[jira] [Created] (AIRFLOW-5699) Add more tests for Dataflow integration

2019-10-18 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5699: -- Summary: Add more tests for Dataflow integration Key: AIRFLOW-5699 URL: https://issues.apache.org/jira/browse/AIRFLOW-5699 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-5698) Organize Dataflow tests

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955005#comment-16955005 ] ASF GitHub Bot commented on AIRFLOW-5698: - mik-laj commented on pull request #6368:

[jira] [Created] (AIRFLOW-5698) Organize Dataflow tests

2019-10-18 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5698: -- Summary: Organize Dataflow tests Key: AIRFLOW-5698 URL: https://issues.apache.org/jira/browse/AIRFLOW-5698 Project: Apache Airflow Issue Type:

[GitHub] [airflow] codecov-io commented on issue #6368: [AIRFLOW-5698][part of AIRFLOW-5697] Organize Dataflow tests

2019-10-18 Thread GitBox
codecov-io commented on issue #6368: [AIRFLOW-5698][part of AIRFLOW-5697] Organize Dataflow tests URL: https://github.com/apache/airflow/pull/6368#issuecomment-544025511 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6368?src=pr=h1) Report > :exclamation: No coverage uploaded

[GitHub] [airflow] codecov-io edited a comment on issue #6368: [AIRFLOW-5698][part of AIRFLOW-5697] Organize Dataflow tests

2019-10-18 Thread GitBox
codecov-io edited a comment on issue #6368: [AIRFLOW-5698][part of AIRFLOW-5697] Organize Dataflow tests URL: https://github.com/apache/airflow/pull/6368#issuecomment-544025511 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6368?src=pr=h1) Report > :exclamation: No coverage

[GitHub] [airflow] mingrammer edited a comment on issue #6364: [AIRFLOW-5693] Support the "blocks" component for the Slack messages

2019-10-18 Thread GitBox
mingrammer edited a comment on issue #6364: [AIRFLOW-5693] Support the "blocks" component for the Slack messages URL: https://github.com/apache/airflow/pull/6364#issuecomment-544039958 CI failed due to this issue. (https://github.com/docker/for-linux/issues/830) And, this issue

[GitHub] [airflow] mingrammer commented on issue #6364: [AIRFLOW-5693] Support the "blocks" component for the Slack messages

2019-10-18 Thread GitBox
mingrammer commented on issue #6364: [AIRFLOW-5693] Support the "blocks" component for the Slack messages URL: https://github.com/apache/airflow/pull/6364#issuecomment-544039958 CI has been failed due to this issue. (https://github.com/docker/for-linux/issues/830) And, this issue

[jira] [Created] (AIRFLOW-5697) Retrofit Dataflow integration

2019-10-18 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-5697: -- Summary: Retrofit Dataflow integration Key: AIRFLOW-5697 URL: https://issues.apache.org/jira/browse/AIRFLOW-5697 Project: Apache Airflow Issue Type:

[jira] [Updated] (AIRFLOW-5700) KubeExecutor - Specify YAML template

2019-10-18 Thread F D (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] F D updated AIRFLOW-5700: - Description: As a developer - I find myself struggling with the Airflow implementation of launching pods

[jira] [Updated] (AIRFLOW-5700) KubeExecutor - Specify YAML template

2019-10-18 Thread F D (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] F D updated AIRFLOW-5700: - Description: As a developer - I find myself struggling with the Airflow implementation of launching pods

[jira] [Closed] (AIRFLOW-5700) KubeExecutor - Specify YAML template

2019-10-18 Thread F D (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] F D closed AIRFLOW-5700. Resolution: Duplicate > KubeExecutor - Specify YAML template > > >

[jira] [Commented] (AIRFLOW-5700) KubeExecutor - Specify YAML template

2019-10-18 Thread F D (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955047#comment-16955047 ] F D commented on AIRFLOW-5700: -- Duplicate of https://issues.apache.org/jira/browse/AIRFLOW-5413 Closing

[jira] [Updated] (AIRFLOW-5698) Organize Dataflow tests

2019-10-18 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-5698: --- Parent: AIRFLOW-5697 Issue Type: Sub-task (was: Improvement) > Organize Dataflow

[jira] [Commented] (AIRFLOW-5699) Add more tests for Dataflow integration

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955008#comment-16955008 ] ASF GitHub Bot commented on AIRFLOW-5699: - mik-laj commented on pull request #6369:

[GitHub] [airflow] KevinYang21 commented on issue #6367: [AIRFLOW-5695] use RUNNING_DEPS to check run from UI

2019-10-18 Thread GitBox
KevinYang21 commented on issue #6367: [AIRFLOW-5695] use RUNNING_DEPS to check run from UI URL: https://github.com/apache/airflow/pull/6367#issuecomment-544007106 So what's left are: ``` DagrunRunningDep DagrunIdDep DagUnpausedDep ExecDateAfterStartDateDep ``` I'm

[GitHub] [airflow] mik-laj commented on a change in pull request #6344: [AIRFLOW-5665] Add path_exists method to SFTPHook

2019-10-18 Thread GitBox
mik-laj commented on a change in pull request #6344: [AIRFLOW-5665] Add path_exists method to SFTPHook URL: https://github.com/apache/airflow/pull/6344#discussion_r336709991 ## File path: airflow/contrib/hooks/sftp_hook.py ## @@ -214,3 +214,12 @@ def get_mod_time(self,

[jira] [Updated] (AIRFLOW-5700) KubeExecutor - Specify YAML template

2019-10-18 Thread F D (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] F D updated AIRFLOW-5700: - Description: As a developer - I find myself struggling with the Airflow implementation of launching pods

[jira] [Updated] (AIRFLOW-5700) KubeExecutor - Specify YAML template

2019-10-18 Thread F D (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] F D updated AIRFLOW-5700: - Description: As a developer - I find myself struggling with the Airflow implementation of launching pods

[GitHub] [airflow] fritz-clicktripz commented on issue #6230: [AIRFLOW-5413] Allow K8S pod to be configured from JSON/YAML file

2019-10-18 Thread GitBox
fritz-clicktripz commented on issue #6230: [AIRFLOW-5413] Allow K8S pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#issuecomment-544047860 `path_to_deployment_file` is not super clear what it means - could the name be something like

[GitHub] [airflow] fritz-clicktripz edited a comment on issue #6230: [AIRFLOW-5413] Allow K8S pod to be configured from JSON/YAML file

2019-10-18 Thread GitBox
fritz-clicktripz edited a comment on issue #6230: [AIRFLOW-5413] Allow K8S pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#issuecomment-544047860 `path_to_deployment_file` is not super clear what it means - could the name be something like

[GitHub] [airflow] fritz-clicktripz edited a comment on issue #6230: [AIRFLOW-5413] Allow K8S pod to be configured from JSON/YAML file

2019-10-18 Thread GitBox
fritz-clicktripz edited a comment on issue #6230: [AIRFLOW-5413] Allow K8S pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#issuecomment-544047860 `path_to_deployment_file` is not super clear what it means - could the name be something like

[GitHub] [airflow] Fokko commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-18 Thread GitBox
Fokko commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r336723480 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed to

[GitHub] [airflow] Fokko opened a new pull request #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-18 Thread GitBox
Fokko opened a new pull request #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370 Make sure you have checked _all_ steps below. - Don't clear the xcom upfront, but only when the job ran and new values are provided.

[jira] [Created] (AIRFLOW-5701) Dont clear xcom explicitly before execution

2019-10-18 Thread Fokko Driesprong (Jira)
Fokko Driesprong created AIRFLOW-5701: - Summary: Dont clear xcom explicitly before execution Key: AIRFLOW-5701 URL: https://issues.apache.org/jira/browse/AIRFLOW-5701 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-5701) Don't clear xcom explicitly before execution

2019-10-18 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-5701: -- Summary: Don't clear xcom explicitly before execution (was: Dont clear xcom

[jira] [Commented] (AIRFLOW-5701) Don't clear xcom explicitly before execution

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955073#comment-16955073 ] ASF GitHub Bot commented on AIRFLOW-5701: - Fokko commented on pull request #6370: AIRFLOW-5701:

<    1   2