[GitHub] [airflow] potiuk commented on issue #4932: [AIRFLOW-3611] Simplified development workflow [Depends on multi-staging]

2019-03-31 Thread GitBox
potiuk commented on issue #4932: [AIRFLOW-3611] Simplified development workflow [Depends on multi-staging] URL: https://github.com/apache/airflow/pull/4932#issuecomment-478454382 Hey @ashb -> you might take a look at the latest version now. I watched your Hangout last week and it was super

[GitHub] [airflow] codecov-io edited a comment on issue #4936: [AIRFLOW-4115] Multi-staging Aiflow Docker image [Step 1/3]

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #4936: [AIRFLOW-4115] Multi-staging Aiflow Docker image [Step 1/3] URL: https://github.com/apache/airflow/pull/4936#issuecomment-478445340 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4936?src=pr&el=h1) Report > Merging [#4936](https://code

[GitHub] [airflow] codecov-io edited a comment on issue #4936: [AIRFLOW-4115] Multi-staging Aiflow Docker image [Step 1/3]

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #4936: [AIRFLOW-4115] Multi-staging Aiflow Docker image [Step 1/3] URL: https://github.com/apache/airflow/pull/4936#issuecomment-478445340 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4936?src=pr&el=h1) Report > Merging [#4936](https://code

[GitHub] [airflow] codecov-io edited a comment on issue #4967: [AIRFLOW-4147] Operator to publish event to Redis

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #4967: [AIRFLOW-4147] Operator to publish event to Redis URL: https://github.com/apache/airflow/pull/4967#issuecomment-477685196 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4967?src=pr&el=h1) Report > Merging [#4967](https://codecov.io/gh/

[GitHub] [airflow] codecov-io edited a comment on issue #4898: [AIRFLOW-XXXX] how to setup simple test env with mysql

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #4898: [AIRFLOW-] how to setup simple test env with mysql URL: https://github.com/apache/airflow/pull/4898#issuecomment-473601105 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4898?src=pr&el=h1) Report > Merging [#4898](https://codecov.i

[GitHub] [airflow] milton0825 commented on issue #5016: [AIRFLOW-4194] Set dag_run state to failed when user terminate backfill

2019-03-31 Thread GitBox
milton0825 commented on issue #5016: [AIRFLOW-4194] Set dag_run state to failed when user terminate backfill URL: https://github.com/apache/airflow/pull/5016#issuecomment-478448914 PTAL @ashb @feng-tao This is an automated m

[GitHub] [airflow] codecov-io commented on issue #5016: [AIRFLOW-4194][WIP] Set dag_run state to failed when user terminate backfill

2019-03-31 Thread GitBox
codecov-io commented on issue #5016: [AIRFLOW-4194][WIP] Set dag_run state to failed when user terminate backfill URL: https://github.com/apache/airflow/pull/5016#issuecomment-478446701 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5016?src=pr&el=h1) Report > Merging [#5016](ht

[GitHub] [airflow] codecov-io commented on issue #4936: [AIRFLOW-4115] Multi-staging Aiflow Docker image [Step 1/3]

2019-03-31 Thread GitBox
codecov-io commented on issue #4936: [AIRFLOW-4115] Multi-staging Aiflow Docker image [Step 1/3] URL: https://github.com/apache/airflow/pull/4936#issuecomment-478445340 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4936?src=pr&el=h1) Report > Merging [#4936](https://codecov.io/

[GitHub] [airflow] potiuk commented on a change in pull request #4936: [AIRFLOW-4115] Multi-staging Aiflow Docker image [Step 1/3]

2019-03-31 Thread GitBox
potiuk commented on a change in pull request #4936: [AIRFLOW-4115] Multi-staging Aiflow Docker image [Step 1/3] URL: https://github.com/apache/airflow/pull/4936#discussion_r270718562 ## File path: .dockerignore ## @@ -0,0 +1,107 @@ +# +# Licensed to the Apache Software Fou

[jira] [Commented] (AIRFLOW-4194) set dag_run state to failed when user terminate backfill

2019-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806392#comment-16806392 ] ASF GitHub Bot commented on AIRFLOW-4194: - milton0825 commented on pull request

[GitHub] [airflow] milton0825 opened a new pull request #5016: [AIRFLOW-4194] Set dag_run state to failed when user terminate backfill

2019-03-31 Thread GitBox
milton0825 opened a new pull request #5016: [AIRFLOW-4194] Set dag_run state to failed when user terminate backfill URL: https://github.com/apache/airflow/pull/5016 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow Jira](https

[jira] [Updated] (AIRFLOW-4194) set dag_run state to failed when user terminate backfill

2019-03-31 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4194: --- Description: Reset dag_run state to failed if user terminate backfill. Otherwise the dag_ru

[GitHub] [airflow] bryanyang0528 commented on a change in pull request #5004: [AIRFLOW-4187] SlackWebhookOperator do not pass http_conn_id to its parent class

2019-03-31 Thread GitBox
bryanyang0528 commented on a change in pull request #5004: [AIRFLOW-4187] SlackWebhookOperator do not pass http_conn_id to its parent class URL: https://github.com/apache/airflow/pull/5004#discussion_r270700074 ## File path: tests/contrib/hooks/test_slack_webhook_hook.py ##

[GitHub] [airflow] bryanyang0528 commented on a change in pull request #5004: [AIRFLOW-4187] SlackWebhookOperator do not pass http_conn_id to its parent class

2019-03-31 Thread GitBox
bryanyang0528 commented on a change in pull request #5004: [AIRFLOW-4187] SlackWebhookOperator do not pass http_conn_id to its parent class URL: https://github.com/apache/airflow/pull/5004#discussion_r270492480 ## File path: tests/contrib/hooks/test_slack_webhook_hook.py ##

[jira] [Created] (AIRFLOW-4211) Add tests for WebHDFSHook

2019-03-31 Thread Felix Uellendall (JIRA)
Felix Uellendall created AIRFLOW-4211: - Summary: Add tests for WebHDFSHook Key: AIRFLOW-4211 URL: https://issues.apache.org/jira/browse/AIRFLOW-4211 Project: Apache Airflow Issue Type: Ne

[jira] [Commented] (AIRFLOW-4211) Add tests for WebHDFSHook

2019-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806323#comment-16806323 ] ASF GitHub Bot commented on AIRFLOW-4211: - feluelle commented on pull request #

[GitHub] [airflow] feluelle opened a new pull request #5015: [AIRFLOW-4211] Add tests for WebHDFSHook

2019-03-31 Thread GitBox
feluelle opened a new pull request #5015: [AIRFLOW-4211] Add tests for WebHDFSHook URL: https://github.com/apache/airflow/pull/5015 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/

[GitHub] [airflow] mik-laj commented on a change in pull request #4821: [AIRFLOW-3998] Use nested commands in cli.

2019-03-31 Thread GitBox
mik-laj commented on a change in pull request #4821: [AIRFLOW-3998] Use nested commands in cli. URL: https://github.com/apache/airflow/pull/4821#discussion_r270695422 ## File path: airflow/bin/cli.py ## @@ -328,34 +348,44 @@ def pool_export_helper(filepath): @cli_util

[GitHub] [airflow] XD-DENG commented on issue #4780: [AIRFLOW-3960] Create Google Cloud Speech operators

2019-03-31 Thread GitBox
XD-DENG commented on issue #4780: [AIRFLOW-3960] Create Google Cloud Speech operators URL: https://github.com/apache/airflow/pull/4780#issuecomment-478402853 LGTM @kaxil @Fokko . (On a vacation so responding slowly, sorry for this) --

[GitHub] [airflow] feng-tao merged pull request #5014: [AIRFLOW-XXX] Update WeTransfer in "Who uses Apache Airflow"

2019-03-31 Thread GitBox
feng-tao merged pull request #5014: [AIRFLOW-XXX] Update WeTransfer in "Who uses Apache Airflow" URL: https://github.com/apache/airflow/pull/5014 This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [airflow] mik-laj edited a comment on issue #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators

2019-03-31 Thread GitBox
mik-laj edited a comment on issue #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators URL: https://github.com/apache/airflow/pull/4980#issuecomment-478396520 @kaxil I apply all your suggestion. In addition, I changed all `literalinclude` to `exampleinclude`, so full code of e

[GitHub] [airflow] mik-laj commented on issue #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators

2019-03-31 Thread GitBox
mik-laj commented on issue #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators URL: https://github.com/apache/airflow/pull/4980#issuecomment-478396520 @kaxil I apply all your suggestion. In addition, I changed all `literalinclude` to `exampleinclude`, so full code of example

[jira] [Commented] (AIRFLOW-4194) set dag_run state to failed when user terminate backfill

2019-03-31 Thread Tao Feng (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806300#comment-16806300 ] Tao Feng commented on AIRFLOW-4194: --- [~milton0825], I never finish the pr([https://g

[GitHub] [airflow] mik-laj commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators

2019-03-31 Thread GitBox
mik-laj commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators URL: https://github.com/apache/airflow/pull/4980#discussion_r270690928 ## File path: airflow/contrib/example_dags/example_gcp_natural_language.py ## @@ -0,0 +1,1

[GitHub] [airflow] kaxil commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators

2019-03-31 Thread GitBox
kaxil commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators URL: https://github.com/apache/airflow/pull/4980#discussion_r270690822 ## File path: airflow/contrib/example_dags/example_gcp_natural_language.py ## @@ -0,0 +1,116

[GitHub] [airflow] kaxil commented on a change in pull request #4633: AIRFLOW-3791: Dataflow

2019-03-31 Thread GitBox
kaxil commented on a change in pull request #4633: AIRFLOW-3791: Dataflow URL: https://github.com/apache/airflow/pull/4633#discussion_r270690735 ## File path: airflow/contrib/hooks/gcp_dataflow_hook.py ## @@ -31,88 +31,111 @@ # This is the default location # https://cloud

[GitHub] [airflow] kaxil commented on a change in pull request #4633: AIRFLOW-3791: Dataflow

2019-03-31 Thread GitBox
kaxil commented on a change in pull request #4633: AIRFLOW-3791: Dataflow URL: https://github.com/apache/airflow/pull/4633#discussion_r270690735 ## File path: airflow/contrib/hooks/gcp_dataflow_hook.py ## @@ -31,88 +31,111 @@ # This is the default location # https://cloud

[GitHub] [airflow] mik-laj commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators

2019-03-31 Thread GitBox
mik-laj commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators URL: https://github.com/apache/airflow/pull/4980#discussion_r270690667 ## File path: airflow/contrib/example_dags/example_gcp_natural_language.py ## @@ -0,0 +1,1

[GitHub] [airflow] kaxil commented on issue #4633: AIRFLOW-3791: Dataflow

2019-03-31 Thread GitBox
kaxil commented on issue #4633: AIRFLOW-3791: Dataflow URL: https://github.com/apache/airflow/pull/4633#issuecomment-478395287 cc @fenglu-g What do you think? This is an automated message from the Apache Git Service. To respo

[GitHub] [airflow] kaxil commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators

2019-03-31 Thread GitBox
kaxil commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators URL: https://github.com/apache/airflow/pull/4980#discussion_r270690512 ## File path: airflow/contrib/example_dags/example_gcp_natural_language.py ## @@ -0,0 +1,116

[GitHub] [airflow] mik-laj commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators

2019-03-31 Thread GitBox
mik-laj commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators URL: https://github.com/apache/airflow/pull/4980#discussion_r270690394 ## File path: airflow/contrib/example_dags/example_gcp_natural_language.py ## @@ -0,0 +1,1

[GitHub] [airflow] kaxil commented on issue #4780: [AIRFLOW-3960] Create Google Cloud Speech operators

2019-03-31 Thread GitBox
kaxil commented on issue #4780: [AIRFLOW-3960] Create Google Cloud Speech operators URL: https://github.com/apache/airflow/pull/4780#issuecomment-478394717 @XD-DENG Any more comments on this? This is an automated message from

[GitHub] [airflow] kaxil commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators

2019-03-31 Thread GitBox
kaxil commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators URL: https://github.com/apache/airflow/pull/4980#discussion_r270690034 ## File path: airflow/contrib/example_dags/example_gcp_natural_language.py ## @@ -0,0 +1,116

[GitHub] [airflow] kaxil commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators

2019-03-31 Thread GitBox
kaxil commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators URL: https://github.com/apache/airflow/pull/4980#discussion_r270690111 ## File path: airflow/contrib/example_dags/example_gcp_natural_language.py ## @@ -0,0 +1,116

[GitHub] [airflow] kaxil commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators

2019-03-31 Thread GitBox
kaxil commented on a change in pull request #4980: [AIRFLOW-3971] Add Google Cloud Natural Language operators URL: https://github.com/apache/airflow/pull/4980#discussion_r270690096 ## File path: airflow/contrib/example_dags/example_gcp_natural_language.py ## @@ -0,0 +1,116

[GitHub] [airflow] codecov-io edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables URL: https://github.com/apache/airflow/pull/5010#issuecomment-478295602 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5010?src=pr&el=h1) Report > Merging [#5010](https://codecov.io/gh/a

[GitHub] [airflow] codecov-io edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables URL: https://github.com/apache/airflow/pull/5010#issuecomment-478295602 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5010?src=pr&el=h1) Report > Merging [#5010](https://codecov.io/gh/a

[GitHub] [airflow] BasPH edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables

2019-03-31 Thread GitBox
BasPH edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables URL: https://github.com/apache/airflow/pull/5010#issuecomment-478358376 ~@Fokko after the last push 1 task failed, which succeeded before, can you rerun that one?~ Noticed there was now a conflict with

[jira] [Commented] (AIRFLOW-3458) Refactor: Move Connection out of models.py

2019-03-31 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806260#comment-16806260 ] Fokko Driesprong commented on AIRFLOW-3458: --- Awesome, thanks! > Refactor: Mo

[jira] [Updated] (AIRFLOW-3458) Refactor: Move Connection out of models.py

2019-03-31 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-3458: -- Fix Version/s: 1.10.3 > Refactor: Move Connection out of models.py >

[jira] [Commented] (AIRFLOW-3458) Refactor: Move Connection out of models.py

2019-03-31 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806259#comment-16806259 ] Ash Berlin-Taylor commented on AIRFLOW-3458: [~Fokko] I've already cherry-p

[GitHub] [airflow] codecov-io edited a comment on issue #4821: [AIRFLOW-3998] Use nested commands in cli.

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #4821: [AIRFLOW-3998] Use nested commands in cli. URL: https://github.com/apache/airflow/pull/4821#issuecomment-468981700 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4821?src=pr&el=h1) Report > Merging [#4821](https://codecov.io/gh/apache/

[jira] [Created] (AIRFLOW-4200) Remove all __future__ imports

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4200: - Summary: Remove all __future__ imports Key: AIRFLOW-4200 URL: https://issues.apache.org/jira/browse/AIRFLOW-4200 Project: Apache Airflow Issue Type

[jira] [Created] (AIRFLOW-4196) AIP-3 Drop support for Python 2

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4196: - Summary: AIP-3 Drop support for Python 2 Key: AIRFLOW-4196 URL: https://issues.apache.org/jira/browse/AIRFLOW-4196 Project: Apache Airflow Issue Ty

[jira] [Created] (AIRFLOW-4210) Update the CI image to Python3

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4210: - Summary: Update the CI image to Python3 Key: AIRFLOW-4210 URL: https://issues.apache.org/jira/browse/AIRFLOW-4210 Project: Apache Airflow Issue Typ

[jira] [Created] (AIRFLOW-4207) Replace __metaclass__ attribute by metaclass as a class keyword argument

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4207: - Summary: Replace __metaclass__ attribute by metaclass as a class keyword argument Key: AIRFLOW-4207 URL: https://issues.apache.org/jira/browse/AIRFLOW-4207

[jira] [Created] (AIRFLOW-4209) Replace imp by importlib

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4209: - Summary: Replace imp by importlib Key: AIRFLOW-4209 URL: https://issues.apache.org/jira/browse/AIRFLOW-4209 Project: Apache Airflow Issue Type: Sub

[jira] [Created] (AIRFLOW-4208) Replace @abstractproperty by @abstractmethod

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4208: - Summary: Replace @abstractproperty by @abstractmethod Key: AIRFLOW-4208 URL: https://issues.apache.org/jira/browse/AIRFLOW-4208 Project: Apache Airflow

[jira] [Created] (AIRFLOW-4206) Remove explicit inheritance of object

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4206: - Summary: Remove explicit inheritance of object Key: AIRFLOW-4206 URL: https://issues.apache.org/jira/browse/AIRFLOW-4206 Project: Apache Airflow Is

[jira] [Created] (AIRFLOW-4205) Uncomment TypeAnnotations

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4205: - Summary: Uncomment TypeAnnotations Key: AIRFLOW-4205 URL: https://issues.apache.org/jira/browse/AIRFLOW-4205 Project: Apache Airflow Issue Type: Su

[jira] [Created] (AIRFLOW-4203) Replace os.path by pathlib (exists since Python 3.5)

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4203: - Summary: Replace os.path by pathlib (exists since Python 3.5) Key: AIRFLOW-4203 URL: https://issues.apache.org/jira/browse/AIRFLOW-4203 Project: Apache Airfl

[jira] [Created] (AIRFLOW-4202) Make setup.py compatible with Python 3 only

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4202: - Summary: Make setup.py compatible with Python 3 only Key: AIRFLOW-4202 URL: https://issues.apache.org/jira/browse/AIRFLOW-4202 Project: Apache Airflow

[jira] [Created] (AIRFLOW-4204) Update Class initialisation

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4204: - Summary: Update Class initialisation Key: AIRFLOW-4204 URL: https://issues.apache.org/jira/browse/AIRFLOW-4204 Project: Apache Airflow Issue Type:

[jira] [Created] (AIRFLOW-4198) Remove all try import py2 version, except import py3 version imports

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4198: - Summary: Remove all try import py2 version, except import py3 version imports Key: AIRFLOW-4198 URL: https://issues.apache.org/jira/browse/AIRFLOW-4198 Proj

[jira] [Created] (AIRFLOW-4197) Remove Python2 CI jobs

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4197: - Summary: Remove Python2 CI jobs Key: AIRFLOW-4197 URL: https://issues.apache.org/jira/browse/AIRFLOW-4197 Project: Apache Airflow Issue Type: Sub-t

[jira] [Created] (AIRFLOW-4201) Replace unicode strings by "normal" strings

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4201: - Summary: Replace unicode strings by "normal" strings Key: AIRFLOW-4201 URL: https://issues.apache.org/jira/browse/AIRFLOW-4201 Project: Apache Airflow

[jira] [Created] (AIRFLOW-4199) Remove all sys.version_info[0] == 3 imports

2019-03-31 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created AIRFLOW-4199: - Summary: Remove all sys.version_info[0] == 3 imports Key: AIRFLOW-4199 URL: https://issues.apache.org/jira/browse/AIRFLOW-4199 Project: Apache Airflow

[GitHub] [airflow] codecov-io commented on issue #5004: [AIRFLOW-4187] SlackWebhookOperator do not pass http_conn_id to its parent class

2019-03-31 Thread GitBox
codecov-io commented on issue #5004: [AIRFLOW-4187] SlackWebhookOperator do not pass http_conn_id to its parent class URL: https://github.com/apache/airflow/pull/5004#issuecomment-478372353 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5004?src=pr&el=h1) Report > Merging [#5004

[jira] [Commented] (AIRFLOW-4014) Add tests for DatastoreHook

2019-03-31 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806238#comment-16806238 ] ASF subversion and git services commented on AIRFLOW-4014: -- Co

[jira] [Resolved] (AIRFLOW-4014) Add tests for DatastoreHook

2019-03-31 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-4014. --- Resolution: Fixed Fix Version/s: 2.0.0 > Add tests for DatastoreHook > -

[jira] [Commented] (AIRFLOW-4014) Add tests for DatastoreHook

2019-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806237#comment-16806237 ] ASF GitHub Bot commented on AIRFLOW-4014: - Fokko commented on pull request #484

[GitHub] [airflow] Fokko merged pull request #4842: [AIRFLOW-4014] Change DatastoreHook and add tests

2019-03-31 Thread GitBox
Fokko merged pull request #4842: [AIRFLOW-4014] Change DatastoreHook and add tests URL: https://github.com/apache/airflow/pull/4842 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] Fokko merged pull request #5008: [AIRFLOW-XXX] Fix typo in README

2019-03-31 Thread GitBox
Fokko merged pull request #5008: [AIRFLOW-XXX] Fix typo in README URL: https://github.com/apache/airflow/pull/5008 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [airflow] codecov-io edited a comment on issue #4821: [AIRFLOW-3998] Use nested commands in cli.

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #4821: [AIRFLOW-3998] Use nested commands in cli. URL: https://github.com/apache/airflow/pull/4821#issuecomment-468981700 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4821?src=pr&el=h1) Report > Merging [#4821](https://codecov.io/gh/apache/

[GitHub] [airflow] codecov-io edited a comment on issue #4821: [AIRFLOW-3998] Use nested commands in cli.

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #4821: [AIRFLOW-3998] Use nested commands in cli. URL: https://github.com/apache/airflow/pull/4821#issuecomment-468981700 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4821?src=pr&el=h1) Report > Merging [#4821](https://codecov.io/gh/apache/

[GitHub] [airflow] codecov-io edited a comment on issue #4821: [AIRFLOW-3998] Use nested commands in cli.

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #4821: [AIRFLOW-3998] Use nested commands in cli. URL: https://github.com/apache/airflow/pull/4821#issuecomment-468981700 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4821?src=pr&el=h1) Report > Merging [#4821](https://codecov.io/gh/apache/

[GitHub] [airflow] codecov-io edited a comment on issue #4861: [AIRFLOW-4034] Make string formatting explicit by removing **locals()

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #4861: [AIRFLOW-4034] Make string formatting explicit by removing **locals() URL: https://github.com/apache/airflow/pull/4861#issuecomment-478360669 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4861?src=pr&el=h1) Report > Merging [#4861](ht

[GitHub] [airflow] codecov-io commented on issue #4861: [AIRFLOW-4034] Make string formatting explicit by removing **locals()

2019-03-31 Thread GitBox
codecov-io commented on issue #4861: [AIRFLOW-4034] Make string formatting explicit by removing **locals() URL: https://github.com/apache/airflow/pull/4861#issuecomment-478360669 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4861?src=pr&el=h1) Report > Merging [#4861](https://c

[jira] [Commented] (AIRFLOW-4172) Invalid parameter --driver-classpath in SparkSubmitHook

2019-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806199#comment-16806199 ] ASF GitHub Bot commented on AIRFLOW-4172: - Fokko commented on pull request #499

[jira] [Updated] (AIRFLOW-4172) Invalid parameter --driver-classpath in SparkSubmitHook

2019-03-31 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4172: -- Fix Version/s: (was: 1.10.0) 2.0.0 > Invalid parameter --drive

[jira] [Resolved] (AIRFLOW-4172) Invalid parameter --driver-classpath in SparkSubmitHook

2019-03-31 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-4172. --- Resolution: Fixed > Invalid parameter --driver-classpath in SparkSubmitHook > -

[jira] [Commented] (AIRFLOW-4172) Invalid parameter --driver-classpath in SparkSubmitHook

2019-03-31 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806200#comment-16806200 ] ASF subversion and git services commented on AIRFLOW-4172: -- Co

[jira] [Commented] (AIRFLOW-4172) Invalid parameter --driver-classpath in SparkSubmitHook

2019-03-31 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806202#comment-16806202 ] ASF subversion and git services commented on AIRFLOW-4172: -- Co

[jira] [Commented] (AIRFLOW-4172) Invalid parameter --driver-classpath in SparkSubmitHook

2019-03-31 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806201#comment-16806201 ] ASF subversion and git services commented on AIRFLOW-4172: -- Co

[GitHub] [airflow] Fokko merged pull request #4992: [AIRFLOW-4172] Fix changes for driver class path option in Spark Subm…

2019-03-31 Thread GitBox
Fokko merged pull request #4992: [AIRFLOW-4172] Fix changes for driver class path option in Spark Subm… URL: https://github.com/apache/airflow/pull/4992 This is an automated message from the Apache Git Service. To respond to

[jira] [Updated] (AIRFLOW-4193) Remove code duplication in test_gcp_api_base_hook

2019-03-31 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-4193: -- Fix Version/s: 2.0.0 > Remove code duplication in test_gcp_api_base_hook > --

[GitHub] [airflow] BasPH commented on issue #5010: [AIRFLOW-4192] Reorganize task context variables

2019-03-31 Thread GitBox
BasPH commented on issue #5010: [AIRFLOW-4192] Reorganize task context variables URL: https://github.com/apache/airflow/pull/5010#issuecomment-478358376 @Fokko after the last push 1 task failed, which succeeded before, can you rerun that one? ---

[GitHub] [airflow] BasPH commented on issue #5010: [AIRFLOW-4192] Reorganize task context variables

2019-03-31 Thread GitBox
BasPH commented on issue #5010: [AIRFLOW-4192] Reorganize task context variables URL: https://github.com/apache/airflow/pull/5010#issuecomment-478358280 @Fokko `yesterday_ds` is removed and `next_execution_date` is still in there, were on the same page then 🙂 --

[GitHub] [airflow] Fokko commented on issue #4861: [AIRFLOW-4034] Make string formatting explicit by removing **locals()

2019-03-31 Thread GitBox
Fokko commented on issue #4861: [AIRFLOW-4034] Make string formatting explicit by removing **locals() URL: https://github.com/apache/airflow/pull/4861#issuecomment-478358175 Restarted the job! Let's see. This is an automated

[jira] [Work started] (AIRFLOW-4193) Remove code duplication in test_gcp_api_base_hook

2019-03-31 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-4193 started by Fokko Driesprong. - > Remove code duplication in test_gcp_api_base_hook > --

[jira] [Commented] (AIRFLOW-4193) Remove code duplication in test_gcp_api_base_hook

2019-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806190#comment-16806190 ] ASF GitHub Bot commented on AIRFLOW-4193: - Fokko commented on pull request #501

[jira] [Commented] (AIRFLOW-4193) Remove code duplication in test_gcp_api_base_hook

2019-03-31 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806191#comment-16806191 ] ASF subversion and git services commented on AIRFLOW-4193: -- Co

[jira] [Assigned] (AIRFLOW-4193) Remove code duplication in test_gcp_api_base_hook

2019-03-31 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong reassigned AIRFLOW-4193: - Assignee: Bas Harenslak > Remove code duplication in test_gcp_api_base_hook >

[jira] [Resolved] (AIRFLOW-4193) Remove code duplication in test_gcp_api_base_hook

2019-03-31 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-4193. --- Resolution: Fixed > Remove code duplication in test_gcp_api_base_hook > ---

[GitHub] [airflow] Fokko merged pull request #5011: [AIRFLOW-4193] Remove code duplication in test_gcp_api_base_hook

2019-03-31 Thread GitBox
Fokko merged pull request #5011: [AIRFLOW-4193] Remove code duplication in test_gcp_api_base_hook URL: https://github.com/apache/airflow/pull/5011 This is an automated message from the Apache Git Service. To respond to the m

[jira] [Updated] (AIRFLOW-3458) Refactor: Move Connection out of models.py

2019-03-31 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-3458: -- Fix Version/s: (was: 1.10.3) 2.0.0 > Refactor: Move Connection

[GitHub] [airflow] Fokko commented on issue #5013: [AIRFLOW-XXX] Omit vendor packages and example dags from being covered by codecov

2019-03-31 Thread GitBox
Fokko commented on issue #5013: [AIRFLOW-XXX] Omit vendor packages and example dags from being covered by codecov URL: https://github.com/apache/airflow/pull/5013#issuecomment-478357601 I know that (at least some) DAGs are used in the tests, but having coverage would be nice here. I'm not

[jira] [Commented] (AIRFLOW-3458) Refactor: Move Connection out of models.py

2019-03-31 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806186#comment-16806186 ] Fokko Driesprong commented on AIRFLOW-3458: --- [~ash] Do you want to cherry-pic

[jira] [Commented] (AIRFLOW-3458) Refactor: Move Connection out of models.py

2019-03-31 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806185#comment-16806185 ] ASF subversion and git services commented on AIRFLOW-3458: -- Co

[jira] [Commented] (AIRFLOW-3458) Refactor: Move Connection out of models.py

2019-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806184#comment-16806184 ] ASF GitHub Bot commented on AIRFLOW-3458: - Fokko commented on pull request #468

[GitHub] [airflow] Fokko merged pull request #4680: [AIRFLOW-3458] Move connection tests

2019-03-31 Thread GitBox
Fokko merged pull request #4680: [AIRFLOW-3458] Move connection tests URL: https://github.com/apache/airflow/pull/4680 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [airflow] Fokko edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables

2019-03-31 Thread GitBox
Fokko edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables URL: https://github.com/apache/airflow/pull/5010#issuecomment-478356870 Thanks for working on this @BasPH I believe that `yesterday_ds` does not make sense since we cannot assume that the schedu

[GitHub] [airflow] Fokko commented on issue #5010: [AIRFLOW-4192] Reorganize task context variables

2019-03-31 Thread GitBox
Fokko commented on issue #5010: [AIRFLOW-4192] Reorganize task context variables URL: https://github.com/apache/airflow/pull/5010#issuecomment-478356870 Thanks for working on thie @BasPH I believe that `yesterday_ds` does not make sense since we cannot assume that the schedule is da

[GitHub] [airflow] codecov-io edited a comment on issue #4821: [AIRFLOW-3998] Use nested commands in cli.

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #4821: [AIRFLOW-3998] Use nested commands in cli. URL: https://github.com/apache/airflow/pull/4821#issuecomment-468981700 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4821?src=pr&el=h1) Report > Merging [#4821](https://codecov.io/gh/apache/

[GitHub] [airflow] codecov-io edited a comment on issue #4821: [AIRFLOW-3998] Use nested commands in cli.

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #4821: [AIRFLOW-3998] Use nested commands in cli. URL: https://github.com/apache/airflow/pull/4821#issuecomment-468981700 # [Codecov](https://codecov.io/gh/apache/airflow/pull/4821?src=pr&el=h1) Report > Merging [#4821](https://codecov.io/gh/apache/

[GitHub] [airflow] BasPH commented on issue #4680: [AIRFLOW-3458] Move connection tests

2019-03-31 Thread GitBox
BasPH commented on issue #4680: [AIRFLOW-3458] Move connection tests URL: https://github.com/apache/airflow/pull/4680#issuecomment-478352824 Finally managed to find some time. One failing test has been removed in the meantime, now the CI is nice and green :) --

[GitHub] [airflow] codecov-io edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables URL: https://github.com/apache/airflow/pull/5010#issuecomment-478295602 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5010?src=pr&el=h1) Report > Merging [#5010](https://codecov.io/gh/a

[GitHub] [airflow] codecov-io edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables URL: https://github.com/apache/airflow/pull/5010#issuecomment-478295602 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5010?src=pr&el=h1) Report > Merging [#5010](https://codecov.io/gh/a

[GitHub] [airflow] codecov-io edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables URL: https://github.com/apache/airflow/pull/5010#issuecomment-478295602 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5010?src=pr&el=h1) Report > Merging [#5010](https://codecov.io/gh/a

[GitHub] [airflow] codecov-io edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables

2019-03-31 Thread GitBox
codecov-io edited a comment on issue #5010: [AIRFLOW-4192] Reorganize task context variables URL: https://github.com/apache/airflow/pull/5010#issuecomment-478295602 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5010?src=pr&el=h1) Report > Merging [#5010](https://codecov.io/gh/a

  1   2   >