[jira] [Updated] (AIRFLOW-4588) Add GoogleDiscoveryApiHook and GoogleApiToS3Transfer

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-4588: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Add

[jira] [Updated] (AIRFLOW-4509) SubDagOperator using scheduler instead of backfill

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-4509: --- Fix Version/s: (was: 1.10.6) 2.0.0 > SubDagOperator using

[jira] [Updated] (AIRFLOW-5052) Add the include_deleted parameter to Salesforce Hook

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5052: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Add the

[jira] [Updated] (AIRFLOW-5399) Add invoke operator for GCP Functions

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5399: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Add invoke operator

[jira] [Updated] (AIRFLOW-5353) Simplify GKEClusterHook

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5353: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Simplify

[jira] [Updated] (AIRFLOW-5114) TypeError when running S3ToGoogleCloudStorageTransferOperator or GoogleCloudStorageToGoogleCloudStorageTransferOperator with default arguments

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5114: --- Fix Version/s: (was: 1.10.6) 2.0.0 > TypeError when running

[jira] [Updated] (AIRFLOW-5479) Normalize get_conn method in GCP Kubernetes hook

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5479: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Normalize get_conn

[jira] [Updated] (AIRFLOW-5330) Add project_id to Datastore hook and operators

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5330: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Add project_id to

[jira] [Updated] (AIRFLOW-5468) Fix PubSub system test class name

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5468: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Fix PubSub system test

[jira] [Updated] (AIRFLOW-5599) Imporve Python 3 support in MLEngine integration

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5599: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Imporve Python 3

[jira] [Updated] (AIRFLOW-5426) Adjust import path in Dataproc example

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5426: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Adjust import path in

[jira] [Updated] (AIRFLOW-5598) Improve MLEngine typehint

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5598: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Improve MLEngine

[jira] [Updated] (AIRFLOW-5446) Rewrite Google KMS Hook with Google Api Client

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5446: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Rewrite Google KMS

[jira] [Updated] (AIRFLOW-5464) Fix GCP Memorystore example DAG

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5464: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Fix GCP Memorystore

[jira] [Updated] (AIRFLOW-5135) Use gapic ClientInfo in GoogleCloudBaseHook

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5135: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Use gapic ClientInfo

[jira] [Updated] (AIRFLOW-5289) Make `body` parameter templated for all gcp operators

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5289: --- Fix Version/s: (was: 1.10.6) > Make `body` parameter templated for all gcp

[jira] [Commented] (AIRFLOW-5126) Read aws_session_token in extra_config of the aws hook

2019-10-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952916#comment-16952916 ] ASF GitHub Bot commented on AIRFLOW-5126: - ashb commented on pull request #6303: AIRFLOW-5126

[GitHub] [airflow] ashb merged pull request #6303: AIRFLOW-5126 Read aws_session_token in extra_config of the aws hook

2019-10-16 Thread GitBox
ashb merged pull request #6303: AIRFLOW-5126 Read aws_session_token in extra_config of the aws hook URL: https://github.com/apache/airflow/pull/6303 This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] louisguitton commented on issue #6313: [AIRFLOW-5643] Reduce duplicated logic in S3Hook

2019-10-16 Thread GitBox
louisguitton commented on issue #6313: [AIRFLOW-5643] Reduce duplicated logic in S3Hook URL: https://github.com/apache/airflow/pull/6313#issuecomment-542755216 > If those are the kubernetes ones - maybe merge it without waiting. We have found with @gerardo a reason why kubernetes tests

[jira] [Updated] (AIRFLOW-5620) Typo in FAQ

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5620: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Typo in FAQ >

[GitHub] [airflow] mik-laj commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme

2019-10-16 Thread GitBox
mik-laj commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme URL: https://github.com/apache/airflow/pull/6349#issuecomment-542760284 We also have brandbook: https://cwiki.apache.org/confluence/display/AIRFLOW/Brandbook

[jira] [Updated] (AIRFLOW-5130) Use GOOGLE_APPLICATION_CREDENTIALS constant from library

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5130: --- Fix Version/s: (was: 2.0.0) 1.10.6 > Use

[jira] [Updated] (AIRFLOW-5126) Read aws_session_token in extra_config of the aws hook

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5126: --- Fix Version/s: 1.10.6 > Read aws_session_token in extra_config of the aws hook >

[jira] [Updated] (AIRFLOW-5585) Docker-context file check gives only marginal improvements for build

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5585: --- Fix Version/s: (was: 2.0.0) 1.10.6 > Docker-context file

[GitHub] [airflow] leahecole commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme

2019-10-16 Thread GitBox
leahecole commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme URL: https://github.com/apache/airflow/pull/6349#issuecomment-542762236 I can add a link to that in this PR also, or would it be better to open a separate PR @mik-laj? > We also have brandbook:

[jira] [Resolved] (AIRFLOW-5497) dag_processing::list_py_file_paths method pydoc needs param added

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5497. Fix Version/s: 1.10.6 Resolution: Done >

[jira] [Updated] (AIRFLOW-4928) Remove redundant config parsing in DagBag

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-4928: --- Fix Version/s: (was: 2.0.0) 1.10.6 > Remove redundant

[GitHub] [airflow] mik-laj commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme

2019-10-16 Thread GitBox
mik-laj commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme URL: https://github.com/apache/airflow/pull/6349#issuecomment-542766326 In this PR it is okay for me This is an automated message from the Apache Git

[GitHub] [airflow] ashb commented on a change in pull request #6336: [AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking

2019-10-16 Thread GitBox
ashb commented on a change in pull request #6336: [AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking URL: https://github.com/apache/airflow/pull/6336#discussion_r335560715 ## File path: airflow/sensors/sql_sensor.py ## @@ -103,5 +103,5 @@ def

[jira] [Reopened] (AIRFLOW-5468) Fix PubSub system test class name

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5468: > Fix PubSub system test class name > - > >

[jira] [Reopened] (AIRFLOW-5465) Fix deprecated imports in examples

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5465: > Fix deprecated imports in examples > -- > >

[jira] [Resolved] (AIRFLOW-4983) DataflowPythonOperator should be able to submit pipelines with python3

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-4983. Resolution: Done > DataflowPythonOperator should be able to submit pipelines

[jira] [Resolved] (AIRFLOW-5446) Rewrite Google KMS Hook with Google Api Client

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5446. Resolution: Done > Rewrite Google KMS Hook with Google Api Client >

[jira] [Resolved] (AIRFLOW-5515) Add stacklevel to GCP deprecation warnings

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5515. Resolution: Done > Add stacklevel to GCP deprecation warnings >

[jira] [Resolved] (AIRFLOW-5599) Imporve Python 3 support in MLEngine integration

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5599. Resolution: Done > Imporve Python 3 support in MLEngine integration >

[jira] [Resolved] (AIRFLOW-5330) Add project_id to Datastore hook and operators

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5330. Resolution: Done > Add project_id to Datastore hook and operators >

[jira] [Reopened] (AIRFLOW-5515) Add stacklevel to GCP deprecation warnings

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5515: > Add stacklevel to GCP deprecation warnings >

[jira] [Resolved] (AIRFLOW-5479) Normalize get_conn method in GCP Kubernetes hook

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5479. Resolution: Done > Normalize get_conn method in GCP Kubernetes hook >

[jira] [Reopened] (AIRFLOW-5479) Normalize get_conn method in GCP Kubernetes hook

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5479: > Normalize get_conn method in GCP Kubernetes hook >

[jira] [Reopened] (AIRFLOW-5330) Add project_id to Datastore hook and operators

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5330: > Add project_id to Datastore hook and operators >

[jira] [Resolved] (AIRFLOW-5426) Adjust import path in Dataproc example

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5426. Resolution: Done > Adjust import path in Dataproc example >

[jira] [Reopened] (AIRFLOW-5114) TypeError when running S3ToGoogleCloudStorageTransferOperator or GoogleCloudStorageToGoogleCloudStorageTransferOperator with default arguments

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5114: > TypeError when running S3ToGoogleCloudStorageTransferOperator or >

[jira] [Reopened] (AIRFLOW-4983) DataflowPythonOperator should be able to submit pipelines with python3

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-4983: > DataflowPythonOperator should be able to submit pipelines with python3 >

[jira] [Reopened] (AIRFLOW-5446) Rewrite Google KMS Hook with Google Api Client

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5446: > Rewrite Google KMS Hook with Google Api Client >

[jira] [Resolved] (AIRFLOW-5468) Fix PubSub system test class name

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5468. Resolution: Done > Fix PubSub system test class name >

[jira] [Resolved] (AIRFLOW-5114) TypeError when running S3ToGoogleCloudStorageTransferOperator or GoogleCloudStorageToGoogleCloudStorageTransferOperator with default arguments

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5114. Resolution: Done > TypeError when running S3ToGoogleCloudStorageTransferOperator

[jira] [Resolved] (AIRFLOW-5353) Simplify GKEClusterHook

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5353. Resolution: Done > Simplify GKEClusterHook > --- > >

[jira] [Reopened] (AIRFLOW-5399) Add invoke operator for GCP Functions

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5399: > Add invoke operator for GCP Functions > - > >

[jira] [Reopened] (AIRFLOW-5353) Simplify GKEClusterHook

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5353: > Simplify GKEClusterHook > --- > > Key:

[jira] [Resolved] (AIRFLOW-5303) Use project_id from GCP credentials

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5303. Resolution: Done > Use project_id from GCP credentials >

[jira] [Reopened] (AIRFLOW-5464) Fix GCP Memorystore example DAG

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5464: > Fix GCP Memorystore example DAG > --- > >

[jira] [Resolved] (AIRFLOW-5464) Fix GCP Memorystore example DAG

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5464. Resolution: Done > Fix GCP Memorystore example DAG >

[jira] [Reopened] (AIRFLOW-5303) Use project_id from GCP credentials

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5303: > Use project_id from GCP credentials > --- > >

[jira] [Reopened] (AIRFLOW-5426) Adjust import path in Dataproc example

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5426: > Adjust import path in Dataproc example > -- >

[jira] [Reopened] (AIRFLOW-5599) Imporve Python 3 support in MLEngine integration

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5599: > Imporve Python 3 support in MLEngine integration >

[jira] [Updated] (AIRFLOW-5515) Add stacklevel to GCP deprecation warnings

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5515: --- Fix Version/s: (was: 1.10.6) 2.0.0 > Add stacklevel to GCP

[jira] [Resolved] (AIRFLOW-5465) Fix deprecated imports in examples

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5465. Resolution: Done > Fix deprecated imports in examples >

[jira] [Resolved] (AIRFLOW-5598) Improve MLEngine typehint

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5598. Resolution: Done > Improve MLEngine typehint > - > >

[jira] [Commented] (AIRFLOW-5126) Read aws_session_token in extra_config of the aws hook

2019-10-16 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952917#comment-16952917 ] ASF subversion and git services commented on AIRFLOW-5126: -- Commit

[GitHub] [airflow] mik-laj commented on issue #6333: [AIRFLOW-5656] Rename provider to providers module

2019-10-16 Thread GitBox
mik-laj commented on issue #6333: [AIRFLOW-5656] Rename provider to providers module URL: https://github.com/apache/airflow/pull/6333#issuecomment-542760786 I restarted tests. This is an automated message from the Apache Git

[GitHub] [airflow] mik-laj commented on issue #6259: [AIRFLOW-XXX] Example for BigQuery to BigQuery operator

2019-10-16 Thread GitBox
mik-laj commented on issue #6259: [AIRFLOW-XXX] Example for BigQuery to BigQuery operator URL: https://github.com/apache/airflow/pull/6259#issuecomment-542762709 Personally, I would prefer all examples for GCP to have system tests

[GitHub] [airflow] ashb commented on a change in pull request #6336: [AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking

2019-10-16 Thread GitBox
ashb commented on a change in pull request #6336: [AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking URL: https://github.com/apache/airflow/pull/6336#discussion_r335561348 ## File path: airflow/sensors/sql_sensor.py ## @@ -103,5 +103,5 @@ def

[GitHub] [airflow] mik-laj commented on issue #6259: [AIRFLOW-XXX] Example for BigQuery to BigQuery operator

2019-10-16 Thread GitBox
mik-laj commented on issue #6259: [AIRFLOW-XXX] Example for BigQuery to BigQuery operator URL: https://github.com/apache/airflow/pull/6259#issuecomment-542773786 This change must also have a ticket https://github.com/apache/airflow/pull/6227#issuecomment-537105167

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335593800 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[jira] [Commented] (AIRFLOW-5683) Add SubDagOperator that propagates skipped state

2019-10-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953115#comment-16953115 ] ASF GitHub Bot commented on AIRFLOW-5683: - feluelle commented on pull request #6352:

[GitHub] [airflow] feluelle opened a new pull request #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle opened a new pull request #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352 ### Jira - https://issues.apache.org/jira/browse/AIRFLOW-5683 ### Description - [x] Here are some details

[GitHub] [airflow] mik-laj commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
mik-laj commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542858230 https://user-images.githubusercontent.com/12058428/66952258-904af600-f05c-11e9-9f62-cf7f74992a52.png;> Currently, this

[GitHub] [airflow] potiuk opened a new pull request #6353: [AIRFLOW-5684] docker-compose-kubernetes still used

2019-10-16 Thread GitBox
potiuk opened a new pull request #6353: [AIRFLOW-5684] docker-compose-kubernetes still used URL: https://github.com/apache/airflow/pull/6353 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5684) Docker-compose-kubernetes still used by breeze

2019-10-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953148#comment-16953148 ] ASF GitHub Bot commented on AIRFLOW-5684: - potiuk commented on pull request #6353:

[GitHub] [airflow] KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-16 Thread GitBox
KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r335692036 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,183 @@ + .. Licensed

[GitHub] [airflow] milton0825 commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-16 Thread GitBox
milton0825 commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r335609229 ## File path: docs/howto/enable-dag-serialization.rst ## @@ -0,0

[jira] [Created] (AIRFLOW-5682) Add support for labels in gcs_to_bq operator

2019-10-16 Thread Lyall Cooper (Jira)
Lyall Cooper created AIRFLOW-5682: - Summary: Add support for labels in gcs_to_bq operator Key: AIRFLOW-5682 URL: https://issues.apache.org/jira/browse/AIRFLOW-5682 Project: Apache Airflow

[jira] [Created] (AIRFLOW-5683) Add SubDagOperator that propagates skipped state

2019-10-16 Thread Felix Uellendall (Jira)
Felix Uellendall created AIRFLOW-5683: - Summary: Add SubDagOperator that propagates skipped state Key: AIRFLOW-5683 URL: https://issues.apache.org/jira/browse/AIRFLOW-5683 Project: Apache Airflow

[GitHub] [airflow] lyallcooper edited a comment on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
lyallcooper edited a comment on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542853862 @mik-laj sorry, I don't seem to have access to that google doc.

[GitHub] [airflow] TobKed commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
TobKed commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542873791 1. @mik-laj is right, it will be good idea to set default label to something like: ``` from airflow.version import version as

[GitHub] [airflow] feluelle commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542878228 > How about we check whether any of the leaf nodes in the subdag is `skipped` and propagate that to parent DAG so

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335593800 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[GitHub] [airflow] houqp commented on a change in pull request #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric

2019-10-16 Thread GitBox
houqp commented on a change in pull request #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric URL: https://github.com/apache/airflow/pull/6342#discussion_r335617211 ## File path: airflow/models/pool.py ## @@ -107,3 +109,33 @@ def open_slots(self,

[GitHub] [airflow] feluelle commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-16 Thread GitBox
feluelle commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#discussion_r335623587 ## File path: BREEZE.rst ## @@ -46,409 +46,586 @@ Here is the short 10 minute video about

[GitHub] [airflow] feluelle commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-16 Thread GitBox
feluelle commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#discussion_r335623735 ## File path: BREEZE.rst ## @@ -474,214 +651,220 @@ Run pylint checks for all files:

[GitHub] [airflow] feluelle commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-16 Thread GitBox
feluelle commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#discussion_r335624250 ## File path: BREEZE.rst ## @@ -46,409 +46,586 @@ Here is the short 10 minute video about

[GitHub] [airflow] mik-laj commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-16 Thread GitBox
mik-laj commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r335653352 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,183 @@ + .. Licensed

[GitHub] [airflow] lyallcooper commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
lyallcooper commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542855432 Also it seems the other BQ-related operators that support labels don't pass in the Airflow version as a default label.

[GitHub] [airflow] milton0825 commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
milton0825 commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542870443 > Currently there is no way of telling the parent dag of a sub dag that an essential task has been skipped.

[jira] [Updated] (AIRFLOW-5643) S3Hook logic is duplicated and could be clearer

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5643: --- Fix Version/s: (was: 2.0.0) 1.10.7 > S3Hook logic is

[GitHub] [airflow] mik-laj commented on issue #6341: Updated airflow

2019-10-16 Thread GitBox
mik-laj commented on issue #6341: Updated airflow URL: https://github.com/apache/airflow/pull/6341#issuecomment-542872654 Can you tell a little more about this change? This is an automated message from the Apache Git Service.

[GitHub] [airflow] feluelle edited a comment on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle edited a comment on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542871719 > > > > Currently there is no way of telling the parent dag of a sub dag that an essential task

[GitHub] [airflow] feluelle edited a comment on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle edited a comment on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542874196 Yes, (we only need to do it for the `skipped` state, because other states like success or failed propagate

[GitHub] [airflow] feluelle commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542874196 Yes, (we only need to do it for the `skipped` state, because other states like success or failed propagate

[GitHub] [airflow] mik-laj commented on issue #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-16 Thread GitBox
mik-laj commented on issue #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#issuecomment-542900700 @feluelle I have twin brother ;-D higrys is a nickname. https://twitter.com/higrys

[GitHub] [airflow] feluelle commented on issue #5997: [AIRFLOW-5396] - Add button Auto Refresh

2019-10-16 Thread GitBox
feluelle commented on issue #5997: [AIRFLOW-5396] - Add button Auto Refresh URL: https://github.com/apache/airflow/pull/5997#issuecomment-542819898 @LucasMMota are you still working on that change? :) This is an automated

[GitHub] [airflow] mik-laj commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-16 Thread GitBox
mik-laj commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r335651696 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,183 @@ + .. Licensed

[jira] [Commented] (AIRFLOW-5664) postgres_to_gcs operator drops milliseconds from timestamps

2019-10-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953215#comment-16953215 ] ASF GitHub Bot commented on AIRFLOW-5664: - osule commented on pull request #6354:

[GitHub] [airflow] osule opened a new pull request #6354: [AIRFLOW-5664] Store timestamps with microseconds precision

2019-10-16 Thread GitBox
osule opened a new pull request #6354: [AIRFLOW-5664] Store timestamps with microseconds precision URL: https://github.com/apache/airflow/pull/6354 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Work started] (AIRFLOW-5683) Add SubDagOperator that propagates skipped state

2019-10-16 Thread Felix Uellendall (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5683 started by Felix Uellendall. - > Add SubDagOperator that propagates skipped state >

[GitHub] [airflow] mik-laj commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-16 Thread GitBox
mik-laj commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r335651246 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,177 @@ + .. Licensed

[GitHub] [airflow] lyallcooper opened a new pull request #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
lyallcooper opened a new pull request #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5682) Add support for labels in gcs_to_bq operator

2019-10-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953111#comment-16953111 ] ASF GitHub Bot commented on AIRFLOW-5682: - lyallcooper commented on pull request #6351:

[GitHub] [airflow] RosterIn commented on a change in pull request #5694: [AIRFLOW-5082] add subject in aws sns hook

2019-10-16 Thread GitBox
RosterIn commented on a change in pull request #5694: [AIRFLOW-5082] add subject in aws sns hook URL: https://github.com/apache/airflow/pull/5694#discussion_r335727498 ## File path: tests/contrib/hooks/test_aws_sns_hook.py ## @@ -42,9 +42,10 @@ def

[GitHub] [airflow] mik-laj commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
mik-laj commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542845497 According to the integration guide, you should also add default labels with the Airflow version

  1   2   3   >