[GitHub] [airflow] ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r336408642 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,185 @@ + .. Licensed to

[GitHub] [airflow] ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r336410072 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,185 @@ + .. Licensed to

[jira] [Commented] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.

2019-10-18 Thread Aaron Fowles (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954516#comment-16954516 ] Aaron Fowles commented on AIRFLOW-: --- Hi Tobiasz, what you already have is farther ahead than

[jira] [Commented] (AIRFLOW-5640) BaseOperator email parameter is wrongly typed and not documented

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954614#comment-16954614 ] ASF GitHub Bot commented on AIRFLOW-5640: - ashb commented on pull request #6315: [AIRFLOW-5640]

[jira] [Commented] (AIRFLOW-5640) BaseOperator email parameter is wrongly typed and not documented

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954619#comment-16954619 ] ASF subversion and git services commented on AIRFLOW-5640: -- Commit

[jira] [Updated] (AIRFLOW-5689) Side-Input in Python3 fails to pickle class

2019-10-18 Thread Jannik Franz (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jannik Franz updated AIRFLOW-5689: -- Description: When running Apache Beam with Python3 on Google Cloud Dataflow Sideinputs don't

[jira] [Resolved] (AIRFLOW-5640) BaseOperator email parameter is wrongly typed and not documented

2019-10-18 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5640. Fix Version/s: 1.10.7 Resolution: Fixed > BaseOperator email parameter is

[GitHub] [airflow] Fokko commented on a change in pull request #6317: [AIRFLOW-5644] Simplify TriggerDagRunOperator usage

2019-10-18 Thread GitBox
Fokko commented on a change in pull request #6317: [AIRFLOW-5644] Simplify TriggerDagRunOperator usage URL: https://github.com/apache/airflow/pull/6317#discussion_r336513331 ## File path: airflow/operators/dagrun_operator.py ## @@ -75,24 +63,21 @@ def __init__(

[jira] [Commented] (AIRFLOW-5687) Upgrade pip to 19.0.2

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954399#comment-16954399 ] ASF GitHub Bot commented on AIRFLOW-5687: - ashb commented on pull request #6361: [AIRFLOW-5687]

[GitHub] [airflow] ashb merged pull request #6361: [AIRFLOW-5687] Use PEP517 while installing Airflow

2019-10-18 Thread GitBox
ashb merged pull request #6361: [AIRFLOW-5687] Use PEP517 while installing Airflow URL: https://github.com/apache/airflow/pull/6361 This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Commented] (AIRFLOW-5649) Skipping tests for non relevant changes

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954404#comment-16954404 ] ASF subversion and git services commented on AIRFLOW-5649: -- Commit

[jira] [Commented] (AIRFLOW-5687) Upgrade pip to 19.0.2

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954423#comment-16954423 ] ASF subversion and git services commented on AIRFLOW-5687: -- Commit

[GitHub] [airflow] Fokko commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-18 Thread GitBox
Fokko commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r336335699 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed to

[GitHub] [airflow] milton0825 merged pull request #5942: [AIRFLOW-5339] Fix infinite wait for Spark subprocess

2019-10-18 Thread GitBox
milton0825 merged pull request #5942: [AIRFLOW-5339] Fix infinite wait for Spark subprocess URL: https://github.com/apache/airflow/pull/5942 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] potiuk merged pull request #6321: [AIRFLOW-5649] Skips some tests for non relevant changes

2019-10-18 Thread GitBox
potiuk merged pull request #6321: [AIRFLOW-5649] Skips some tests for non relevant changes URL: https://github.com/apache/airflow/pull/6321 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] ashb commented on a change in pull request #6362: [AIRFLOW-5688] Merge alembic migrations

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6362: [AIRFLOW-5688] Merge alembic migrations URL: https://github.com/apache/airflow/pull/6362#discussion_r336382873 ## File path: airflow/migrations/versions/b0125267960b_merge_004c1210f153_and_74effc47d867.py ## @@ -24,9

[GitHub] [airflow] KKcorps edited a comment on issue #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-18 Thread GitBox
KKcorps edited a comment on issue #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#issuecomment-543607897 @mik-laj @jaketf The documentation needs to be included in this PR only, right? Also, @mik-laj where should I place this doc, inside howto

[GitHub] [airflow] KKcorps commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-18 Thread GitBox
KKcorps commented on issue #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#issuecomment-543607897 @mik-laj @jaketf The documentation needs to be included in this PR only, right? This

[jira] [Resolved] (AIRFLOW-5574) Google Analytics script could not be loaded

2019-10-18 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5574. Fix Version/s: 1.10.6 Resolution: Fixed > Google Analytics script could

[jira] [Resolved] (AIRFLOW-5224) gcs_to_bq.GoogleCloudStorageToBigQueryOperator - Specify Encoding for BQ ingestion

2019-10-18 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5224. Fix Version/s: 1.10.7 Resolution: Fixed >

[GitHub] [airflow] ryanyuan commented on issue #6355: [AIRFLOW-5685] Loading AVRO file from GCS to BQ throwing ValueError

2019-10-18 Thread GitBox
ryanyuan commented on issue #6355: [AIRFLOW-5685] Loading AVRO file from GCS to BQ throwing ValueError URL: https://github.com/apache/airflow/pull/6355#issuecomment-543528998 > If there is an error and test passed when support for AVRO was added then something is missing in the test isn't

[jira] [Created] (AIRFLOW-5688) Merge alembic migrations

2019-10-18 Thread Fokko Driesprong (Jira)
Fokko Driesprong created AIRFLOW-5688: - Summary: Merge alembic migrations Key: AIRFLOW-5688 URL: https://issues.apache.org/jira/browse/AIRFLOW-5688 Project: Apache Airflow Issue Type:

[GitHub] [airflow] KKcorps commented on issue #6295: [AIRFLOW-XXX] GSoD: Adding Task re-run documentation

2019-10-18 Thread GitBox
KKcorps commented on issue #6295: [AIRFLOW-XXX] GSoD: Adding Task re-run documentation URL: https://github.com/apache/airflow/pull/6295#issuecomment-543624922 @ashb Preview Links for the PR: http://airflow.kharekartik.surge.sh/dag-run.html

[jira] [Commented] (AIRFLOW-4574) Add SSHHook private key parameter pkey

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954435#comment-16954435 ] ASF subversion and git services commented on AIRFLOW-4574: -- Commit

[jira] [Commented] (AIRFLOW-4574) Add SSHHook private key parameter pkey

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954434#comment-16954434 ] ASF GitHub Bot commented on AIRFLOW-4574: - ashb commented on pull request #6163: [AIRFLOW-4574]

[jira] [Commented] (AIRFLOW-5649) Skipping tests for non relevant changes

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954403#comment-16954403 ] ASF GitHub Bot commented on AIRFLOW-5649: - potiuk commented on pull request #6321:

[jira] [Resolved] (AIRFLOW-5339) Wait forever spark hook if python version is 3

2019-10-18 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5339. Fix Version/s: 1.10.7 Resolution: Fixed > Wait forever spark hook if

[GitHub] [airflow] ashb commented on issue #5942: [AIRFLOW-5339] Fix infinite wait for Spark subprocess

2019-10-18 Thread GitBox
ashb commented on issue #5942: [AIRFLOW-5339] Fix infinite wait for Spark subprocess URL: https://github.com/apache/airflow/pull/5942#issuecomment-543618794 @milton0825 When you merge a PR can you please also Reslove the Jira and set the FixVersion appropriately (to 2.0.0 if the change is

[GitHub] [airflow] potiuk commented on issue #6321: [AIRFLOW-5649] Skips some tests for non relevant changes

2019-10-18 Thread GitBox
potiuk commented on issue #6321: [AIRFLOW-5649] Skips some tests for non relevant changes URL: https://github.com/apache/airflow/pull/6321#issuecomment-543567131 The last change reverses the behaviour of direct pushes. As discussed in Slack it will be better to always run all the tests

[jira] [Commented] (AIRFLOW-5687) Upgrade pip to 19.0.2

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954400#comment-16954400 ] ASF subversion and git services commented on AIRFLOW-5687: -- Commit

[jira] [Resolved] (AIRFLOW-5434) Use hook to provide credentials in GKEPodOperator

2019-10-18 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5434. Fix Version/s: 2.0.0 Resolution: Fixed Marking this for targeting 2.0 as

[GitHub] [airflow] ashb commented on issue #5942: [AIRFLOW-5339] Fix infinite wait for Spark subprocess

2019-10-18 Thread GitBox
ashb commented on issue #5942: [AIRFLOW-5339] Fix infinite wait for Spark subprocess URL: https://github.com/apache/airflow/pull/5942#issuecomment-543609890 Anyone know how this would behave in Py2? This is an automated

[jira] [Resolved] (AIRFLOW-5649) Skipping tests for non relevant changes

2019-10-18 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5649. --- Fix Version/s: 2.0.0 Resolution: Fixed > Skipping tests for non relevant changes >

[GitHub] [airflow] ashb merged pull request #6163: [AIRFLOW-4574] SSHHook private_key may only be supplied in extras

2019-10-18 Thread GitBox
ashb merged pull request #6163: [AIRFLOW-4574] SSHHook private_key may only be supplied in extras URL: https://github.com/apache/airflow/pull/6163 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] KKcorps commented on issue #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
KKcorps commented on issue #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#issuecomment-543631525 Preview Links for PR: http://airflow.kharekartik-operator.surge.sh/howto/operator/custom-operator.html

[GitHub] [airflow] SaturnFromTitan commented on issue #6315: [AIRFLOW-5640] fix get_email_address_list types

2019-10-18 Thread GitBox
SaturnFromTitan commented on issue #6315: [AIRFLOW-5640] fix get_email_address_list types URL: https://github.com/apache/airflow/pull/6315#issuecomment-543631854 For the past 2 days I've been restarting the CI build over and over again - some tests are timing out nonetheless... From

[GitHub] [airflow] Fokko opened a new pull request #6362: [AIRFLOW-5688] Merge alembic migrations

2019-10-18 Thread GitBox
Fokko opened a new pull request #6362: [AIRFLOW-5688] Merge alembic migrations URL: https://github.com/apache/airflow/pull/6362 We have two heads in the migrations: ``` $ alembic branches 939bb1e647c8 (branchpoint) -> 6e96a59344a4 -> 004c1210f153

[jira] [Commented] (AIRFLOW-5688) Merge alembic migrations

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954318#comment-16954318 ] ASF GitHub Bot commented on AIRFLOW-5688: - Fokko commented on pull request #6362:

[jira] [Commented] (AIRFLOW-5339) Wait forever spark hook if python version is 3

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954351#comment-16954351 ] ASF GitHub Bot commented on AIRFLOW-5339: - milton0825 commented on pull request #5942:

[jira] [Commented] (AIRFLOW-5339) Wait forever spark hook if python version is 3

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954353#comment-16954353 ] ASF subversion and git services commented on AIRFLOW-5339: -- Commit

[jira] [Commented] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.

2019-10-18 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954471#comment-16954471 ] Kamil Bregula commented on AIRFLOW-: [~TobKed] Do you have any input? You've probably

[jira] [Commented] (AIRFLOW-5415) Druid Broker Hook does not respect authentication parameters

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954534#comment-16954534 ] ASF subversion and git services commented on AIRFLOW-5415: -- Commit

[GitHub] [airflow] Fokko merged pull request #5967: [AIRFLOW-5415] Enable authentication for druid query hook.

2019-10-18 Thread GitBox
Fokko merged pull request #5967: [AIRFLOW-5415] Enable authentication for druid query hook. URL: https://github.com/apache/airflow/pull/5967 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-5415) Druid Broker Hook does not respect authentication parameters

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954533#comment-16954533 ] ASF GitHub Bot commented on AIRFLOW-5415: - Fokko commented on pull request #5967:

[GitHub] [airflow] codecov-io commented on issue #6333: [AIRFLOW-5656] Rename provider to providers module

2019-10-18 Thread GitBox
codecov-io commented on issue #6333: [AIRFLOW-5656] Rename provider to providers module URL: https://github.com/apache/airflow/pull/6333#issuecomment-543723665 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6333?src=pr=h1) Report > Merging

[jira] [Updated] (AIRFLOW-5690) Task heartbeat is being reported as a warning

2019-10-18 Thread Aditya Vishwakarma (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Vishwakarma updated AIRFLOW-5690: Description: This bug is on the master branch and v1-10-stable. All my workers

[jira] [Created] (AIRFLOW-5690) Task heartbeat is being reported as a warning

2019-10-18 Thread Aditya Vishwakarma (Jira)
Aditya Vishwakarma created AIRFLOW-5690: --- Summary: Task heartbeat is being reported as a warning Key: AIRFLOW-5690 URL: https://issues.apache.org/jira/browse/AIRFLOW-5690 Project: Apache Airflow

svn commit: r36380 - /dev/airflow/1.10.6rc1/

2019-10-18 Thread ash
Author: ash Date: Fri Oct 18 14:07:38 2019 New Revision: 36380 Log: Add artifacts for Airflow 1.10.6rc1 Added: dev/airflow/1.10.6rc1/ dev/airflow/1.10.6rc1/apache-airflow-1.10.6rc1-bin.tar.gz (with props) dev/airflow/1.10.6rc1/apache-airflow-1.10.6rc1-bin.tar.gz.asc

[GitHub] [airflow] ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r336410826 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,183 @@ + .. Licensed to

[GitHub] [airflow] ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r336407631 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,185 @@ + .. Licensed to

[GitHub] [airflow] ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r336407890 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,185 @@ + .. Licensed to

[GitHub] [airflow] ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r336411161 ## File path: docs/howto/operator/index.rst ## @@ -36,3 +36,4 @@ information. kubernetes

[GitHub] [airflow] ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r336408559 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,185 @@ + .. Licensed to

[GitHub] [airflow] ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r336406576 ## File path: docs/concepts.rst ## @@ -97,6 +97,8 @@ any of its operators. This makes it easy

[GitHub] [airflow] ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-18 Thread GitBox
ashb commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r336406939 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,185 @@ + .. Licensed to

[GitHub] [airflow] codecov-io edited a comment on issue #6345: [AIRFLOW-5667] Improve type annotations in GCP

2019-10-18 Thread GitBox
codecov-io edited a comment on issue #6345: [AIRFLOW-5667] Improve type annotations in GCP URL: https://github.com/apache/airflow/pull/6345#issuecomment-543708655 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6345?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #6345: [AIRFLOW-5667] Improve type annotations in GCP

2019-10-18 Thread GitBox
codecov-io commented on issue #6345: [AIRFLOW-5667] Improve type annotations in GCP URL: https://github.com/apache/airflow/pull/6345#issuecomment-543708655 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6345?src=pr=h1) Report > Merging

[GitHub] [airflow] ashb merged pull request #6356: [AIRFLOW-XXX] Changelog for 1.10.6 (rc1)

2019-10-18 Thread GitBox
ashb merged pull request #6356: [AIRFLOW-XXX] Changelog for 1.10.6 (rc1) URL: https://github.com/apache/airflow/pull/6356 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] BasPH commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-18 Thread GitBox
BasPH commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r336480180 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,214 @@

[jira] [Updated] (AIRFLOW-5689) Side-Input in Python3 fails to pickle class

2019-10-18 Thread Jannik Franz (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jannik Franz updated AIRFLOW-5689: -- Description: When running Apache Beam with Python3 on Google Cloud Dataflow Sideinputs don't

[jira] [Commented] (AIRFLOW-5689) Side-Input in Python3 fails to pickle class

2019-10-18 Thread Jannik Franz (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954620#comment-16954620 ] Jannik Franz commented on AIRFLOW-5689: --- Before upgrading to Python3, this error did not occur.

svn commit: r36379 - in /dev/airflow: 1.10.2rc3/ 1.10.3b1/ 1.10.3b2/ 1.10.3rc1/ 1.10.3rc2/ 1.10.4b2/ 1.10.4rc1/ 1.10.4rc2/ 1.10.4rc3/ 1.10.4rc4/ 1.10.4rc5/

2019-10-18 Thread ash
Author: ash Date: Fri Oct 18 14:01:45 2019 New Revision: 36379 Log: Remove old Airflow dev releases Removed: dev/airflow/1.10.2rc3/ dev/airflow/1.10.3b1/ dev/airflow/1.10.3b2/ dev/airflow/1.10.3rc1/ dev/airflow/1.10.3rc2/ dev/airflow/1.10.4b2/ dev/airflow/1.10.4rc1/

[GitHub] [airflow] ashb commented on issue #6356: [AIRFLOW-XXX] Changelog for 1.10.6 (rc1)

2019-10-18 Thread GitBox
ashb commented on issue #6356: [AIRFLOW-XXX] Changelog for 1.10.6 (rc1) URL: https://github.com/apache/airflow/pull/6356#issuecomment-543767834 > 2 new operators were missed from this release? > GoogleCloudStorageToGoogleDrive > https://issues.apache.org/jira/browse/AIRFLOW-4758 >

[jira] [Commented] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.

2019-10-18 Thread Aaron Fowles (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954443#comment-16954443 ] Aaron Fowles commented on AIRFLOW-: --- I've developed a basic GCS to SFTP operator which

[jira] [Commented] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.

2019-10-18 Thread Tobiasz Kedzierski (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954489#comment-16954489 ] Tobiasz Kedzierski commented on AIRFLOW-: - Hi [~aaronfowles], [~pulinpathneja],

[GitHub] [airflow] codecov-io commented on issue #6362: [AIRFLOW-5688] Merge alembic migrations

2019-10-18 Thread GitBox
codecov-io commented on issue #6362: [AIRFLOW-5688] Merge alembic migrations URL: https://github.com/apache/airflow/pull/6362#issuecomment-543663701 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6362?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.

2019-10-18 Thread Tobiasz Kedzierski (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954524#comment-16954524 ] Tobiasz Kedzierski commented on AIRFLOW-: - Thanks [~aaronfowles]. Are you on

[jira] [Resolved] (AIRFLOW-5656) Rename provider to providers module

2019-10-18 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5656. --- Fix Version/s: 2.0.0 Resolution: Fixed > Rename provider to providers module >

[jira] [Commented] (AIRFLOW-5656) Rename provider to providers module

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954572#comment-16954572 ] ASF GitHub Bot commented on AIRFLOW-5656: - potiuk commented on pull request #6333:

[GitHub] [airflow] potiuk merged pull request #6333: [AIRFLOW-5656] Rename provider to providers module

2019-10-18 Thread GitBox
potiuk merged pull request #6333: [AIRFLOW-5656] Rename provider to providers module URL: https://github.com/apache/airflow/pull/6333 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (AIRFLOW-5656) Rename provider to providers module

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954573#comment-16954573 ] ASF subversion and git services commented on AIRFLOW-5656: -- Commit

[jira] [Commented] (AIRFLOW-4216) Sensors not rescheduled when root task with 'reschedule' mode

2019-10-18 Thread Jannik Franz (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954608#comment-16954608 ] Jannik Franz commented on AIRFLOW-4216: --- [~jackjack10] This error has stopped ocurring for us

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6317: [AIRFLOW-5644] Simplify TriggerDagRunOperator usage

2019-10-18 Thread GitBox
nuclearpinguin commented on a change in pull request #6317: [AIRFLOW-5644] Simplify TriggerDagRunOperator usage URL: https://github.com/apache/airflow/pull/6317#discussion_r336508465 ## File path: airflow/example_dags/example_trigger_target_dag.py ## @@ -18,65 +18,36 @@

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6317: [AIRFLOW-5644] Simplify TriggerDagRunOperator usage

2019-10-18 Thread GitBox
nuclearpinguin commented on a change in pull request #6317: [AIRFLOW-5644] Simplify TriggerDagRunOperator usage URL: https://github.com/apache/airflow/pull/6317#discussion_r336509802 ## File path: tests/core.py ## @@ -511,18 +510,6 @@ def check_failure(context,

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6317: [AIRFLOW-5644] Simplify TriggerDagRunOperator usage

2019-10-18 Thread GitBox
nuclearpinguin commented on a change in pull request #6317: [AIRFLOW-5644] Simplify TriggerDagRunOperator usage URL: https://github.com/apache/airflow/pull/6317#discussion_r336510499 ## File path: airflow/operators/dagrun_operator.py ## @@ -75,24 +63,21 @@ def __init__(

[GitHub] [airflow] nuclearpinguin commented on issue #6317: [AIRFLOW-5644] Simplify TriggerDagRunOperator usage

2019-10-18 Thread GitBox
nuclearpinguin commented on issue #6317: [AIRFLOW-5644] Simplify TriggerDagRunOperator usage URL: https://github.com/apache/airflow/pull/6317#issuecomment-543765994 In overall I like the proposed simplification ✅ This is an

[GitHub] [airflow] potiuk commented on issue #6315: [AIRFLOW-5640] fix get_email_address_list types

2019-10-18 Thread GitBox
potiuk commented on issue #6315: [AIRFLOW-5640] fix get_email_address_list types URL: https://github.com/apache/airflow/pull/6315#issuecomment-543649191 Hey @SaturnFromTitan - please rebase to latest master - we've just merged a workaround for failing Kubernetes tests which should make

[jira] [Commented] (AIRFLOW-5574) Google Analytics script could not be loaded

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954483#comment-16954483 ] ASF subversion and git services commented on AIRFLOW-5574: -- Commit

[jira] [Commented] (AIRFLOW-4574) Add SSHHook private key parameter pkey

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954484#comment-16954484 ] ASF subversion and git services commented on AIRFLOW-4574: -- Commit

[jira] [Commented] (AIRFLOW-5574) Google Analytics script could not be loaded

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954585#comment-16954585 ] ASF subversion and git services commented on AIRFLOW-5574: -- Commit

[jira] [Commented] (AIRFLOW-3333) New features enable transferring of files or data from GCS to a SFTP remote path and SFTP to GCS path.

2019-10-18 Thread Tobiasz Kedzierski (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954491#comment-16954491 ] Tobiasz Kedzierski commented on AIRFLOW-: - Maybe I will add units tests to

[GitHub] [airflow] ashb merged pull request #6315: [AIRFLOW-5640] fix get_email_address_list types

2019-10-18 Thread GitBox
ashb merged pull request #6315: [AIRFLOW-5640] fix get_email_address_list types URL: https://github.com/apache/airflow/pull/6315 This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Created] (AIRFLOW-5689) Side-Input in Python3 fails to pickle class

2019-10-18 Thread Jannik Franz (Jira)
Jannik Franz created AIRFLOW-5689: - Summary: Side-Input in Python3 fails to pickle class Key: AIRFLOW-5689 URL: https://issues.apache.org/jira/browse/AIRFLOW-5689 Project: Apache Airflow

[GitHub] [airflow] potiuk commented on issue #5693: [AIRFLOW-5080] Added npm to apt-get install in compile.sh for docker

2019-10-18 Thread GitBox
potiuk commented on issue #5693: [AIRFLOW-5080] Added npm to apt-get install in compile.sh for docker URL: https://github.com/apache/airflow/pull/5693#issuecomment-543757209 I think this can be closed now as the "kind" changed the approach quite a bit. I am looking into fixing the kind

[GitHub] [airflow] potiuk closed pull request #5693: [AIRFLOW-5080] Added npm to apt-get install in compile.sh for docker

2019-10-18 Thread GitBox
potiuk closed pull request #5693: [AIRFLOW-5080] Added npm to apt-get install in compile.sh for docker URL: https://github.com/apache/airflow/pull/5693 This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (AIRFLOW-5434) Use hook to provide credentials in GKEPodOperator

2019-10-18 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954468#comment-16954468 ] Kamil Bregula commented on AIRFLOW-5434: I agree. This is a cleaning change and there is not

[jira] [Commented] (AIRFLOW-5687) Upgrade pip to 19.0.2

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954584#comment-16954584 ] ASF subversion and git services commented on AIRFLOW-5687: -- Commit

[jira] [Commented] (AIRFLOW-4574) Add SSHHook private key parameter pkey

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954586#comment-16954586 ] ASF subversion and git services commented on AIRFLOW-4574: -- Commit

[jira] [Commented] (AIRFLOW-5687) Upgrade pip to 19.0.2

2019-10-18 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954583#comment-16954583 ] ASF subversion and git services commented on AIRFLOW-5687: -- Commit

[jira] [Updated] (AIRFLOW-5690) Task heartbeat is being reported as a warning

2019-10-18 Thread Aditya Vishwakarma (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Vishwakarma updated AIRFLOW-5690: Description: This bug is on the master branch and v1-10-stable. All my workers

[GitHub] [airflow] leahecole commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme

2019-10-18 Thread GitBox
leahecole commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme URL: https://github.com/apache/airflow/pull/6349#issuecomment-543765150 rebased to newest master because of Jarek's email This is an automated message

[GitHub] [airflow] codecov-io edited a comment on issue #6315: [AIRFLOW-5640] fix get_email_address_list types

2019-10-18 Thread GitBox
codecov-io edited a comment on issue #6315: [AIRFLOW-5640] fix get_email_address_list types URL: https://github.com/apache/airflow/pull/6315#issuecomment-541341253 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6315?src=pr=h1) Report > Merging

[GitHub] [airflow] mik-laj closed pull request #6363: Dataflow retrofit 919dd8979

2019-10-18 Thread GitBox
mik-laj closed pull request #6363: Dataflow retrofit 919dd8979 URL: https://github.com/apache/airflow/pull/6363 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] mik-laj opened a new pull request #6363: Dataflow retrofit 919dd8979

2019-10-18 Thread GitBox
mik-laj opened a new pull request #6363: Dataflow retrofit 919dd8979 URL: https://github.com/apache/airflow/pull/6363 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW/)

[GitHub] [airflow] simpleranchero commented on a change in pull request #6345: [AIRFLOW-5667] Improve type annotations in GCP

2019-10-18 Thread GitBox
simpleranchero commented on a change in pull request #6345: [AIRFLOW-5667] Improve type annotations in GCP URL: https://github.com/apache/airflow/pull/6345#discussion_r336472573 ## File path: airflow/gcp/hooks/cloud_sql.py ## @@ -924,17 +924,17 @@ def

[GitHub] [airflow] SaturnFromTitan commented on issue #6315: [AIRFLOW-5640] fix get_email_address_list types

2019-10-18 Thread GitBox
SaturnFromTitan commented on issue #6315: [AIRFLOW-5640] fix get_email_address_list types URL: https://github.com/apache/airflow/pull/6315#issuecomment-543724239 Thanks @potiuk - it worked! :) like @ashb mentioned before, the PR is ready for another review now

[airflow-site] branch aip-11 updated: Improve typography - maps, for loops(#77)

2019-10-18 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a commit to branch aip-11 in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/aip-11 by this push: new 054a4e0 Improve typography - maps,

[GitHub] [airflow-site] mik-laj merged pull request #77: Improve typography

2019-10-18 Thread GitBox
mik-laj merged pull request #77: Improve typography URL: https://github.com/apache/airflow-site/pull/77 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (AIRFLOW-5080) npm: not found with ./airflow/www_rbac/compile_assets.sh

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954632#comment-16954632 ] ASF GitHub Bot commented on AIRFLOW-5080: - potiuk commented on pull request #5693:

[GitHub] [airflow] TobKed commented on a change in pull request #6345: [AIRFLOW-5667] Improve type annotations in GCP

2019-10-18 Thread GitBox
TobKed commented on a change in pull request #6345: [AIRFLOW-5667] Improve type annotations in GCP URL: https://github.com/apache/airflow/pull/6345#discussion_r336535574 ## File path: airflow/gcp/hooks/cloud_sql.py ## @@ -924,17 +924,17 @@ def

  1   2   >