[GitHub] [airflow] mik-laj commented on issue #6355: [AIRFLOW-5685] Loading AVRO file from GCS to BQ throwing ValueError

2019-10-16 Thread GitBox
mik-laj commented on issue #6355: [AIRFLOW-5685] Loading AVRO file from GCS to BQ throwing ValueError URL: https://github.com/apache/airflow/pull/6355#issuecomment-543003552 CC: @TobKed This is an automated message from the

[GitHub] [airflow] danieltahara edited a comment on issue #4660: [AIRFLOW-3819] - Allow the configuration of a global default for work…

2019-10-16 Thread GitBox
danieltahara edited a comment on issue #4660: [AIRFLOW-3819] - Allow the configuration of a global default for work… URL: https://github.com/apache/airflow/pull/4660#issuecomment-542982778 I actually don't think this is a problem best solved at the Kubernetes level. Since LimitRanges are

[GitHub] [airflow] danieltahara commented on issue #4660: [AIRFLOW-3819] - Allow the configuration of a global default for work…

2019-10-16 Thread GitBox
danieltahara commented on issue #4660: [AIRFLOW-3819] - Allow the configuration of a global default for work… URL: https://github.com/apache/airflow/pull/4660#issuecomment-542982778 I actually don't think this is a problem best solved at the Kubernetes level. Since LimitRanges are applied

[jira] [Created] (AIRFLOW-5685) Loading AVRO file from GCS to BQ throwing ValueError

2019-10-16 Thread Ryan Yuan (Jira)
Ryan Yuan created AIRFLOW-5685: -- Summary: Loading AVRO file from GCS to BQ throwing ValueError Key: AIRFLOW-5685 URL: https://issues.apache.org/jira/browse/AIRFLOW-5685 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-5685) Loading AVRO file from GCS to BQ throwing ValueError

2019-10-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953296#comment-16953296 ] ASF GitHub Bot commented on AIRFLOW-5685: - ryanyuan commented on pull request #6355:

[GitHub] [airflow] ryanyuan opened a new pull request #6355: [AIRFLOW-5685] Loading AVRO file from GCS to BQ throwing ValueError

2019-10-16 Thread GitBox
ryanyuan opened a new pull request #6355: [AIRFLOW-5685] Loading AVRO file from GCS to BQ throwing ValueError URL: https://github.com/apache/airflow/pull/6355 Using GoogleCloudStorageToBigQueryOperator to load AVRO file is causing exception as follows: Traceback (most recent call

[jira] [Work started] (AIRFLOW-5685) Loading AVRO file from GCS to BQ throwing ValueError

2019-10-16 Thread Ryan Yuan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5685 started by Ryan Yuan. -- > Loading AVRO file from GCS to BQ throwing ValueError >

[GitHub] [airflow] lyallcooper commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
lyallcooper commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542937526 Alright, updated to add in the `airflow-version` label automatically

[GitHub] [airflow] codecov-io commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
codecov-io commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542936295 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6351?src=pr=h1) Report > Merging

[GitHub] [airflow] JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335754928 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335754928 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335752238 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335752238 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
JonnyIncognito commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335752238 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] RosterIn commented on a change in pull request #5694: [AIRFLOW-5082] add subject in aws sns hook

2019-10-16 Thread GitBox
RosterIn commented on a change in pull request #5694: [AIRFLOW-5082] add subject in aws sns hook URL: https://github.com/apache/airflow/pull/5694#discussion_r335727498 ## File path: tests/contrib/hooks/test_aws_sns_hook.py ## @@ -42,9 +42,10 @@ def

[jira] [Commented] (AIRFLOW-5664) postgres_to_gcs operator drops milliseconds from timestamps

2019-10-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953215#comment-16953215 ] ASF GitHub Bot commented on AIRFLOW-5664: - osule commented on pull request #6354:

[GitHub] [airflow] osule opened a new pull request #6354: [AIRFLOW-5664] Store timestamps with microseconds precision

2019-10-16 Thread GitBox
osule opened a new pull request #6354: [AIRFLOW-5664] Store timestamps with microseconds precision URL: https://github.com/apache/airflow/pull/6354 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] [airflow] mik-laj commented on issue #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-16 Thread GitBox
mik-laj commented on issue #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#issuecomment-542900700 @feluelle I have twin brother ;-D higrys is a nickname. https://twitter.com/higrys

[jira] [Assigned] (AIRFLOW-5664) postgres_to_gcs operator drops milliseconds from timestamps

2019-10-16 Thread Oluwafemi Sule (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oluwafemi Sule reassigned AIRFLOW-5664: --- Assignee: Oluwafemi Sule > postgres_to_gcs operator drops milliseconds from

[GitHub] [airflow] feluelle commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542878228 > How about we check whether any of the leaf nodes in the subdag is `skipped` and propagate that to parent DAG so

[GitHub] [airflow] KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-16 Thread GitBox
KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r335692036 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,183 @@ + .. Licensed

[GitHub] [airflow] milton0825 commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
milton0825 commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542875495 How about we check whether any of the leaf nodes in the subdag is `skipped` and propagate that to parent DAG so

[GitHub] [airflow] feluelle edited a comment on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle edited a comment on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542874196 Yes, (we only need to do it for the `skipped` state, because other states like success or failed propagate

[GitHub] [airflow] feluelle commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542874196 Yes, (we only need to do it for the `skipped` state, because other states like success or failed propagate

[GitHub] [airflow] TobKed commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
TobKed commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542873791 1. @mik-laj is right, it will be good idea to set default label to something like: ``` from airflow.version import version as

[GitHub] [airflow] milton0825 commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
milton0825 commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542873507 So the PR is that we propagate the state of essential tasks in the subdag to the parent DAG?

[GitHub] [airflow] feluelle edited a comment on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle edited a comment on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542871719 > > > > Currently there is no way of telling the parent dag of a sub dag that an essential task

[GitHub] [airflow] mik-laj commented on issue #6341: Updated airflow

2019-10-16 Thread GitBox
mik-laj commented on issue #6341: Updated airflow URL: https://github.com/apache/airflow/pull/6341#issuecomment-542872654 Can you tell a little more about this change? This is an automated message from the Apache Git Service.

[GitHub] [airflow] feluelle edited a comment on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle edited a comment on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542871719 > > > > Currently there is no way of telling the parent dag of a sub dag that an essential task

[GitHub] [airflow] feluelle edited a comment on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle edited a comment on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542871719 > > > > Currently there is no way of telling the parent dag of a sub dag that an essential task

[GitHub] [airflow] feluelle commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542871719 > > > > Currently there is no way of telling the parent dag of a sub dag that an essential task has been

[GitHub] [airflow] milton0825 commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
milton0825 commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542870443 > Currently there is no way of telling the parent dag of a sub dag that an essential task has been skipped.

[jira] [Commented] (AIRFLOW-5684) Docker-compose-kubernetes still used by breeze

2019-10-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953148#comment-16953148 ] ASF GitHub Bot commented on AIRFLOW-5684: - potiuk commented on pull request #6353:

[GitHub] [airflow] potiuk opened a new pull request #6353: [AIRFLOW-5684] docker-compose-kubernetes still used

2019-10-16 Thread GitBox
potiuk opened a new pull request #6353: [AIRFLOW-5684] docker-compose-kubernetes still used URL: https://github.com/apache/airflow/pull/6353 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-5684) Docker-compose-kubernetes still used by breeze

2019-10-16 Thread Jarek Potiuk (Jira)
Jarek Potiuk created AIRFLOW-5684: - Summary: Docker-compose-kubernetes still used by breeze Key: AIRFLOW-5684 URL: https://issues.apache.org/jira/browse/AIRFLOW-5684 Project: Apache Airflow

[GitHub] [airflow] mik-laj commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
mik-laj commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542858230 https://user-images.githubusercontent.com/12058428/66952258-904af600-f05c-11e9-9f62-cf7f74992a52.png;> Currently, this

[GitHub] [airflow] lyallcooper commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
lyallcooper commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542855432 Also it seems the other BQ-related operators that support labels don't pass in the Airflow version as a default label.

[GitHub] [airflow] lyallcooper edited a comment on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
lyallcooper edited a comment on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542853862 @mik-laj sorry, I don't seem to have access to that google doc.

[GitHub] [airflow] lyallcooper commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
lyallcooper commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542853862 Sorry, I don't seem to have access to that google doc. This is

[GitHub] [airflow] feluelle commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle commented on issue #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352#issuecomment-542848213 @milton0825 I requested you to review because I think you know the most about subdags :)

[jira] [Commented] (AIRFLOW-5683) Add SubDagOperator that propagates skipped state

2019-10-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953115#comment-16953115 ] ASF GitHub Bot commented on AIRFLOW-5683: - feluelle commented on pull request #6352:

[GitHub] [airflow] feluelle opened a new pull request #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state

2019-10-16 Thread GitBox
feluelle opened a new pull request #6352: [WIP][AIRFLOW-5683] Add SubDagOperator that propagates skipped state URL: https://github.com/apache/airflow/pull/6352 ### Jira - https://issues.apache.org/jira/browse/AIRFLOW-5683 ### Description - [x] Here are some details

[GitHub] [airflow] mik-laj commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
mik-laj commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542845749 Sample PR: https://github.com/apache/airflow/pull/6296/files This is

[GitHub] [airflow] mik-laj commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
mik-laj commented on issue #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351#issuecomment-542845497 According to the integration guide, you should also add default labels with the Airflow version

[jira] [Commented] (AIRFLOW-5682) Add support for labels in gcs_to_bq operator

2019-10-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953111#comment-16953111 ] ASF GitHub Bot commented on AIRFLOW-5682: - lyallcooper commented on pull request #6351:

[GitHub] [airflow] lyallcooper opened a new pull request #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator

2019-10-16 Thread GitBox
lyallcooper opened a new pull request #6351: [AIRFLOW-5682] Allow labels in gcs_to_bq operator URL: https://github.com/apache/airflow/pull/6351 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow

[GitHub] [airflow] mik-laj commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-16 Thread GitBox
mik-laj commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r335653352 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,183 @@ + .. Licensed

[GitHub] [airflow] mik-laj commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-16 Thread GitBox
mik-laj commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r335651696 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,183 @@ + .. Licensed

[GitHub] [airflow] mik-laj commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-16 Thread GitBox
mik-laj commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r335651246 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,177 @@ + .. Licensed

[GitHub] [airflow] KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-16 Thread GitBox
KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r335648181 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,177 @@ + .. Licensed

[jira] [Work started] (AIRFLOW-5683) Add SubDagOperator that propagates skipped state

2019-10-16 Thread Felix Uellendall (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5683 started by Felix Uellendall. - > Add SubDagOperator that propagates skipped state >

[jira] [Created] (AIRFLOW-5683) Add SubDagOperator that propagates skipped state

2019-10-16 Thread Felix Uellendall (Jira)
Felix Uellendall created AIRFLOW-5683: - Summary: Add SubDagOperator that propagates skipped state Key: AIRFLOW-5683 URL: https://issues.apache.org/jira/browse/AIRFLOW-5683 Project: Apache Airflow

[jira] [Created] (AIRFLOW-5682) Add support for labels in gcs_to_bq operator

2019-10-16 Thread Lyall Cooper (Jira)
Lyall Cooper created AIRFLOW-5682: - Summary: Add support for labels in gcs_to_bq operator Key: AIRFLOW-5682 URL: https://issues.apache.org/jira/browse/AIRFLOW-5682 Project: Apache Airflow

[GitHub] [airflow] ToxaZ commented on a change in pull request #6336: [AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking

2019-10-16 Thread GitBox
ToxaZ commented on a change in pull request #6336: [AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking URL: https://github.com/apache/airflow/pull/6336#discussion_r335627167 ## File path: airflow/sensors/sql_sensor.py ## @@ -103,5 +103,5 @@ def

[GitHub] [airflow] feluelle commented on issue #5914: [AIRFLOW-5311] Add an AWS Lambda Operator

2019-10-16 Thread GitBox
feluelle commented on issue #5914: [AIRFLOW-5311] Add an AWS Lambda Operator URL: https://github.com/apache/airflow/pull/5914#issuecomment-542821090 ping @iainjames88 :) This is an automated message from the Apache Git

[GitHub] [airflow] feluelle commented on issue #5997: [AIRFLOW-5396] - Add button Auto Refresh

2019-10-16 Thread GitBox
feluelle commented on issue #5997: [AIRFLOW-5396] - Add button Auto Refresh URL: https://github.com/apache/airflow/pull/5997#issuecomment-542819898 @LucasMMota are you still working on that change? :) This is an automated

[GitHub] [airflow] feluelle commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-16 Thread GitBox
feluelle commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#discussion_r335623587 ## File path: BREEZE.rst ## @@ -46,409 +46,586 @@ Here is the short 10 minute video about

[GitHub] [airflow] feluelle commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-16 Thread GitBox
feluelle commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#discussion_r335623735 ## File path: BREEZE.rst ## @@ -474,214 +651,220 @@ Run pylint checks for all files:

[GitHub] [airflow] feluelle commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD

2019-10-16 Thread GitBox
feluelle commented on a change in pull request #6285: [AIRFLOW-XXX] Updates to Breeze documentation from GSOD URL: https://github.com/apache/airflow/pull/6285#discussion_r335624250 ## File path: BREEZE.rst ## @@ -46,409 +46,586 @@ Here is the short 10 minute video about

[jira] [Updated] (AIRFLOW-5643) S3Hook logic is duplicated and could be clearer

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5643: --- Fix Version/s: (was: 2.0.0) 1.10.7 > S3Hook logic is

[GitHub] [airflow] houqp commented on a change in pull request #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric

2019-10-16 Thread GitBox
houqp commented on a change in pull request #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric URL: https://github.com/apache/airflow/pull/6342#discussion_r335617211 ## File path: airflow/models/pool.py ## @@ -107,3 +109,33 @@ def open_slots(self,

[GitHub] [airflow] milton0825 commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-10-16 Thread GitBox
milton0825 commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r335609229 ## File path: docs/howto/enable-dag-serialization.rst ## @@ -0,0

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335593800 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335593800 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335593800 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335593800 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335593800 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335593800 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335593800 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335593800 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335587922 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335589712 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[jira] [Created] (AIRFLOW-5681) Allow specification of a tag or hash for the git_sync init container

2019-10-16 Thread George Miller (Jira)
George Miller created AIRFLOW-5681: -- Summary: Allow specification of a tag or hash for the git_sync init container Key: AIRFLOW-5681 URL: https://issues.apache.org/jira/browse/AIRFLOW-5681 Project:

[jira] [Commented] (AIRFLOW-5681) Allow specification of a tag or hash for the git_sync init container

2019-10-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953008#comment-16953008 ] ASF GitHub Bot commented on AIRFLOW-5681: - george-miller commented on pull request #6350:

[jira] [Updated] (AIRFLOW-5681) Allow specification of a tag or hash for the git_sync init container

2019-10-16 Thread George Miller (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Miller updated AIRFLOW-5681: --- Description: We want to deploy dags based on tags on a branch, and want to use the

[GitHub] [airflow] george-miller opened a new pull request #6350: [AIRFLOW-5681] Allow specification of a tag or hash for the git_sync init container

2019-10-16 Thread GitBox
george-miller opened a new pull request #6350: [AIRFLOW-5681] Allow specification of a tag or hash for the git_sync init container URL: https://github.com/apache/airflow/pull/6350 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the

[jira] [Commented] (AIRFLOW-5643) S3Hook logic is duplicated and could be clearer

2019-10-16 Thread Felix Uellendall (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953002#comment-16953002 ] Felix Uellendall commented on AIRFLOW-5643: --- [~ash] I set Fix Version to 2.0 since you said

[jira] [Resolved] (AIRFLOW-5643) S3Hook logic is duplicated and could be clearer

2019-10-16 Thread Felix Uellendall (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Uellendall resolved AIRFLOW-5643. --- Resolution: Fixed > S3Hook logic is duplicated and could be clearer >

[jira] [Updated] (AIRFLOW-5643) S3Hook logic is duplicated and could be clearer

2019-10-16 Thread Felix Uellendall (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Uellendall updated AIRFLOW-5643: -- Fix Version/s: 2.0.0 > S3Hook logic is duplicated and could be clearer >

[jira] [Commented] (AIRFLOW-5643) S3Hook logic is duplicated and could be clearer

2019-10-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952997#comment-16952997 ] ASF GitHub Bot commented on AIRFLOW-5643: - feluelle commented on pull request #6313:

[GitHub] [airflow] feluelle commented on issue #6313: [AIRFLOW-5643] Reduce duplicated logic in S3Hook

2019-10-16 Thread GitBox
feluelle commented on issue #6313: [AIRFLOW-5643] Reduce duplicated logic in S3Hook URL: https://github.com/apache/airflow/pull/6313#issuecomment-542792264 Yes, Jarek I just saw the thread right after I reran the tests. I think we can merge it then. 

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335581468 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[GitHub] [airflow] dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish commented on a change in pull request #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r335581468 ## File path: airflow/models/base_async_operator.py ## @@ -0,0 +1,161 @@ +# -*- coding: utf-8 -*- +# +# Licensed

[GitHub] [airflow] dstandish edited a comment on issue #6210: [AIRFLOW-5567] BaseAsyncOperator

2019-10-16 Thread GitBox
dstandish edited a comment on issue #6210: [AIRFLOW-5567] BaseAsyncOperator URL: https://github.com/apache/airflow/pull/6210#issuecomment-542495934 I gave this a try ... one curious thing while the task is in "waiting for retry" status, the log is not visible. while it runs poke

[GitHub] [airflow] KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-16 Thread GitBox
KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r335577650 ## File path: docs/howto/operator/index.rst ## @@ -36,3 +36,4 @@ information.

[GitHub] [airflow] KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc

2019-10-16 Thread GitBox
KKcorps commented on a change in pull request #6348: [AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc URL: https://github.com/apache/airflow/pull/6348#discussion_r335576837 ## File path: docs/howto/operator/custom-operator.rst ## @@ -0,0 +1,177 @@ + .. Licensed

[GitHub] [airflow] mik-laj commented on issue #6259: [AIRFLOW-XXX] Example for BigQuery to BigQuery operator

2019-10-16 Thread GitBox
mik-laj commented on issue #6259: [AIRFLOW-XXX] Example for BigQuery to BigQuery operator URL: https://github.com/apache/airflow/pull/6259#issuecomment-542773786 This change must also have a ticket https://github.com/apache/airflow/pull/6227#issuecomment-537105167

[GitHub] [airflow] ashb commented on a change in pull request #6336: [AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking

2019-10-16 Thread GitBox
ashb commented on a change in pull request #6336: [AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking URL: https://github.com/apache/airflow/pull/6336#discussion_r335561348 ## File path: airflow/sensors/sql_sensor.py ## @@ -103,5 +103,5 @@ def

[GitHub] [airflow] ashb commented on a change in pull request #6336: [AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking

2019-10-16 Thread GitBox
ashb commented on a change in pull request #6336: [AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking URL: https://github.com/apache/airflow/pull/6336#discussion_r335560715 ## File path: airflow/sensors/sql_sensor.py ## @@ -103,5 +103,5 @@ def

[GitHub] [airflow] mik-laj commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme

2019-10-16 Thread GitBox
mik-laj commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme URL: https://github.com/apache/airflow/pull/6349#issuecomment-542766326 In this PR it is okay for me This is an automated message from the Apache Git

[jira] [Updated] (AIRFLOW-4928) Remove redundant config parsing in DagBag

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-4928: --- Fix Version/s: (was: 2.0.0) 1.10.6 > Remove redundant

[jira] [Resolved] (AIRFLOW-5497) dag_processing::list_py_file_paths method pydoc needs param added

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5497. Fix Version/s: 1.10.6 Resolution: Done >

[GitHub] [airflow] mik-laj commented on issue #6259: [AIRFLOW-XXX] Example for BigQuery to BigQuery operator

2019-10-16 Thread GitBox
mik-laj commented on issue #6259: [AIRFLOW-XXX] Example for BigQuery to BigQuery operator URL: https://github.com/apache/airflow/pull/6259#issuecomment-542762709 Personally, I would prefer all examples for GCP to have system tests

[jira] [Updated] (AIRFLOW-5130) Use GOOGLE_APPLICATION_CREDENTIALS constant from library

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5130: --- Fix Version/s: (was: 2.0.0) 1.10.6 > Use

[jira] [Updated] (AIRFLOW-5126) Read aws_session_token in extra_config of the aws hook

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5126: --- Fix Version/s: 1.10.6 > Read aws_session_token in extra_config of the aws hook >

[jira] [Updated] (AIRFLOW-5585) Docker-context file check gives only marginal improvements for build

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5585: --- Fix Version/s: (was: 2.0.0) 1.10.6 > Docker-context file

[GitHub] [airflow] leahecole commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme

2019-10-16 Thread GitBox
leahecole commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme URL: https://github.com/apache/airflow/pull/6349#issuecomment-542762236 I can add a link to that in this PR also, or would it be better to open a separate PR @mik-laj? > We also have brandbook:

[jira] [Resolved] (AIRFLOW-5399) Add invoke operator for GCP Functions

2019-10-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5399. Resolution: Done > Add invoke operator for GCP Functions >

[GitHub] [airflow] mik-laj commented on issue #6333: [AIRFLOW-5656] Rename provider to providers module

2019-10-16 Thread GitBox
mik-laj commented on issue #6333: [AIRFLOW-5656] Rename provider to providers module URL: https://github.com/apache/airflow/pull/6333#issuecomment-542760786 I restarted tests. This is an automated message from the Apache Git

[GitHub] [airflow] mik-laj commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme

2019-10-16 Thread GitBox
mik-laj commented on issue #6349: [AIRFLOW-XXX] Add logo info to readme URL: https://github.com/apache/airflow/pull/6349#issuecomment-542760284 We also have brandbook: https://cwiki.apache.org/confluence/display/AIRFLOW/Brandbook

  1   2   3   >