[GitHub] [airflow] jml commented on issue #5598: [AIRFLOW-733][AIRFLOW-883] Apply default_args when setting `op.dag = dag` or `dag >> op`

2019-08-15 Thread GitBox
jml commented on issue #5598: [AIRFLOW-733][AIRFLOW-883] Apply default_args when setting `op.dag = dag` or `dag >> op` URL: https://github.com/apache/airflow/pull/5598#issuecomment-521613107 That could just as readily be written as: ```python dag = DAG() generate_tasks(dag)

[GitHub] [airflow] akki commented on issue #5489: [AIRFLOW-4843] Allow orchestration via Docker Swarm (SwarmOperator)

2019-08-15 Thread GitBox
akki commented on issue #5489: [AIRFLOW-4843] Allow orchestration via Docker Swarm (SwarmOperator) URL: https://github.com/apache/airflow/pull/5489#issuecomment-521615573 @acordiner thanks. If the feature is supported by the Python Docker client API, it should be pretty straightforward to

[jira] [Commented] (AIRFLOW-5226) Consistent licences for all html JINJA templatesc

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908054#comment-16908054 ] ASF GitHub Bot commented on AIRFLOW-5226: - potiuk commented on pull request #5828:

[GitHub] [airflow] potiuk opened a new pull request #5828: [AIRFLOW-5226] Consistent licences for all jinja templates

2019-08-15 Thread GitBox
potiuk opened a new pull request #5828: [AIRFLOW-5226] Consistent licences for all jinja templates URL: https://github.com/apache/airflow/pull/5828 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5227) Consistent licences for all .sql files

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908061#comment-16908061 ] ASF GitHub Bot commented on AIRFLOW-5227: - potiuk commented on pull request #5829:

[jira] [Resolved] (AIRFLOW-4952) Remove unused arguments in tests

2019-08-15 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-4952. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove unused arguments in tests >

[jira] [Created] (AIRFLOW-5229) Add licence to all otehr file types

2019-08-15 Thread Jarek Potiuk (JIRA)
Jarek Potiuk created AIRFLOW-5229: - Summary: Add licence to all otehr file types Key: AIRFLOW-5229 URL: https://issues.apache.org/jira/browse/AIRFLOW-5229 Project: Apache Airflow Issue Type:

[GitHub] [airflow] ashb commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-15 Thread GitBox
ashb commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r314335561 ## File path: airflow/models/serialized_dag.py ## @@ -0,0 +1,173 @@ +#

[GitHub] [airflow] jml commented on issue #5598: [AIRFLOW-733][AIRFLOW-883] Apply default_args when setting `op.dag = dag` or `dag >> op`

2019-08-15 Thread GitBox
jml commented on issue #5598: [AIRFLOW-733][AIRFLOW-883] Apply default_args when setting `op.dag = dag` or `dag >> op` URL: https://github.com/apache/airflow/pull/5598#issuecomment-521608287 Maybe in Airflow 2.0, we should make the `dag` argument to `BaseOperator` non-optional and not

[GitHub] [airflow] ashb commented on issue #5598: [AIRFLOW-733][AIRFLOW-883] Apply default_args when setting `op.dag = dag` or `dag >> op`

2019-08-15 Thread GitBox
ashb commented on issue #5598: [AIRFLOW-733][AIRFLOW-883] Apply default_args when setting `op.dag = dag` or `dag >> op` URL: https://github.com/apache/airflow/pull/5598#issuecomment-521613826 Yeah, this probably can be changed and tieded up now. We'll probably have to fix a lot of our own

[jira] [Commented] (AIRFLOW-5223) Use kind for Kubernetes in CI

2019-08-15 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908033#comment-16908033 ] Jarek Potiuk commented on AIRFLOW-5223: --- (y) > Use kind for Kubernetes in CI >

[jira] [Updated] (AIRFLOW-5225) Consistent licences can be added automatically for all JS files

2019-08-15 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-5225: -- Summary: Consistent licences can be added automatically for all JS files (was: Licences can

[jira] [Created] (AIRFLOW-5226) Consistent licences for all html JINJA templatesc

2019-08-15 Thread Jarek Potiuk (JIRA)
Jarek Potiuk created AIRFLOW-5226: - Summary: Consistent licences for all html JINJA templatesc Key: AIRFLOW-5226 URL: https://issues.apache.org/jira/browse/AIRFLOW-5226 Project: Apache Airflow

[jira] [Created] (AIRFLOW-5227) Consistent licences for all .sql files

2019-08-15 Thread Jarek Potiuk (JIRA)
Jarek Potiuk created AIRFLOW-5227: - Summary: Consistent licences for all .sql files Key: AIRFLOW-5227 URL: https://issues.apache.org/jira/browse/AIRFLOW-5227 Project: Apache Airflow Issue

[GitHub] [airflow] feluelle commented on a change in pull request #5825: [AIRFLOW-5218] less polling for AWS Batch status

2019-08-15 Thread GitBox
feluelle commented on a change in pull request #5825: [AIRFLOW-5218] less polling for AWS Batch status URL: https://github.com/apache/airflow/pull/5825#discussion_r314349833 ## File path: airflow/contrib/operators/awsbatch_operator.py ## @@ -105,6 +106,7 @@ def

[GitHub] [airflow] ashb commented on issue #5598: [AIRFLOW-733][AIRFLOW-883] Apply default_args when setting `op.dag = dag` or `dag >> op`

2019-08-15 Thread GitBox
ashb commented on issue #5598: [AIRFLOW-733][AIRFLOW-883] Apply default_args when setting `op.dag = dag` or `dag >> op` URL: https://github.com/apache/airflow/pull/5598#issuecomment-521609959 Maybe with the context manager (`with DAG:`) that is doable now, but I suspect this feature

[GitHub] [airflow] potiuk opened a new pull request #5829: [AIRFLOW-5227] Consistent licence for .sql files

2019-08-15 Thread GitBox
potiuk opened a new pull request #5829: [AIRFLOW-5227] Consistent licence for .sql files URL: https://github.com/apache/airflow/pull/5829 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

2019-08-15 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908063#comment-16908063 ] ASF subversion and git services commented on AIRFLOW-5161: -- Commit

[jira] [Commented] (AIRFLOW-5225) Licences can be added automatically for all JS files

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908050#comment-16908050 ] ASF GitHub Bot commented on AIRFLOW-5225: - potiuk commented on pull request #5827:

[GitHub] [airflow] potiuk opened a new pull request #5827: [AIRFLOW-5225] Consistent licence for all JS files

2019-08-15 Thread GitBox
potiuk opened a new pull request #5827: [AIRFLOW-5225] Consistent licence for all JS files URL: https://github.com/apache/airflow/pull/5827 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] [airflow] mik-laj commented on a change in pull request #5828: [AIRFLOW-5226] Consistent licences for all jinja templates

2019-08-15 Thread GitBox
mik-laj commented on a change in pull request #5828: [AIRFLOW-5226] Consistent licences for all jinja templates URL: https://github.com/apache/airflow/pull/5828#discussion_r314296261 ## File path: airflow/www/templates/appbuilder/navbar.html ## @@ -1,3 +1,22 @@ +{#

[GitHub] [airflow] mik-laj commented on a change in pull request #5828: [AIRFLOW-5226] Consistent licences for all jinja templates

2019-08-15 Thread GitBox
mik-laj commented on a change in pull request #5828: [AIRFLOW-5226] Consistent licences for all jinja templates URL: https://github.com/apache/airflow/pull/5828#discussion_r314296288 ## File path: airflow/www/templates/appbuilder/navbar_menu.html ## @@ -1,3 +1,22 @@ +{# +

[GitHub] [airflow] mik-laj commented on a change in pull request #5828: [AIRFLOW-5226] Consistent licences for all jinja templates

2019-08-15 Thread GitBox
mik-laj commented on a change in pull request #5828: [AIRFLOW-5226] Consistent licences for all jinja templates URL: https://github.com/apache/airflow/pull/5828#discussion_r314296336 ## File path: airflow/www/templates/appbuilder/navbar_right.html ## @@ -1,3 +1,22 @@ +{#

[GitHub] [airflow] mik-laj commented on a change in pull request #5828: [AIRFLOW-5226] Consistent licences for all jinja templates

2019-08-15 Thread GitBox
mik-laj commented on a change in pull request #5828: [AIRFLOW-5226] Consistent licences for all jinja templates URL: https://github.com/apache/airflow/pull/5828#discussion_r314296200 ## File path: airflow/www/templates/appbuilder/index.html ## @@ -1,3 +1,22 @@ +{# +

[GitHub] [airflow] potiuk merged pull request #5830: [AIRFLOW-XXX] Remove duplicate lines from CONTRIBUTING.md

2019-08-15 Thread GitBox
potiuk merged pull request #5830: [AIRFLOW-XXX] Remove duplicate lines from CONTRIBUTING.md URL: https://github.com/apache/airflow/pull/5830 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] acordiner commented on issue #5489: [AIRFLOW-4843] Allow orchestration via Docker Swarm (SwarmOperator)

2019-08-15 Thread GitBox
acordiner commented on issue #5489: [AIRFLOW-4843] Allow orchestration via Docker Swarm (SwarmOperator) URL: https://github.com/apache/airflow/pull/5489#issuecomment-521621285 @akki - Great! Yes, they're part of the API:

[jira] [Created] (AIRFLOW-5225) Licences can be added automatically for all JS files

2019-08-15 Thread Jarek Potiuk (JIRA)
Jarek Potiuk created AIRFLOW-5225: - Summary: Licences can be added automatically for all JS files Key: AIRFLOW-5225 URL: https://issues.apache.org/jira/browse/AIRFLOW-5225 Project: Apache Airflow

[GitHub] [airflow] kaxil opened a new pull request #5830: [AIRFLOW-XXX] Remove duplicate lines from CONTRIBUTING.md

2019-08-15 Thread GitBox
kaxil opened a new pull request #5830: [AIRFLOW-XXX] Remove duplicate lines from CONTRIBUTING.md URL: https://github.com/apache/airflow/pull/5830 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-5228) Questions on Airflow licensing and support

2019-08-15 Thread Ramkumar (JIRA)
Ramkumar created AIRFLOW-5228: - Summary: Questions on Airflow licensing and support Key: AIRFLOW-5228 URL: https://issues.apache.org/jira/browse/AIRFLOW-5228 Project: Apache Airflow Issue Type:

[GitHub] [airflow] potiuk opened a new pull request #5831: [AIRFLOW-5229] Consistent licences to all other files

2019-08-15 Thread GitBox
potiuk opened a new pull request #5831: [AIRFLOW-5229] Consistent licences to all other files URL: https://github.com/apache/airflow/pull/5831 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5229) Add licence to all otehr file types

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908092#comment-16908092 ] ASF GitHub Bot commented on AIRFLOW-5229: - potiuk commented on pull request #5831:

[jira] [Updated] (AIRFLOW-5228) support statements for Airflow

2019-08-15 Thread Ramkumar (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramkumar updated AIRFLOW-5228: -- Summary: support statements for Airflow (was: Questions on Airflow licensing and support) >

[jira] [Updated] (AIRFLOW-5228) support statements for Airflow

2019-08-15 Thread Ramkumar (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramkumar updated AIRFLOW-5228: -- Description: Hallo I am working on an Airflow POC. I understand Airflow is an Open source project

[jira] [Commented] (AIRFLOW-5161) Add pre-commit hooks to run static checks for only changed files

2019-08-15 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907850#comment-16907850 ] ASF subversion and git services commented on AIRFLOW-5161: -- Commit

[jira] [Created] (AIRFLOW-5222) Dag run status is wrongly set to SUCCESS

2019-08-15 Thread Deavarajegowda M T (JIRA)
Deavarajegowda M T created AIRFLOW-5222: --- Summary: Dag run status is wrongly set to SUCCESS Key: AIRFLOW-5222 URL: https://issues.apache.org/jira/browse/AIRFLOW-5222 Project: Apache Airflow

[jira] [Created] (AIRFLOW-5223) Use kind for Kubernetes in CI

2019-08-15 Thread Gerardo Curiel (JIRA)
Gerardo Curiel created AIRFLOW-5223: --- Summary: Use kind for Kubernetes in CI Key: AIRFLOW-5223 URL: https://issues.apache.org/jira/browse/AIRFLOW-5223 Project: Apache Airflow Issue Type:

[GitHub] [airflow] Fokko commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes

2019-08-15 Thread GitBox
Fokko commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#discussion_r314250600 ## File path: airflow/contrib/hooks/grpc_hook.py ##

[GitHub] [airflow] Fokko commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes

2019-08-15 Thread GitBox
Fokko commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#discussion_r314250523 ## File path: airflow/contrib/hooks/bigquery_hook.py

[GitHub] [airflow] BasPH commented on issue #5815: [AIRFLOW-5210] Make finding template files more efficient

2019-08-15 Thread GitBox
BasPH commented on issue #5815: [AIRFLOW-5210] Make finding template files more efficient URL: https://github.com/apache/airflow/pull/5815#issuecomment-521545112 No, my bad, I accidentally clicked the revert button. I deleted the "revert" branch.

[jira] [Commented] (AIRFLOW-3601) update operators to BigQuery to support location

2019-08-15 Thread Michael (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907891#comment-16907891 ] Michael commented on AIRFLOW-3601: -- I noticed that as part of this issue BigQueryCheckOperator was

[jira] [Created] (AIRFLOW-5224) gcs_to_bq.GoogleCloudStorageToBigQueryOperator - Specify Encoding for BQ ingestion

2019-08-15 Thread Anand Kumar (JIRA)
Anand Kumar created AIRFLOW-5224: Summary: gcs_to_bq.GoogleCloudStorageToBigQueryOperator - Specify Encoding for BQ ingestion Key: AIRFLOW-5224 URL: https://issues.apache.org/jira/browse/AIRFLOW-5224

[jira] [Updated] (AIRFLOW-5224) gcs_to_bq.GoogleCloudStorageToBigQueryOperator - Specify Encoding for BQ ingestion

2019-08-15 Thread Anand Kumar (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anand Kumar updated AIRFLOW-5224: - Description: Hi, The current business project we are enabling has been built completely on

[GitHub] [airflow] StevenReitsma commented on issue #5645: [AIRFLOW-5027] Get logs from CloudWatch for ECSOperators

2019-08-15 Thread GitBox
StevenReitsma commented on issue #5645: [AIRFLOW-5027] Get logs from CloudWatch for ECSOperators URL: https://github.com/apache/airflow/pull/5645#issuecomment-521714189 PTAL @ashb This is an automated message from the

[jira] [Created] (AIRFLOW-5230) Refactor template file loading functions

2019-08-15 Thread Bas Harenslak (JIRA)
Bas Harenslak created AIRFLOW-5230: -- Summary: Refactor template file loading functions Key: AIRFLOW-5230 URL: https://issues.apache.org/jira/browse/AIRFLOW-5230 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-5230) Refactor template file loading functions

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908349#comment-16908349 ] ASF GitHub Bot commented on AIRFLOW-5230: - BasPH commented on pull request #5832:

[GitHub] [airflow] BasPH opened a new pull request #5832: [AIRFLOW-5230] Refactor template file loading functionality

2019-08-15 Thread GitBox
BasPH opened a new pull request #5832: [AIRFLOW-5230] Refactor template file loading functionality URL: https://github.com/apache/airflow/pull/5832 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] [airflow] darrenleeweber commented on a change in pull request #5825: [AIRFLOW-5218] less polling for AWS Batch status

2019-08-15 Thread GitBox
darrenleeweber commented on a change in pull request #5825: [AIRFLOW-5218] less polling for AWS Batch status URL: https://github.com/apache/airflow/pull/5825#discussion_r314423519 ## File path: airflow/contrib/operators/awsbatch_operator.py ## @@ -105,6 +106,7 @@ def

[GitHub] [airflow] akki commented on issue #5489: [AIRFLOW-4843] Allow orchestration via Docker Swarm (SwarmOperator)

2019-08-15 Thread GitBox
akki commented on issue #5489: [AIRFLOW-4843] Allow orchestration via Docker Swarm (SwarmOperator) URL: https://github.com/apache/airflow/pull/5489#issuecomment-521706461 @acordiner That's great. Would you like to list down your thoughts/ideas as a ticket in

[GitHub] [airflow] darrenleeweber commented on a change in pull request #5825: [AIRFLOW-5218] less polling for AWS Batch status

2019-08-15 Thread GitBox
darrenleeweber commented on a change in pull request #5825: [AIRFLOW-5218] less polling for AWS Batch status URL: https://github.com/apache/airflow/pull/5825#discussion_r314426834 ## File path: airflow/contrib/operators/awsbatch_operator.py ## @@ -105,6 +106,7 @@ def

[jira] [Created] (AIRFLOW-5231) S3Hook delete fails with over 1000 keys

2019-08-15 Thread Silviu Tantos (JIRA)
Silviu Tantos created AIRFLOW-5231: -- Summary: S3Hook delete fails with over 1000 keys Key: AIRFLOW-5231 URL: https://issues.apache.org/jira/browse/AIRFLOW-5231 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-5224) gcs_to_bq.GoogleCloudStorageToBigQueryOperator - Specify Encoding for BQ ingestion

2019-08-15 Thread Eric Walisko (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908420#comment-16908420 ] Eric Walisko commented on AIRFLOW-5224: --- I represent another team that is being impacted by this

[jira] [Updated] (AIRFLOW-5228) support statements for Airflow

2019-08-15 Thread Ramkumar (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramkumar updated AIRFLOW-5228: -- Description: Hallo I am working on an Airflow POC. I understand Airflow is an Open source project

[GitHub] [airflow] darrenleeweber commented on issue #5825: [AIRFLOW-5218] less polling for AWS Batch status

2019-08-15 Thread GitBox
darrenleeweber commented on issue #5825: [AIRFLOW-5218] less polling for AWS Batch status URL: https://github.com/apache/airflow/pull/5825#issuecomment-521802371 Most of the CI builds are OK but one of them timed-out and I don't have access to restart it -

[GitHub] [airflow] richgong edited a comment on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-08-15 Thread GitBox
richgong edited a comment on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-521805775 @milton0825 @potiuk @Fokko @kaxil @ashb @feng-tao Can we get a new release with this feature included?

[jira] [Updated] (AIRFLOW-5224) gcs_to_bq.GoogleCloudStorageToBigQueryOperator - Specify Encoding for BQ ingestion

2019-08-15 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-5224: --- Component/s: gcp > gcs_to_bq.GoogleCloudStorageToBigQueryOperator - Specify Encoding for

[jira] [Commented] (AIRFLOW-4285) Current TI DEPS are confusing and not up to date

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908509#comment-16908509 ] ASF GitHub Bot commented on AIRFLOW-4285: - KevinYang21 commented on pull request #5079:

[jira] [Commented] (AIRFLOW-5228) support statements for Airflow

2019-08-15 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908513#comment-16908513 ] Kamil Bregula commented on AIRFLOW-5228: In Airflow, deployment of the environment is a very

[GitHub] [airflow] potiuk merged pull request #5831: [AIRFLOW-5229] Consistent licences to all other files

2019-08-15 Thread GitBox
potiuk merged pull request #5831: [AIRFLOW-5229] Consistent licences to all other files URL: https://github.com/apache/airflow/pull/5831 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (AIRFLOW-5229) Add licence to all other file types

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908560#comment-16908560 ] ASF GitHub Bot commented on AIRFLOW-5229: - potiuk commented on pull request #5831:

[jira] [Commented] (AIRFLOW-5229) Add licence to all other file types

2019-08-15 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908561#comment-16908561 ] ASF subversion and git services commented on AIRFLOW-5229: -- Commit

[jira] [Commented] (AIRFLOW-5225) Consistent licences can be added automatically for all JS files

2019-08-15 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908567#comment-16908567 ] ASF subversion and git services commented on AIRFLOW-5225: -- Commit

[jira] [Resolved] (AIRFLOW-5225) Consistent licences can be added automatically for all JS files

2019-08-15 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5225. --- Resolution: Fixed Fix Version/s: 1.10.5 > Consistent licences can be added

[GitHub] [airflow] richgong commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-08-15 Thread GitBox
richgong commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-521805775 @milton0825 @potiuk @Fokko @kaxil Can we get a new release with this feature included?

[GitHub] [airflow] richgong edited a comment on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-08-15 Thread GitBox
richgong edited a comment on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-521805775 @milton0825 @potiuk @Fokko @kaxil @ashb Can we get a new release with this feature included?

[jira] [Updated] (AIRFLOW-5229) Add licence to all other file types

2019-08-15 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-5229: --- Summary: Add licence to all other file types (was: Add licence to all otehr file types)

[jira] [Closed] (AIRFLOW-5228) support statements for Airflow

2019-08-15 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula closed AIRFLOW-5228. -- Resolution: Invalid Jira is used to report bugs and requests for new features. This is not a

[GitHub] [airflow] mik-laj commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes

2019-08-15 Thread GitBox
mik-laj commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#discussion_r314521061 ## File path:

[GitHub] [airflow] milton0825 commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-08-15 Thread GitBox
milton0825 commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-521825390 We can probably include this PR as part of our next release but I am not sure how the release timeline looks like.

[jira] [Commented] (AIRFLOW-5227) Consistent licences for all .sql files

2019-08-15 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908558#comment-16908558 ] ASF subversion and git services commented on AIRFLOW-5227: -- Commit

[GitHub] [airflow] potiuk merged pull request #5829: [AIRFLOW-5227] Consistent licence for .sql files

2019-08-15 Thread GitBox
potiuk merged pull request #5829: [AIRFLOW-5227] Consistent licence for .sql files URL: https://github.com/apache/airflow/pull/5829 This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Commented] (AIRFLOW-5227) Consistent licences for all .sql files

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908557#comment-16908557 ] ASF GitHub Bot commented on AIRFLOW-5227: - potiuk commented on pull request #5829:

[jira] [Commented] (AIRFLOW-5227) Consistent licences for all .sql files

2019-08-15 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908559#comment-16908559 ] ASF subversion and git services commented on AIRFLOW-5227: -- Commit

[jira] [Resolved] (AIRFLOW-5227) Consistent licences for all .sql files

2019-08-15 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5227. --- Resolution: Fixed Fix Version/s: 1.10.5 > Consistent licences for all .sql files >

[GitHub] [airflow] KevinYang21 merged pull request #5079: [AIRFLOW-4285] Update task dependency context defination and usage

2019-08-15 Thread GitBox
KevinYang21 merged pull request #5079: [AIRFLOW-4285] Update task dependency context defination and usage URL: https://github.com/apache/airflow/pull/5079 This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (AIRFLOW-5228) support statements for Airflow

2019-08-15 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908508#comment-16908508 ] Kamil Bregula commented on AIRFLOW-5228: {quote}> a) Can you guide me for getting the support

[jira] [Commented] (AIRFLOW-5220) Easy form to create airflow dags

2019-08-15 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908516#comment-16908516 ] Kamil Bregula commented on AIRFLOW-5220: Are you planning to work on this feature? > Easy form

[GitHub] [airflow] mik-laj commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes

2019-08-15 Thread GitBox
mik-laj commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#discussion_r314521808 ## File path:

[GitHub] [airflow] mik-laj commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes

2019-08-15 Thread GitBox
mik-laj commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#discussion_r314521724 ## File path:

[GitHub] [airflow] mik-laj commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-08-15 Thread GitBox
mik-laj commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-521821005 it will be very difficult. Every releasr is a lot of work.it is difficult to make a separate release for one PR. Why

[jira] [Commented] (AIRFLOW-5225) Consistent licences can be added automatically for all JS files

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908563#comment-16908563 ] ASF GitHub Bot commented on AIRFLOW-5225: - potiuk commented on pull request #5827:

[jira] [Commented] (AIRFLOW-5225) Consistent licences can be added automatically for all JS files

2019-08-15 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908564#comment-16908564 ] ASF subversion and git services commented on AIRFLOW-5225: -- Commit

[jira] [Commented] (AIRFLOW-5229) Add licence to all other file types

2019-08-15 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908562#comment-16908562 ] ASF subversion and git services commented on AIRFLOW-5229: -- Commit

[GitHub] [airflow] potiuk merged pull request #5827: [AIRFLOW-5225] Consistent licence for all JS files

2019-08-15 Thread GitBox
potiuk merged pull request #5827: [AIRFLOW-5225] Consistent licence for all JS files URL: https://github.com/apache/airflow/pull/5827 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Resolved] (AIRFLOW-5229) Add licence to all other file types

2019-08-15 Thread Jarek Potiuk (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5229. --- Resolution: Fixed Fix Version/s: 1.10.5 > Add licence to all other file types >

[GitHub] [airflow] cBournhonesque commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class

2019-08-15 Thread GitBox
cBournhonesque commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class URL: https://github.com/apache/airflow/pull/5824#issuecomment-521745204 Do we want to treat sidecar containers differently then the main container? Shouldn't the API allow for the

[GitHub] [airflow] mik-laj opened a new pull request #5833: [AIRFLOW-XXX] Remove "Setup Test Environment using MySQL" article

2019-08-15 Thread GitBox
mik-laj opened a new pull request #5833: [AIRFLOW-XXX] Remove "Setup Test Environment using MySQL" article URL: https://github.com/apache/airflow/pull/5833 The CI environment has changed, so the page is no longer valid. https://github.com/apache/airflow/pull/4938 --- Make

[GitHub] [airflow] pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class

2019-08-15 Thread GitBox
pgagnon commented on issue #5824: [AIRFLOW-5215] Add sidecar containers support to Pod class URL: https://github.com/apache/airflow/pull/5824#issuecomment-521748700 @cBournhonesque At this time I am trying keep this as API-compatible as possible. Changing the `Pod` interface to accept a

[GitHub] [airflow] ashb commented on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-15 Thread GitBox
ashb commented on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-521767547 I'm testing out a few changes on my branch based off this one:

[GitHub] [airflow] mik-laj opened a new pull request #5834: [AIRFLOW-XXX] Group executors in one section

2019-08-15 Thread GitBox
mik-laj opened a new pull request #5834: [AIRFLOW-XXX] Group executors in one section URL: https://github.com/apache/airflow/pull/5834 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Updated] (AIRFLOW-5232) Create pagerdutyhook in the airflow plugins, to support pagerduty.

2019-08-15 Thread sri ram chegondi (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sri ram chegondi updated AIRFLOW-5232: -- Summary: Create pagerdutyhook in the airflow plugins, to support pagerduty. (was:

[jira] [Created] (AIRFLOW-5232) Add pagerdutyhook to the airflow default plugins

2019-08-15 Thread sri ram chegondi (JIRA)
sri ram chegondi created AIRFLOW-5232: - Summary: Add pagerdutyhook to the airflow default plugins Key: AIRFLOW-5232 URL: https://issues.apache.org/jira/browse/AIRFLOW-5232 Project: Apache Airflow

[GitHub] [airflow] codecov-io edited a comment on issue #5088: [AIRFLOW-4330] - Change _create_or_update_secret to work with python3

2019-08-15 Thread GitBox
codecov-io edited a comment on issue #5088: [AIRFLOW-4330] - Change _create_or_update_secret to work with python3 URL: https://github.com/apache/airflow/pull/5088#issuecomment-482559987 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5088?src=pr=h1) Report > :exclamation: No

[jira] [Created] (AIRFLOW-5233) Check for consistency in whitespace (tabs/eols) and common problems

2019-08-15 Thread Jarek Potiuk (JIRA)
Jarek Potiuk created AIRFLOW-5233: - Summary: Check for consistency in whitespace (tabs/eols) and common problems Key: AIRFLOW-5233 URL: https://issues.apache.org/jira/browse/AIRFLOW-5233 Project:

[GitHub] [airflow] potiuk opened a new pull request #5836: [AIRFLOW-5234] Rst files have consistent, auto-added license

2019-08-15 Thread GitBox
potiuk opened a new pull request #5836: [AIRFLOW-5234] Rst files have consistent, auto-added license URL: https://github.com/apache/airflow/pull/5836 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5234) Check for consistency and auto-add licences for .rst files

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908695#comment-16908695 ] ASF GitHub Bot commented on AIRFLOW-5234: - potiuk commented on pull request #5836:

[GitHub] [airflow] potiuk commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes

2019-08-15 Thread GitBox
potiuk commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#discussion_r314551942 ## File path: airflow/contrib/hooks/grpc_hook.py

[GitHub] [airflow] potiuk commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes

2019-08-15 Thread GitBox
potiuk commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#discussion_r314551685 ## File path: airflow/contrib/hooks/bigquery_hook.py

[jira] [Created] (AIRFLOW-5234) Check for consistency and auto-add licences for .rst files

2019-08-15 Thread Jarek Potiuk (JIRA)
Jarek Potiuk created AIRFLOW-5234: - Summary: Check for consistency and auto-add licences for .rst files Key: AIRFLOW-5234 URL: https://issues.apache.org/jira/browse/AIRFLOW-5234 Project: Apache

[GitHub] [airflow] potiuk commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes

2019-08-15 Thread GitBox
potiuk commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#discussion_r314556526 ## File path:

[GitHub] [airflow] potiuk commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes

2019-08-15 Thread GitBox
potiuk commented on a change in pull request #5786: [AIRFLOW-5170] Fix encoding pragmas, consistent licences for python files and related pylint fixes URL: https://github.com/apache/airflow/pull/5786#discussion_r314556794 ## File path:

  1   2   >