[GitHub] [airflow] TobKed commented on issue #6096: [AIRFLOW-5477] Rewrite Google PubSub Hook to Google Cloud Python

2019-09-19 Thread GitBox
TobKed commented on issue #6096: [AIRFLOW-5477] Rewrite Google PubSub Hook to Google Cloud Python URL: https://github.com/apache/airflow/pull/6096#issuecomment-532984150 Rebased on the last `master`. This is an automated

[GitHub] [airflow] haoliang7 opened a new pull request #6149: [AIRFLOW-XXX] Fix typo and format error

2019-09-19 Thread GitBox
haoliang7 opened a new pull request #6149: [AIRFLOW-XXX] Fix typo and format error URL: https://github.com/apache/airflow/pull/6149 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] mohannadbanayosi opened a new pull request #6151: [AIRFLOW-5522] BQ list dataset tables operator

2019-09-19 Thread GitBox
mohannadbanayosi opened a new pull request #6151: [AIRFLOW-5522] BQ list dataset tables operator URL: https://github.com/apache/airflow/pull/6151 ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW-5522) issues and references

[jira] [Commented] (AIRFLOW-4928) Remove redundant config parsing in DagBag

2019-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933178#comment-16933178 ] ASF GitHub Bot commented on AIRFLOW-4928: - ashb commented on pull request #5557: [AIRFLOW-4928]

[jira] [Commented] (AIRFLOW-4928) Remove redundant config parsing in DagBag

2019-09-19 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933179#comment-16933179 ] ASF subversion and git services commented on AIRFLOW-4928: -- Commit

[GitHub] [airflow] ashb merged pull request #5557: [AIRFLOW-4928] Move all config parses to class properties

2019-09-19 Thread GitBox
ashb merged pull request #5557: [AIRFLOW-4928] Move all config parses to class properties URL: https://github.com/apache/airflow/pull/5557 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] mik-laj commented on issue #5643: [AIRFLOW-3617] Kubernetes gpu support

2019-09-19 Thread GitBox
mik-laj commented on issue #5643: [AIRFLOW-3617] Kubernetes gpu support URL: https://github.com/apache/airflow/pull/5643#issuecomment-533062413 Because request must be equals to limits if you define GPU resources. This is an

[GitHub] [airflow] TobKed commented on issue #6142: [AIRFLOW-5515] Add stacklevel to GCP deprecation warnings

2019-09-19 Thread GitBox
TobKed commented on issue #6142: [AIRFLOW-5515] Add stacklevel to GCP deprecation warnings URL: https://github.com/apache/airflow/pull/6142#issuecomment-532986961 I've added stacklevel to mentioned files and rebased on the newest `master`.

[GitHub] [airflow] ashb commented on a change in pull request #6130: [AIRFLOW-5508] Add a whitelist mechanism for the StatsD metrics

2019-09-19 Thread GitBox
ashb commented on a change in pull request #6130: [AIRFLOW-5508] Add a whitelist mechanism for the StatsD metrics URL: https://github.com/apache/airflow/pull/6130#discussion_r326060714 ## File path: scripts/ci/kubernetes/kube/templates/configmaps.template.yaml ## @@ -54,6

[jira] [Commented] (AIRFLOW-5522) BQ operator to get list of dataset tables

2019-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933216#comment-16933216 ] ASF GitHub Bot commented on AIRFLOW-5522: - mohannadbanayosi commented on pull request #6151:

[GitHub] [airflow] aaaaahaaaaa commented on issue #5643: [AIRFLOW-3617] Kubernetes gpu support

2019-09-19 Thread GitBox
aha commented on issue #5643: [AIRFLOW-3617] Kubernetes gpu support URL: https://github.com/apache/airflow/pull/5643#issuecomment-533061811 @CatarinaSilva Is there a reason why this PR only allows to specify `limits` but not `requests` for GPUs?

[GitHub] [airflow] nuclearpinguin commented on issue #6139: [AIRFLOW-5513] Move example_pubsub_flow.py to GCP package

2019-09-19 Thread GitBox
nuclearpinguin commented on issue #6139: [AIRFLOW-5513] Move example_pubsub_flow.py to GCP package URL: https://github.com/apache/airflow/pull/6139#issuecomment-533010648 I extended the `example_pubsub.py` and removed the other one. Now everything is in one place.

[jira] [Resolved] (AIRFLOW-4928) Remove redundant config parsing in DagBag

2019-09-19 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-4928. Fix Version/s: 2.0.0 Resolution: Fixed > Remove redundant config parsing

[GitHub] [airflow] eladkal commented on issue #5564: [AIRFLOW-4289] fix spark_binary argument being ignored in SparkSubmit…

2019-09-19 Thread GitBox
eladkal commented on issue #5564: [AIRFLOW-4289] fix spark_binary argument being ignored in SparkSubmit… URL: https://github.com/apache/airflow/pull/5564#issuecomment-533038775 @boiler i see the problem I will PR a fix This

[GitHub] [airflow] clacke commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-09-19 Thread GitBox
clacke commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-533051838 I can't believe I actually found it.

[GitHub] [airflow] TobKed opened a new pull request #6150: [AIRFLOW-5521] Fix link to GCP documentation

2019-09-19 Thread GitBox
TobKed opened a new pull request #6150: [AIRFLOW-5521] Fix link to GCP documentation URL: https://github.com/apache/airflow/pull/6150 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5521) Fix link to GCP documentation

2019-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933204#comment-16933204 ] ASF GitHub Bot commented on AIRFLOW-5521: - TobKed commented on pull request #6150:

[jira] [Commented] (AIRFLOW-5521) Fix link to GCP documentation

2019-09-19 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933232#comment-16933232 ] ASF subversion and git services commented on AIRFLOW-5521: -- Commit

[GitHub] [airflow] ashb commented on issue #6130: [AIRFLOW-5508] Add a whitelist mechanism for the StatsD metrics

2019-09-19 Thread GitBox
ashb commented on issue #6130: [AIRFLOW-5508] Add a whitelist mechanism for the StatsD metrics URL: https://github.com/apache/airflow/pull/6130#issuecomment-533060677 Random point: Could you find a name to use other than "whitelist" - perhaps "allow_list"?

[GitHub] [airflow] TobKed opened a new pull request #6148: [AIRFLOW-XXX] Add link to GCP Example DAGs source code

2019-09-19 Thread GitBox
TobKed opened a new pull request #6148: [AIRFLOW-XXX] Add link to GCP Example DAGs source code URL: https://github.com/apache/airflow/pull/6148 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] mik-laj commented on issue #5643: [AIRFLOW-3617] Kubernetes gpu support

2019-09-19 Thread GitBox
mik-laj commented on issue #5643: [AIRFLOW-3617] Kubernetes gpu support URL: https://github.com/apache/airflow/pull/5643#issuecomment-533062862 You can specify GPU in both limits and requests but these two values must be equal.

[jira] [Created] (AIRFLOW-5521) Fix link to GCP documentation

2019-09-19 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-5521: --- Summary: Fix link to GCP documentation Key: AIRFLOW-5521 URL: https://issues.apache.org/jira/browse/AIRFLOW-5521 Project: Apache Airflow Issue

[GitHub] [airflow] qlemaire22 commented on issue #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration

2019-09-19 Thread GitBox
qlemaire22 commented on issue #6124: [AIRFLOW-5501] in_cluster default value in KubernetesPodOperator overwrites configuration URL: https://github.com/apache/airflow/pull/6124#issuecomment-533001017 Fix committer. This is an

[jira] [Created] (AIRFLOW-5522) BQ operator to get list of dataset tables

2019-09-19 Thread Mohannad Albanayosy (Jira)
Mohannad Albanayosy created AIRFLOW-5522: Summary: BQ operator to get list of dataset tables Key: AIRFLOW-5522 URL: https://issues.apache.org/jira/browse/AIRFLOW-5522 Project: Apache Airflow

[GitHub] [airflow] clacke commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill

2019-09-19 Thread GitBox
clacke commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler instead of backfill URL: https://github.com/apache/airflow/pull/5498#issuecomment-533049167 Correction: We have actually moved to using `POST /api/experimental/dags/:dag_id/dag_runs` for triggering the DAG, not

[jira] [Commented] (AIRFLOW-5521) Fix link to GCP documentation

2019-09-19 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933231#comment-16933231 ] ASF subversion and git services commented on AIRFLOW-5521: -- Commit

[GitHub] [airflow] ashb merged pull request #6150: [AIRFLOW-5521] Fix link to GCP documentation

2019-09-19 Thread GitBox
ashb merged pull request #6150: [AIRFLOW-5521] Fix link to GCP documentation URL: https://github.com/apache/airflow/pull/6150 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] ashb commented on issue #6150: [AIRFLOW-5521] Fix link to GCP documentation

2019-09-19 Thread GitBox
ashb commented on issue #6150: [AIRFLOW-5521] Fix link to GCP documentation URL: https://github.com/apache/airflow/pull/6150#issuecomment-533058609 Docs stage has passed, I'm merging this. This is an automated message from

[jira] [Commented] (AIRFLOW-5521) Fix link to GCP documentation

2019-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933230#comment-16933230 ] ASF GitHub Bot commented on AIRFLOW-5521: - ashb commented on pull request #6150: [AIRFLOW-5521]

[GitHub] [airflow] haoliang7 commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel

2019-09-19 Thread GitBox
haoliang7 commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel URL: https://github.com/apache/airflow/pull/6147#issuecomment-533071890 > If you want to install an integration service like GCP you can install it via `pip install -e ".[devel,gcp]"` @feluelle

[GitHub] [airflow] codecov-io edited a comment on issue #5998: [AIRFLOW-5398] Update contrib example DAGs to context manager

2019-09-19 Thread GitBox
codecov-io edited a comment on issue #5998: [AIRFLOW-5398] Update contrib example DAGs to context manager URL: https://github.com/apache/airflow/pull/5998#issuecomment-531900151 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5998?src=pr=h1) Report > Merging

[GitHub] [airflow] mohannadbanayosi commented on issue #6151: [AIRFLOW-5522] BQ list dataset tables operator

2019-09-19 Thread GitBox
mohannadbanayosi commented on issue #6151: [AIRFLOW-5522] BQ list dataset tables operator URL: https://github.com/apache/airflow/pull/6151#issuecomment-533126538 Extended the BQ example DAG to include the new operator. @nuclearpinguin

[GitHub] [airflow] ashb commented on a change in pull request #6102: WIP: [AIRFLOW-4309] Remove Broken Dag error after Dag is deleted

2019-09-19 Thread GitBox
ashb commented on a change in pull request #6102: WIP: [AIRFLOW-4309] Remove Broken Dag error after Dag is deleted URL: https://github.com/apache/airflow/pull/6102#discussion_r326195843 ## File path: airflow/api/common/experimental/delete_dag.py ## @@ -22,7 +22,7 @@ from

[GitHub] [airflow] kaxil commented on a change in pull request #6102: WIP: [AIRFLOW-4309] Remove Broken Dag error after Dag is deleted

2019-09-19 Thread GitBox
kaxil commented on a change in pull request #6102: WIP: [AIRFLOW-4309] Remove Broken Dag error after Dag is deleted URL: https://github.com/apache/airflow/pull/6102#discussion_r326200216 ## File path: airflow/api/common/experimental/delete_dag.py ## @@ -22,7 +22,7 @@

[GitHub] [airflow] feluelle removed a comment on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel

2019-09-19 Thread GitBox
feluelle removed a comment on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel URL: https://github.com/apache/airflow/pull/6147#issuecomment-533067492 I don't think this is right. Because it is not a `minimal requirement` for all example dags to run.

[GitHub] [airflow] kaxil commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-09-19 Thread GitBox
kaxil commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-533073129 @KevinYang21 Can we please create a new Jira issue for this so that it is easier to understand in Changelog

[GitHub] [airflow] feluelle commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel

2019-09-19 Thread GitBox
feluelle commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel URL: https://github.com/apache/airflow/pull/6147#issuecomment-533088400 Maybe we should differentiate between example dags for minimal installation and advanced installation enabling advanced examples?

[GitHub] [airflow] mik-laj edited a comment on issue #5643: [AIRFLOW-3617] Kubernetes gpu support

2019-09-19 Thread GitBox
mik-laj edited a comment on issue #5643: [AIRFLOW-3617] Kubernetes gpu support URL: https://github.com/apache/airflow/pull/5643#issuecomment-533062862 > You can specify GPU in both limits and requests but these two values must be equal.

[GitHub] [airflow] feluelle removed a comment on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel

2019-09-19 Thread GitBox
feluelle removed a comment on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel URL: https://github.com/apache/airflow/pull/6147#issuecomment-533067916 If you want to install an integration service like GCP you can install it via `pip install -e ".[devel,gcp]"`

[jira] [Commented] (AIRFLOW-5224) gcs_to_bq.GoogleCloudStorageToBigQueryOperator - Specify Encoding for BQ ingestion

2019-09-19 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933260#comment-16933260 ] Kaxil Naik commented on AIRFLOW-5224: - Sure, we can add this in our next release.   Can you send

[GitHub] [airflow] haoliang7 commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel

2019-09-19 Thread GitBox
haoliang7 commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel URL: https://github.com/apache/airflow/pull/6147#issuecomment-533076731 > I don't think this is right. Because it is not a minimal requirement for all example dags to run. > > If you want to install

[GitHub] [airflow] codecov-io edited a comment on issue #6093: [AIRFLOW-5475] Normalize gcp_conn_id in operators and hooks

2019-09-19 Thread GitBox
codecov-io edited a comment on issue #6093: [AIRFLOW-5475] Normalize gcp_conn_id in operators and hooks URL: https://github.com/apache/airflow/pull/6093#issuecomment-531406726 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6093?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6093: [AIRFLOW-5475] Normalize gcp_conn_id in operators and hooks

2019-09-19 Thread GitBox
codecov-io edited a comment on issue #6093: [AIRFLOW-5475] Normalize gcp_conn_id in operators and hooks URL: https://github.com/apache/airflow/pull/6093#issuecomment-531406726 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6093?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-09-19 Thread GitBox
codecov-io edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-529755241 # [Codecov](https://codecov.io/gh/apache/airflow/pull/5743?src=pr=h1) Report > Merging

[GitHub] [airflow] feluelle commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel

2019-09-19 Thread GitBox
feluelle commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel URL: https://github.com/apache/airflow/pull/6147#issuecomment-533067916 If you want to install an integration service like GCP you can install it via `pip install -e ".[devel,gcp]"`

[GitHub] [airflow] kaxil commented on a change in pull request #6130: [AIRFLOW-5508] Add a whitelist mechanism for the StatsD metrics

2019-09-19 Thread GitBox
kaxil commented on a change in pull request #6130: [AIRFLOW-5508] Add a whitelist mechanism for the StatsD metrics URL: https://github.com/apache/airflow/pull/6130#discussion_r326103752 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -538,6 +538,9 @@

[GitHub] [airflow] codecov-io edited a comment on issue #6139: [AIRFLOW-5513] Move example_pubsub_flow.py to GCP package

2019-09-19 Thread GitBox
codecov-io edited a comment on issue #6139: [AIRFLOW-5513] Move example_pubsub_flow.py to GCP package URL: https://github.com/apache/airflow/pull/6139#issuecomment-532712379 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6139?src=pr=h1) Report > Merging

[GitHub] [airflow] mohannadbanayosi commented on a change in pull request #6151: [AIRFLOW-5522] BQ list dataset tables operator

2019-09-19 Thread GitBox
mohannadbanayosi commented on a change in pull request #6151: [AIRFLOW-5522] BQ list dataset tables operator URL: https://github.com/apache/airflow/pull/6151#discussion_r326169066 ## File path: airflow/gcp/hooks/bigquery.py ## @@ -1430,6 +1430,38 @@ def cancel_query(self)

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6151: [AIRFLOW-5522] BQ list dataset tables operator

2019-09-19 Thread GitBox
nuclearpinguin commented on a change in pull request #6151: [AIRFLOW-5522] BQ list dataset tables operator URL: https://github.com/apache/airflow/pull/6151#discussion_r326137711 ## File path: airflow/gcp/hooks/bigquery.py ## @@ -1430,6 +1430,38 @@ def cancel_query(self)

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #6151: [AIRFLOW-5522] BQ list dataset tables operator

2019-09-19 Thread GitBox
nuclearpinguin commented on a change in pull request #6151: [AIRFLOW-5522] BQ list dataset tables operator URL: https://github.com/apache/airflow/pull/6151#discussion_r326137711 ## File path: airflow/gcp/hooks/bigquery.py ## @@ -1430,6 +1430,38 @@ def cancel_query(self)

[GitHub] [airflow] kaxil opened a new pull request #6152: [AIRFLOW-XXX] Fix incorrect units in docs for metrics using Timers

2019-09-19 Thread GitBox
kaxil opened a new pull request #6152: [AIRFLOW-XXX] Fix incorrect units in docs for metrics using Timers URL: https://github.com/apache/airflow/pull/6152 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] codecov-io edited a comment on issue #6142: [AIRFLOW-5515] Add stacklevel to GCP deprecation warnings

2019-09-19 Thread GitBox
codecov-io edited a comment on issue #6142: [AIRFLOW-5515] Add stacklevel to GCP deprecation warnings URL: https://github.com/apache/airflow/pull/6142#issuecomment-532767410 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6142?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-5224) gcs_to_bq.GoogleCloudStorageToBigQueryOperator - Specify Encoding for BQ ingestion

2019-09-19 Thread Anand Kumar (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933606#comment-16933606 ] Anand Kumar commented on AIRFLOW-5224: -- [~kaxilnaik] That's right and it doesn't automatically

[GitHub] [airflow] feng-tao merged pull request #6152: [AIRFLOW-XXX] Fix incorrect units in docs for metrics using Timers

2019-09-19 Thread GitBox
feng-tao merged pull request #6152: [AIRFLOW-XXX] Fix incorrect units in docs for metrics using Timers URL: https://github.com/apache/airflow/pull/6152 This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] codecov-io commented on issue #6152: [AIRFLOW-XXX] Fix incorrect units in docs for metrics using Timers

2019-09-19 Thread GitBox
codecov-io commented on issue #6152: [AIRFLOW-XXX] Fix incorrect units in docs for metrics using Timers URL: https://github.com/apache/airflow/pull/6152#issuecomment-533196353 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6152?src=pr=h1) Report > Merging

[GitHub] [airflow] nuclearpinguin commented on issue #6122: [AIRFLOW-5499] Move GCP utils to core

2019-09-19 Thread GitBox
nuclearpinguin commented on issue #6122: [AIRFLOW-5499] Move GCP utils to core URL: https://github.com/apache/airflow/pull/6122#issuecomment-533214025 @mik-laj can we move on? This is an automated message from the Apache Git

[jira] [Commented] (AIRFLOW-5224) gcs_to_bq.GoogleCloudStorageToBigQueryOperator - Specify Encoding for BQ ingestion

2019-09-19 Thread Eric Walisko (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933598#comment-16933598 ] Eric Walisko commented on AIRFLOW-5224: --- [~kaxilnaik] I wish it did, however we saw this error

[GitHub] [airflow] codecov-io edited a comment on issue #6152: [AIRFLOW-XXX] Fix incorrect units in docs for metrics using Timers

2019-09-19 Thread GitBox
codecov-io edited a comment on issue #6152: [AIRFLOW-XXX] Fix incorrect units in docs for metrics using Timers URL: https://github.com/apache/airflow/pull/6152#issuecomment-533196353 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6152?src=pr=h1) Report > Merging

[GitHub] [airflow] feluelle commented on issue #6066: [AIRFLOW-XXX] Update to new logo

2019-09-19 Thread GitBox
feluelle commented on issue #6066: [AIRFLOW-XXX] Update to new logo URL: https://github.com/apache/airflow/pull/6066#issuecomment-533225097 What do you guys think of adding the `wordmark` logo to the [landscape](https://github.com/cncf/landscape) ?

[GitHub] [airflow] nuclearpinguin commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel

2019-09-19 Thread GitBox
nuclearpinguin commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel URL: https://github.com/apache/airflow/pull/6147#issuecomment-533283500 @haoliang7 can you share the error? This is an automated message

[GitHub] [airflow] nuclearpinguin removed a comment on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel

2019-09-19 Thread GitBox
nuclearpinguin removed a comment on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel URL: https://github.com/apache/airflow/pull/6147#issuecomment-533283500 @haoliang7 can you share the error? This is an automated

[jira] [Commented] (AIRFLOW-5515) Add stacklevel to GCP deprecation warnings

2019-09-19 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933765#comment-16933765 ] ASF subversion and git services commented on AIRFLOW-5515: -- Commit

[GitHub] [airflow] mik-laj merged pull request #6139: [AIRFLOW-5513] Move example_pubsub_flow.py to GCP package

2019-09-19 Thread GitBox
mik-laj merged pull request #6139: [AIRFLOW-5513] Move example_pubsub_flow.py to GCP package URL: https://github.com/apache/airflow/pull/6139 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-5515) Add stacklevel to GCP deprecation warnings

2019-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933764#comment-16933764 ] ASF GitHub Bot commented on AIRFLOW-5515: - mik-laj commented on pull request #6142:

[GitHub] [airflow] penghou620 opened a new pull request #6153: [AIRFLOW-3388] Add support to Array Jobs for AWS Batch Operator

2019-09-19 Thread GitBox
penghou620 opened a new pull request #6153: [AIRFLOW-3388] Add support to Array Jobs for AWS Batch Operator URL: https://github.com/apache/airflow/pull/6153 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-5523) DAGs never get cleaned up from webservers if DAG file is removed from the scheduler

2019-09-19 Thread Dan Davydov (Jira)
Dan Davydov created AIRFLOW-5523: Summary: DAGs never get cleaned up from webservers if DAG file is removed from the scheduler Key: AIRFLOW-5523 URL: https://issues.apache.org/jira/browse/AIRFLOW-5523

[GitHub] [airflow] codecov-io commented on issue #6153: [AIRFLOW-3388] Add support to Array Jobs for AWS Batch Operator

2019-09-19 Thread GitBox
codecov-io commented on issue #6153: [AIRFLOW-3388] Add support to Array Jobs for AWS Batch Operator URL: https://github.com/apache/airflow/pull/6153#issuecomment-533301847 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6153?src=pr=h1) Report > Merging

[GitHub] [airflow] mik-laj merged pull request #6142: [AIRFLOW-5515] Add stacklevel to GCP deprecation warnings

2019-09-19 Thread GitBox
mik-laj merged pull request #6142: [AIRFLOW-5515] Add stacklevel to GCP deprecation warnings URL: https://github.com/apache/airflow/pull/6142 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] mik-laj commented on issue #6122: [AIRFLOW-5499] Move GCP utils to core

2019-09-19 Thread GitBox
mik-laj commented on issue #6122: [AIRFLOW-5499] Move GCP utils to core URL: https://github.com/apache/airflow/pull/6122#issuecomment-533312772 Sorry. I'm busy now, but I looked. I have an important client project and it's hard to find the time to review open source changes. I hope you

[jira] [Commented] (AIRFLOW-3388) AWS Batch Operator, add support to Array Jobs

2019-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933725#comment-16933725 ] ASF GitHub Bot commented on AIRFLOW-3388: - penghou620 commented on pull request #6153:

[GitHub] [airflow] nuclearpinguin commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel

2019-09-19 Thread GitBox
nuclearpinguin commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel URL: https://github.com/apache/airflow/pull/6147#issuecomment-533285705 > Maybe we should differentiate between example dags for minimal installation and advanced installation enabling advanced

[jira] [Commented] (AIRFLOW-5513) Move example_pubsub_flow.py to GCP package

2019-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933766#comment-16933766 ] ASF GitHub Bot commented on AIRFLOW-5513: - mik-laj commented on pull request #6139:

[jira] [Commented] (AIRFLOW-5513) Move example_pubsub_flow.py to GCP package

2019-09-19 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933767#comment-16933767 ] ASF subversion and git services commented on AIRFLOW-5513: -- Commit

[GitHub] [airflow] TobKed opened a new pull request #6154: [AIRFLOW-5526] Update docs configuration due to migration of GCP docs

2019-09-19 Thread GitBox
TobKed opened a new pull request #6154: [AIRFLOW-5526] Update docs configuration due to migration of GCP docs URL: https://github.com/apache/airflow/pull/6154 Make sure you have checked _all_ steps below. ### Jira - [ ] https://issues.apache.org/jira/browse/AIRFLOW-5526

[jira] [Created] (AIRFLOW-5525) Extra TaskTemplate and ContainerSpec arguments in SwarmOperator

2019-09-19 Thread Alister Cordiner (Jira)
Alister Cordiner created AIRFLOW-5525: - Summary: Extra TaskTemplate and ContainerSpec arguments in SwarmOperator Key: AIRFLOW-5525 URL: https://issues.apache.org/jira/browse/AIRFLOW-5525 Project:

[GitHub] [airflow] iroddis commented on issue #5787: [AIRFLOW-5172] Add choice of interval edge scheduling

2019-09-19 Thread GitBox
iroddis commented on issue #5787: [AIRFLOW-5172] Add choice of interval edge scheduling URL: https://github.com/apache/airflow/pull/5787#issuecomment-533383000 Sorry for the random commits on this. Getting the unit tests running is still a challenge, especially on osx where I'm doing

[jira] [Created] (AIRFLOW-5526) Update docs configuration due to migration of GCP docs

2019-09-19 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-5526: --- Summary: Update docs configuration due to migration of GCP docs Key: AIRFLOW-5526 URL: https://issues.apache.org/jira/browse/AIRFLOW-5526 Project:

[GitHub] [airflow] feluelle commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel

2019-09-19 Thread GitBox
feluelle commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into devel URL: https://github.com/apache/airflow/pull/6147#issuecomment-533067492 I don't think this is right. Because it is not a `minimal requirement` for all example dags to run.

[GitHub] [airflow] ashb commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de…

2019-09-19 Thread GitBox
ashb commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and behaviour of zombie de… URL: https://github.com/apache/airflow/pull/5908#issuecomment-533072256 I don't really have the context anymore to review this usefully, but if Stefan thinks this is okay lets go with it.

[GitHub] [airflow] codecov-io edited a comment on issue #6122: [AIRFLOW-5499] Move GCP utils to core

2019-09-19 Thread GitBox
codecov-io edited a comment on issue #6122: [AIRFLOW-5499] Move GCP utils to core URL: https://github.com/apache/airflow/pull/6122#issuecomment-531783904 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6122?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-5526) Update docs configuration due to migration of GCP docs

2019-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934090#comment-16934090 ] ASF GitHub Bot commented on AIRFLOW-5526: - TobKed commented on pull request #6154:

[GitHub] [airflow] TobKed commented on issue #6154: [AIRFLOW-5526] Update docs configuration due to migration of GCP docs

2019-09-19 Thread GitBox
TobKed commented on issue #6154: [AIRFLOW-5526] Update docs configuration due to migration of GCP docs URL: https://github.com/apache/airflow/pull/6154#issuecomment-533418518 cc @ashb This is an automated message from the

[GitHub] [airflow] mik-laj commented on issue #6154: [AIRFLOW-5526] Update docs configuration due to migration of GCP docs

2019-09-19 Thread GitBox
mik-laj commented on issue #6154: [AIRFLOW-5526] Update docs configuration due to migration of GCP docs URL: https://github.com/apache/airflow/pull/6154#issuecomment-533418637 Are we use all these libraries? Can you check it? 'pip freeze|grep -v' I'm afraid of build speed also. Does it

[jira] [Created] (AIRFLOW-5524) Airflow Mark Success tasks in GUI uses values from Clear

2019-09-19 Thread Felix Tubiana (Jira)
Felix Tubiana created AIRFLOW-5524: -- Summary: Airflow Mark Success tasks in GUI uses values from Clear Key: AIRFLOW-5524 URL: https://issues.apache.org/jira/browse/AIRFLOW-5524 Project: Apache

[jira] [Commented] (AIRFLOW-2910) models.Connection cannot use https

2019-09-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933831#comment-16933831 ] ASF GitHub Bot commented on AIRFLOW-2910: - potiuk commented on pull request #5239:

[GitHub] [airflow] potiuk closed pull request #5239: [WIP][AIRFLOW-2910] Add HTTP URI support

2019-09-19 Thread GitBox
potiuk closed pull request #5239: [WIP][AIRFLOW-2910] Add HTTP URI support URL: https://github.com/apache/airflow/pull/5239 This is an automated message from the Apache Git Service. To respond to the message, please log on