TobKed commented on issue #6096: [AIRFLOW-5477] Rewrite Google PubSub Hook to
Google Cloud Python
URL: https://github.com/apache/airflow/pull/6096#issuecomment-532984150
Rebased on the last `master`.
This is an automated
haoliang7 opened a new pull request #6149: [AIRFLOW-XXX] Fix typo and format
error
URL: https://github.com/apache/airflow/pull/6149
Make sure you have checked _all_ steps below.
### Jira
- [ ] My PR addresses the following [Airflow
mohannadbanayosi opened a new pull request #6151: [AIRFLOW-5522] BQ list
dataset tables operator
URL: https://github.com/apache/airflow/pull/6151
### Jira
- [x] My PR addresses the following [Airflow
Jira](https://issues.apache.org/jira/browse/AIRFLOW-5522) issues and references
[
https://issues.apache.org/jira/browse/AIRFLOW-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933178#comment-16933178
]
ASF GitHub Bot commented on AIRFLOW-4928:
-
ashb commented on pull request #5557: [AIRFLOW-4928]
[
https://issues.apache.org/jira/browse/AIRFLOW-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933179#comment-16933179
]
ASF subversion and git services commented on AIRFLOW-4928:
--
Commit
ashb merged pull request #5557: [AIRFLOW-4928] Move all config parses to class
properties
URL: https://github.com/apache/airflow/pull/5557
This is an automated message from the Apache Git Service.
To respond to the message,
mik-laj commented on issue #5643: [AIRFLOW-3617] Kubernetes gpu support
URL: https://github.com/apache/airflow/pull/5643#issuecomment-533062413
Because request must be equals to limits if you define GPU resources.
This is an
TobKed commented on issue #6142: [AIRFLOW-5515] Add stacklevel to GCP
deprecation warnings
URL: https://github.com/apache/airflow/pull/6142#issuecomment-532986961
I've added stacklevel to mentioned files and rebased on the newest `master`.
ashb commented on a change in pull request #6130: [AIRFLOW-5508] Add a
whitelist mechanism for the StatsD metrics
URL: https://github.com/apache/airflow/pull/6130#discussion_r326060714
##
File path: scripts/ci/kubernetes/kube/templates/configmaps.template.yaml
##
@@ -54,6
[
https://issues.apache.org/jira/browse/AIRFLOW-5522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933216#comment-16933216
]
ASF GitHub Bot commented on AIRFLOW-5522:
-
mohannadbanayosi commented on pull request #6151:
[
https://issues.apache.org/jira/browse/AIRFLOW-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ash Berlin-Taylor resolved AIRFLOW-4928.
Fix Version/s: 2.0.0
Resolution: Fixed
> Remove redundant config parsing
eladkal commented on issue #5564: [AIRFLOW-4289] fix spark_binary argument
being ignored in SparkSubmit…
URL: https://github.com/apache/airflow/pull/5564#issuecomment-533038775
@boiler i see the problem I will PR a fix
This
clacke commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler
instead of backfill
URL: https://github.com/apache/airflow/pull/5498#issuecomment-533051838
I can't believe I actually found it.
TobKed opened a new pull request #6150: [AIRFLOW-5521] Fix link to GCP
documentation
URL: https://github.com/apache/airflow/pull/6150
Make sure you have checked _all_ steps below.
### Jira
- [ ] My PR addresses the following [Airflow
[
https://issues.apache.org/jira/browse/AIRFLOW-5521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933204#comment-16933204
]
ASF GitHub Bot commented on AIRFLOW-5521:
-
TobKed commented on pull request #6150:
[
https://issues.apache.org/jira/browse/AIRFLOW-5521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933232#comment-16933232
]
ASF subversion and git services commented on AIRFLOW-5521:
--
Commit
ashb commented on issue #6130: [AIRFLOW-5508] Add a whitelist mechanism for the
StatsD metrics
URL: https://github.com/apache/airflow/pull/6130#issuecomment-533060677
Random point: Could you find a name to use other than "whitelist" - perhaps
"allow_list"?
TobKed opened a new pull request #6148: [AIRFLOW-XXX] Add link to GCP Example
DAGs source code
URL: https://github.com/apache/airflow/pull/6148
Make sure you have checked _all_ steps below.
### Jira
- [ ] My PR addresses the following [Airflow
mik-laj commented on issue #5643: [AIRFLOW-3617] Kubernetes gpu support
URL: https://github.com/apache/airflow/pull/5643#issuecomment-533062862
You can specify GPU in both limits and requests but these two values must be
equal.
Tobiasz Kedzierski created AIRFLOW-5521:
---
Summary: Fix link to GCP documentation
Key: AIRFLOW-5521
URL: https://issues.apache.org/jira/browse/AIRFLOW-5521
Project: Apache Airflow
Issue
qlemaire22 commented on issue #6124: [AIRFLOW-5501] in_cluster default value in
KubernetesPodOperator overwrites configuration
URL: https://github.com/apache/airflow/pull/6124#issuecomment-533001017
Fix committer.
This is an
Mohannad Albanayosy created AIRFLOW-5522:
Summary: BQ operator to get list of dataset tables
Key: AIRFLOW-5522
URL: https://issues.apache.org/jira/browse/AIRFLOW-5522
Project: Apache Airflow
clacke commented on issue #5498: [AIRFLOW-4509] SubDagOperator using scheduler
instead of backfill
URL: https://github.com/apache/airflow/pull/5498#issuecomment-533049167
Correction: We have actually moved to using `POST
/api/experimental/dags/:dag_id/dag_runs` for triggering the DAG, not
[
https://issues.apache.org/jira/browse/AIRFLOW-5521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933231#comment-16933231
]
ASF subversion and git services commented on AIRFLOW-5521:
--
Commit
ashb merged pull request #6150: [AIRFLOW-5521] Fix link to GCP documentation
URL: https://github.com/apache/airflow/pull/6150
This is an automated message from the Apache Git Service.
To respond to the message, please log on
ashb commented on issue #6150: [AIRFLOW-5521] Fix link to GCP documentation
URL: https://github.com/apache/airflow/pull/6150#issuecomment-533058609
Docs stage has passed, I'm merging this.
This is an automated message from
[
https://issues.apache.org/jira/browse/AIRFLOW-5521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933230#comment-16933230
]
ASF GitHub Bot commented on AIRFLOW-5521:
-
ashb commented on pull request #6150: [AIRFLOW-5521]
haoliang7 commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into
devel
URL: https://github.com/apache/airflow/pull/6147#issuecomment-533071890
> If you want to install an integration service like GCP you can install it
via `pip install -e ".[devel,gcp]"`
@feluelle
codecov-io edited a comment on issue #5998: [AIRFLOW-5398] Update contrib
example DAGs to context manager
URL: https://github.com/apache/airflow/pull/5998#issuecomment-531900151
# [Codecov](https://codecov.io/gh/apache/airflow/pull/5998?src=pr=h1)
Report
> Merging
mohannadbanayosi commented on issue #6151: [AIRFLOW-5522] BQ list dataset
tables operator
URL: https://github.com/apache/airflow/pull/6151#issuecomment-533126538
Extended the BQ example DAG to include the new operator. @nuclearpinguin
ashb commented on a change in pull request #6102: WIP: [AIRFLOW-4309] Remove
Broken Dag error after Dag is deleted
URL: https://github.com/apache/airflow/pull/6102#discussion_r326195843
##
File path: airflow/api/common/experimental/delete_dag.py
##
@@ -22,7 +22,7 @@
from
kaxil commented on a change in pull request #6102: WIP: [AIRFLOW-4309] Remove
Broken Dag error after Dag is deleted
URL: https://github.com/apache/airflow/pull/6102#discussion_r326200216
##
File path: airflow/api/common/experimental/delete_dag.py
##
@@ -22,7 +22,7 @@
feluelle removed a comment on issue #6147: [AIRFLOW-5512] Add gcp dependencies
into devel
URL: https://github.com/apache/airflow/pull/6147#issuecomment-533067492
I don't think this is right. Because it is not a `minimal requirement` for
all example dags to run.
kaxil commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and
behaviour of zombie de…
URL: https://github.com/apache/airflow/pull/5908#issuecomment-533073129
@KevinYang21 Can we please create a new Jira issue for this so that it is
easier to understand in Changelog
feluelle commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into
devel
URL: https://github.com/apache/airflow/pull/6147#issuecomment-533088400
Maybe we should differentiate between example dags for minimal installation
and advanced installation enabling advanced examples?
mik-laj edited a comment on issue #5643: [AIRFLOW-3617] Kubernetes gpu support
URL: https://github.com/apache/airflow/pull/5643#issuecomment-533062862
> You can specify GPU in both limits and requests but these two values must
be equal.
feluelle removed a comment on issue #6147: [AIRFLOW-5512] Add gcp dependencies
into devel
URL: https://github.com/apache/airflow/pull/6147#issuecomment-533067916
If you want to install an integration service like GCP you can install it
via `pip install -e ".[devel,gcp]"`
[
https://issues.apache.org/jira/browse/AIRFLOW-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933260#comment-16933260
]
Kaxil Naik commented on AIRFLOW-5224:
-
Sure, we can add this in our next release.
Can you send
haoliang7 commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into
devel
URL: https://github.com/apache/airflow/pull/6147#issuecomment-533076731
> I don't think this is right. Because it is not a minimal requirement for
all example dags to run.
>
> If you want to install
codecov-io edited a comment on issue #6093: [AIRFLOW-5475] Normalize
gcp_conn_id in operators and hooks
URL: https://github.com/apache/airflow/pull/6093#issuecomment-531406726
# [Codecov](https://codecov.io/gh/apache/airflow/pull/6093?src=pr=h1)
Report
> Merging
codecov-io edited a comment on issue #6093: [AIRFLOW-5475] Normalize
gcp_conn_id in operators and hooks
URL: https://github.com/apache/airflow/pull/6093#issuecomment-531406726
# [Codecov](https://codecov.io/gh/apache/airflow/pull/6093?src=pr=h1)
Report
> Merging
codecov-io edited a comment on issue #5743: [AIRFLOW-5088][AIP-24] Persisting
serialized DAG in DB for webserver scalability
URL: https://github.com/apache/airflow/pull/5743#issuecomment-529755241
# [Codecov](https://codecov.io/gh/apache/airflow/pull/5743?src=pr=h1)
Report
> Merging
feluelle commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into
devel
URL: https://github.com/apache/airflow/pull/6147#issuecomment-533067916
If you want to install an integration service like GCP you can install it
via `pip install -e ".[devel,gcp]"`
kaxil commented on a change in pull request #6130: [AIRFLOW-5508] Add a
whitelist mechanism for the StatsD metrics
URL: https://github.com/apache/airflow/pull/6130#discussion_r326103752
##
File path: airflow/config_templates/default_airflow.cfg
##
@@ -538,6 +538,9 @@
codecov-io edited a comment on issue #6139: [AIRFLOW-5513] Move
example_pubsub_flow.py to GCP package
URL: https://github.com/apache/airflow/pull/6139#issuecomment-532712379
# [Codecov](https://codecov.io/gh/apache/airflow/pull/6139?src=pr=h1)
Report
> Merging
mohannadbanayosi commented on a change in pull request #6151: [AIRFLOW-5522] BQ
list dataset tables operator
URL: https://github.com/apache/airflow/pull/6151#discussion_r326169066
##
File path: airflow/gcp/hooks/bigquery.py
##
@@ -1430,6 +1430,38 @@ def cancel_query(self)
nuclearpinguin commented on a change in pull request #6151: [AIRFLOW-5522] BQ
list dataset tables operator
URL: https://github.com/apache/airflow/pull/6151#discussion_r326137711
##
File path: airflow/gcp/hooks/bigquery.py
##
@@ -1430,6 +1430,38 @@ def cancel_query(self)
nuclearpinguin commented on a change in pull request #6151: [AIRFLOW-5522] BQ
list dataset tables operator
URL: https://github.com/apache/airflow/pull/6151#discussion_r326137711
##
File path: airflow/gcp/hooks/bigquery.py
##
@@ -1430,6 +1430,38 @@ def cancel_query(self)
kaxil opened a new pull request #6152: [AIRFLOW-XXX] Fix incorrect units in
docs for metrics using Timers
URL: https://github.com/apache/airflow/pull/6152
Make sure you have checked _all_ steps below.
### Jira
- [ ] My PR addresses the following [Airflow
codecov-io edited a comment on issue #6142: [AIRFLOW-5515] Add stacklevel to
GCP deprecation warnings
URL: https://github.com/apache/airflow/pull/6142#issuecomment-532767410
# [Codecov](https://codecov.io/gh/apache/airflow/pull/6142?src=pr=h1)
Report
> Merging
[
https://issues.apache.org/jira/browse/AIRFLOW-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933606#comment-16933606
]
Anand Kumar commented on AIRFLOW-5224:
--
[~kaxilnaik] That's right and it doesn't automatically
feng-tao merged pull request #6152: [AIRFLOW-XXX] Fix incorrect units in docs
for metrics using Timers
URL: https://github.com/apache/airflow/pull/6152
This is an automated message from the Apache Git Service.
To respond to
codecov-io commented on issue #6152: [AIRFLOW-XXX] Fix incorrect units in docs
for metrics using Timers
URL: https://github.com/apache/airflow/pull/6152#issuecomment-533196353
# [Codecov](https://codecov.io/gh/apache/airflow/pull/6152?src=pr=h1)
Report
> Merging
nuclearpinguin commented on issue #6122: [AIRFLOW-5499] Move GCP utils to core
URL: https://github.com/apache/airflow/pull/6122#issuecomment-533214025
@mik-laj can we move on?
This is an automated message from the Apache Git
[
https://issues.apache.org/jira/browse/AIRFLOW-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933598#comment-16933598
]
Eric Walisko commented on AIRFLOW-5224:
---
[~kaxilnaik] I wish it did, however we saw this error
codecov-io edited a comment on issue #6152: [AIRFLOW-XXX] Fix incorrect units
in docs for metrics using Timers
URL: https://github.com/apache/airflow/pull/6152#issuecomment-533196353
# [Codecov](https://codecov.io/gh/apache/airflow/pull/6152?src=pr=h1)
Report
> Merging
feluelle commented on issue #6066: [AIRFLOW-XXX] Update to new logo
URL: https://github.com/apache/airflow/pull/6066#issuecomment-533225097
What do you guys think of adding the `wordmark` logo to the
[landscape](https://github.com/cncf/landscape) ?
nuclearpinguin commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies
into devel
URL: https://github.com/apache/airflow/pull/6147#issuecomment-533283500
@haoliang7 can you share the error?
This is an automated message
nuclearpinguin removed a comment on issue #6147: [AIRFLOW-5512] Add gcp
dependencies into devel
URL: https://github.com/apache/airflow/pull/6147#issuecomment-533283500
@haoliang7 can you share the error?
This is an automated
[
https://issues.apache.org/jira/browse/AIRFLOW-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933765#comment-16933765
]
ASF subversion and git services commented on AIRFLOW-5515:
--
Commit
mik-laj merged pull request #6139: [AIRFLOW-5513] Move example_pubsub_flow.py
to GCP package
URL: https://github.com/apache/airflow/pull/6139
This is an automated message from the Apache Git Service.
To respond to the
[
https://issues.apache.org/jira/browse/AIRFLOW-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933764#comment-16933764
]
ASF GitHub Bot commented on AIRFLOW-5515:
-
mik-laj commented on pull request #6142:
penghou620 opened a new pull request #6153: [AIRFLOW-3388] Add support to Array
Jobs for AWS Batch Operator
URL: https://github.com/apache/airflow/pull/6153
Make sure you have checked _all_ steps below.
### Jira
- [x] My PR addresses the following [Airflow
Dan Davydov created AIRFLOW-5523:
Summary: DAGs never get cleaned up from webservers if DAG file is
removed from the scheduler
Key: AIRFLOW-5523
URL: https://issues.apache.org/jira/browse/AIRFLOW-5523
codecov-io commented on issue #6153: [AIRFLOW-3388] Add support to Array Jobs
for AWS Batch Operator
URL: https://github.com/apache/airflow/pull/6153#issuecomment-533301847
# [Codecov](https://codecov.io/gh/apache/airflow/pull/6153?src=pr=h1)
Report
> Merging
mik-laj merged pull request #6142: [AIRFLOW-5515] Add stacklevel to GCP
deprecation warnings
URL: https://github.com/apache/airflow/pull/6142
This is an automated message from the Apache Git Service.
To respond to the
mik-laj commented on issue #6122: [AIRFLOW-5499] Move GCP utils to core
URL: https://github.com/apache/airflow/pull/6122#issuecomment-533312772
Sorry. I'm busy now, but I looked. I have an important client project and
it's hard to find the time to review open source changes. I hope you
[
https://issues.apache.org/jira/browse/AIRFLOW-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933725#comment-16933725
]
ASF GitHub Bot commented on AIRFLOW-3388:
-
penghou620 commented on pull request #6153:
nuclearpinguin commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies
into devel
URL: https://github.com/apache/airflow/pull/6147#issuecomment-533285705
> Maybe we should differentiate between example dags for minimal
installation and advanced installation enabling advanced
[
https://issues.apache.org/jira/browse/AIRFLOW-5513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933766#comment-16933766
]
ASF GitHub Bot commented on AIRFLOW-5513:
-
mik-laj commented on pull request #6139:
[
https://issues.apache.org/jira/browse/AIRFLOW-5513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933767#comment-16933767
]
ASF subversion and git services commented on AIRFLOW-5513:
--
Commit
TobKed opened a new pull request #6154: [AIRFLOW-5526] Update docs
configuration due to migration of GCP docs
URL: https://github.com/apache/airflow/pull/6154
Make sure you have checked _all_ steps below.
### Jira
- [ ] https://issues.apache.org/jira/browse/AIRFLOW-5526
Alister Cordiner created AIRFLOW-5525:
-
Summary: Extra TaskTemplate and ContainerSpec arguments in
SwarmOperator
Key: AIRFLOW-5525
URL: https://issues.apache.org/jira/browse/AIRFLOW-5525
Project:
iroddis commented on issue #5787: [AIRFLOW-5172] Add choice of interval edge
scheduling
URL: https://github.com/apache/airflow/pull/5787#issuecomment-533383000
Sorry for the random commits on this. Getting the unit tests running is
still a challenge, especially on osx where I'm doing
Tobiasz Kedzierski created AIRFLOW-5526:
---
Summary: Update docs configuration due to migration of GCP docs
Key: AIRFLOW-5526
URL: https://issues.apache.org/jira/browse/AIRFLOW-5526
Project:
feluelle commented on issue #6147: [AIRFLOW-5512] Add gcp dependencies into
devel
URL: https://github.com/apache/airflow/pull/6147#issuecomment-533067492
I don't think this is right. Because it is not a `minimal requirement` for
all example dags to run.
ashb commented on issue #5908: Revert "[AIRFLOW-4797] Improve performance and
behaviour of zombie de…
URL: https://github.com/apache/airflow/pull/5908#issuecomment-533072256
I don't really have the context anymore to review this usefully, but if
Stefan thinks this is okay lets go with it.
[
https://issues.apache.org/jira/browse/AIRFLOW-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934090#comment-16934090
]
ASF GitHub Bot commented on AIRFLOW-5526:
-
TobKed commented on pull request #6154:
TobKed commented on issue #6154: [AIRFLOW-5526] Update docs configuration due
to migration of GCP docs
URL: https://github.com/apache/airflow/pull/6154#issuecomment-533418518
cc @ashb
This is an automated message from the
mik-laj commented on issue #6154: [AIRFLOW-5526] Update docs configuration due
to migration of GCP docs
URL: https://github.com/apache/airflow/pull/6154#issuecomment-533418637
Are we use all these libraries? Can you check it? 'pip freeze|grep -v'
I'm afraid of build speed also. Does it
Felix Tubiana created AIRFLOW-5524:
--
Summary: Airflow Mark Success tasks in GUI uses values from Clear
Key: AIRFLOW-5524
URL: https://issues.apache.org/jira/browse/AIRFLOW-5524
Project: Apache
[
https://issues.apache.org/jira/browse/AIRFLOW-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933831#comment-16933831
]
ASF GitHub Bot commented on AIRFLOW-2910:
-
potiuk commented on pull request #5239:
potiuk closed pull request #5239: [WIP][AIRFLOW-2910] Add HTTP URI support
URL: https://github.com/apache/airflow/pull/5239
This is an automated message from the Apache Git Service.
To respond to the message, please log on
83 matches
Mail list logo
