[
https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szymon Grzemski updated AIRFLOW-5071:
-
Attachment: image-2020-07-08-07-58-42-972.png
> Thousand os Executor reports task
hlokired commented on issue #9096:
URL: https://github.com/apache/airflow/issues/9096#issuecomment-655282131
Hi,
Can you please provide the mailer list, when we can discuss with in the
group.
Thanks,
This is
jhtimmins opened a new pull request #9716:
URL: https://github.com/apache/airflow/pull/9716
Currently, the test suite involves 70 different test runs. This is in part
bc we test Pythons 3.6, 3.7, and 3.8, against multiple different datastores. To
reduce the number of tests, and speed up
potiuk edited a comment on pull request #9715:
URL: https://github.com/apache/airflow/pull/9715#issuecomment-655273339
cc: @msumit @arthur @Fokko @jghoman @aoen @KevinYang21 @alexvanboxel @ashb
@aijamalnk @feng-tao @kaxil @bolkedebruin @criccomini @mistercrunch @hiteshs
@saguziel
potiuk commented on pull request #9715:
URL: https://github.com/apache/airflow/pull/9715#issuecomment-655273339
cc: @ashb -> we were discussing that we want to add explicit COC indeed. For
now we are all bound by the Apache COC
http://www.apache.org/foundation/policies/conduct.html and I
vlasvlasvlas opened a new pull request #9715:
URL: https://github.com/apache/airflow/pull/9715
hope we can get a code of conduct for issues! thanks :D
---
Make sure to mark the boxes below before creating PR: [x]
- [ ] Description above provides context of the change
- [
boring-cyborg[bot] commented on pull request #9715:
URL: https://github.com/apache/airflow/pull/9715#issuecomment-655270213
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are unsure about any anything please check
our
jhtimmins commented on a change in pull request #9597:
URL: https://github.com/apache/airflow/pull/9597#discussion_r451266925
##
File path: airflow/api_connexion/endpoints/task_instance_endpoint.py
##
@@ -14,23 +14,110 @@
# KIND, either express or implied. See the License
jhtimmins commented on a change in pull request #9597:
URL: https://github.com/apache/airflow/pull/9597#discussion_r451266466
##
File path: airflow/api_connexion/endpoints/task_instance_endpoint.py
##
@@ -14,23 +14,110 @@
# KIND, either express or implied. See the License
jhtimmins commented on issue #8111:
URL: https://github.com/apache/airflow/issues/8111#issuecomment-655258363
@mik-laj I'm a bit confused about the need to have a customizable auth
scheme, where the user can pick a common implementation or add their own.
Connexion seems to support a small
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag nightly-master was modified! ***
from ac12401 (commit)
to 6c15885 (commit)
from
coopergillan commented on a change in pull request #9517:
URL: https://github.com/apache/airflow/pull/9517#discussion_r451247522
##
File path: airflow/providers/amazon/aws/operators/athena.py
##
@@ -28,9 +28,6 @@ class AWSAthenaOperator(BaseOperator):
"""
An operator
alanbrent edited a comment on issue #8212:
URL: https://github.com/apache/airflow/issues/8212#issuecomment-655216002
Can confirm that using a threaded `gunicorn` worker (`gevent` in our case)
breaks the web component's ability to show task logs that are in S3. Moving
back to `sync` works
alanbrent commented on issue #8212:
URL: https://github.com/apache/airflow/issues/8212#issuecomment-655216002
Can confirm that using a threaded `gunicorn` worker (`gevent` in our case)
breaks the web component's ability to show task logs that are in S3. Moving
back to `sync` works for us,
kaxil commented on a change in pull request #9645:
URL: https://github.com/apache/airflow/pull/9645#discussion_r451199613
##
File path: docs/howto/set-config.rst
##
@@ -73,6 +91,7 @@ The universal order of precedence for all configuration
options is as follows:
#. set as a
kaxil commented on a change in pull request #9645:
URL: https://github.com/apache/airflow/pull/9645#discussion_r451199524
##
File path: docs/howto/set-config.rst
##
@@ -46,7 +46,18 @@ the key like this:
[core]
sql_alchemy_conn_cmd = bash_command_to_run
-The
kaxil commented on a change in pull request #9645:
URL: https://github.com/apache/airflow/pull/9645#discussion_r451199040
##
File path: airflow/configuration.py
##
@@ -267,17 +278,32 @@ def _get_env_var_option(self, section, key):
env_var_cmd = env_var + '_CMD'
kaxil commented on a change in pull request #9645:
URL: https://github.com/apache/airflow/pull/9645#discussion_r451199109
##
File path: airflow/secrets/base_secrets.py
##
@@ -73,3 +75,12 @@ def get_variable(self, key: str) -> Optional[str]:
:return: Variable Value
kaxil commented on a change in pull request #9645:
URL: https://github.com/apache/airflow/pull/9645#discussion_r451196233
##
File path: airflow/configuration.py
##
@@ -267,17 +278,32 @@ def _get_env_var_option(self, section, key):
env_var_cmd = env_var + '_CMD'
kaxil commented on a change in pull request #9452:
URL: https://github.com/apache/airflow/pull/9452#discussion_r451195371
##
File path: airflow/www/decorators.py
##
@@ -44,7 +45,7 @@ def wrapper(*args, **kwargs):
event=f.__name__,
[
https://issues.apache.org/jira/browse/AIRFLOW-4431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153082#comment-17153082
]
Joy Peterson commented on AIRFLOW-4431:
---
[~diederikwp], This is happening for me when I
ephraimbuddy opened a new pull request #9714:
URL: https://github.com/apache/airflow/pull/9714
---
Closes: #9386
This PR completes the move of task log handlers to their providers package.
`GCSTaskHandler` and `WasbTaskHandler` have been moved to their respective
provider
benbenbang opened a new issue #9713:
URL: https://github.com/apache/airflow/issues/9713
- Issue:
We encountered an issue that is mainly caused by overloading calls from
Airflow to Vault while Vault was experiencing downtime.
- Context:
A few days ago while Vault was down for
tanjinP commented on pull request #9079:
URL: https://github.com/apache/airflow/pull/9079#issuecomment-655076947
Looks like some static checks failing, will address
This is an automated message from the Apache Git Service.
royberkoweee commented on pull request #9667:
URL: https://github.com/apache/airflow/pull/9667#issuecomment-655068112
Thanks @turbaszek, appreciate all the guidance
This is an automated message from the Apache Git
kaxil closed pull request #9427:
URL: https://github.com/apache/airflow/pull/9427
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/master by this push:
new 6c15885 generate go client from openapi spec
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/master by this push:
new 6c15885 generate go client from openapi spec
[
https://issues.apache.org/jira/browse/AIRFLOW-6497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17152950#comment-17152950
]
ASF GitHub Bot commented on AIRFLOW-6497:
-
mik-laj edited a comment on pull request #7597:
URL:
mik-laj edited a comment on pull request #7597:
URL: https://github.com/apache/airflow/pull/7597#issuecomment-593430117
It is worth noting that this also solves one more problem. The modules are
always reloaded.
potiuk merged pull request #9502:
URL: https://github.com/apache/airflow/pull/9502
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
boring-cyborg[bot] commented on pull request #9701:
URL: https://github.com/apache/airflow/pull/9701#issuecomment-655019770
Awesome work, congrats on your first merged pull request!
This is an automated message from the
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/master by this push:
new 397b33f Update Thumbtack points of contact
kaxil merged pull request #9701:
URL: https://github.com/apache/airflow/pull/9701
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
ashb commented on pull request #9636:
URL: https://github.com/apache/airflow/pull/9636#issuecomment-655010166
So this is definitely a missing feature but there are two problems.
1. This PR doesn't have unit tests, and it needs them before it's going to
be merged
2. This ends up
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/master by this push:
new 502b6ea use the correct claim name in the
potiuk commented on pull request #9688:
URL: https://github.com/apache/airflow/pull/9688#issuecomment-655001610
Cool!
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
potiuk merged pull request #9688:
URL: https://github.com/apache/airflow/pull/9688
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
kaxil commented on a change in pull request #9670:
URL: https://github.com/apache/airflow/pull/9670#discussion_r451015688
##
File path: airflow/migrations/env.py
##
@@ -21,7 +21,7 @@
from alembic import context
from airflow import models, settings
-from
[
https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17152897#comment-17152897
]
Lindsay Portelli commented on AIRFLOW-5071:
---
Running 1.10.10 deployed on K8s using kubernetes
potiuk closed pull request #9706:
URL: https://github.com/apache/airflow/pull/9706
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
potiuk commented on pull request #9706:
URL: https://github.com/apache/airflow/pull/9706#issuecomment-654980251
I think it should be fine - especially in the future. We are switching to
separation of providers to "providers packages". Actually we already have the
backport packages that
feluelle edited a comment on pull request #7903:
URL: https://github.com/apache/airflow/pull/7903#issuecomment-654978821
Please rebase once again - just to be sure. :)
It is very long ago since you last pushed a commit.
feluelle commented on pull request #7903:
URL: https://github.com/apache/airflow/pull/7903#issuecomment-654978821
Please rebase once again - just to be sure. :)
This is an automated message from the Apache Git Service.
To
zhongjiajie edited a comment on pull request #7903:
URL: https://github.com/apache/airflow/pull/7903#issuecomment-654977519
Ok, we have +1 here, if no one disapproval here in a few day I will merge
this patch to master.
zhongjiajie commented on pull request #7903:
URL: https://github.com/apache/airflow/pull/7903#issuecomment-654977519
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
zhongjiajie removed a comment on pull request #7903:
URL: https://github.com/apache/airflow/pull/7903#issuecomment-654977536
Ok, we have +1 here, if no one disapproval here I will merge this patch to
master.
This is an
zhongjiajie commented on issue #9134:
URL: https://github.com/apache/airflow/issues/9134#issuecomment-654976434
I think it depend on what we could add streaming to airflow, if it will task
many times, maybe support parts of flink function on flink operator is
acceptable.
gregbrowndev commented on issue #9707:
URL: https://github.com/apache/airflow/issues/9707#issuecomment-654968688
Apologies, I misunderstood how the Docker Registry connection worked.
For anyone else running into this, here is a simple DAG which updates a
'docker_ecr' connection
gregbrowndev closed issue #9707:
URL: https://github.com/apache/airflow/issues/9707
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
potiuk commented on a change in pull request #9670:
URL: https://github.com/apache/airflow/pull/9670#discussion_r450980760
##
File path: airflow/migrations/env.py
##
@@ -21,7 +21,7 @@
from alembic import context
from airflow import models, settings
-from
potiuk closed issue #9101:
URL: https://github.com/apache/airflow/issues/9101
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
potiuk commented on issue #9101:
URL: https://github.com/apache/airflow/issues/9101#issuecomment-654964030
Indeed!
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
coopergillan commented on pull request #9517:
URL: https://github.com/apache/airflow/pull/9517#issuecomment-654955944
@turbaszek - just rebased and cleaned up the wording a bit. Apologies that I
didn't see your approval first. Please let me know if it still stands.
turbaszek commented on a change in pull request #9517:
URL: https://github.com/apache/airflow/pull/9517#discussion_r450964004
##
File path: airflow/providers/amazon/aws/operators/athena.py
##
@@ -28,9 +28,6 @@ class AWSAthenaOperator(BaseOperator):
"""
An operator
turbaszek commented on a change in pull request #9667:
URL: https://github.com/apache/airflow/pull/9667#discussion_r450960127
##
File path: tests/providers/google/cloud/transfers/test_gcs_to_gcs.py
##
@@ -86,6 +86,21 @@ def test_execute_no_suffix(self, mock_hook):
turbaszek removed a comment on pull request #9712:
URL: https://github.com/apache/airflow/pull/9712#issuecomment-654947095
TIL: `NameTuple` is supported by json.loads while `tuple` rises TypeError
This is an automated
turbaszek commented on pull request #9712:
URL: https://github.com/apache/airflow/pull/9712#issuecomment-654947095
TIL: `NameTuple` is supported by json.loads while `tuple` rises TypeError
This is an automated message from
turbaszek opened a new pull request #9712:
URL: https://github.com/apache/airflow/pull/9712
---
Make sure to mark the boxes below before creating PR: [x]
- [x] Description above provides context of the change
- [x] Unit tests coverage for changes (not needed for documentation
This is an automated email from the ASF dual-hosted git repository.
turbaszek pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/master by this push:
new 4ad3bb5 Fix _process_executor_events
turbaszek closed issue #9689:
URL: https://github.com/apache/airflow/issues/9689
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
turbaszek merged pull request #9692:
URL: https://github.com/apache/airflow/pull/9692
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
turbaszek commented on issue #9101:
URL: https://github.com/apache/airflow/issues/9101#issuecomment-654920252
I think it's already done @potiuk ?
This is an automated message from the Apache Git Service.
To respond to the
mik-laj commented on issue #9708:
URL: https://github.com/apache/airflow/issues/9708#issuecomment-654908258
@coopergillan I assigned you to this ticket. When you create a PR, add a
link to this ticket so that others can see your work.
51yu commented on issue #9213:
URL: https://github.com/apache/airflow/issues/9213#issuecomment-654906639
@kaxil Thanks for helping. I create another relevant issue
https://github.com/apache/airflow/issues/9711
This is an
51yu opened a new issue #9711:
URL: https://github.com/apache/airflow/issues/9711
**Apache Airflow version**:
1.10
**Kubernetes version (if you are using kubernetes)** (use `kubectl version`):
not k8s issue
**Environment**:
linux
**What happened**:
when
kaxil commented on issue #9213:
URL: https://github.com/apache/airflow/issues/9213#issuecomment-654904122
That commit is 4 years old :D so something else might have reverted back
that behaviour.
I will mark it for 1.10.12
coopergillan commented on issue #9708:
URL: https://github.com/apache/airflow/issues/9708#issuecomment-654895399
Hi @mik-laj - I would love to grab at least one of these providers. May just
need a little bit of time
This
takunnithan commented on pull request #9556:
URL: https://github.com/apache/airflow/pull/9556#issuecomment-654893895
Hi @mik-laj, Is this good to merge ? Could you please review the PR.
This is an automated message from the
coopergillan commented on a change in pull request #9517:
URL: https://github.com/apache/airflow/pull/9517#discussion_r450897421
##
File path: airflow/providers/amazon/aws/operators/athena.py
##
@@ -28,9 +28,6 @@ class AWSAthenaOperator(BaseOperator):
"""
An operator
coopergillan commented on a change in pull request #9517:
URL: https://github.com/apache/airflow/pull/9517#discussion_r450894155
##
File path: airflow/providers/amazon/aws/operators/athena.py
##
@@ -28,9 +28,6 @@ class AWSAthenaOperator(BaseOperator):
"""
An operator
roskoN closed issue #9709:
URL: https://github.com/apache/airflow/issues/9709
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
roskoN commented on issue #9709:
URL: https://github.com/apache/airflow/issues/9709#issuecomment-654858990
@mik-laj Thank you for the detailed but concise explanation. It perfectly
makes sense.
And, of course, for those who do not like this, there is an easy workaround.
kaxil commented on a change in pull request #9670:
URL: https://github.com/apache/airflow/pull/9670#discussion_r450862296
##
File path: airflow/migrations/env.py
##
@@ -21,7 +21,7 @@
from alembic import context
from airflow import models, settings
-from
boring-cyborg[bot] commented on issue #9710:
URL: https://github.com/apache/airflow/issues/9710#issuecomment-654848253
Thanks for opening your first issue here! Be sure to follow the issue
template!
This is an automated
Nandito4 opened a new issue #9710:
URL: https://github.com/apache/airflow/issues/9710
**Apache Airflow version**:
1.10.10
**Kubernetes version (if you are using kubernetes)** (use `kubectl version`):
v1.15.11
**Environment**:
- **Cloud provider or hardware
mik-laj edited a comment on issue #9709:
URL: https://github.com/apache/airflow/issues/9709#issuecomment-654844898
@roskoN Airflow 2.0 will not have a non-RBAC interface. For this reason, we
try to encourage users to use RBAC. One way to do this is to create additional
reasons for
mik-laj commented on issue #9709:
URL: https://github.com/apache/airflow/issues/9709#issuecomment-654844898
@roskoN Airflow 2.0 will not have a non-RBAC interface. For this reason, we
try to encourage users to use RBAC. One way to do this is to create additional
reasons for migrating to
shaneikennedy commented on pull request #9706:
URL: https://github.com/apache/airflow/pull/9706#issuecomment-654843321
@potiuk after looking setup.py actually specifies simple-salesforce < 1.0.0
(branch v1-10-test), so I think my installation method was just wrong (got an
error for
jacobhjkim commented on a change in pull request #7944:
URL: https://github.com/apache/airflow/pull/7944#discussion_r450845896
##
File path: airflow/providers/hashicorp/secrets/vault.py
##
@@ -150,7 +156,29 @@ def get_conn_uri(self, conn_id: str) -> Optional[str]:
kaxil commented on a change in pull request #7944:
URL: https://github.com/apache/airflow/pull/7944#discussion_r450844959
##
File path: airflow/providers/hashicorp/secrets/vault.py
##
@@ -150,7 +156,29 @@ def get_conn_uri(self, conn_id: str) -> Optional[str]:
:param
jacobhjkim commented on a change in pull request #7944:
URL: https://github.com/apache/airflow/pull/7944#discussion_r450823815
##
File path: airflow/providers/hashicorp/secrets/vault.py
##
@@ -150,7 +156,29 @@ def get_conn_uri(self, conn_id: str) -> Optional[str]:
kaxil commented on a change in pull request #7944:
URL: https://github.com/apache/airflow/pull/7944#discussion_r450844959
##
File path: airflow/providers/hashicorp/secrets/vault.py
##
@@ -150,7 +156,29 @@ def get_conn_uri(self, conn_id: str) -> Optional[str]:
:param
roskoN opened a new issue #9709:
URL: https://github.com/apache/airflow/issues/9709
**Description**
Currently, in order to use DAG tags, one needs to enable RBAC. Thus, one
needs to set it up in order to be able to use the feature.
**Use case / motivation**
While, this
boring-cyborg[bot] commented on issue #9709:
URL: https://github.com/apache/airflow/issues/9709#issuecomment-654836311
Thanks for opening your first issue here! Be sure to follow the issue
template!
This is an automated
shaneikennedy commented on pull request #9706:
URL: https://github.com/apache/airflow/pull/9706#issuecomment-654834671
> So I believe setup.py is wrong (it says >1.0.0) . Is it possible that you
add change to setup.py for that ? Note that you will have to generate
requirements for this
OmairK commented on issue #9708:
URL: https://github.com/apache/airflow/issues/9708#issuecomment-654831164
> I'm interested too. We would do it one PR per provider I guess?
Yeah this sounds like a good idea.
This
mik-laj commented on issue #9708:
URL: https://github.com/apache/airflow/issues/9708#issuecomment-654830501
@OmairK I assigned you to this ticket.
I also added a small note to the first post.
> If you decide to finish this ticket you don't have to do all the work
yourself.
ephraimbuddy commented on issue #9708:
URL: https://github.com/apache/airflow/issues/9708#issuecomment-654830776
I'm interested too. We would do it one PR per provider I guess?
This is an automated message from the Apache
OmairK commented on issue #9708:
URL: https://github.com/apache/airflow/issues/9708#issuecomment-654825998
This looks interesting, can you assign me this task @mik-laj
This is an automated message from the Apache Git
mik-laj commented on issue #9134:
URL: https://github.com/apache/airflow/issues/9134#issuecomment-654820970
@SteNicholas I think we can add two operators. One that starts streaming
operations on a remote cluster, return ID to XCOM and the other that stops
these operations. However, I have
royberkoweee commented on a change in pull request #9667:
URL: https://github.com/apache/airflow/pull/9667#discussion_r450825113
##
File path: airflow/providers/google/cloud/transfers/gcs_to_gcs.py
##
@@ -276,6 +280,21 @@ def _copy_source_with_wildcard(self, hook, prefix):
jacobhjkim commented on a change in pull request #7944:
URL: https://github.com/apache/airflow/pull/7944#discussion_r450823815
##
File path: airflow/providers/hashicorp/secrets/vault.py
##
@@ -150,7 +156,29 @@ def get_conn_uri(self, conn_id: str) -> Optional[str]:
royberkoweee commented on a change in pull request #9667:
URL: https://github.com/apache/airflow/pull/9667#discussion_r450822599
##
File path: tests/providers/google/cloud/transfers/test_gcs_to_gcs.py
##
@@ -86,6 +86,19 @@ def test_execute_no_suffix(self, mock_hook):
mik-laj opened a new issue #9708:
URL: https://github.com/apache/airflow/issues/9708
Helllo,
We've introduced mypy, but it's not very useful if we don't have type
annotations. I think it's worth starting with the providers package, which is
most often used by end-users. Currently,
potiuk commented on pull request #9706:
URL: https://github.com/apache/airflow/pull/9706#issuecomment-654812039
So I believe setup.py is wrong (it says >1.0.0) . Is it possible that you
add change to setup.py for that ? Note that you will have to generate
requirements for this (as
mik-laj edited a comment on issue #9096:
URL: https://github.com/apache/airflow/issues/9096#issuecomment-654807990
@hlokired Apache Airflow is an Open Source project, so the community
manages it. Each feature that is added to this project is the result of
volunteer work or was done by
mik-laj edited a comment on issue #9096:
URL: https://github.com/apache/airflow/issues/9096#issuecomment-654807990
@hlokired Apache Airflow is an Open Source project, so the community
manages it. Each feature that is added to this project is the result of
volunteer work or was done by
mik-laj edited a comment on issue #9096:
URL: https://github.com/apache/airflow/issues/9096#issuecomment-654807990
@hlokired Apache Airflow is an Open Source project, so the community
manages it. Each feature that is added to this project is the result of
volunteer work or was done by
mik-laj commented on issue #9096:
URL: https://github.com/apache/airflow/issues/9096#issuecomment-654807990
@hlokired This is an Open Source project, so the community manages it. Each
feature that is added to this project is the result of volunteer work or was
done by other companies
1 - 100 of 155 matches
Mail list logo
