[
https://issues.apache.org/jira/browse/AIRFLOW-6782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dobromir Montauk reassigned AIRFLOW-6782:
-
Assignee: (was: Dobromir Montauk)
> airflow-xcom-sidecar container
[
https://issues.apache.org/jira/browse/AIRFLOW-6782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dobromir Montauk reassigned AIRFLOW-6782:
-
Assignee: Dobromir Montauk
> airflow-xcom-sidecar container prevents pods
randr97 commented on a change in pull request #8895:
URL: https://github.com/apache/airflow/pull/8895#discussion_r426355048
##
File path: airflow/providers/amazon/aws/operators/s3_bucket.py
##
@@ -0,0 +1,132 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
randr97 commented on a change in pull request #8895:
URL: https://github.com/apache/airflow/pull/8895#discussion_r426355048
##
File path: airflow/providers/amazon/aws/operators/s3_bucket.py
##
@@ -0,0 +1,132 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
randr97 commented on a change in pull request #8895:
URL: https://github.com/apache/airflow/pull/8895#discussion_r426355048
##
File path: airflow/providers/amazon/aws/operators/s3_bucket.py
##
@@ -0,0 +1,132 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
realradical commented on pull request #8875:
URL: https://github.com/apache/airflow/pull/8875#issuecomment-629928724
@ashb the quarantined CI build job fails.. any idea?
This is an automated message from the Apache Git
crazy-2020 commented on pull request #8824:
URL: https://github.com/apache/airflow/pull/8824#issuecomment-629923465
Hi @mik-laj , Could you please help review this PR? Thanks.
This is an automated message from the Apache
mik-laj commented on pull request #8897:
URL: https://github.com/apache/airflow/pull/8897#issuecomment-629905124
@zacharya19 Can you look at it?
This is an automated message from the Apache Git Service.
To respond to the
potiuk commented on pull request #8898:
URL: https://github.com/apache/airflow/pull/8898#issuecomment-629877057
@ashb @kaxil -> I figured out that we have really two modes of release -
one for "SVN" where we only rename the files with rc but the version inside is
without the suffix, and
potiuk opened a new pull request #8898:
URL: https://github.com/apache/airflow/pull/8898
---
Make sure to mark the boxes below before creating PR: [x]
- [x] Description above provides context of the change
- [x] Unit tests coverage for changes (not needed for documentation
TRReeve edited a comment on issue #8212:
URL: https://github.com/apache/airflow/issues/8212#issuecomment-629872414
@marclamberti Your answer is how I understood it would work as well and it
half worked for me I would get the logs uploading fine into the S3 bucket but
then when i went to
TRReeve edited a comment on issue #8212:
URL: https://github.com/apache/airflow/issues/8212#issuecomment-629872414
@marclamberti Your answer is how I understood it would work as well and it
half worked for me I would get the logs uploading fine into the S3 bucket but
then when i went to
TRReeve commented on issue #8212:
URL: https://github.com/apache/airflow/issues/8212#issuecomment-629872414
@marclamberti Your answer is how I understood it would work as well but when
I would get the logs uploading fine into the S3 bucket but then when i went to
"view logs" in the UI it
marclamberti commented on issue #8212:
URL: https://github.com/apache/airflow/issues/8212#issuecomment-629870279
@TRReeve I didn’t need to do that. Actually, if you want to have the remote
logging working with the kubernetes executor, you have to define additional
kubernetes environment
stale[bot] closed pull request #7806:
URL: https://github.com/apache/airflow/pull/7806
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
tanjinP commented on issue #8286:
URL: https://github.com/apache/airflow/issues/8286#issuecomment-629863159
@mik-laj just a few questions and concerns before I dive deeply into this:
1. The Memorystore Redis Hook and Operator have a 'generic' name
(`cloud_memorystore.py`). This new one
RosterIn commented on pull request #6931:
URL: https://github.com/apache/airflow/pull/6931#issuecomment-629860834
@mik-laj is there something else needed?
This is an automated message from the Apache Git Service.
To respond
[
https://issues.apache.org/jira/browse/AIRFLOW-6372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109646#comment-17109646
]
ASF GitHub Bot commented on AIRFLOW-6372:
-
RosterIn commented on pull request #6931:
URL:
RosterIn commented on pull request #8002:
URL: https://github.com/apache/airflow/pull/8002#issuecomment-629860568
@gor-obr there is a failure
`tests/models/test_dag.py:577:13: E123 closing bracket does not match
indentation of opening bracket's line
`
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 12c5e5d Prepare release candidate for backport packages (#8891)
add 2121f49 Avoid failure on transient
potiuk merged pull request #8892:
URL: https://github.com/apache/airflow/pull/8892
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
boring-cyborg[bot] commented on pull request #8897:
URL: https://github.com/apache/airflow/pull/8897#issuecomment-629852431
Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are unsure about any anything please check
our
Sangarshanan opened a new pull request #8897:
URL: https://github.com/apache/airflow/pull/8897
Closes #8821
Clicking on a tag to filter dags with that tag, a quicker alternative to
searching
This my first pull request on airflow and is a minor feature, happy to make
changes
mik-laj commented on a change in pull request #8895:
URL: https://github.com/apache/airflow/pull/8895#discussion_r426298861
##
File path: airflow/providers/amazon/aws/hooks/s3.py
##
@@ -664,6 +664,23 @@ def copy_object(self,
VijayantSoni edited a comment on pull request #8701:
URL: https://github.com/apache/airflow/pull/8701#issuecomment-629850001
@ashb Made the changes as per your suggestion. Also added unit tests, but
moto does not support mocking aws elasticache hence the tests won't run.
I looked at
VijayantSoni commented on pull request #8701:
URL: https://github.com/apache/airflow/pull/8701#issuecomment-629850001
@ashb Made the changes as per your suggestion. Also added unit tests, but
moto does not support mocking aws elasticache hence the tests won't run.
I looked at other
jeffolsi opened a new issue #8896:
URL: https://github.com/apache/airflow/issues/8896
**Description**
salesforce is missing integration with GCS.
**Use case / motivation**
ability to copy data from sales force into GCS
**Related Issues**
realradical commented on a change in pull request #8875:
URL: https://github.com/apache/airflow/pull/8875#discussion_r426297022
##
File path: airflow/www/forms.py
##
@@ -82,7 +82,8 @@ class DagRunForm(DynamicForm):
widget=Select2Widget())
execution_date =
JeffryMAC commented on a change in pull request #8895:
URL: https://github.com/apache/airflow/pull/8895#discussion_r426295941
##
File path: airflow/providers/amazon/aws/operators/s3_bucket.py
##
@@ -0,0 +1,132 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
Author: potiuk
Date: Sun May 17 19:20:39 2020
New Revision: 39639
Log:
Delete bad release
Removed:
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/
Added:
dev/airflow/backport-providers/2020.5.20rc1/apache-airflow-backport-providers-email-2020.5.20rc1-bin.tar.gz.asc
==
---
Author: potiuk
Date: Sun May 17 19:12:06 2020
New Revision: 39638
Log:
Add artifacts for Airflow 2020.5.20rc1
Added:
dev/airflow/backport-providers/2020.5.20rc1/
dev/airflow/backport-providers/2020.5.20rc1/apache-airflow-backport-providers-2020.5.20rc1-source.tar.gz
(with props)
Added:
dev/airflow/backport-providers/2020.5.20rc1/apache_airflow_backport_providers_apache_druid-2020.5.20rc1-py2.py3-none-any.whl.asc
==
---
Added:
dev/airflow/backport-providers/2020.5.20rc1/apache_airflow_backport_providers_papermill-2020.5.20rc1-py2.py3-none-any.whl.sha512
==
---
randr97 opened a new pull request #8895:
URL: https://github.com/apache/airflow/pull/8895
---
Make sure to mark the boxes below before creating PR: [x]
- [x] Description above provides context of the change
- [x] Unit tests coverage for changes (not needed for documentation
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag backport-providers-2020.5.20rc1
in repository https://gitbox.apache.org/repos/asf/airflow.git.
at 12c5e5d (commit)
No new revisions were added by this update.
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag nightly
in repository https://gitbox.apache.org/repos/asf/airflow.git.
at 4917bff (commit)
No new revisions were added by this update.
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag backport-providers-2020.5.20rc1
in repository https://gitbox.apache.org/repos/asf/airflow.git.
at 12c5e5d (commit)
No new revisions were added by this update.
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
at 42c5975 (commit)
No new revisions were added by this update.
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
at 42c5975 (commit)
No new revisions were added by this update.
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag backport-providers-2020.5.20rc1
in repository https://gitbox.apache.org/repos/asf/airflow.git.
at 12c5e5d (commit)
No new revisions were added by this update.
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag nightly
in repository https://gitbox.apache.org/repos/asf/airflow.git.
at 4917bff (commit)
No new revisions were added by this update.
potiuk merged pull request #8891:
URL: https://github.com/apache/airflow/pull/8891
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
[
https://issues.apache.org/jira/browse/AIRFLOW-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jarek Potiuk resolved AIRFLOW-1536.
---
Fix Version/s: 2.0.0
Resolution: Fixed
> DaemonContext uses default umask 0
>
mik-laj opened a new issue #8894:
URL: https://github.com/apache/airflow/issues/8894
Hello,
We have a lot of guides that are fantastic.
https://airflow.readthedocs.io/en/latest/howto/operator/index.html
https://airflow.readthedocs.io/en/latest/howto/operator/gcp/index.html
mik-laj commented on pull request #8870:
URL: https://github.com/apache/airflow/pull/8870#issuecomment-629836672
@dinigo Static checks are sad. Can you fix it?
This is an automated message from the Apache Git Service.
To
ashb commented on a change in pull request #8875:
URL: https://github.com/apache/airflow/pull/8875#discussion_r426287475
##
File path: airflow/www/forms.py
##
@@ -82,7 +82,8 @@ class DagRunForm(DynamicForm):
widget=Select2Widget())
execution_date = DateTimeField(
realradical commented on a change in pull request #8875:
URL: https://github.com/apache/airflow/pull/8875#discussion_r426287007
##
File path: airflow/www/forms.py
##
@@ -82,7 +82,8 @@ class DagRunForm(DynamicForm):
widget=Select2Widget())
execution_date =
[
https://issues.apache.org/jira/browse/AIRFLOW-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109592#comment-17109592
]
ASF GitHub Bot commented on AIRFLOW-6856:
-
mik-laj removed a comment on pull request #8751:
mik-laj removed a comment on pull request #8751:
URL: https://github.com/apache/airflow/pull/8751#issuecomment-628373546
Zrobię to jako osobne commit.Zrobiłem to jako jeden PR z dwóch powodów:
- cała zmiane odtworzyłem od nowa, ponieważ jest zbyt dużo różnic,
-
realradical commented on a change in pull request #8875:
URL: https://github.com/apache/airflow/pull/8875#discussion_r426286484
##
File path: tests/www/test_views.py
##
@@ -2601,14 +2601,14 @@ def test_create_dagrun(self):
dr =
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch v1-10-test
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from 7eba52b [AIRFLOW-4052] Allow filtering using "event" and "owner" in
"Log" view (#4881)
new 01c8db2
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch v1-10-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
commit 01c8db23199aef7f17e541bae5f8c42392b4
Author: Jarek Potiuk
AuthorDate: Tue May 12 13:28:55 2020 +0200
mik-laj commented on issue #8258:
URL: https://github.com/apache/airflow/issues/8258#issuecomment-629830743
@rammady Do you need any help?
@elwinarens I know you work on it too. Would you like to share something?
Collaborative work is more effective and beneficial.
mik-laj commented on pull request #8539:
URL: https://github.com/apache/airflow/pull/8539#issuecomment-629829528
Fantastic work! I am waiting for your next contributions.
This is an automated message from the Apache Git
mik-laj commented on a change in pull request #:
URL: https://github.com/apache/airflow/pull/#discussion_r426282931
##
File path: tests/test_utils/amazon_system_helpers.py
##
@@ -51,6 +54,27 @@ def provide_aws_s3_bucket(name):
@pytest.mark.system("amazon")
class
mik-laj commented on issue #8806:
URL: https://github.com/apache/airflow/issues/8806#issuecomment-629828037
@turbaszek Can you look at it?
This is an automated message from the Apache Git Service.
To respond to the message,
mik-laj opened a new issue #8893:
URL: https://github.com/apache/airflow/issues/8893
Hello,
We have script that allows us to display class names.
https://github.com/apache/airflow/blob/master/scripts/list-integrations.py
It would be nice if it were possible to display template
potiuk opened a new pull request #8892:
URL: https://github.com/apache/airflow/pull/8892
When you build from the scratch and some transient requirements
fail, the initial step of installation might fail.
We are now using latest valid constraintes from teh DEFAULT_BRANCH
branch
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/master by this push:
new ff342fc Added SalesforceHook missing method
boring-cyborg[bot] commented on pull request #8644:
URL: https://github.com/apache/airflow/pull/8644#issuecomment-629813205
Awesome work, congrats on your first merged pull request!
This is an automated message from the
potiuk merged pull request #8644:
URL: https://github.com/apache/airflow/pull/8644
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
potiuk opened a new pull request #8891:
URL: https://github.com/apache/airflow/pull/8891
After preparing the 2020.5.19 release candidate and
reviewing the packages, some changes turned out to be necessary.
Therefore the date was changed to 2020.5.20 with the folowing
fixes:
randr97 edited a comment on issue #8890:
URL: https://github.com/apache/airflow/issues/8890#issuecomment-629808815
> @randr97 a lot of organizations manage infrastructure like S3 buckets
through infrastructure-as-code scripts, usually Terraform since that is what
AWS supports natively.
randr97 commented on issue #8890:
URL: https://github.com/apache/airflow/issues/8890#issuecomment-629808815
> @randr97 a lot of organizations manage infrastructure like S3 buckets
through infrastructure-as-code scripts, usually Terraform since that is what
AWS supports natively. The way
prateeksan commented on issue #8890:
URL: https://github.com/apache/airflow/issues/8890#issuecomment-629808178
@randr97 a lot of organizations manage infrastructure like S3 buckets
through infrastructure-as-code scripts, usually Terraform since that is what
AWS supports natively. The way
randr97 edited a comment on issue #8890:
URL: https://github.com/apache/airflow/issues/8890#issuecomment-629805198
> @randr97 is this to create and delete buckets or objects in buckets? If it
is to create/delete buckets, how would you interact with Terraform state
backends?
Hi
randr97 commented on issue #8890:
URL: https://github.com/apache/airflow/issues/8890#issuecomment-629805198
> @randr97 is this to create and delete buckets or objects in buckets? If it
is to create/delete buckets, how would you interact with Terraform state
backends?
Hi @prateeksan,
Author: potiuk
Date: Sun May 17 12:31:12 2020
New Revision: 39633
Log:
Add Jarek Potiuk to the list of developers
Modified:
release/airflow/KEYS
Modified: release/airflow/KEYS
==
--- release/airflow/KEYS (original)
Modified:
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/apache_airflow_backport_providers_sftp-2020.5.19rc1-py2.py3-none-any.whl.asc
==
---
Author: potiuk
Date: Sun May 17 11:55:56 2020
New Revision: 39631
Log:
Add artifacts for Airflow backport-providers-2020.5.19
Modified:
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/apache-airflow-backport-providers-2020.5.19rc1-source-bin.tar.gz.asc
Modified:
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/apache-airflow-backport-providers-segment-2020.5.19rc1-bin.tar.gz.asc
==
---
Copied:
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/apache_airflow_backport_providers_apache_spark-2020.5.19rc1-py2.py3-none-any.whl.sha512
(from r39627,
Copied:
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/apache-airflow-backport-providers-2020.5.19rc1-source-bin.tar.gz.asc
(from r39627,
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/apache-airflow-backport-providers-2020.5.19-source-bin.tar.gz.asc)
Copied:
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/apache_airflow_backport_providers_papermill-2020.5.19rc1-py2.py3-none-any.whl.sha512
(from r39627,
Copied:
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/apache-airflow-backport-providers-microsoft-winrm-2020.5.19rc1-bin.tar.gz.asc
(from r39627,
Author: potiuk
Date: Sun May 17 11:52:42 2020
New Revision: 39629
Log:
Add artifacts for Airflow backport-providers-2020.5.19
Added:
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/apache-airflow-backport-providers-2020.5.19rc1-source-bin.tar.gz
- copied unchanged from
Added:
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/apache-airflow-backport-providers-dingding-2020.5.19-bin.tar.gz.asc
==
---
Added:
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/apache_airflow_backport_providers_microsoft_mssql-2020.5.19-py2.py3-none-any.whl.sha512
==
---
Author: potiuk
Date: Sun May 17 11:18:59 2020
New Revision: 39626
Log:
Add artifacts for backport-providers-2020.5.19
Added:
dev/airflow/backport-providers/
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/
Added:
dev/airflow/backport-providers/backport-providers-2020.5.19rc1/apache-airflow-backport-providers-ssh-2020.5.19-bin.tar.gz.asc
==
---
randr97 opened a new issue #8890:
URL: https://github.com/apache/airflow/issues/8890
**Description**
AWS missing operators include CREATE and DELETE S3 operator. This issue
caters to creating these operators. Also writing system tests for the same.
**Use case / motivation**
Many
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag backport-providers-2020.5.19
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag backport-providers-2020.5.19 was modified! ***
from 92585ca (commit)
to
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
at 0de597f (commit)
No new revisions were added by this update.
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag nightly
in repository https://gitbox.apache.org/repos/asf/airflow.git.
at 4917bff (commit)
No new revisions were added by this update.
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag nightly
in repository https://gitbox.apache.org/repos/asf/airflow.git.
at 4917bff (commit)
No new revisions were added by this update.
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
at 0de597f (commit)
No new revisions were added by this update.
ashb commented on a change in pull request #8598:
URL: https://github.com/apache/airflow/pull/8598#discussion_r426237136
##
File path: airflow/providers/apache/hive/hooks/hive.py
##
@@ -708,7 +708,11 @@ def _get_max_partition_from_part_specs(part_specs,
partition_key,
ashb commented on a change in pull request #8598:
URL: https://github.com/apache/airflow/pull/8598#discussion_r426236942
##
File path: airflow/providers/apache/hive/hooks/hive.py
##
@@ -708,7 +708,11 @@ def _get_max_partition_from_part_specs(part_specs,
partition_key,
[
https://issues.apache.org/jira/browse/AIRFLOW-4078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109398#comment-17109398
]
Pujitha Jaji commented on AIRFLOW-4078:
---
Hello [~Mauricio3112] Hope are doing well. Even I am not
milton0825 edited a comment on pull request #8889:
URL: https://github.com/apache/airflow/pull/8889#issuecomment-629749913
@mik-laj Thanks for sharing the info. `Variable` via `SecretBackend` can
only read values and I don't think we should extend `SecretBackend` to support
write due to
milton0825 commented on pull request #8889:
URL: https://github.com/apache/airflow/pull/8889#issuecomment-629749913
@mik-laj Thanks for sharing the info. `Variable` via `SecretBackend` can
only read values and I am not sure if we should extend `SecretBackend` to
support write due to
92 matches
Mail list logo
