[GitHub] [airflow] stale[bot] commented on issue #6652: [AIRFLOW-5548] [AIRFLOW-5550] REST API enhancement - dag info, task …

2020-04-10 Thread GitBox
stale[bot] commented on issue #6652: [AIRFLOW-5548] [AIRFLOW-5550] REST API enhancement - dag info, task … URL: https://github.com/apache/airflow/pull/6652#issuecomment-612320874 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if

[GitHub] [airflow] zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration

2020-04-10 Thread GitBox
zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration URL: https://github.com/apache/airflow/pull/6007#discussion_r407007155 ## File path: airflow/providers/amazon/aws/hooks/glue.py ## @@ -0,0 +1,172 @@ +# -*- coding: utf-8 -*-

[GitHub] [airflow] zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration

2020-04-10 Thread GitBox
zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration URL: https://github.com/apache/airflow/pull/6007#discussion_r407007155 ## File path: airflow/providers/amazon/aws/hooks/glue.py ## @@ -0,0 +1,172 @@ +# -*- coding: utf-8 -*-

[GitHub] [airflow] zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration

2020-04-10 Thread GitBox
zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration URL: https://github.com/apache/airflow/pull/6007#discussion_r407006702 ## File path: airflow/providers/amazon/aws/operators/glue.py ## @@ -0,0 +1,117 @@ +# -*- coding: utf-8

[GitHub] [airflow] zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration

2020-04-10 Thread GitBox
zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration URL: https://github.com/apache/airflow/pull/6007#discussion_r407007155 ## File path: airflow/providers/amazon/aws/hooks/glue.py ## @@ -0,0 +1,172 @@ +# -*- coding: utf-8 -*-

[GitHub] [airflow] zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration

2020-04-10 Thread GitBox
zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration URL: https://github.com/apache/airflow/pull/6007#discussion_r407006702 ## File path: airflow/providers/amazon/aws/operators/glue.py ## @@ -0,0 +1,117 @@ +# -*- coding: utf-8

[GitHub] [airflow] zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration

2020-04-10 Thread GitBox
zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration URL: https://github.com/apache/airflow/pull/6007#discussion_r407006873 ## File path: airflow/providers/amazon/aws/sensors/glue.py ## @@ -0,0 +1,56 @@ +# -*- coding: utf-8 -*

[GitHub] [airflow] zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration

2020-04-10 Thread GitBox
zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration URL: https://github.com/apache/airflow/pull/6007#discussion_r407006545 ## File path: airflow/providers/amazon/aws/operators/glue.py ## @@ -0,0 +1,117 @@ +# -*- coding: utf-8

[GitHub] [airflow] zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration

2020-04-10 Thread GitBox
zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration URL: https://github.com/apache/airflow/pull/6007#discussion_r406964834 ## File path: airflow/providers/amazon/aws/operators/glue.py ## @@ -0,0 +1,117 @@ +# -*- coding: utf-8

[GitHub] [airflow] jmcarp commented on a change in pull request #8145: Drop redundant project id null checks.

2020-04-10 Thread GitBox
jmcarp commented on a change in pull request #8145: Drop redundant project id null checks. URL: https://github.com/apache/airflow/pull/8145#discussion_r407006276 ## File path: tests/providers/google/cloud/hooks/test_cloud_sql.py ## @@ -561,29 +513,6 @@ def test_get_instanc

[GitHub] [airflow] mik-laj commented on issue #8145: Drop redundant project id null checks.

2020-04-10 Thread GitBox
mik-laj commented on issue #8145: Drop redundant project id null checks. URL: https://github.com/apache/airflow/pull/8145#issuecomment-612298753 If you would like to add support for more decorators, the most popular decorator is `apply_defaullts. However, this will be best done in a separat

[GitHub] [airflow] mik-laj commented on a change in pull request #8145: Drop redundant project id null checks.

2020-04-10 Thread GitBox
mik-laj commented on a change in pull request #8145: Drop redundant project id null checks. URL: https://github.com/apache/airflow/pull/8145#discussion_r407003212 ## File path: airflow/providers/google/cloud/hooks/dataflow.py ## @@ -730,10 +718,10 @@ def is_job_dataflow_ru

[GitHub] [airflow] mik-laj commented on a change in pull request #8145: Drop redundant project id null checks.

2020-04-10 Thread GitBox
mik-laj commented on a change in pull request #8145: Drop redundant project id null checks. URL: https://github.com/apache/airflow/pull/8145#discussion_r407003143 ## File path: airflow/providers/google/cloud/hooks/dataflow.py ## @@ -585,10 +579,10 @@ def start_python_dataf

[GitHub] [airflow] mik-laj commented on a change in pull request #8145: Drop redundant project id null checks.

2020-04-10 Thread GitBox
mik-laj commented on a change in pull request #8145: Drop redundant project id null checks. URL: https://github.com/apache/airflow/pull/8145#discussion_r407002760 ## File path: tests/providers/google/cloud/hooks/test_cloud_sql.py ## @@ -561,29 +513,6 @@ def test_get_instan

[GitHub] [airflow] xpyct600 edited a comment on issue #8179: Airflow LDAP authentication with RBAC features

2020-04-10 Thread GitBox
xpyct600 edited a comment on issue #8179: Airflow LDAP authentication with RBAC features URL: https://github.com/apache/airflow/issues/8179#issuecomment-612261854 Hi, @Abhishekchechani Yep, you can use script https://github.com/xpyct600/fab_ldap_sync for this. Add all necessary LDAP

[GitHub] [airflow] xpyct600 edited a comment on issue #8179: Airflow LDAP authentication with RBAC features

2020-04-10 Thread GitBox
xpyct600 edited a comment on issue #8179: Airflow LDAP authentication with RBAC features URL: https://github.com/apache/airflow/issues/8179#issuecomment-612261854 Hi, @Abhishekchechani Yep, you can use script https://github.com/xpyct600/fab_ldap_sync for this. Add all necessary LDAP

[GitHub] [airflow] jmcarp commented on a change in pull request #8145: Drop redundant project id null checks.

2020-04-10 Thread GitBox
jmcarp commented on a change in pull request #8145: Drop redundant project id null checks. URL: https://github.com/apache/airflow/pull/8145#discussion_r406995719 ## File path: airflow/providers/google/cloud/hooks/datacatalog.py ## @@ -659,7 +659,7 @@ def list_tags(

[GitHub] [airflow] jmcarp commented on a change in pull request #8145: Drop redundant project id null checks.

2020-04-10 Thread GitBox
jmcarp commented on a change in pull request #8145: Drop redundant project id null checks. URL: https://github.com/apache/airflow/pull/8145#discussion_r406995108 ## File path: airflow/providers/google/cloud/example_dags/example_automl_tables.py ## @@ -139,7 +139,6 @@ def g

[GitHub] [airflow] xpyct600 commented on issue #8179: Airflow LDAP authentication with RBAC features

2020-04-10 Thread GitBox
xpyct600 commented on issue #8179: Airflow LDAP authentication with RBAC features URL: https://github.com/apache/airflow/issues/8179#issuecomment-612261854 Hi, @Abhishekchechani Yep, you can use script https://github.com/xpyct600/fab_ldap_sync for this. Add all necessary LDAP groups

[GitHub] [airflow] mustafagok opened a new pull request #8248: ECSOperator: Make launch_type parameter optional

2020-04-10 Thread GitBox
mustafagok opened a new pull request #8248: ECSOperator: Make launch_type parameter optional URL: https://github.com/apache/airflow/pull/8248 launch_type is not a required parameter for run_task method See: https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ecs.h

[GitHub] [airflow] dlampsi opened a new issue #8247: Serialized DAG trigger via UI error - AttributeError: 'NoneType' object has no attribute 'create_dagrun'

2020-04-10 Thread GitBox
dlampsi opened a new issue #8247: Serialized DAG trigger via UI error - AttributeError: 'NoneType' object has no attribute 'create_dagrun' URL: https://github.com/apache/airflow/issues/8247 **Apache Airflow version**: 1.10.10 **Kubernetes version (if you are using kubernetes)** (

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8247: Serialized DAG trigger via UI error - AttributeError: 'NoneType' object has no attribute 'create_dagrun'

2020-04-10 Thread GitBox
boring-cyborg[bot] commented on issue #8247: Serialized DAG trigger via UI error - AttributeError: 'NoneType' object has no attribute 'create_dagrun' URL: https://github.com/apache/airflow/issues/8247#issuecomment-612234631 Thanks for opening your first issue here! Be sure to follow the iss

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8246: Docs: LatestOnlyOperator documentation is misleading

2020-04-10 Thread GitBox
boring-cyborg[bot] commented on issue #8246: Docs: LatestOnlyOperator documentation is misleading URL: https://github.com/apache/airflow/issues/8246#issuecomment-612228581 Thanks for opening your first issue here! Be sure to follow the issue template! -

[GitHub] [airflow] ynouri opened a new issue #8246: Docs: LatestOnlyOperator documentation is misleading

2020-04-10 Thread GitBox
ynouri opened a new issue #8246: Docs: LatestOnlyOperator documentation is misleading URL: https://github.com/apache/airflow/issues/8246 I'm relatively new to Airflow and I started experimenting with LatestOnlyOperator for the needs of my team. The operator itself seems to work fine

[GitHub] [airflow] zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration

2020-04-10 Thread GitBox
zachliu commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration URL: https://github.com/apache/airflow/pull/6007#discussion_r406951798 ## File path: airflow/providers/amazon/aws/hooks/glue.py ## @@ -0,0 +1,172 @@ +# -*- coding: utf-8 -*-

[GitHub] [airflow] pdeardorff-r7 commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration

2020-04-10 Thread GitBox
pdeardorff-r7 commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration URL: https://github.com/apache/airflow/pull/6007#discussion_r406942344 ## File path: airflow/providers/amazon/aws/hooks/glue.py ## @@ -0,0 +1,172 @@ +# -*- coding: utf

[GitHub] [airflow] pdeardorff-r7 commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration

2020-04-10 Thread GitBox
pdeardorff-r7 commented on a change in pull request #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration URL: https://github.com/apache/airflow/pull/6007#discussion_r406940636 ## File path: airflow/providers/amazon/aws/hooks/glue.py ## @@ -0,0 +1,172 @@ +# -*- coding: utf

[GitHub] [airflow] jumiller-cotiviti commented on issue #8179: Airflow LDAP authentication with RBAC features

2020-04-10 Thread GitBox
jumiller-cotiviti commented on issue #8179: Airflow LDAP authentication with RBAC features URL: https://github.com/apache/airflow/issues/8179#issuecomment-612194146 Since this might leave a lot of people who were already using ldap with groups in the lurch here is a script a guy wrote

[GitHub] [airflow] Abhishekchechani commented on issue #3015: [AIRFLOW-85] Convert Airflow Webserver UI to FAB for RBAC support

2020-04-10 Thread GitBox
Abhishekchechani commented on issue #3015: [AIRFLOW-85] Convert Airflow Webserver UI to FAB for RBAC support URL: https://github.com/apache/airflow/pull/3015#issuecomment-612167128 I have enabled Airflow with LDAP credentials with FAB. But the problem is that all the users have the Admin r

[GitHub] [airflow] xyu opened a new issue #8245: Add Option for BashOperator to Set State to SKIPPED

2020-04-10 Thread GitBox
xyu opened a new issue #8245: Add Option for BashOperator to Set State to SKIPPED URL: https://github.com/apache/airflow/issues/8245 Allow BashOperator Tasks to Skip instead of Fail With the BashOperator sometimes I want to signal that the task should soft fail / return in a skipped

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8245: Add Option for BashOperator to Set State to SKIPPED

2020-04-10 Thread GitBox
boring-cyborg[bot] commented on issue #8245: Add Option for BashOperator to Set State to SKIPPED URL: https://github.com/apache/airflow/issues/8245#issuecomment-612153032 Thanks for opening your first issue here! Be sure to follow the issue template! --

[GitHub] [airflow] xyu opened a new pull request #8244: Add Option for BashOperator to Set State to SKIPPED

2020-04-10 Thread GitBox
xyu opened a new pull request #8244: Add Option for BashOperator to Set State to SKIPPED URL: https://github.com/apache/airflow/pull/8244 Currently the BashOperator will raise an `AirflowException` on any non-zero exit code which will cause the task state to be set to `State.FAILED`. This

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8244: Add Option for BashOperator to Set State to SKIPPED

2020-04-10 Thread GitBox
boring-cyborg[bot] commented on issue #8244: Add Option for BashOperator to Set State to SKIPPED URL: https://github.com/apache/airflow/pull/8244#issuecomment-612148648 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are uns

[GitHub] [airflow] crhyatt commented on issue #7626: [AIRFLOW-5575] Cannot use the mark future success/failure feature in the UI

2020-04-10 Thread GitBox
crhyatt commented on issue #7626: [AIRFLOW-5575] Cannot use the mark future success/failure feature in the UI URL: https://github.com/apache/airflow/pull/7626#issuecomment-612146931 @dimberman Can you explain the Codecov report to me? ---

[airflow-site] branch asf-site updated: Update - Fri 10 Apr 2020 18:46:30 BST

2020-04-10 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new e05fc23 Update - Fri 10 Apr 2020 1

[airflow-site] branch master updated: Update Meetup Details & minor blog post improvements

2020-04-10 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/master by this push: new a09ab59 Update Meetup Details & minor

[airflow-site] branch asf-site updated: Update - Fri 10 Apr 2020 18:33:19 BST

2020-04-10 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 1b9c0a9 Update - Fri 10 Apr 2020 1

[GitHub] [airflow-site] kaxil merged pull request #263: Add more info in 1.10.10 blogpost

2020-04-10 Thread GitBox
kaxil merged pull request #263: Add more info in 1.10.10 blogpost URL: https://github.com/apache/airflow-site/pull/263 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[airflow-site] branch add-more-info created (now 3483b43)

2020-04-10 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch add-more-info in repository https://gitbox.apache.org/repos/asf/airflow-site.git. at 3483b43 Add more info in 1.10.10 blogpost This branch includes the following new commits: new

[GitHub] [airflow-site] kaxil opened a new pull request #263: Add more info in 1.10.10 blogpost

2020-04-10 Thread GitBox
kaxil opened a new pull request #263: Add more info in 1.10.10 blogpost URL: https://github.com/apache/airflow-site/pull/263 This is an automated message from the Apache Git Service. To respond to the message, please log on t

[airflow-site] 01/01: Add more info in 1.10.10 blogpost

2020-04-10 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch add-more-info in repository https://gitbox.apache.org/repos/asf/airflow-site.git commit 3483b43325f771ccfe03fb61d0cc418a8b7f5f9f Author: Kaxil Naik AuthorDate: Fri Apr 10 18:22:29 2020 +0100

[airflow-site] branch master updated: Add more info in 1.10.10 blogpost (#263)

2020-04-10 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/master by this push: new 8d51861 Add more info in 1.10.10 blogp

[jira] [Commented] (AIRFLOW-7118) Honor schema type for mysql to gcs data pre-process

2020-04-10 Thread Hongyi Wang (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17080642#comment-17080642 ] Hongyi Wang commented on AIRFLOW-7118: -- Issue solved with PR [https://github.com/a

[jira] [Resolved] (AIRFLOW-7118) Honor schema type for mysql to gcs data pre-process

2020-04-10 Thread Hongyi Wang (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyi Wang resolved AIRFLOW-7118. -- Resolution: Fixed > Honor schema type for mysql to gcs data pre-process > ---

[jira] [Commented] (AIRFLOW-7113) Airflow failed to render gantt view due to missing start_date

2020-04-10 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17080634#comment-17080634 ] t oo commented on AIRFLOW-7113: --- [~Cong Zhu] pr is merged so can close this? > Airflow f

[GitHub] [airflow] dimberman commented on a change in pull request #8222: github action tests

2020-04-10 Thread GitBox
dimberman commented on a change in pull request #8222: github action tests URL: https://github.com/apache/airflow/pull/8222#discussion_r406835330 ## File path: .github/workflows/ci-k8s.yml ## @@ -0,0 +1,68 @@ +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] dimberman commented on issue #8222: github action tests

2020-04-10 Thread GitBox
dimberman commented on issue #8222: github action tests URL: https://github.com/apache/airflow/pull/8222#issuecomment-612107991 @potiuk yes I have a PR I'm working on that will allow us to run the official airflow chart https://github.com/astronomer/airflow-chart/pull/67. Right now I'm jus

[GitHub] [airflow] csurett commented on issue #7843: Colorblind friendly UI

2020-04-10 Thread GitBox
csurett commented on issue #7843: Colorblind friendly UI URL: https://github.com/apache/airflow/issues/7843#issuecomment-612108149 Couldn't the colors be made into a user preference using Javascript and a cookie? This is an a

[GitHub] [airflow] dimberman commented on a change in pull request #8222: github action tests

2020-04-10 Thread GitBox
dimberman commented on a change in pull request #8222: github action tests URL: https://github.com/apache/airflow/pull/8222#discussion_r406834596 ## File path: .github/workflows/ci-k8s.yml ## @@ -0,0 +1,68 @@ +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] potiuk commented on a change in pull request #8222: github action tests

2020-04-10 Thread GitBox
potiuk commented on a change in pull request #8222: github action tests URL: https://github.com/apache/airflow/pull/8222#discussion_r406800665 ## File path: .github/workflows/ci-k8s.yml ## @@ -0,0 +1,68 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] potiuk commented on a change in pull request #8222: github action tests

2020-04-10 Thread GitBox
potiuk commented on a change in pull request #8222: github action tests URL: https://github.com/apache/airflow/pull/8222#discussion_r406799087 ## File path: .github/workflows/ci-k8s.yml ## @@ -0,0 +1,68 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or

[GitHub] [airflow] potiuk commented on a change in pull request #8222: github action tests

2020-04-10 Thread GitBox
potiuk commented on a change in pull request #8222: github action tests URL: https://github.com/apache/airflow/pull/8222#discussion_r406829365 ## File path: scripts/ci/ci_run_airflow_testing.sh ## @@ -79,36 +79,3 @@ done RUN_INTEGRATION_TESTS=${RUN_INTEGRATION_TESTS:=""}

[GitHub] [airflow] potiuk commented on a change in pull request #8222: github action tests

2020-04-10 Thread GitBox
potiuk commented on a change in pull request #8222: github action tests URL: https://github.com/apache/airflow/pull/8222#discussion_r406798871 ## File path: .github/workflows/ci-k8s.yml ## @@ -0,0 +1,68 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or

[jira] [Updated] (AIRFLOW-4357) Tool tip offset when using RBAC

2020-04-10 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-4357: Fix Version/s: 1.10.11 > Tool tip offset when using RBAC > --- > >

[airflow-site] branch asf-site updated: Add blogpost for 1.10.10

2020-04-10 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new ee0b93a Add blogpost for 1.10.10 e

[airflow-site] branch master updated: Add blog post for Airflow 1.10.10 (#262)

2020-04-10 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/master by this push: new 1c01299 Add blog post for Airflow 1.10

[GitHub] [airflow-site] kaxil merged pull request #262: Add blog post for Airflow 1.10.10

2020-04-10 Thread GitBox
kaxil merged pull request #262: Add blog post for Airflow 1.10.10 URL: https://github.com/apache/airflow-site/pull/262 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [airflow-site] kaxil opened a new pull request #262: Add blog post for Airflow 1.10.10

2020-04-10 Thread GitBox
kaxil opened a new pull request #262: Add blog post for Airflow 1.10.10 URL: https://github.com/apache/airflow-site/pull/262 Adds a blog post for Airflow 1.10.10 Updates and Features This is an automated message from the Apach

[airflow-site] branch blog-post-1.10.10 created (now 87e4369)

2020-04-10 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch blog-post-1.10.10 in repository https://gitbox.apache.org/repos/asf/airflow-site.git. at 87e4369 Add blog post for Airflow 1.10.10 This branch includes the following new commits:

[airflow-site] 01/01: Add blog post for Airflow 1.10.10

2020-04-10 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch blog-post-1.10.10 in repository https://gitbox.apache.org/repos/asf/airflow-site.git commit 87e4369bd7688095c03f2407af17208c49950ee6 Author: Kaxil Naik AuthorDate: Fri Apr 10 16:36:22 2020 +01

[GitHub] [airflow] mik-laj commented on issue #8213: Fix issue #8163 where gcp auth fails

2020-04-10 Thread GitBox
mik-laj commented on issue #8213: Fix issue #8163 where gcp auth fails URL: https://github.com/apache/airflow/pull/8213#issuecomment-612076261 Static checks don't pass. Can you fix it? This is an automated message from the Ap

[GitHub] [airflow] potiuk commented on issue #8222: github action tests

2020-04-10 Thread GitBox
potiuk commented on issue #8222: github action tests URL: https://github.com/apache/airflow/pull/8222#issuecomment-612068856 Looking at it now :) @dimberman ! This is an automated message from the Apache Git Service. To re

[GitHub] [airflow] a-jumani commented on issue #8242: Jinjafy params arg in BaseOperator

2020-04-10 Thread GitBox
a-jumani commented on issue #8242: Jinjafy params arg in BaseOperator URL: https://github.com/apache/airflow/pull/8242#issuecomment-612060816 @dimberman Will appreciate your comments. This is an automated message from the Apac

[GitHub] [airflow] codecov-io commented on issue #8240: GCP SparkR Example

2020-04-10 Thread GitBox
codecov-io commented on issue #8240: GCP SparkR Example URL: https://github.com/apache/airflow/pull/8240#issuecomment-612055560 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8240?src=pr&el=h1) Report > Merging [#8240](https://codecov.io/gh/apache/airflow/pull/8240?src=pr&el=desc

[GitHub] [airflow] maxcountryman opened a new issue #8243: Sentry tags appear to be missing

2020-04-10 Thread GitBox
maxcountryman opened a new issue #8243: Sentry tags appear to be missing URL: https://github.com/apache/airflow/issues/8243 After switching over to the now-included Sentry plugin for Airflow, we're noticing that Sentry seems to be having some issues. The most obvious problem is that now Se

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8243: Sentry tags appear to be missing

2020-04-10 Thread GitBox
boring-cyborg[bot] commented on issue #8243: Sentry tags appear to be missing URL: https://github.com/apache/airflow/issues/8243#issuecomment-612053090 Thanks for opening your first issue here! Be sure to follow the issue template! --

[GitHub] [airflow] a-jumani opened a new pull request #8242: Jinjafy params arg in BaseOperator

2020-04-10 Thread GitBox
a-jumani opened a new pull request #8242: Jinjafy params arg in BaseOperator URL: https://github.com/apache/airflow/pull/8242 Change allows params argument in BaseOperator to be templated. Closes #7910 --- Make sure to mark the boxes below before creating PR: [x] - [

[GitHub] [airflow] a-jumani closed pull request #8241: Jinjafy params in BaseOperator

2020-04-10 Thread GitBox
a-jumani closed pull request #8241: Jinjafy params in BaseOperator URL: https://github.com/apache/airflow/pull/8241 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] a-jumani opened a new pull request #8241: Jinjafy params in BaseOperator

2020-04-10 Thread GitBox
a-jumani opened a new pull request #8241: Jinjafy params in BaseOperator URL: https://github.com/apache/airflow/pull/8241 Changes allow params argument in BaseOperator to be templated. Closes #7910 --- Make sure to mark the boxes below before creating PR: [x] - [x] D

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8241: Jinjafy params in BaseOperator

2020-04-10 Thread GitBox
boring-cyborg[bot] commented on issue #8241: Jinjafy params in BaseOperator URL: https://github.com/apache/airflow/pull/8241#issuecomment-612037086 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything

[GitHub] [airflow] codecov-io edited a comment on issue #8174: Added GoogleDisplayVideo360DownloadLineItemsOperator

2020-04-10 Thread GitBox
codecov-io edited a comment on issue #8174: Added GoogleDisplayVideo360DownloadLineItemsOperator URL: https://github.com/apache/airflow/pull/8174#issuecomment-610453239 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8174?src=pr&el=h1) Report > Merging [#8174](https://codecov.io/

[GitHub] [airflow] potiuk commented on issue #8229: Proper version is displayed when running prod image via Breeze

2020-04-10 Thread GitBox
potiuk commented on issue #8229: Proper version is displayed when running prod image via Breeze URL: https://github.com/apache/airflow/pull/8229#issuecomment-612033935 Hey @feluelle - can you double check if this works :) ? T

[GitHub] [airflow] potiuk merged pull request #8239: Upgraded to latest version of requirements

2020-04-10 Thread GitBox
potiuk merged pull request #8239: Upgraded to latest version of requirements URL: https://github.com/apache/airflow/pull/8239 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] cboden edited a comment on issue #8172: setproctitle causes "Expected in: flat namespace" error

2020-04-10 Thread GitBox
cboden edited a comment on issue #8172: setproctitle causes "Expected in: flat namespace" error URL: https://github.com/apache/airflow/issues/8172#issuecomment-612027480 I'm having this same problem. MacOS 10.15.3 with Python 3.7.6 installed via Homebrew inside a native venv (`python3 -m v

[GitHub] [airflow] cboden commented on issue #8172: setproctitle causes "Expected in: flat namespace" error

2020-04-10 Thread GitBox
cboden commented on issue #8172: setproctitle causes "Expected in: flat namespace" error URL: https://github.com/apache/airflow/issues/8172#issuecomment-612027480 I'm having this same problem. MacOS 10.15.3 with Python 3.7.6 installed via Homebrew installed inside a native venv (`python3 -

[GitHub] [airflow] mik-laj commented on a change in pull request #8213: Fix issue #8163 where gcp auth fails

2020-04-10 Thread GitBox
mik-laj commented on a change in pull request #8213: Fix issue #8163 where gcp auth fails URL: https://github.com/apache/airflow/pull/8213#discussion_r406754526 ## File path: airflow/providers/google/cloud/utils/credentials_provider.py ## @@ -241,7 +241,14 @@ def get_crede

[GitHub] [airflow] mik-laj commented on a change in pull request #8213: Fix issue #8163 where gcp auth fails

2020-04-10 Thread GitBox
mik-laj commented on a change in pull request #8213: Fix issue #8163 where gcp auth fails URL: https://github.com/apache/airflow/pull/8213#discussion_r406754526 ## File path: airflow/providers/google/cloud/utils/credentials_provider.py ## @@ -241,7 +241,14 @@ def get_crede

[GitHub] [airflow] potiuk merged pull request #8234: Docker image build include now releses 1.10.10 version

2020-04-10 Thread GitBox
potiuk merged pull request #8234: Docker image build include now releses 1.10.10 version URL: https://github.com/apache/airflow/pull/8234 This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [airflow] turbaszek commented on a change in pull request #8240: GCP SparkR Example

2020-04-10 Thread GitBox
turbaszek commented on a change in pull request #8240: GCP SparkR Example URL: https://github.com/apache/airflow/pull/8240#discussion_r406745858 ## File path: airflow/providers/google/cloud/example_dags/example_dataproc.py ## @@ -104,6 +105,12 @@ "pyspark_job": {"main_

[GitHub] [airflow] turbaszek commented on a change in pull request #8240: GCP SparkR Example

2020-04-10 Thread GitBox
turbaszek commented on a change in pull request #8240: GCP SparkR Example URL: https://github.com/apache/airflow/pull/8240#discussion_r406746389 ## File path: tests/providers/google/cloud/operators/test_dataproc_system.py ## @@ -35,16 +37,28 @@ print(words) """ +sparkr_

[GitHub] [airflow] turbaszek commented on a change in pull request #8240: GCP SparkR Example

2020-04-10 Thread GitBox
turbaszek commented on a change in pull request #8240: GCP SparkR Example URL: https://github.com/apache/airflow/pull/8240#discussion_r406738057 ## File path: airflow/providers/google/cloud/example_dags/example_dataproc.py ## @@ -38,7 +38,8 @@ OUTPUT_PATH = "gs://{}/{}/".f

[GitHub] [airflow] roelhogervorst commented on a change in pull request #8240: GCP SparkR Example

2020-04-10 Thread GitBox
roelhogervorst commented on a change in pull request #8240: GCP SparkR Example URL: https://github.com/apache/airflow/pull/8240#discussion_r406733588 ## File path: airflow/providers/google/cloud/example_dags/example_dataproc.py ## @@ -38,7 +38,8 @@ OUTPUT_PATH = "gs://{}/{

[GitHub] [airflow] roelhogervorst commented on a change in pull request #8240: GCP SparkR Example

2020-04-10 Thread GitBox
roelhogervorst commented on a change in pull request #8240: GCP SparkR Example URL: https://github.com/apache/airflow/pull/8240#discussion_r406733054 ## File path: airflow/providers/google/cloud/example_dags/example_dataproc.py ## @@ -38,7 +38,8 @@ OUTPUT_PATH = "gs://{}/{

[GitHub] [airflow] roelhogervorst opened a new pull request #8240: GCP SparkR Example

2020-04-10 Thread GitBox
roelhogervorst opened a new pull request #8240: GCP SparkR Example URL: https://github.com/apache/airflow/pull/8240 Show how to schedule R, and sparkR jobs on a dataproc cluster. The functionality to run that kind of job is already in dataproc, but it was not so clear how to do that fr

[GitHub] [airflow] kaxil commented on a change in pull request #7741: [AIRFLOW-7076] Add support for HashiCorp Vault as Secrets Backend

2020-04-10 Thread GitBox
kaxil commented on a change in pull request #7741: [AIRFLOW-7076] Add support for HashiCorp Vault as Secrets Backend URL: https://github.com/apache/airflow/pull/7741#discussion_r406725554 ## File path: airflow/providers/hashicorp/secrets/vault.py ## @@ -0,0 +1,197 @@ +# +#

[GitHub] [airflow] khyurri commented on issue #8237: dag will never start if we set a cron string with a clear day of week to the schedule_interval arg

2020-04-10 Thread GitBox
khyurri commented on issue #8237: dag will never start if we set a cron string with a clear day of week to the schedule_interval arg URL: https://github.com/apache/airflow/issues/8237#issuecomment-611997641 Could you provide more information on how you run this DAG and what do you expec

[GitHub] [airflow] turbaszek merged pull request #8232: Simplify DAG.set_dag_runs_state method

2020-04-10 Thread GitBox
turbaszek merged pull request #8232: Simplify DAG.set_dag_runs_state method URL: https://github.com/apache/airflow/pull/8232 This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [airflow] roelhogervorst commented on a change in pull request #7864: GCP SparkR operator

2020-04-10 Thread GitBox
roelhogervorst commented on a change in pull request #7864: GCP SparkR operator URL: https://github.com/apache/airflow/pull/7864#discussion_r406710965 ## File path: airflow/providers/google/cloud/operators/dataproc.py ## @@ -1359,6 +1359,128 @@ def execute(self, context):

[GitHub] [airflow] potiuk commented on issue #8239: Upgraded to latest version of requirements

2020-04-10 Thread GitBox
potiuk commented on issue #8239: Upgraded to latest version of requirements URL: https://github.com/apache/airflow/pull/8239#issuecomment-611977597 Updated to latest version of requirements for constraint files. This is an aut

[GitHub] [airflow] potiuk opened a new pull request #8239: Upgraded to latest version of requirements

2020-04-10 Thread GitBox
potiuk opened a new pull request #8239: Upgraded to latest version of requirements URL: https://github.com/apache/airflow/pull/8239 --- Make sure to mark the boxes below before creating PR: [x] - [x] Description above provides context of the change - [x] Unit tests coverage for

[jira] [Commented] (AIRFLOW-7118) Honor schema type for mysql to gcs data pre-process

2020-04-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17080391#comment-17080391 ] ASF GitHub Bot commented on AIRFLOW-7118: - mik-laj commented on pull request #8

[GitHub] [airflow] mik-laj merged pull request #8090: [AIRFLOW-7118] Honor schema type for MySQL to GCS data pre-process

2020-04-10 Thread GitBox
mik-laj merged pull request #8090: [AIRFLOW-7118] Honor schema type for MySQL to GCS data pre-process URL: https://github.com/apache/airflow/pull/8090 This is an automated message from the Apache Git Service. To respond to t

[jira] [Comment Edited] (AIRFLOW-7110) Refactor the way logs are written to/read from Elasticsearch

2020-04-10 Thread Patrick Gaudreau (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17080023#comment-17080023 ] Patrick Gaudreau edited comment on AIRFLOW-7110 at 4/10/20, 10:09 AM: ---

[GitHub] [airflow] potiuk edited a comment on issue #8234: Docker image build include now releses 1.10.10 version

2020-04-10 Thread GitBox
potiuk edited a comment on issue #8234: Docker image build include now releses 1.10.10 version URL: https://github.com/apache/airflow/pull/8234#issuecomment-611951502 @kaxil @feluelle @ashb @dimberman -> this is a change in the image that includes released 1.10.10 version. I included few s

[GitHub] [airflow] michalslowikowski00 commented on a change in pull request #8174: Added GoogleDisplayVideo360DownloadLineItemsOperator

2020-04-10 Thread GitBox
michalslowikowski00 commented on a change in pull request #8174: Added GoogleDisplayVideo360DownloadLineItemsOperator URL: https://github.com/apache/airflow/pull/8174#discussion_r406676405 ## File path: airflow/providers/google/marketing_platform/operators/display_video.py ###

[GitHub] [airflow] potiuk edited a comment on issue #8234: Docker image build include now releses 1.10.10 version

2020-04-10 Thread GitBox
potiuk edited a comment on issue #8234: Docker image build include now releses 1.10.10 version URL: https://github.com/apache/airflow/pull/8234#issuecomment-611951502 @kaxil @feluelle @ashb @dimberman -> this is a change in the image that includes released 1.10.10 version. I included few s

[GitHub] [airflow] potiuk edited a comment on issue #8234: Docker image build include now releses 1.10.10 version

2020-04-10 Thread GitBox
potiuk edited a comment on issue #8234: Docker image build include now releses 1.10.10 version URL: https://github.com/apache/airflow/pull/8234#issuecomment-611951502 @kaxil @feluelle @ashb @dimberman -> this is a change in the image that includes released 1.10.10 version. I included few s

[GitHub] [airflow] potiuk commented on issue #8234: Docker image build include now releses 1.10.10 version

2020-04-10 Thread GitBox
potiuk commented on issue #8234: Docker image build include now releses 1.10.10 version URL: https://github.com/apache/airflow/pull/8234#issuecomment-611951502 @kaxil @feluelle @ashb @dimberman -> this is a change in the image that includes released 1.10.10 version. I included few simplifi

[GitHub] [airflow] codecov-io edited a comment on issue #8232: Simplify DAG.set_dag_runs_state method

2020-04-10 Thread GitBox
codecov-io edited a comment on issue #8232: Simplify DAG.set_dag_runs_state method URL: https://github.com/apache/airflow/pull/8232#issuecomment-611742609 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8232?src=pr&el=h1) Report > Merging [#8232](https://codecov.io/gh/apache/airf

[GitHub] [airflow] codecov-io edited a comment on issue #8232: Simplify DAG.set_dag_runs_state method

2020-04-10 Thread GitBox
codecov-io edited a comment on issue #8232: Simplify DAG.set_dag_runs_state method URL: https://github.com/apache/airflow/pull/8232#issuecomment-611742609 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8232?src=pr&el=h1) Report > Merging [#8232](https://codecov.io/gh/apache/airf

  1   2   >