[jira] [Commented] (AIRFLOW-6440) AWS Fargate Executor (AIP-29) (WIP)

2020-08-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173596#comment-17173596 ] ASF GitHub Bot commented on AIRFLOW-6440: - stale[bot] closed pull request #7030: URL:

[GitHub] [airflow] stale[bot] commented on pull request #8536: [Airflow-7044] - add ability to specify RSA public key in extra field of SSH connection.

2020-08-08 Thread GitBox
stale[bot] commented on pull request #8536: URL: https://github.com/apache/airflow/pull/8536#issuecomment-670836641 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GitHub] [airflow] stale[bot] closed pull request #7030: [AIRFLOW-6440][AIP-29] Add AWS Fargate Executor

2020-08-08 Thread GitBox
stale[bot] closed pull request #7030: URL: https://github.com/apache/airflow/pull/7030 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] stale[bot] commented on pull request #9464: Fix DockerOperator xcom

2020-08-08 Thread GitBox
stale[bot] commented on pull request #9464: URL: https://github.com/apache/airflow/pull/9464#issuecomment-670836647 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GitHub] [airflow] stale[bot] commented on pull request #8635: Improve __repr__

2020-08-08 Thread GitBox
stale[bot] commented on pull request #8635: URL: https://github.com/apache/airflow/pull/8635#issuecomment-670836643 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GitHub] [airflow] stale[bot] closed pull request #7637: [AIRFLOW-6994] SparkSubmitOperator re-launches spark driver even when original driver still running

2020-08-08 Thread GitBox
stale[bot] closed pull request #7637: URL: https://github.com/apache/airflow/pull/7637 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] stale[bot] commented on pull request #8975: [AIRFLOW-8969] Atlas Backend module improvements

2020-08-08 Thread GitBox
stale[bot] commented on pull request #8975: URL: https://github.com/apache/airflow/pull/8975#issuecomment-670836655 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GitHub] [airflow] stale[bot] commented on pull request #8256: updated _write_args on PythonVirtualenvOperator

2020-08-08 Thread GitBox
stale[bot] commented on pull request #8256: URL: https://github.com/apache/airflow/pull/8256#issuecomment-670836658 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[jira] [Commented] (AIRFLOW-6994) SparkSubmitOperator re launches spark driver even when original driver still running

2020-08-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173597#comment-17173597 ] ASF GitHub Bot commented on AIRFLOW-6994: - stale[bot] closed pull request #7637: URL:

[GitHub] [airflow] stale[bot] commented on pull request #6961: [AIRFLOW-XXX] Add task execution process on CeleryExecutor diagram

2020-08-08 Thread GitBox
stale[bot] commented on pull request #6961: URL: https://github.com/apache/airflow/pull/6961#issuecomment-670836649 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GitHub] [airflow] stale[bot] commented on pull request #9438: Detect missing docs for config options

2020-08-08 Thread GitBox
stale[bot] commented on pull request #9438: URL: https://github.com/apache/airflow/pull/9438#issuecomment-670836651 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GitHub] [airflow] stale[bot] commented on pull request #8734: Added optional logging for pod container statuses once a pod fails. T…

2020-08-08 Thread GitBox
stale[bot] commented on pull request #8734: URL: https://github.com/apache/airflow/pull/8734#issuecomment-670836635 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GitHub] [airflow] stale[bot] commented on pull request #9346: Mark task as failed when it fails in Celery

2020-08-08 Thread GitBox
stale[bot] commented on pull request #9346: URL: https://github.com/apache/airflow/pull/9346#issuecomment-670836638 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GitHub] [airflow] rootcss commented on a change in pull request #10236: Update example on docs/howto/connection/index.rst

2020-08-08 Thread GitBox
rootcss commented on a change in pull request #10236: URL: https://github.com/apache/airflow/pull/10236#discussion_r467368131 ## File path: docs/howto/connection/index.rst ## @@ -118,62 +118,53 @@ The JSON format contains an object where the key contains the connection ID and

[GitHub] [airflow] mik-laj opened a new pull request #10242: Move celery-exclusive feature to CeleryExecutor page

2020-08-08 Thread GitBox
mik-laj opened a new pull request #10242: URL: https://github.com/apache/airflow/pull/10242 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] stale[bot] closed pull request #9179: [Feature] Add @everyminute to schedule_interval

2020-08-08 Thread GitBox
stale[bot] closed pull request #9179: URL: https://github.com/apache/airflow/pull/9179 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] stale[bot] closed pull request #7682: [AIRFLOW-7031] Airflow WinRM endpoint is hardcoded to HTTP

2020-08-08 Thread GitBox
stale[bot] closed pull request #7682: URL: https://github.com/apache/airflow/pull/7682 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Commented] (AIRFLOW-7031) Airflow WinRM endpoint is hardcoded to HTTP

2020-08-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173614#comment-17173614 ] ASF GitHub Bot commented on AIRFLOW-7031: - stale[bot] closed pull request #7682: URL:

[GitHub] [airflow] mik-laj opened a new pull request #10241: Create "Managing variable" in howto directory

2020-08-08 Thread GitBox
mik-laj opened a new pull request #10241: URL: https://github.com/apache/airflow/pull/10241 I will soon want to develop this feature more and need some space to describe improvements. https://github.com/apache/airflow/issues/9856 https://github.com/apache/airflow/issues/9855

[GitHub] [airflow] rootcss commented on pull request #10236: Update example on docs/howto/connection/index.rst

2020-08-08 Thread GitBox
rootcss commented on pull request #10236: URL: https://github.com/apache/airflow/pull/10236#issuecomment-670831004 @mik-laj tests have failed due to missing indent in tests' connections dict. https://github.com/apache/airflow/pull/10236/checks?check_run_id=960763585#step:6:1028

[GitHub] [airflow] kaxil opened a new pull request #10251: Fix more typos in docs/

2020-08-08 Thread GitBox
kaxil opened a new pull request #10251: URL: https://github.com/apache/airflow/pull/10251 Found some more typos --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] potiuk merged pull request #10251: Fix more typos in docs/

2020-08-08 Thread GitBox
potiuk merged pull request #10251: URL: https://github.com/apache/airflow/pull/10251 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk merged pull request #10252: Remove Unnecessary list literal in Tuple for Kylin Operator

2020-08-08 Thread GitBox
potiuk merged pull request #10252: URL: https://github.com/apache/airflow/pull/10252 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated (8986e75 -> ae9dd56)

2020-08-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 8986e75 Add Playsimple Games to "Who uses Apache Airflow?" (#10253) add ae9dd56 Fix more typos in docs/

[GitHub] [airflow] potiuk merged pull request #10239: Add tip about airflow config command on docs/howto/secrets-backend/index.rst

2020-08-08 Thread GitBox
potiuk merged pull request #10239: URL: https://github.com/apache/airflow/pull/10239 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated (31afc0d -> 77f2e22)

2020-08-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 31afc0d Move celery-exclusive feature to CeleryExecutor page (#10242) add 77f2e22 Add tip about airflow

[GitHub] [airflow] potiuk merged pull request #10238: Set language on code-block on docs/howto/email-config.rst

2020-08-08 Thread GitBox
potiuk merged pull request #10238: URL: https://github.com/apache/airflow/pull/10238 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] Swalloow commented on pull request #9969: Add typing to amazon provider EMR

2020-08-08 Thread GitBox
Swalloow commented on pull request #9969: URL: https://github.com/apache/airflow/pull/9969#issuecomment-670926486 @mik-laj During the rebase process, all previous history has been pushed to this PR. Would it be okay or How can I fix it?

[GitHub] [airflow] kaxil commented on a change in pull request #10230: Fix KubernetesPodOperator reattachment

2020-08-08 Thread GitBox
kaxil commented on a change in pull request #10230: URL: https://github.com/apache/airflow/pull/10230#discussion_r467472962 ## File path: airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py ## @@ -304,14 +297,40 @@ def execute(self, context) -> Optional[str]:

[GitHub] [airflow] kaxil commented on a change in pull request #10230: Fix KubernetesPodOperator reattachment

2020-08-08 Thread GitBox
kaxil commented on a change in pull request #10230: URL: https://github.com/apache/airflow/pull/10230#discussion_r467472950 ## File path: airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py ## @@ -304,14 +297,40 @@ def execute(self, context) -> Optional[str]:

[airflow] branch master updated (77f2e22 -> aba29bf)

2020-08-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 77f2e22 Add tip about airflow config command on docs/howto/secrets-backend/index.rst (#10239) add aba29bf

[GitHub] [airflow] mik-laj commented on pull request #10236: Update example on docs/howto/connection/index.rst

2020-08-08 Thread GitBox
mik-laj commented on pull request #10236: URL: https://github.com/apache/airflow/pull/10236#issuecomment-670850533 @rootcss Thanks you. I updated this PR now. This is an automated message from the Apache Git Service. To

[GitHub] [airflow] kaxil commented on a change in pull request #10237: Update section about connection on docs/usage-cli.rst

2020-08-08 Thread GitBox
kaxil commented on a change in pull request #10237: URL: https://github.com/apache/airflow/pull/10237#discussion_r467455446 ## File path: docs/usage-cli.rst ## @@ -71,10 +71,10 @@ If you’re using ``zsh``, add the following to your ``.zshrc``: bashcompinit eval

[GitHub] [airflow] kaxil commented on a change in pull request #10240: Move cluster policy to separate page

2020-08-08 Thread GitBox
kaxil commented on a change in pull request #10240: URL: https://github.com/apache/airflow/pull/10240#discussion_r467455288 ## File path: docs/howto/cluster-policy.rst ## @@ -0,0 +1,75 @@ + .. Licensed to the Apache Software Foundation (ASF) under one +or more contributor

[GitHub] [airflow] michalslowikowski00 opened a new pull request #10246: Added DataprepGetJobsForJobGroupOperator

2020-08-08 Thread GitBox
michalslowikowski00 opened a new pull request #10246: URL: https://github.com/apache/airflow/pull/10246 This is task is about adding new operator in Airflow -- Dataprerp. Dataprep is cloud data service for analysis and machine learning. related:

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #10253: Adding playsimple games under "Who uses Apache Airflow?" in README.md.

2020-08-08 Thread GitBox
boring-cyborg[bot] commented on pull request #10253: URL: https://github.com/apache/airflow/pull/10253#issuecomment-670937433 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] joshi95 opened a new pull request #10253: Adding playsimple games under "Who uses Apache Airflow?" in README.md.

2020-08-08 Thread GitBox
joshi95 opened a new pull request #10253: URL: https://github.com/apache/airflow/pull/10253 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] potiuk merged pull request #10242: Move celery-exclusive feature to CeleryExecutor page

2020-08-08 Thread GitBox
potiuk merged pull request #10242: URL: https://github.com/apache/airflow/pull/10242 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk commented on pull request #10242: Move celery-exclusive feature to CeleryExecutor page

2020-08-08 Thread GitBox
potiuk commented on pull request #10242: URL: https://github.com/apache/airflow/pull/10242#issuecomment-670949707 I was planning to merge the muti-executor solution I created some time ago where queues would become useful across the board. However it should not block the move now .

[airflow] branch master updated: Move celery-exclusive feature to CeleryExecutor page (#10242)

2020-08-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 31afc0d Move celery-exclusive feature to

[airflow] branch master updated: Remove redundant "and_" condition when using filter (#10232)

2020-08-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 7930234 Remove redundant "and_" condition

[GitHub] [airflow] kaxil opened a new pull request #10244: Add 'apache.beam' to docs/installation.rst

2020-08-08 Thread GitBox
kaxil opened a new pull request #10244: URL: https://github.com/apache/airflow/pull/10244 Also replace `'apache_beam'` to `apache.beam` for extras --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] kaxil opened a new pull request #10250: Add whitespace around operator in docs/build

2020-08-08 Thread GitBox
kaxil opened a new pull request #10250: URL: https://github.com/apache/airflow/pull/10250 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] kaxil merged pull request #10217: Replace remaining uses of "bail"

2020-08-08 Thread GitBox
kaxil merged pull request #10217: URL: https://github.com/apache/airflow/pull/10217 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[airflow] branch master updated: Replace remaining uses of "bail" (#10217)

2020-08-08 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 0d8bc95 Replace remaining uses of "bail"

[airflow] branch master updated (e7c069c -> 53683b8)

2020-08-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from e7c069c Triggering DAG with Future Date (#10249) add 53683b8 Fix typo in docs/stable-rest-api/redoc.rst

[airflow] branch master updated (620400f -> e7c069c)

2020-08-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 620400f Add whitespace around operator in docs/build (#10250) add e7c069c Triggering DAG with Future Date

[GitHub] [airflow] potiuk merged pull request #10248: Fix typo in docs/stable-rest-api/redoc.rst

2020-08-08 Thread GitBox
potiuk merged pull request #10248: URL: https://github.com/apache/airflow/pull/10248 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk merged pull request #10245: Fix link for the Jinja Project in docs/tutorial.rst

2020-08-08 Thread GitBox
potiuk merged pull request #10245: URL: https://github.com/apache/airflow/pull/10245 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated (53683b8 -> b989cea)

2020-08-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 53683b8 Fix typo in docs/stable-rest-api/redoc.rst (#10248) add b989cea Fix link for the Jinja Project in

[GitHub] [airflow] potiuk merged pull request #10232: Remove redundant "and_" condition when using filter

2020-08-08 Thread GitBox
potiuk merged pull request #10232: URL: https://github.com/apache/airflow/pull/10232 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk commented on issue #10196: Move Announcement page to airflow.apache.org

2020-08-08 Thread GitBox
potiuk commented on issue #10196: URL: https://github.com/apache/airflow/issues/10196#issuecomment-670951131 I think it would be best to have separate section. It could be blog but I think announcements should be more 'permanent' :)

[GitHub] [airflow] kaxil commented on a change in pull request #10241: Create "Managing variable" in howto directory

2020-08-08 Thread GitBox
kaxil commented on a change in pull request #10241: URL: https://github.com/apache/airflow/pull/10241#discussion_r467455156 ## File path: docs/howto/variable.rst ## @@ -0,0 +1,72 @@ + .. Licensed to the Apache Software Foundation (ASF) under one +or more contributor

[GitHub] [airflow] kaxil opened a new pull request #10248: Fix typo in docs/stable-rest-api/redoc.rst

2020-08-08 Thread GitBox
kaxil opened a new pull request #10248: URL: https://github.com/apache/airflow/pull/10248 `shpinx` -> `Sphinx` --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] kaxil opened a new pull request #10252: Remove Unnecessary list literal in Tuple for Kylin Operator

2020-08-08 Thread GitBox
kaxil opened a new pull request #10252: URL: https://github.com/apache/airflow/pull/10252 It is unnecessary to use a list or tuple literal within a call to tuple. Before: ``` In [1]: tuple(["ERROR", "DISCARDED", "KILLED", "SUICIDAL", "STOPPED"]) Out[1]: ('ERROR',

[GitHub] [airflow] kaxil merged pull request #10253: Adding playsimple games in "Who uses Apache Airflow?"

2020-08-08 Thread GitBox
kaxil merged pull request #10253: URL: https://github.com/apache/airflow/pull/10253 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #10253: Adding playsimple games in "Who uses Apache Airflow?"

2020-08-08 Thread GitBox
boring-cyborg[bot] commented on pull request #10253: URL: https://github.com/apache/airflow/pull/10253#issuecomment-670938058 Awesome work, congrats on your first merged pull request! This is an automated message from

[airflow] branch master updated: Add Playsimple Games to "Who uses Apache Airflow?" (#10253)

2020-08-08 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 8986e75 Add Playsimple Games to "Who uses

[GitHub] [airflow] potiuk merged pull request #10250: Add whitespace around operator in docs/build

2020-08-08 Thread GitBox
potiuk merged pull request #10250: URL: https://github.com/apache/airflow/pull/10250 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated (edc51e3 -> 620400f)

2020-08-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from edc51e3 Remove Unnecessary list literal in Tuple for Kylin Operator (#10252) add 620400f Add whitespace

[GitHub] [airflow] potiuk merged pull request #10249: Triggering DAG with Future Date

2020-08-08 Thread GitBox
potiuk merged pull request #10249: URL: https://github.com/apache/airflow/pull/10249 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk commented on pull request #9969: Add typing to amazon provider EMR

2020-08-08 Thread GitBox
potiuk commented on pull request #9969: URL: https://github.com/apache/airflow/pull/9969#issuecomment-670947569 You need to just get your commit from the top and rebase it on top of master. See the CONTRIBUTING.rst - there is a section about it in the docs and some useful links explaining

[airflow] branch master updated (ae9dd56 -> edc51e3)

2020-08-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from ae9dd56 Fix more typos in docs/ (#10251) add edc51e3 Remove Unnecessary list literal in Tuple for Kylin

[GitHub] [airflow] potiuk merged pull request #10244: Add 'apache.beam' to docs/installation.rst

2020-08-08 Thread GitBox
potiuk merged pull request #10244: URL: https://github.com/apache/airflow/pull/10244 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated: Improve documentation in docs/start.rst (#10243)

2020-08-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new b7e4d33 Improve documentation in

[GitHub] [airflow] potiuk merged pull request #10243: Improve documentation in docs/start.rst

2020-08-08 Thread GitBox
potiuk merged pull request #10243: URL: https://github.com/apache/airflow/pull/10243 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated (b989cea -> 69225d7)

2020-08-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from b989cea Fix link for the Jinja Project in docs/tutorial.rst (#10245) add 69225d7 Add 'apache.beam' to

[GitHub] [airflow] kaxil opened a new pull request #10243: Improve documentation in docs/start.rst

2020-08-08 Thread GitBox
kaxil opened a new pull request #10243: URL: https://github.com/apache/airflow/pull/10243 `lay` -> `create` Remove ` # if you build with master` as this is the document for Master itself --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] kaxil opened a new pull request #10245: Fix link for the Jinja Project in docs/tutorial.rst

2020-08-08 Thread GitBox
kaxil opened a new pull request #10245: URL: https://github.com/apache/airflow/pull/10245 `http://jinja.pocoo.org/docs/dev/` -> `https://jinja.palletsprojects.com/` --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] kaxil opened a new pull request #10247: Create separate section for Cron Presets

2020-08-08 Thread GitBox
kaxil opened a new pull request #10247: URL: https://github.com/apache/airflow/pull/10247 Separate section will help linking to the exisiting Cron Presets --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] kaxil opened a new pull request #10249: Triggering DAG with Future Date

2020-08-08 Thread GitBox
kaxil opened a new pull request #10249: URL: https://github.com/apache/airflow/pull/10249 THis will allow linking this section --- **^ Add meaningful description above** Read the **[Pull Request

[airflow] branch master updated (c295338 -> 0d8bc95)

2020-08-08 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from c295338 Add labels param to Google MLEngine Operators (#10222) add 0d8bc95 Replace remaining uses of

[GitHub] [airflow] kaxil commented on issue #10154: DAG_TAG table and foreign key constraint

2020-08-08 Thread GitBox
kaxil commented on issue #10154: URL: https://github.com/apache/airflow/issues/10154#issuecomment-670940986 I wasn't able to reproduce the error from the Webserver, can you let me know the steps to reproduce it. I get what you are saying for the SQL statement but the delete_dag

[GitHub] [airflow] potiuk merged pull request #10235: Add system tests for CloudSecretManagerBackend

2020-08-08 Thread GitBox
potiuk merged pull request #10235: URL: https://github.com/apache/airflow/pull/10235 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated (aba29bf -> 12eed9d)

2020-08-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from aba29bf Set language on code-block on docs/howto/email-config.rst (#10238) add 12eed9d Add system tests for

[GitHub] [airflow] dstandish commented on a change in pull request #9677: Transfer to upload sftp files to blob storage

2020-08-08 Thread GitBox
dstandish commented on a change in pull request #9677: URL: https://github.com/apache/airflow/pull/9677#discussion_r467524252 ## File path: airflow/providers/microsoft/azure/transfers/sftp_to_wasb.py ## @@ -0,0 +1,166 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] chenzuoli edited a comment on issue #10155: Airflow 1.10.10 + DAG SERIALIZATION = fails to start manually the DAG's operators

2020-08-08 Thread GitBox
chenzuoli edited a comment on issue #10155: URL: https://github.com/apache/airflow/issues/10155#issuecomment-671000423 I get this error too, and fix it: vim airflow/serialization/serialized_objects.py +582 replace: `dag.task_dict[task_id]._upstream_task_ids.add(task_id) # pylint:

[GitHub] [airflow] chenzuoli commented on issue #10155: Airflow 1.10.10 + DAG SERIALIZATION = fails to start manually the DAG's operators

2020-08-08 Thread GitBox
chenzuoli commented on issue #10155: URL: https://github.com/apache/airflow/issues/10155#issuecomment-671000423 I get this error too, and fix it: vim airflow/serialization/serialized_objects.py +582 replace: `dag.task_dict[task_id]._upstream_task_ids.add(task_id)` # pylint:

[GitHub] [airflow] kubatyszko commented on pull request #10256: fixes http hook using schema field from airflow.models.connection.Con…

2020-08-08 Thread GitBox
kubatyszko commented on pull request #10256: URL: https://github.com/apache/airflow/pull/10256#issuecomment-670992363 > Can you add unit tests to avoid regression? I'll try to look at the tests soon, I'd like to wait for the CI runs to complete, it seems that many unrelated ones are

[GitHub] [airflow] utkarsharma2 commented on a change in pull request #9907: Added feature to Import connections from a file.

2020-08-08 Thread GitBox
utkarsharma2 commented on a change in pull request #9907: URL: https://github.com/apache/airflow/pull/9907#discussion_r467492937 ## File path: airflow/cli/commands/connection_command.py ## @@ -153,3 +155,93 @@ def connections_delete(args): msg = '\n\tSuccessfully

[GitHub] [airflow] potiuk commented on a change in pull request #10246: Added DataprepGetJobsForJobGroupOperator

2020-08-08 Thread GitBox
potiuk commented on a change in pull request #10246: URL: https://github.com/apache/airflow/pull/10246#discussion_r467495623 ## File path: airflow/providers/google/cloud/hooks/dataprep.py ## @@ -0,0 +1,74 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] khyurri opened a new pull request #10254: Warning about unsafe migrations

2020-08-08 Thread GitBox
khyurri opened a new pull request #10254: URL: https://github.com/apache/airflow/pull/10254 This PR resolves issue https://github.com/apache/airflow/issues/10129 Output examples: ``` [2020-08-08 23:20:29,394] {db.py:681} ERROR - Automatic migration is not available

[airflow] branch constraints-master updated: Updating constraints. GH run id:200557695

2020-08-08 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 2cdd0f0 Updating

[GitHub] [airflow] mik-laj commented on a change in pull request #10241: Create "Managing variable" in howto directory

2020-08-08 Thread GitBox
mik-laj commented on a change in pull request #10241: URL: https://github.com/apache/airflow/pull/10241#discussion_r467503305 ## File path: docs/howto/variable.rst ## @@ -0,0 +1,72 @@ + .. Licensed to the Apache Software Foundation (ASF) under one +or more contributor

[jira] [Commented] (AIRFLOW-6251) add config for max tasks per dag to prevent scheduler denial of service

2020-08-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173712#comment-17173712 ] ASF GitHub Bot commented on AIRFLOW-6251: - stale[bot] closed pull request #7157: URL:

[GitHub] [airflow] stale[bot] closed pull request #7157: [AIRFLOW-6251] add config for max tasks per dag

2020-08-08 Thread GitBox
stale[bot] closed pull request #7157: URL: https://github.com/apache/airflow/pull/7157 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] wolvery commented on a change in pull request #9677: Transfer to upload sftp files to blob storage

2020-08-08 Thread GitBox
wolvery commented on a change in pull request #9677: URL: https://github.com/apache/airflow/pull/9677#discussion_r467515654 ## File path: airflow/providers/microsoft/azure/transfers/sftp_to_wasb.py ## @@ -0,0 +1,166 @@ +# +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] khyurri commented on issue #10129: Warning about unsafe migrations

2020-08-08 Thread GitBox
khyurri commented on issue #10129: URL: https://github.com/apache/airflow/issues/10129#issuecomment-670971058 I've created PR. Not sure, how to add this functionality into `airflow upgrade-check`, we can move this functions to a more suitable place.

[GitHub] [airflow] kubatyszko opened a new pull request #10256: fixes http hook using schema field from airflow.models.connection.Con…

2020-08-08 Thread GitBox
kubatyszko opened a new pull request #10256: URL: https://github.com/apache/airflow/pull/10256 …nection, this one parses schema field from parts AFTER the / , while the connection schema is returned within conn_type field. This PR modifies http hook to use conn.conn_type instead of

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #10256: fixes http hook using schema field from airflow.models.connection.Con…

2020-08-08 Thread GitBox
boring-cyborg[bot] commented on pull request #10256: URL: https://github.com/apache/airflow/pull/10256#issuecomment-670988577 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] kubatyszko opened a new issue #10255: http hook uses schema field from Connection object instead of conn_type

2020-08-08 Thread GitBox
kubatyszko opened a new issue #10255: URL: https://github.com/apache/airflow/issues/10255 **Apache Airflow version**: MASTER **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): 1.16 **Environment**: - **Cloud provider or hardware

[GitHub] [airflow] boring-cyborg[bot] commented on issue #10255: http hook uses schema field from Connection object instead of conn_type

2020-08-08 Thread GitBox
boring-cyborg[bot] commented on issue #10255: URL: https://github.com/apache/airflow/issues/10255#issuecomment-670988511 Thanks for opening your first issue here! Be sure to follow the issue template! This is an

[GitHub] [airflow] mik-laj edited a comment on pull request #10256: fixes http hook using schema field from airflow.models.connection.Con…

2020-08-08 Thread GitBox
mik-laj edited a comment on pull request #10256: URL: https://github.com/apache/airflow/pull/10256#issuecomment-670990333 Can you add unit tests to avoid regression? This is an automated message from the Apache Git Service.

[GitHub] [airflow] mik-laj commented on pull request #10256: fixes http hook using schema field from airflow.models.connection.Con…

2020-08-08 Thread GitBox
mik-laj commented on pull request #10256: URL: https://github.com/apache/airflow/pull/10256#issuecomment-670990333 Can you add system tests to avoid regression? This is an automated message from the Apache Git Service. To

[GitHub] [airflow] JeffryMAC commented on a change in pull request #10241: Create "Managing variable" in howto directory

2020-08-08 Thread GitBox
JeffryMAC commented on a change in pull request #10241: URL: https://github.com/apache/airflow/pull/10241#discussion_r467501205 ## File path: docs/howto/variable.rst ## @@ -0,0 +1,72 @@ + .. Licensed to the Apache Software Foundation (ASF) under one +or more contributor

[GitHub] [airflow] potiuk commented on a change in pull request #10241: Create "Managing variable" in howto directory

2020-08-08 Thread GitBox
potiuk commented on a change in pull request #10241: URL: https://github.com/apache/airflow/pull/10241#discussion_r467508200 ## File path: docs/howto/variable.rst ## @@ -15,7 +15,7 @@ specific language governing permissions and limitations under the License.

[GitHub] [airflow] stale[bot] commented on pull request #9358: Tests for AWS Athena

2020-08-08 Thread GitBox
stale[bot] commented on pull request #9358: URL: https://github.com/apache/airflow/pull/9358#issuecomment-670836631 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GitHub] [airflow] stale[bot] commented on pull request #9081: Get spark driver pod status if log stream interrupted accidentally

2020-08-08 Thread GitBox
stale[bot] commented on pull request #9081: URL: https://github.com/apache/airflow/pull/9081#issuecomment-670836627 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GitHub] [airflow] mik-laj opened a new pull request #10240: Move cluster policy to separate page

2020-08-08 Thread GitBox
mik-laj opened a new pull request #10240: URL: https://github.com/apache/airflow/pull/10240 This is a very rarely used feature and should not be introduced to novice users. I will soon want to develop this feature more and need some space to describe improvements.