[GitHub] [airflow] ismailsimsek edited a comment on issue #8657: Add a configuration option to enable Airflow to look for DAGs in a specified S3 bucket.

2020-05-03 Thread GitBox
ismailsimsek edited a comment on issue #8657: URL: https://github.com/apache/airflow/issues/8657#issuecomment-623117678 related to [AIRFLOW-2221] Create DagFetcher abstraction #3138 This is an automated message from the

[GitHub] [airflow] ismailsimsek commented on issue #8657: Add a configuration option to enable Airflow to look for DAGs in a specified S3 bucket.

2020-05-03 Thread GitBox
ismailsimsek commented on issue #8657: URL: https://github.com/apache/airflow/issues/8657#issuecomment-623117678 #3138 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (AIRFLOW-6722) Can't modify a variable with an existing value to have an empty value

2020-05-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17098442#comment-17098442 ] ASF GitHub Bot commented on AIRFLOW-6722: - stale[bot] commented on pull request #7345: URL:

[GitHub] [airflow] stale[bot] commented on pull request #7345: [AIRFLOW-6722] Solved bug related to being unable to blank out variables

2020-05-03 Thread GitBox
stale[bot] commented on pull request #7345: URL: https://github.com/apache/airflow/pull/7345#issuecomment-623114702 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #8689: [AIRFLOW-8605] Added docker compose

2020-05-03 Thread GitBox
boring-cyborg[bot] commented on pull request #8689: URL: https://github.com/apache/airflow/pull/8689#issuecomment-623114376 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] habibdhif opened a new pull request #8689: [AIRFLOW-8605] Added docker compose

2020-05-03 Thread GitBox
habibdhif opened a new pull request #8689: URL: https://github.com/apache/airflow/pull/8689 This adds a docker compose example to run Airflow installation. The Compose defines multiple services to run Airflow. There is an init service which is an ephemeral container to initialize

[jira] [Commented] (AIRFLOW-6481) SalesforceHook attempts to use .str accessor on object dtype

2020-05-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17098362#comment-17098362 ] ASF GitHub Bot commented on AIRFLOW-6481: - potiuk edited a comment on pull request #7703: URL:

[jira] [Commented] (AIRFLOW-6481) SalesforceHook attempts to use .str accessor on object dtype

2020-05-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17098361#comment-17098361 ] ASF GitHub Bot commented on AIRFLOW-6481: - potiuk commented on pull request #7703: URL:

[GitHub] [airflow] potiuk edited a comment on pull request #7703: [AIRFLOW-6481] Fix bug in SalesforceHook

2020-05-03 Thread GitBox
potiuk edited a comment on pull request #7703: URL: https://github.com/apache/airflow/pull/7703#issuecomment-623092386 We are trying to minimise cherry-picking now. Next week hopefully we are going to release backport operators - so yo will be able to install

[GitHub] [airflow] potiuk commented on pull request #7703: [AIRFLOW-6481] Fix bug in SalesforceHook

2020-05-03 Thread GitBox
potiuk commented on pull request #7703: URL: https://github.com/apache/airflow/pull/7703#issuecomment-623092386 We are trying to minimise cherry-picking now. Next week hopefully we are going to release backport operators - so yo will be able to install airflow-backported-salesforce

[GitHub] [airflow] jonathanshir commented on a change in pull request #8652: [AIP-31] Implement XComArg model to functionally pass output from one operator to the next

2020-05-03 Thread GitBox
jonathanshir commented on a change in pull request #8652: URL: https://github.com/apache/airflow/pull/8652#discussion_r419081295 ## File path: tests/models/test_xcom_arg.py ## @@ -0,0 +1,146 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] jonathanshir commented on a change in pull request #8652: [AIP-31] Implement XComArg model to functionally pass output from one operator to the next

2020-05-03 Thread GitBox
jonathanshir commented on a change in pull request #8652: URL: https://github.com/apache/airflow/pull/8652#discussion_r419081295 ## File path: tests/models/test_xcom_arg.py ## @@ -0,0 +1,146 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

[GitHub] [airflow] lihan commented on issue #8664: Postgres to GCS operator - use named cursor

2020-05-03 Thread GitBox
lihan commented on issue #8664: URL: https://github.com/apache/airflow/issues/8664#issuecomment-623086863 @maroshmka I also have a reference implementation, and hit by the same problem. Loading all data into memory is not the way to go. `class

[GitHub] [airflow] jonathanshir commented on a change in pull request #8652: [AIP-31] Implement XComArg model to functionally pass output from one operator to the next

2020-05-03 Thread GitBox
jonathanshir commented on a change in pull request #8652: URL: https://github.com/apache/airflow/pull/8652#discussion_r419080730 ## File path: airflow/models/baseoperator.py ## @@ -804,12 +804,15 @@ def render_template( # pylint: disable=too-many-return-statements

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8688: accessing Json variable jinja doesn't work when variable has hyphen

2020-05-03 Thread GitBox
boring-cyborg[bot] commented on issue #8688: URL: https://github.com/apache/airflow/issues/8688#issuecomment-623078354 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] eladkal opened a new issue #8688: accessing Json variable jinja doesn't work when variable has hyphen

2020-05-03 Thread GitBox
eladkal opened a new issue #8688: URL: https://github.com/apache/airflow/issues/8688 **What happened**: Defined variable as: ![Screen Shot 2020-05-03 at 11 45 51](https://user-images.githubusercontent.com/45845474/80909798-b81d5500-8d33-11ea-93ee-2859997bf0ef.png)

[GitHub] [airflow] BasPH opened a new issue #8687: Airflow webserver should handle signals immediately when starting

2020-05-03 Thread GitBox
BasPH opened a new issue #8687: URL: https://github.com/apache/airflow/issues/8687 **Apache Airflow version**: 1.10.10 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): **Environment**: - **Cloud provider or hardware configuration**:

[GitHub] [airflow] BasPH commented on issue #8649: Add support for more than 1 cron exp per DAG

2020-05-03 Thread GitBox
BasPH commented on issue #8649: URL: https://github.com/apache/airflow/issues/8649#issuecomment-623074363 Thanks for pointing this out @jeffolsi, that indeed makes no sense and seems like a fundamental error which should be fixed. What version are you running on? Let's make a separate

[GitHub] [airflow] jeffolsi commented on pull request #8675: show correct duration on graph view for running task (#8311)

2020-05-03 Thread GitBox
jeffolsi commented on pull request #8675: URL: https://github.com/apache/airflow/pull/8675#issuecomment-623073288 If I may point Invalid date is also misleading. ![PR](https://user-images.githubusercontent.com/64190742/80909263-8a361180-8d2f-11ea-9e4e-1fd41e6ae232.png) There is

[GitHub] [airflow] jeffolsi opened a new issue #8686: A more generic on_failure, on_retry methods

2020-05-03 Thread GitBox
jeffolsi opened a new issue #8686: URL: https://github.com/apache/airflow/issues/8686 **Description** Airflow offers to setup: ``` default_args = { 'owner': 'airflow', 'depends_on_past': False, 'start_date': datetime(2015, 6, 1), 'email':

[GitHub] [airflow] XD-DENG opened a new pull request #8685: Fix Spark connection add/edit UI pages

2020-05-03 Thread GitBox
XD-DENG opened a new pull request #8685: URL: https://github.com/apache/airflow/pull/8685 Currently in `master` and `1.10.10`, connection add/edit UI pages are not working correctly. ## Current Connection Adding for Spark ('Spark' in not available):

[GitHub] [airflow] jeffolsi commented on issue #8649: Add support for more than 1 cron exp per DAG

2020-05-03 Thread GitBox
jeffolsi commented on issue #8649: URL: https://github.com/apache/airflow/issues/8649#issuecomment-623064361 @BasPH This is the DAG defintion: ``` with DAG( dag_id=DAG_NAME, default_args=default_args, schedule_interval=timedelta(minutes=60),

<    1   2