[GitHub] [airflow] boring-cyborg[bot] commented on issue #8659: Setting num_retries for a google-cloud-platform using env variables breaks break running of google tasks

2020-04-30 Thread GitBox
boring-cyborg[bot] commented on issue #8659: URL: https://github.com/apache/airflow/issues/8659#issuecomment-622259238 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] jtmiclat opened a new issue #8659: Setting num_retries for a google-cloud-platform using env variables breaks break running of google tasks

2020-04-30 Thread GitBox
jtmiclat opened a new issue #8659: URL: https://github.com/apache/airflow/issues/8659 **Apache Airflow version**: 1.10.10 **Environment**: - **Cloud provider or hardware configuration**: - **OS** (e.g. from /etc/os-release): Pop!\_OS 18.04 LTS"l - **Kernel** (e.g. `uname

[jira] [Commented] (AIRFLOW-249) Refactor the SLA mechanism

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097162#comment-17097162 ] ASF GitHub Bot commented on AIRFLOW-249: seanxwzhang commented on a change in pull request

[GitHub] [airflow] seanxwzhang commented on a change in pull request #8545: [AIRFLOW-249] Refactor the SLA mechanism (Continuation from #3584 )

2020-04-30 Thread GitBox
seanxwzhang commented on a change in pull request #8545: URL: https://github.com/apache/airflow/pull/8545#discussion_r418414577 ## File path: airflow/models/baseoperator.py ## @@ -392,10 +442,79 @@ def __init__( % (self.task_id, dag.dag_id))

[GitHub] [airflow] seanxwzhang commented on a change in pull request #8545: [AIRFLOW-249] Refactor the SLA mechanism (Continuation from #3584 )

2020-04-30 Thread GitBox
seanxwzhang commented on a change in pull request #8545: URL: https://github.com/apache/airflow/pull/8545#discussion_r418404338 ## File path: airflow/utils/sla.py ## @@ -0,0 +1,500 @@ +# Licensed to the Apache Software Foundation (ASF) under one Review comment: sure,

[jira] [Commented] (AIRFLOW-249) Refactor the SLA mechanism

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097153#comment-17097153 ] ASF GitHub Bot commented on AIRFLOW-249: seanxwzhang commented on a change in pull request

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8658: airflow clear cli very slow

2020-04-30 Thread GitBox
boring-cyborg[bot] commented on issue #8658: URL: https://github.com/apache/airflow/issues/8658#issuecomment-622234394 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] yee379 opened a new issue #8658: airflow clear cli very slow

2020-04-30 Thread GitBox
yee379 opened a new issue #8658: URL: https://github.com/apache/airflow/issues/8658 **Apache Airflow version**: 1.10.10 **Environment**: postgres backend **What happened**: i often have dag run tasks that fail. more often or not, rerunning the task will work - even

[jira] [Commented] (AIRFLOW-249) Refactor the SLA mechanism

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097145#comment-17097145 ] ASF GitHub Bot commented on AIRFLOW-249: seanxwzhang commented on a change in pull request

[GitHub] [airflow] seanxwzhang commented on a change in pull request #8545: [AIRFLOW-249] Refactor the SLA mechanism (Continuation from #3584 )

2020-04-30 Thread GitBox
seanxwzhang commented on a change in pull request #8545: URL: https://github.com/apache/airflow/pull/8545#discussion_r418254475 ## File path: airflow/models/baseoperator.py ## @@ -392,10 +442,79 @@ def __init__( % (self.task_id, dag.dag_id))

[GitHub] [airflow] ashb commented on a change in pull request #8637: Add check for pre-2.0 style hostname_callable config value

2020-04-30 Thread GitBox
ashb commented on a change in pull request #8637: URL: https://github.com/apache/airflow/pull/8637#discussion_r418391929 ## File path: tests/test_configuration.py ## @@ -440,33 +441,42 @@ def make_config(): # lookup even if we remove this explicit fallback

[GitHub] [airflow] ashb commented on a change in pull request #8637: Add check for pre-2.0 style hostname_callable config value

2020-04-30 Thread GitBox
ashb commented on a change in pull request #8637: URL: https://github.com/apache/airflow/pull/8637#discussion_r418391772 ## File path: tests/test_configuration.py ## @@ -440,33 +441,42 @@ def make_config(): # lookup even if we remove this explicit fallback

[GitHub] [airflow] potiuk commented on pull request #8635: Improve __repr__

2020-04-30 Thread GitBox
potiuk commented on pull request #8635: URL: https://github.com/apache/airflow/pull/8635#issuecomment-622204034 Please rebase. It should be fixed now. This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] DmitryRusakovKodiak opened a new issue #8657: Add a configuration option to enable Airflow to look for DAGs in a specified S3 bucket.

2020-04-30 Thread GitBox
DmitryRusakovKodiak opened a new issue #8657: URL: https://github.com/apache/airflow/issues/8657 **Description** Add a configuration option to use S3 as a DAGs storage/provider. **Use case / motivation** Currently Airflow assumes that all DAGs are stored in `/some/path/dags`

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8656: How to make Airflow to get DAGs from S3 bucket if KubernetesExecutor is used?

2020-04-30 Thread GitBox
boring-cyborg[bot] commented on issue #8656: URL: https://github.com/apache/airflow/issues/8656#issuecomment-622140262 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] DmitryRusakovKodiak opened a new issue #8656: How to make Airflow to get DAGs from S3 bucket if KubernetesExecutor is used?

2020-04-30 Thread GitBox
DmitryRusakovKodiak opened a new issue #8656: URL: https://github.com/apache/airflow/issues/8656 Hi, guys! We are trying to run Airflow in Kubernetes. Currently we use KubernetesExecutor instead of Celery. The DAGs are located in a private aws S3 bucket. The problem, however, is

[GitHub] [airflow] XD-DENG opened a new pull request #8655: Reduce response payload size of /dag_stats and /task_stats

2020-04-30 Thread GitBox
XD-DENG opened a new pull request #8655: URL: https://github.com/apache/airflow/pull/8655 This PR is to replicate the changes done in https://github.com/apache/airflow/pull/8633 for `1.10.*` branch This is an automated

[GitHub] [airflow] reltuk commented on pull request #8640: Support k8s auth method in vault secrets provider

2020-04-30 Thread GitBox
reltuk commented on pull request #8640: URL: https://github.com/apache/airflow/pull/8640#issuecomment-622115328 Not sure about the most recent lint failure...I moved pylint directive comment to the line above the class.

[GitHub] [airflow] JonnyWaffles opened a new issue #8654: Custom Operator Documentation Typo

2020-04-30 Thread GitBox
JonnyWaffles opened a new issue #8654: URL: https://github.com/apache/airflow/issues/8654 Hi friends, There is a typo in the documentation regarding customer operators [here](https://airflow.apache.org/docs/stable/howto/custom-operator.html#creating-a-custom-operator). `name`

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8654: Custom Operator Documentation Typo

2020-04-30 Thread GitBox
boring-cyborg[bot] commented on issue #8654: URL: https://github.com/apache/airflow/issues/8654#issuecomment-622096033 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] YingboWang commented on pull request #8624: Profile hostname for celery executor (#8619)

2020-04-30 Thread GitBox
YingboWang commented on pull request #8624: URL: https://github.com/apache/airflow/pull/8624#issuecomment-622084656 @ashb Thank you for your comments. Although the issue was raised from celery executor. It could raise question for all executor with distributed workers: "where did

[GitHub] [airflow] exploy commented on issue #8645: BigQuery: integer range partitioning support for BQ tables

2020-04-30 Thread GitBox
exploy commented on issue #8645: URL: https://github.com/apache/airflow/issues/8645#issuecomment-622075183 Related PR https://github.com/apache/airflow/pull/8653 This is an automated message from the Apache Git Service. To

[GitHub] [airflow] YingboWang commented on a change in pull request #8624: Profile hostname for celery executor (#8619)

2020-04-30 Thread GitBox
YingboWang commented on a change in pull request #8624: URL: https://github.com/apache/airflow/pull/8624#discussion_r418249567 ## File path: airflow/executors/base_executor.py ## @@ -58,7 +58,7 @@ def __init__(self, parallelism: int = PARALLELISM): self.queued_tasks:

[GitHub] [airflow] BasPH commented on issue #8649: Add support for more than 1 cron exp per DAG

2020-04-30 Thread GitBox
BasPH commented on issue #8649: URL: https://github.com/apache/airflow/issues/8649#issuecomment-622068812 Can you provide an example (screenshot/code/whatever) where that happens? As far as I know, the next execution date is always computed with the `start_date` and `schedule_interval`,

[GitHub] [airflow] exploy opened a new pull request #8653: [AIRFLOW-8645] BQ: integer range partitioning support for BQ tables

2020-04-30 Thread GitBox
exploy opened a new pull request #8653: URL: https://github.com/apache/airflow/pull/8653 Support for integer range partitioning for BigQuery tables There is already support for time partitioning while creating BQ tables and Google offers more options than only time partitioning.

[GitHub] [airflow] BasPH commented on pull request #8651: [AIP-31] [AIRFLOW-8058] Retrieve current execution context without altering function's signature

2020-04-30 Thread GitBox
BasPH commented on pull request #8651: URL: https://github.com/apache/airflow/pull/8651#issuecomment-622065975 I don't really understand it yet. Could you provide a practical example? Plus, please don't place code in `utils` unless absolutely necessary. I'm sure we can think of a

[GitHub] [airflow] jeffolsi commented on issue #8649: Add support for more than 1 cron exp per DAG

2020-04-30 Thread GitBox
jeffolsi commented on issue #8649: URL: https://github.com/apache/airflow/issues/8649#issuecomment-622065472 > An immediate solution to your last sentence is to use timedelta. This is also supported: `schedule_interval=timedelta(weeks=2)`. It's not the same. When specifying cron exp

[GitHub] [airflow] BasPH commented on issue #8649: Add support for more than 1 cron exp per DAG

2020-04-30 Thread GitBox
BasPH commented on issue #8649: URL: https://github.com/apache/airflow/issues/8649#issuecomment-622061008 An immediate solution to your last sentence is to use timedelta. This is also supported: `schedule_interval=timedelta(weeks=2)`.

[GitHub] [airflow] XD-DENG commented on pull request #8633: Reduce response payload size of /dag_stats and /task_stats

2020-04-30 Thread GitBox
XD-DENG commented on pull request #8633: URL: https://github.com/apache/airflow/pull/8633#issuecomment-622061490 Hi @potiuk , I have noticed your latest CI fix. Have rebased here. This is an automated message from the Apache

[GitHub] [airflow] kaxil commented on pull request #8633: Reduce response payload size of /dag_stats and /task_stats

2020-04-30 Thread GitBox
kaxil commented on pull request #8633: URL: https://github.com/apache/airflow/pull/8633#issuecomment-622043102 > @potiuk are you fine that I go ahead to merge this first? The latest commit only fails in the two `CI Build / Requirements` builds. > > @kaxil I think I also need to

[jira] [Commented] (AIRFLOW-249) Refactor the SLA mechanism

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096846#comment-17096846 ] ASF GitHub Bot commented on AIRFLOW-249: seanxwzhang commented on a change in pull request

[GitHub] [airflow] seanxwzhang commented on a change in pull request #8545: [AIRFLOW-249] Refactor the SLA mechanism (Continuation from #3584 )

2020-04-30 Thread GitBox
seanxwzhang commented on a change in pull request #8545: URL: https://github.com/apache/airflow/pull/8545#discussion_r418201150 ## File path: airflow/jobs/scheduler_job.py ## @@ -750,7 +600,16 @@ def _process_dags(self, dags: List[DAG], session=None): if

[GitHub] [airflow] jonathanshir opened a new pull request #8652: [AIP-31] Implement XComArg model to be passed between operators

2020-04-30 Thread GitBox
jonathanshir opened a new pull request #8652: URL: https://github.com/apache/airflow/pull/8652 This PR is a part of [AIP-31], and closes #8055 #8053 #8052 . The goal of the XComArg model is to create a communication token to be passed between operators. In this fashion, we can wire the

[GitHub] [airflow] acroos commented on issue #8629: DockerOperator cannot pull image when docker client uses json-file log driver

2020-04-30 Thread GitBox
acroos commented on issue #8629: URL: https://github.com/apache/airflow/issues/8629#issuecomment-622017595 @timrourke to be honest, I didn't try many other options. It seems to me like this will be an issue regardless of log driver indeed, according to docker-py docs, a dict is the

[GitHub] [airflow] jonathanshir opened a new pull request #8651: [AIP-31] [AIRFLOW-8058] Retrieve current execution context without altering function's signature

2020-04-30 Thread GitBox
jonathanshir opened a new pull request #8651: URL: https://github.com/apache/airflow/pull/8651 This PR is a part of [AIP-31], and closes #8058 The goal of this issue is to detach the execution context from the executing method's signature. Before, the only way to retrieve execution

[GitHub] [airflow] timrourke commented on pull request #8287: [AIRFLOW-4363] Fix JSON encoding error

2020-04-30 Thread GitBox
timrourke commented on pull request #8287: URL: https://github.com/apache/airflow/pull/8287#issuecomment-622005823 thank you, @retornam, for fixing this. i ran into this issue myself after upgrading to 1.10.10. appreciate the work :clap:

[jira] [Commented] (AIRFLOW-4363) Encounter JSON Decode Error when using docker operator

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096817#comment-17096817 ] ASF GitHub Bot commented on AIRFLOW-4363: - timrourke commented on pull request #8287: URL:

[GitHub] [airflow] BigCheeze45 commented on issue #8494: TriggerDagOperator sometimes causes database to trigger UniqueViolation constraint

2020-04-30 Thread GitBox
BigCheeze45 commented on issue #8494: URL: https://github.com/apache/airflow/issues/8494#issuecomment-622005444 I'm also seeing the same error in my environment. We can reproduce it consistently with a manual trigger (`schedule_interval=None`) Executor: LocalExecutor Backend: MSSQL

[GitHub] [airflow] timrourke commented on issue #8629: DockerOperator cannot pull image when docker client uses json-file log driver

2020-04-30 Thread GitBox
timrourke commented on issue #8629: URL: https://github.com/apache/airflow/issues/8629#issuecomment-622004008 @acroos FYI, I tried changing `/etc/docker/daemon.json` to use `journald` to no avail; I think this issue exists regardless of what logging driver selected. Were you able to

[GitHub] [airflow] XD-DENG commented on pull request #8633: Reduce response payload size of /dag_stats and /task_stats

2020-04-30 Thread GitBox
XD-DENG commented on pull request #8633: URL: https://github.com/apache/airflow/pull/8633#issuecomment-622003671 @potiuk are you fine that I go ahead to merge this first? The latest commit only fails in the two `CI Build / Requirements` builds. @kaxil I think I also need to prepare

[GitHub] [airflow] XD-DENG commented on a change in pull request #8633: Reduce response payload size of /dag_stats and /task_stats

2020-04-30 Thread GitBox
XD-DENG commented on a change in pull request #8633: URL: https://github.com/apache/airflow/pull/8633#discussion_r418181679 ## File path: tests/www/test_views.py ## @@ -521,6 +521,8 @@ def test_dag_stats(self): def test_task_stats(self): resp =

[GitHub] [airflow] peter-volkov commented on issue #8650: Custom connection for backported Yandex.Cloud provider

2020-04-30 Thread GitBox
peter-volkov commented on issue #8650: URL: https://github.com/apache/airflow/issues/8650#issuecomment-621995310 Related discussion in Slack https://app.slack.com/client/TCQ18L22Z/CUKA3KQ81/thread/CUKA3KQ81-1588259396.032300

[GitHub] [airflow] peter-volkov opened a new issue #8650: Custom connection for backported Yandex.Cloud provider

2020-04-30 Thread GitBox
peter-volkov opened a new issue #8650: URL: https://github.com/apache/airflow/issues/8650 There is a Yandex.Cloud provider in master branch. However, I want it completely backported to Airflow 1.* to distribute among the clients. The problem is this provider requires a custom

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8650: Custom connection for backported Yandex.Cloud provider

2020-04-30 Thread GitBox
boring-cyborg[bot] commented on issue #8650: URL: https://github.com/apache/airflow/issues/8650#issuecomment-621991083 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] jeffolsi commented on pull request #7703: [AIRFLOW-6481] Fix bug in SalesforceHook

2020-04-30 Thread GitBox
jeffolsi commented on pull request #7703: URL: https://github.com/apache/airflow/pull/7703#issuecomment-621988474 can this bug fix be released in next version? This is an automated message from the Apache Git Service. To

[jira] [Commented] (AIRFLOW-6481) SalesforceHook attempts to use .str accessor on object dtype

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096783#comment-17096783 ] ASF GitHub Bot commented on AIRFLOW-6481: - jeffolsi commented on pull request #7703: URL:

[GitHub] [airflow] jhtimmins commented on a change in pull request #8637: Add check for pre-2.0 style hostname_callable config value

2020-04-30 Thread GitBox
jhtimmins commented on a change in pull request #8637: URL: https://github.com/apache/airflow/pull/8637#discussion_r418110002 ## File path: airflow/configuration.py ## @@ -188,25 +189,37 @@ def _validate(self): for section, replacement in

[jira] [Commented] (AIRFLOW-2971) Health check command for scheduler

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096676#comment-17096676 ] ASF GitHub Bot commented on AIRFLOW-2971: - aneesh-joseph edited a comment on pull request

[jira] [Commented] (AIRFLOW-2971) Health check command for scheduler

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096675#comment-17096675 ] ASF GitHub Bot commented on AIRFLOW-2971: - aneesh-joseph edited a comment on pull request

[GitHub] [airflow] aneesh-joseph edited a comment on pull request #6277: [AIRFLOW-2971] Add health check CLI for scheduler

2020-04-30 Thread GitBox
aneesh-joseph edited a comment on pull request #6277: URL: https://github.com/apache/airflow/pull/6277#issuecomment-621935133 @colinjc thanks for this one, I'm using a custom health check script(based on this) for my k8s probes. Can you get this in, so that I can directly use this?

[GitHub] [airflow] aneesh-joseph edited a comment on pull request #6277: [AIRFLOW-2971] Add health check CLI for scheduler

2020-04-30 Thread GitBox
aneesh-joseph edited a comment on pull request #6277: URL: https://github.com/apache/airflow/pull/6277#issuecomment-621935133 @colinjc thanks for this one, I'm using a custom health check script(based on this) for my k8s deployment. Can you get this in, so that I can directly use this?

[jira] [Commented] (AIRFLOW-2971) Health check command for scheduler

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096674#comment-17096674 ] ASF GitHub Bot commented on AIRFLOW-2971: - aneesh-joseph commented on pull request #6277: URL:

[GitHub] [airflow] aneesh-joseph commented on pull request #6277: [AIRFLOW-2971] Add health check CLI for scheduler

2020-04-30 Thread GitBox
aneesh-joseph commented on pull request #6277: URL: https://github.com/apache/airflow/pull/6277#issuecomment-621935133 @colinjc thanks for this one, I'm using it as a health check script for my k8s deployment. Can you get this in, so that I can directly use this?

[GitHub] [airflow] jeffolsi opened a new issue #8649: Add support for more than 1 corn exp per DAG

2020-04-30 Thread GitBox
jeffolsi opened a new issue #8649: URL: https://github.com/apache/airflow/issues/8649 **Description** Allow DAG to accept list of cron expression and schedule the dag in correlation to all of them. Similar to how it can be done in cron job **Use case / motivation** Some

[GitHub] [airflow] jhtimmins commented on pull request #8637: Add check for pre-2.0 style hostname_callable config value

2020-04-30 Thread GitBox
jhtimmins commented on pull request #8637: URL: https://github.com/apache/airflow/pull/8637#issuecomment-621927544 Depends on https://github.com/apache/airflow/pull/8463. @dimberman mind adding that to the description? This

[GitHub] [airflow] potiuk opened a new pull request #8648: Fix the process of requirements generations

2020-04-30 Thread GitBox
potiuk opened a new pull request #8648: URL: https://github.com/apache/airflow/pull/8648 Right now requirements will be only checked during the CI build if the setup.py has changed and if yes, clear instructions will be given. The diff will still be printed otherwise but it will

[GitHub] [airflow] NBardelot commented on pull request #7682: [AIRFLOW-7031] Airflow WinRM endpoint is hardcoded to HTTP

2020-04-30 Thread GitBox
NBardelot commented on pull request #7682: URL: https://github.com/apache/airflow/pull/7682#issuecomment-621906955 > I kindly ask you to verify the created PR Yep I wrote the comment before seeing that going from master to v1-10-stable was a mess. I fixed it. :)

[jira] [Commented] (AIRFLOW-7031) Airflow WinRM endpoint is hardcoded to HTTP

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096612#comment-17096612 ] ASF GitHub Bot commented on AIRFLOW-7031: - NBardelot commented on pull request #7682: URL:

[jira] [Updated] (AIRFLOW-5407) RBAC Graph View tasks are not highlighted when overing statuses

2020-04-30 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5407: --- Fix Version/s: 1.10.9 > RBAC Graph View tasks are not highlighted when overing

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8647: Import fails when dags subfolder and plugins subfolder have the same name

2020-04-30 Thread GitBox
boring-cyborg[bot] commented on issue #8647: URL: https://github.com/apache/airflow/issues/8647#issuecomment-621876479 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] kondla opened a new issue #8647: Import fails when dags subfolder and plugins subfolder have the same name

2020-04-30 Thread GitBox
kondla opened a new issue #8647: URL: https://github.com/apache/airflow/issues/8647 **Apache Airflow version**: apache-airflow = {extras = ["gcp"],version = "==1.10.9"} **Environment**: - **OS**: macOS Catalina - **Install tools**: Pipenv **What happened**:

[jira] [Commented] (AIRFLOW-4744) improve to access DAG Runs page from DAG information page

2020-04-30 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096558#comment-17096558 ] Ash Berlin-Taylor commented on AIRFLOW-4744: Hi [~hkak03key], Sorry for letting this issue

[jira] [Commented] (AIRFLOW-7031) Airflow WinRM endpoint is hardcoded to HTTP

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096552#comment-17096552 ] ASF GitHub Bot commented on AIRFLOW-7031: - ad-m commented on pull request #7682: URL:

[GitHub] [airflow] ad-m commented on pull request #7682: [AIRFLOW-7031] Airflow WinRM endpoint is hardcoded to HTTP

2020-04-30 Thread GitBox
ad-m commented on pull request #7682: URL: https://github.com/apache/airflow/pull/7682#issuecomment-621868140 @mik-laj , @Fokko, do you have any comments regarding that PR? This is an automated message from the Apache Git

[jira] [Commented] (AIRFLOW-7031) Airflow WinRM endpoint is hardcoded to HTTP

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096547#comment-17096547 ] ASF GitHub Bot commented on AIRFLOW-7031: - ad-m commented on pull request #7682: URL:

[GitHub] [airflow] ad-m commented on pull request #7682: [AIRFLOW-7031] Airflow WinRM endpoint is hardcoded to HTTP

2020-04-30 Thread GitBox
ad-m commented on pull request #7682: URL: https://github.com/apache/airflow/pull/7682#issuecomment-621865464 I kindly ask you to verify the created PR, because you are modifying hundreds of files and provide hundreds of commits. I am afraid that the rebase was not carried out in an

[GitHub] [airflow] dependabot[bot] opened a new pull request #8646: Bump jquery from 3.4.1 to 3.5.0 in /airflow/www

2020-04-30 Thread GitBox
dependabot[bot] opened a new pull request #8646: URL: https://github.com/apache/airflow/pull/8646 Bumps [jquery](https://github.com/jquery/jquery) from 3.4.1 to 3.5.0. Commits https://github.com/jquery/jquery/commit/7a0a850f3d41c0412609c1d32b1e602d4afe2f4e;>7a0a850 3.5.0

[jira] [Commented] (AIRFLOW-7031) Airflow WinRM endpoint is hardcoded to HTTP

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096540#comment-17096540 ] ASF GitHub Bot commented on AIRFLOW-7031: - NBardelot commented on pull request #7682: URL:

[GitHub] [airflow] NBardelot commented on pull request #7682: [AIRFLOW-7031] Airflow WinRM endpoint is hardcoded to HTTP

2020-04-30 Thread GitBox
NBardelot commented on pull request #7682: URL: https://github.com/apache/airflow/pull/7682#issuecomment-621862440 @ad-m done (on branch v1-10-stable) This is an automated message from the Apache Git Service. To respond to

[jira] [Reopened] (AIRFLOW-5438) Task Duration / Landing times - add title to axis

2020-04-30 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-5438: > Task Duration / Landing times - add title to axis >

[jira] [Assigned] (AIRFLOW-5438) Task Duration / Landing times - add title to axis

2020-04-30 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reassigned AIRFLOW-5438: -- Assignee: (was: Jakob Homan) > Task Duration / Landing times - add

[GitHub] [airflow] zachliu commented on issue #8311: Task Duration Missing from the Graph View Tool-tip for Running Tasks

2020-04-30 Thread GitBox
zachliu commented on issue #8311: URL: https://github.com/apache/airflow/issues/8311#issuecomment-621859934 upgraded to `1.10.10` two weeks ago, just noticed this issue :sweat_smile: This is an automated message from the

[GitHub] [airflow] exploy opened a new issue #8645: BigQuery: integer range partitioning support for BQ tables

2020-04-30 Thread GitBox
exploy opened a new issue #8645: URL: https://github.com/apache/airflow/issues/8645 **Description** Support for integer range partitioning for BigQuery tables **Use case / motivation** There is already support for time partitioning while creating BQ tables and Google

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8645: BigQuery: integer range partitioning support for BQ tables

2020-04-30 Thread GitBox
boring-cyborg[bot] commented on issue #8645: URL: https://github.com/apache/airflow/issues/8645#issuecomment-621836578 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] pranjalmittal commented on issue #8565: SalesforceHook missing method to return dataframe

2020-04-30 Thread GitBox
pranjalmittal commented on issue #8565: URL: https://github.com/apache/airflow/issues/8565#issuecomment-621830739 Created a PR for the issue: https://github.com/apache/airflow/pull/8644 This is an automated message from the

[GitHub] [airflow] pranjalmittal opened a new pull request #8644: 8565: SalesforceHook missing method to return dataframe

2020-04-30 Thread GitBox
pranjalmittal opened a new pull request #8644: URL: https://github.com/apache/airflow/pull/8644 --- SalesforceHook function `write_object_to_file` is divided to `object_to_df` which returns a dataframe and then the `write_object_to_file` uses `object_to_df` as the first step before

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #8644: 8565: SalesforceHook missing method to return dataframe

2020-04-30 Thread GitBox
boring-cyborg[bot] commented on pull request #8644: URL: https://github.com/apache/airflow/pull/8644#issuecomment-621830323 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] kaxil commented on a change in pull request #8633: Reduce response payload size of /dag_stats and /task_stats

2020-04-30 Thread GitBox
kaxil commented on a change in pull request #8633: URL: https://github.com/apache/airflow/pull/8633#discussion_r417984584 ## File path: tests/www/test_views.py ## @@ -521,6 +521,8 @@ def test_dag_stats(self): def test_task_stats(self): resp =

[GitHub] [airflow] kaxil commented on a change in pull request #8633: Reduce response payload size of /dag_stats and /task_stats

2020-04-30 Thread GitBox
kaxil commented on a change in pull request #8633: URL: https://github.com/apache/airflow/pull/8633#discussion_r417984584 ## File path: tests/www/test_views.py ## @@ -521,6 +521,8 @@ def test_dag_stats(self): def test_task_stats(self): resp =

[GitHub] [airflow] kaxil commented on pull request #8633: Reduce response payload size of /dag_stats and /task_stats

2020-04-30 Thread GitBox
kaxil commented on pull request #8633: URL: https://github.com/apache/airflow/pull/8633#issuecomment-621813031 There is a test failure about JSON response too: ``` > self.assertEqual(set(resp.json().items()[0][1][0].keys()), {'state', 'count',

[GitHub] [airflow] kaxil commented on pull request #8625: [AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows()

2020-04-30 Thread GitBox
kaxil commented on pull request #8625: URL: https://github.com/apache/airflow/pull/8625#issuecomment-621810841 Marking it for 1.10.11 for now, when we start cherry-picking will double check if it is fine for 1.10.11 This

[jira] [Commented] (AIRFLOW-4734) Upsert functionality for PostgresHook.insert_rows()

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096489#comment-17096489 ] ASF GitHub Bot commented on AIRFLOW-4734: - kaxil commented on pull request #8625: URL:

[GitHub] [airflow] stackapack commented on issue #8292: Bump supported mysqlclient to <1.5

2020-04-30 Thread GitBox
stackapack commented on issue #8292: URL: https://github.com/apache/airflow/issues/8292#issuecomment-621806169 @potiuk Are you still reviewing all requirements? Happy to work on this if not :) This is an automated message

[GitHub] [airflow] ashb commented on pull request #8637: Add check for pre-2.0 style hostname_callable config value

2020-04-30 Thread GitBox
ashb commented on pull request #8637: URL: https://github.com/apache/airflow/pull/8637#issuecomment-621726818 (Don't merge this yet, Github Actions haven't run yet) This is an automated message from the Apache Git Service.

[jira] [Closed] (AIRFLOW-1925) Task status colours are impossible to distinguish for colour blind people

2020-04-30 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor closed AIRFLOW-1925. -- Resolution: Fixed > Task status colours are impossible to distinguish for colour

[GitHub] [airflow] ashb commented on issue #7843: Colorblind friendly UI

2020-04-30 Thread GitBox
ashb commented on issue #7843: URL: https://github.com/apache/airflow/issues/7843#issuecomment-621724291 @preston-m-price Can you recommend some colours that work for you please? Not _promising_ we'll change it, but we can look at it. (And or different shapes too.)

[jira] [Commented] (AIRFLOW-4734) Upsert functionality for PostgresHook.insert_rows()

2020-04-30 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096359#comment-17096359 ] ASF subversion and git services commented on AIRFLOW-4734: -- Commit

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #8625: [AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows()

2020-04-30 Thread GitBox
boring-cyborg[bot] commented on pull request #8625: URL: https://github.com/apache/airflow/pull/8625#issuecomment-621715353 Awesome work, congrats on your first merged pull request! This is an automated message from the

[GitHub] [airflow] ashb commented on pull request #8625: [AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows()

2020-04-30 Thread GitBox
ashb commented on pull request #8625: URL: https://github.com/apache/airflow/pull/8625#issuecomment-621715491 @kaxil Think we could pull this in to 1.10.11 easily or not? This is an automated message from the Apache Git

[jira] [Commented] (AIRFLOW-2516) Deadlock found when trying to update task_instance table

2020-04-30 Thread Nedzad Campara (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096355#comment-17096355 ] Nedzad Campara commented on AIRFLOW-2516: - I can confirm this issue is still present in 1.10.9

[jira] [Commented] (AIRFLOW-4734) Upsert functionality for PostgresHook.insert_rows()

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096358#comment-17096358 ] ASF GitHub Bot commented on AIRFLOW-4734: - ashb commented on pull request #8625: URL:

[jira] [Commented] (AIRFLOW-4734) Upsert functionality for PostgresHook.insert_rows()

2020-04-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096357#comment-17096357 ] ASF GitHub Bot commented on AIRFLOW-4734: - boring-cyborg[bot] commented on pull request #8625:

[GitHub] [airflow] aalemanq opened a new issue #8643: Can't setup enviroments for use secrets in docker-swarm

2020-04-30 Thread GitBox
aalemanq opened a new issue #8643: URL: https://github.com/apache/airflow/issues/8643 Hello, I spend so many weeks trying to configure airflow using secrets in docker swarm. I try to use this config in my compose: environment: - LOAD_EX=y -

[GitHub] [airflow] ashb commented on a change in pull request #8624: Profile hostname for celery executor (#8619)

2020-04-30 Thread GitBox
ashb commented on a change in pull request #8624: URL: https://github.com/apache/airflow/pull/8624#discussion_r417860289 ## File path: airflow/executors/base_executor.py ## @@ -58,7 +58,7 @@ def __init__(self, parallelism: int = PARALLELISM): self.queued_tasks:

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8643: Can't setup enviroments for use secrets in docker-swarm

2020-04-30 Thread GitBox
boring-cyborg[bot] commented on issue #8643: URL: https://github.com/apache/airflow/issues/8643#issuecomment-621708157 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] ashb commented on issue #8636: Request Line is too large

2020-04-30 Thread GitBox
ashb commented on issue #8636: URL: https://github.com/apache/airflow/issues/8636#issuecomment-621705106 Fixed by #7364 which was released in 1.10.10. This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] ashb commented on a change in pull request #8637: Changes deprecated config check rules.

2020-04-30 Thread GitBox
ashb commented on a change in pull request #8637: URL: https://github.com/apache/airflow/pull/8637#discussion_r417852863 ## File path: airflow/configuration.py ## @@ -105,7 +106,6 @@ def default_config_yaml() -> dict: with open(file_path) as config_file: return

[GitHub] [airflow] ashb commented on a change in pull request #8637: Changes deprecated config check rules.

2020-04-30 Thread GitBox
ashb commented on a change in pull request #8637: URL: https://github.com/apache/airflow/pull/8637#discussion_r417852019 ## File path: airflow/configuration.py ## @@ -188,25 +189,37 @@ def _validate(self): for section, replacement in self.deprecated_values.items():

[GitHub] [airflow] ashb commented on a change in pull request #8637: Changes deprecated config check rules.

2020-04-30 Thread GitBox
ashb commented on a change in pull request #8637: URL: https://github.com/apache/airflow/pull/8637#discussion_r417851317 ## File path: airflow/configuration.py ## @@ -158,7 +158,8 @@ class AirflowConfigParser(ConfigParser): # about. Mapping of section -> setting -> { old,

[GitHub] [airflow] ashb commented on pull request #8637: Changes deprecated config check rules.

2020-04-30 Thread GitBox
ashb commented on pull request #8637: URL: https://github.com/apache/airflow/pull/8637#issuecomment-621698837 This lets us pull the change back in to 1.10.x, so that by the time 2.0 is around people will have had time and notice to update, without reading (the now quite long) UPDATING.md.

  1   2   >