[GitHub] [airflow] hadoken69 commented on issue #18267: GCSToS3Operator : files already uploaded because of wrong prefix

2022-01-02 Thread GitBox
hadoken69 commented on issue #18267: URL: https://github.com/apache/airflow/issues/18267#issuecomment-1003918187 > @amaterasu-coder are you working on this issue? No -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] tanelk commented on pull request #19747: Fix Tasks getting stuck in scheduled state

2022-01-02 Thread GitBox
tanelk commented on pull request #19747: URL: https://github.com/apache/airflow/pull/19747#issuecomment-1003897449 > Tests are failing, can you take a look plz @tanelk I fixed the merge issue. The `test_scheduler_job` suite passes now. -- This is an automated message from the

[GitHub] [airflow] yuqian90 commented on issue #13827: ExternalTaskMarker with user_defined_macros do not work in Airflow 2.0 or with store_serialized_dags = True in Airflow 1.10.*

2022-01-02 Thread GitBox
yuqian90 commented on issue #13827: URL: https://github.com/apache/airflow/issues/13827#issuecomment-1003895321 > Hey @yuqian90 , did the proposed solution work for you locally? Do you think we should make a PR to fix? > > (Apologies couldn't reply here earlier) Hi, @kaxil,

[GitHub] [airflow] Bowrna commented on pull request #20066: Rewrite Breeze setup autocomplete

2022-01-02 Thread GitBox
Bowrna commented on pull request #20066: URL: https://github.com/apache/airflow/pull/20066#issuecomment-1003884390 > Yeah @Bowrna I will wake up in 6 hours, I will ping you to test together . Thanks for let me know :) Sure @edithturn we can work when you are free on this. I will

[GitHub] [airflow] Bowrna commented on issue #20252: Breeze: Asciiart disabling

2022-01-02 Thread GitBox
Bowrna commented on issue #20252: URL: https://github.com/apache/airflow/issues/20252#issuecomment-1003884195 @potiuk I will pick up this task. Could you tell me the right flag name in the .build directory which indicates ASCIIART enable/disable state? Right now I don't see any relevant

[GitHub] [airflow] edithturn commented on pull request #20066: Rewrite Breeze setup autocomplete

2022-01-02 Thread GitBox
edithturn commented on pull request #20066: URL: https://github.com/apache/airflow/pull/20066#issuecomment-1003883741 Yeah @Bowrna I will wake up in 6 hours, I will ping you to test together . Thanks for let me know :) -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] Bowrna commented on pull request #20066: Rewrite Breeze setup autocomplete

2022-01-02 Thread GitBox
Bowrna commented on pull request #20066: URL: https://github.com/apache/airflow/pull/20066#issuecomment-1003883151 I am currently working on this task. With traces I have generated with help from @edithturn I will first try to fix that code and try working along with Edith to see if it

[GitHub] [airflow] uranusjr commented on issue #19903: Error setting dependencies on task_group defined using the decorator

2022-01-02 Thread GitBox
uranusjr commented on issue #19903: URL: https://github.com/apache/airflow/issues/19903#issuecomment-1003874514 I don’t recall any logic checking a function’s content, so this is very surprising. I can reproduce though; it seems like if the function does not have a body, even the _task_

[airflow] branch constraints-main updated: Updating constraints. Build id:1647852428

2022-01-02 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new fc38490 Updating

[GitHub] [airflow] jedcunningham commented on a change in pull request #20578: Use KubernetesHook to create api client in KubernetesPodOperator

2022-01-02 Thread GitBox
jedcunningham commented on a change in pull request #20578: URL: https://github.com/apache/airflow/pull/20578#discussion_r777288232 ## File path: airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py ## @@ -348,15 +351,17 @@ def launcher(self) ->

[GitHub] [airflow] ashb opened a new pull request #18797: Update Kubernetes library version and backport pickle-fix for Loggers

2022-01-02 Thread GitBox
ashb opened a new pull request #18797: URL: https://github.com/apache/airflow/pull/18797 Previously we pinned this version as v12 as a change to Kube library internals meant v1.Pod objects now have a logger object inside them, and couldn't be pickled on Python 3.6. To fix that

[airflow] branch main updated (f668fa7 -> 138f38f)

2022-01-02 Thread uranusjr
This is an automated email from the ASF dual-hosted git repository. uranusjr pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from f668fa7 Generate constraints in PRs when upgrading dependencies (#20624) add 138f38f Fix mypy errors in

[GitHub] [airflow] uranusjr merged pull request #20482: Fix mypy errors in airflow/utils/

2022-01-02 Thread GitBox
uranusjr merged pull request #20482: URL: https://github.com/apache/airflow/pull/20482 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] uranusjr commented on a change in pull request #20625: Fxing MyPy issues inside airflow/providers/qubole

2022-01-02 Thread GitBox
uranusjr commented on a change in pull request #20625: URL: https://github.com/apache/airflow/pull/20625#discussion_r777283387 ## File path: airflow/providers/qubole/operators/qubole.py ## @@ -217,7 +217,7 @@ class QuboleOperator(BaseOperator): 'cluster_label', )

[GitHub] [airflow] auvipy commented on a change in pull request #19703: upgrade celery 5.2.3

2022-01-02 Thread GitBox
auvipy commented on a change in pull request #19703: URL: https://github.com/apache/airflow/pull/19703#discussion_r777275872 ## File path: setup.py ## @@ -227,7 +227,7 @@ def write_version(filename: str = os.path.join(*[my_dir, "airflow", "git_version

[GitHub] [airflow] auvipy commented on pull request #19703: upgrade celery 5.2.3

2022-01-02 Thread GitBox
auvipy commented on pull request #19703: URL: https://github.com/apache/airflow/pull/19703#issuecomment-1003809598 actually it contains several memory leaks/usage issues in amqp & redis & 1 moderate but very old security issue. -- This is an automated message from the Apache Git

[GitHub] [airflow] github-actions[bot] commented on pull request #18670: Don't allow creating users via API unless DB auth type is used

2022-01-02 Thread GitBox
github-actions[bot] commented on pull request #18670: URL: https://github.com/apache/airflow/pull/18670#issuecomment-1003799523 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank

[GitHub] [airflow] github-actions[bot] closed pull request #19536: Fix dynamic queue loss

2022-01-02 Thread GitBox
github-actions[bot] closed pull request #19536: URL: https://github.com/apache/airflow/pull/19536 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] rsg17 commented on a change in pull request #20542: [Part 1]: Add hook for integrating with Google Calendar

2022-01-02 Thread GitBox
rsg17 commented on a change in pull request #20542: URL: https://github.com/apache/airflow/pull/20542#discussion_r777262111 ## File path: airflow/providers/google/suite/hooks/calendar.py ## @@ -0,0 +1,213 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +#

[GitHub] [airflow] khalidmammadov commented on issue #19891: Re-enable MyPy

2022-01-02 Thread GitBox
khalidmammadov commented on issue #19891: URL: https://github.com/apache/airflow/issues/19891#issuecomment-1003788264 @potiuk What's the communities view on [PEP 585](https://www.python.org/dev/peps/pep-0585/)? Looks like there will be another large refactoring needed to remove these type

[GitHub] [airflow] khalidmammadov opened a new pull request #20625: Fxing MyPy issues inside airflow/providers/qubole

2022-01-02 Thread GitBox
khalidmammadov opened a new pull request #20625: URL: https://github.com/apache/airflow/pull/20625 Part of https://github.com/apache/airflow/issues/19891 - Fixed type of a field in a sub-class as super class was changed - Applied `tuple` conversion to adhere to the type of the

[GitHub] [airflow] xiaoxugao commented on issue #16610: Dag Dependency page not showing anything

2022-01-02 Thread GitBox
xiaoxugao commented on issue #16610: URL: https://github.com/apache/airflow/issues/16610#issuecomment-1003784507 Hey, is this issue solved? I still have the same problem as @SamiRehmanNostra . -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] khalidmammadov commented on issue #19891: Re-enable MyPy

2022-01-02 Thread GitBox
khalidmammadov commented on issue #19891: URL: https://github.com/apache/airflow/issues/19891#issuecomment-1003782683 I have started looking into `airflow/providers/qubole`. Please let me know if anyone is looking at it already -- This is an automated message from the Apache Git

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003782233 Could it be the scheduler settings?: ``` # [scheduler] airflow_scheduler_job_heartbeat_sec: 5 airflow_scheduler_clean_tis_without_dagrun_interval: 15.0

[GitHub] [airflow] t4n1o commented on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o commented on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003782233 Could it be one of these settings: ``` # [scheduler] airflow_scheduler_job_heartbeat_sec: 5 airflow_scheduler_clean_tis_without_dagrun_interval: 15.0

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003779286 > 1. Do you actually have scheduler running at all? Does it have coninuous access to the DB? Yes, the scheduler is visible in the running processes, and also

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003779286 > 1. Do you actually have scheduler running at all? Does it have coninuous access to the DB? Yes, the scheduler is visible in the running processes, and also

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003779286 > 1. Do you actually have scheduler running at all? Does it have coninuous access to the DB? Yes, the scheduler is visible in the running processes, and also

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003779286 > 1. Do you actually have scheduler running at all? Does it have coninuous access to the DB? Yes, the scheduler is visible in the running processes, and also

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003779286 > 1. Do you actually have scheduler running at all? Does it have coninuous access to the DB? Yes, the scheduler is visible in the running processes, and also

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003779286 > 1. Do you actually have scheduler running at all? Does it have coninuous access to the DB? Yes, the scheduler is visible in the running processes, and also

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003779286 > 1. Do you actually have scheduler running at all? Does it have coninuous access to the DB? Yes, the scheduler is visible in the running processes, and also

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003779286 > 1. Do you actually have scheduler running at all? Does it have coninuous access to the DB? Yes, the scheduler is visible in the running processes, and also

[GitHub] [airflow] t4n1o commented on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o commented on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003780682 I'm sorry, I didn't intend this to turn into an unpaid debugging session, and it looks like a cosmetic problem more than anything. So I'm comfortable closing this thread if you

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003779286 > 1. Do you actually have scheduler running at all? Does it have coninuous access to the DB? Yes, the scheduler is visible in the running processes, and also

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003779286 > 1. Do you actually have scheduler running at all? Does it have coninuous access to the DB? Yes, the scheduler is visible in the running processes, and also

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003779286 > 1. Do you actually have scheduler running at all? Does it have coninuous access to the DB? Yes, the scheduler is visible in the running processes, and also

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003779286 > 1. Do you actually have scheduler running at all? Does it have coninuous access to the DB? Yes, the scheduler is visible in the running processes, and also

[GitHub] [airflow] t4n1o commented on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o commented on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003779286 > 1. Do you actually have scheduler running at all? Does it have coninuous access to the DB? Yes, the scheduler is visible in the running processes, and also

[GitHub] [airflow] t4n1o commented on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o commented on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003776503 Apache Airflow version| 2.2.3 executor | LocalExecutor

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003776503 ``` Apache Airflow version| 2.2.3 executor | LocalExecutor

[GitHub] [airflow] t4n1o removed a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o removed a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003725072 Here is the code for the two tasks: Python archives mirror: https://gist.github.com/t4n1o/301e492106f54d185d726cc4bd9df1c1 Rust parser:

[GitHub] [airflow] moshederri removed a comment on issue #19903: Error setting dependencies on task_group defined using the decorator

2022-01-02 Thread GitBox
moshederri removed a comment on issue #19903: URL: https://github.com/apache/airflow/issues/19903#issuecomment-1003771492 Quick question about this - i tried changing the content of the function to something other than `pass` or `print` but for some reason i am still getting the same

[GitHub] [airflow] moshederri edited a comment on issue #19903: Error setting dependencies on task_group defined using the decorator

2022-01-02 Thread GitBox
moshederri edited a comment on issue #19903: URL: https://github.com/apache/airflow/issues/19903#issuecomment-1003771492 Quick question about this - i tried changing the content of the function to something other than `pass` or `print` but for some reason i am still getting the same

[GitHub] [airflow] moshederri commented on issue #19903: Error setting dependencies on task_group defined using the decorator

2022-01-02 Thread GitBox
moshederri commented on issue #19903: URL: https://github.com/apache/airflow/issues/19903#issuecomment-1003771492 Quick question about this - i tried changing the content of the function to something other than `pass` or `print` but for some reason i am still getting the same exception

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #20482: Fix mypy errors in airflow/utils/

2022-01-02 Thread GitBox
ephraimbuddy commented on a change in pull request #20482: URL: https://github.com/apache/airflow/pull/20482#discussion_r777248907 ## File path: airflow/utils/context.pyi ## @@ -48,7 +48,7 @@ class VariableAccessor: class ConnectionAccessor: def get(self, key: str,

[GitHub] [airflow] potiuk commented on pull request #19703: upgrde celery 5.2.3

2022-01-02 Thread GitBox
potiuk commented on pull request #19703: URL: https://github.com/apache/airflow/pull/19703#issuecomment-1003763949 That should be enough @auvipy ! Looks good all tests passed. Anyone knows any potential problem involved with it ? When we merge it, we will have to refresh the

[jira] [Commented] (AIRFLOW-4922) If a task crashes, host name is not committed to the database so logs aren't able to be seen in the UI

2022-01-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467689#comment-17467689 ] ASF GitHub Bot commented on AIRFLOW-4922: - derkuci commented on pull request #6722: URL:

[GitHub] [airflow] derkuci commented on pull request #6722: [AIRFLOW-4922]Fix task get log by Web UI

2022-01-02 Thread GitBox
derkuci commented on pull request #6722: URL: https://github.com/apache/airflow/pull/6722#issuecomment-1003763219 @xuemengran nvm. I guess you meant the PR suggested here. I tried that; the log table has changed, and I couldn't match the information easily. The `execution_date` column

[GitHub] [airflow] potiuk commented on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
potiuk commented on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003760088 > I'm not sure how airflow is intended to be used, but sometimes people find other use cases for a tool they haven't designed. > > We run a task that can take a few hours to

[jira] [Commented] (AIRFLOW-4922) If a task crashes, host name is not committed to the database so logs aren't able to be seen in the UI

2022-01-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467682#comment-17467682 ] ASF GitHub Bot commented on AIRFLOW-4922: - derkuci commented on pull request #6722: URL:

[GitHub] [airflow] derkuci commented on pull request #6722: [AIRFLOW-4922]Fix task get log by Web UI

2022-01-02 Thread GitBox
derkuci commented on pull request #6722: URL: https://github.com/apache/airflow/pull/6722#issuecomment-1003754230 > In the 2.1.1 version, I tried to modify the airflow/utils/log/file_task_handler.py file to obtain the hostname information by reading the log table. I confirmed through

[airflow] branch constraints-main updated: Updating constraints. Build id:1646343198

2022-01-02 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new ac63204 Updating

[GitHub] [airflow] t4n1o commented on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o commented on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003725511 What I do find use for in airflow - keeping track of tasks - sending emails when a task fails - running the tasks every day like cron + a nice ui -- This is an automated

[GitHub] [airflow] t4n1o edited a comment on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o edited a comment on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003724797 I'm not sure how airflow is intended to be used, but sometimes people find other use cases for a tool they haven't designed. We run a task that can take a few hours

[GitHub] [airflow] t4n1o commented on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o commented on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003725072 Here is the code for the two tasks: Python archives mirror: https://gist.github.com/t4n1o/301e492106f54d185d726cc4bd9df1c1 Rust parser:

[airflow] branch main updated: Generate constraints in PRs when upgrading dependencies (#20624)

2022-01-02 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new f668fa7 Generate constraints in PRs when

[GitHub] [airflow] t4n1o commented on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o commented on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003724797 I'm not sure how airflow is intended to be useful, but sometimes people find other use cases for a tool they haven't designed. We run a task that can take a few hours to

[GitHub] [airflow] potiuk merged pull request #20624: Generate constraints in PRs when upgrading dependencies

2022-01-02 Thread GitBox
potiuk merged pull request #20624: URL: https://github.com/apache/airflow/pull/20624 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] t4n1o commented on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
t4n1o commented on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003723593 ``` from datetime import timedelta from airflow import DAG from airflow.operators.bash import BashOperator from airflow.utils.dates import days_ago

[airflow] branch constraints-main updated: Updating constraints. Build id:1646047459

2022-01-02 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 341f85e Updating

[GitHub] [airflow] mariotaddeucci commented on issue #20615: Status of testing Providers that were prepared on December 31, 2021

2022-01-02 Thread GitBox
mariotaddeucci commented on issue #20615: URL: https://github.com/apache/airflow/issues/20615#issuecomment-1003714559 #20506 all good o/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] mik-laj closed issue #8715: Documentation about loading packages in Python / Airflow

2022-01-02 Thread GitBox
mik-laj closed issue #8715: URL: https://github.com/apache/airflow/issues/8715 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] auvipy commented on pull request #19703: try celery 5.2.1

2022-01-02 Thread GitBox
auvipy commented on pull request #19703: URL: https://github.com/apache/airflow/pull/19703#issuecomment-1003704625 let me know what else needs to be updated -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[airflow] branch main updated (9265ba3 -> e877e7a)

2022-01-02 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 9265ba3 Update pre-commit hooks (#20623) add e877e7a Fix flaky sensor test (#20617) No new revisions were

[GitHub] [airflow] potiuk merged pull request #20617: Fix flaky sensor test

2022-01-02 Thread GitBox
potiuk merged pull request #20617: URL: https://github.com/apache/airflow/pull/20617 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #20624: Generate constraints in PRs when upgrading dependencies

2022-01-02 Thread GitBox
github-actions[bot] commented on pull request #20624: URL: https://github.com/apache/airflow/pull/20624#issuecomment-1003704212 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[airflow] branch main updated: Update pre-commit hooks (#20623)

2022-01-02 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 9265ba3 Update pre-commit hooks (#20623)

[GitHub] [airflow] mik-laj merged pull request #20623: Update pre-commit hooks

2022-01-02 Thread GitBox
mik-laj merged pull request #20623: URL: https://github.com/apache/airflow/pull/20623 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] saveriogzz commented on issue #20615: Status of testing Providers that were prepared on December 31, 2021

2022-01-02 Thread GitBox
saveriogzz commented on issue #20615: URL: https://github.com/apache/airflow/issues/20615#issuecomment-1003703918 #20164 all good! ✅ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] github-actions[bot] commented on pull request #20617: Fix flaky sensor test

2022-01-02 Thread GitBox
github-actions[bot] commented on pull request #20617: URL: https://github.com/apache/airflow/pull/20617#issuecomment-1003699131 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] potiuk opened a new pull request #20624: Generate constraints in PRs when upgrading dependencies

2022-01-02 Thread GitBox
potiuk opened a new pull request #20624: URL: https://github.com/apache/airflow/pull/20624 The constraints generation was only happening in push/scheduled runs, but sometimes it is useful to check what constraints would be generated even in the PRs that change setup.py/setup.cfg

[GitHub] [airflow] potiuk commented on issue #19192: The scheduler does not appear to be running. Last heartbeat was received X minutes ago.

2022-01-02 Thread GitBox
potiuk commented on issue #19192: URL: https://github.com/apache/airflow/issues/19192#issuecomment-1003697121 I think you are misusing Airlfow. Airlfow by definition can run multiple tasks even with single local executor, so you are likely misunderstanding how airflow operators are run

[GitHub] [airflow] github-actions[bot] commented on pull request #20623: Update pre-commit hooks

2022-01-02 Thread GitBox
github-actions[bot] commented on pull request #20623: URL: https://github.com/apache/airflow/pull/20623#issuecomment-1003696251 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[airflow] branch main updated (567228e -> d823cf7)

2022-01-02 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 567228e Fix empty excludes in selective checks (#20622) add d823cf7 Fix generation of "Status provider" issue

[GitHub] [airflow] mik-laj opened a new pull request #20623: Update pre-commit hooks

2022-01-02 Thread GitBox
mik-laj opened a new pull request #20623: URL: https://github.com/apache/airflow/pull/20623 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

[airflow] branch main updated (f011f66 -> 567228e)

2022-01-02 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from f011f66 Add twine check for provider packages (#20619) add 567228e Fix empty excludes in selective checks

[GitHub] [airflow] potiuk merged pull request #20621: Fix generation of "Status provider" issue

2022-01-02 Thread GitBox
potiuk merged pull request #20621: URL: https://github.com/apache/airflow/pull/20621 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated (5eccb53 -> f011f66)

2022-01-02 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 5eccb53 Fix flaky dask executor test (#20620) add f011f66 Add twine check for provider packages (#20619) No

[GitHub] [airflow] potiuk merged pull request #20622: Fix empty excludes in selective checks

2022-01-02 Thread GitBox
potiuk merged pull request #20622: URL: https://github.com/apache/airflow/pull/20622 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk merged pull request #20619: Add twine check for provider packages

2022-01-02 Thread GitBox
potiuk merged pull request #20619: URL: https://github.com/apache/airflow/pull/20619 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] PApostol commented on issue #20615: Status of testing Providers that were prepared on December 31, 2021

2022-01-02 Thread GitBox
PApostol commented on issue #20615: URL: https://github.com/apache/airflow/issues/20615#issuecomment-1003690469 #19978 addresses the issue and works as expected. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] mik-laj commented on a change in pull request #19508: :bug: (BigQueryHook) fix compatibility with sqlalchemy engine

2022-01-02 Thread GitBox
mik-laj commented on a change in pull request #19508: URL: https://github.com/apache/airflow/pull/19508#discussion_r777188126 ## File path: airflow/providers/google/cloud/hooks/bigquery.py ## @@ -161,6 +161,23 @@ def get_client(self, project_id: Optional[str] = None,

[GitHub] [airflow] mik-laj commented on a change in pull request #19508: :bug: (BigQueryHook) fix compatibility with sqlalchemy engine

2022-01-02 Thread GitBox
mik-laj commented on a change in pull request #19508: URL: https://github.com/apache/airflow/pull/19508#discussion_r777187783 ## File path: airflow/providers/google/cloud/hooks/bigquery.py ## @@ -161,6 +161,23 @@ def get_client(self, project_id: Optional[str] = None,

[GitHub] [airflow] mik-laj commented on a change in pull request #19508: :bug: (BigQueryHook) fix compatibility with sqlalchemy engine

2022-01-02 Thread GitBox
mik-laj commented on a change in pull request #19508: URL: https://github.com/apache/airflow/pull/19508#discussion_r777187653 ## File path: airflow/providers/google/cloud/hooks/bigquery.py ## @@ -161,6 +161,23 @@ def get_client(self, project_id: Optional[str] = None,

[GitHub] [airflow] mik-laj commented on a change in pull request #19508: :bug: (BigQueryHook) fix compatibility with sqlalchemy engine

2022-01-02 Thread GitBox
mik-laj commented on a change in pull request #19508: URL: https://github.com/apache/airflow/pull/19508#discussion_r777187252 ## File path: tests/providers/google/cloud/hooks/test_bigquery.py ## @@ -1837,3 +1840,38 @@ def test_create_external_table_description(self,

[GitHub] [airflow] github-actions[bot] commented on pull request #20619: Add twine check for provider packages

2022-01-02 Thread GitBox
github-actions[bot] commented on pull request #20619: URL: https://github.com/apache/airflow/pull/20619#issuecomment-1003688055 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] github-actions[bot] commented on pull request #20621: Fix generation of "Status provider" issue

2022-01-02 Thread GitBox
github-actions[bot] commented on pull request #20621: URL: https://github.com/apache/airflow/pull/20621#issuecomment-1003687855 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might

[GitHub] [airflow] github-actions[bot] commented on pull request #20622: Fix empty excludes in selective checks

2022-01-02 Thread GitBox
github-actions[bot] commented on pull request #20622: URL: https://github.com/apache/airflow/pull/20622#issuecomment-1003687635 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] potiuk commented on pull request #20622: Fix empty excludes in selective checks

2022-01-02 Thread GitBox
potiuk commented on pull request #20622: URL: https://github.com/apache/airflow/pull/20622#issuecomment-1003686839 Example errors: https://github.com/apache/airflow/actions/runs/1644533214 -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] potiuk opened a new pull request #20622: Fix empty excludes in selective checks

2022-01-02 Thread GitBox
potiuk opened a new pull request #20622: URL: https://github.com/apache/airflow/pull/20622 After removing Python 3.6, some of the excludes have been empty - which caused error when evaluating combinations to run im main or when FULL_TESTS were needed. This PR brings sane