Re: [VOTE] AIP-31: Airflow functional DAG definition

Started to break down some tasks in GitHub, please find them here:  https://github.com/apache/airflow/issues?q=is%3Aissue+AIP-31+ I preferred to fall on the too small issues over the overloaded issues so there are quite a few of them. Some issues are more detailed than others. Any feedback on

Re: [DISCUSS] AIP-31: Airflow functional DAG API

> > We should maybe move this conversation to slack if there’s anything > specific in the AIP that I did not cover. Otherwise, I will submit it for > vote and start breaking down the work in issues (I guess now GitHub > issues?). Yes, now that the Vote has passed, please feel free to start

Re: New committer: Jiajie Zhong

Welcome! On Wed, Apr 1, 2020 at 2:05 PM Tao Feng wrote: > Congrats! > > On Wed, Apr 1, 2020 at 12:56 AM Robin Edwards wrote: > > > Nice one Jiajie :-) > > > > Cheers, > > > > R > > > > On Wed, 1 Apr 2020 at 07:58, Michał Słowikowski > > wrote: > > > > > > Congratulations! > > > > > > Best

Re: New committer: Jiajie Zhong

Congrats! On Wed, Apr 1, 2020 at 12:56 AM Robin Edwards wrote: > Nice one Jiajie :-) > > Cheers, > > R > > On Wed, 1 Apr 2020 at 07:58, Michał Słowikowski > wrote: > > > > Congratulations! > > > > Best regards > > M. > > > > wt., 31 mar 2020, 21:00 użytkownik Xinbin Huang > > napisał: > > > >

Re: how to set CELERY_TASK_RESULT_EXPIRES in Airflow

it's a very old ticket. We have introduced mechanisms that allow for much more flexible configurations. if you need to add only one option in the Celery configuration then you can do it using the option mentioned earlier. On Wed, Apr 1, 2020 at 8:32 PM heng gu wrote: > > thanks for your quick

Re: how to set CELERY_TASK_RESULT_EXPIRES in Airflow

thanks for your quick response.  found it on [AIRFLOW-661] Celery Task Result Expiry - ASF JIRA | | | | [AIRFLOW-661] Celery Task Result Expiry - ASF JIRA | | | It looks like the fix has not been released. On Wednesday, April 1, 2020, 12:28:00 PM EDT, Kamil Breguła wrote:

Re: how to set CELERY_TASK_RESULT_EXPIRES in Airflow

Hello, I am not sure, but please look at this configuration option. This is probably the solution to your problem https://airflow.readthedocs.io/en/latest/configurations-ref.html#celery-config-options Best regards, Kamil On Wed, Apr 1, 2020 at 5:43 PM heng gu wrote: > > I am using Celery

how to set CELERY_TASK_RESULT_EXPIRES in Airflow

I am using Celery Executor with RabbitMQ and PostgreSQL database backend. The  celery_taskmeta table never got automatically cleaned by Airflow. In Celery configuration, you can set  CELERY_TASK_RESULT_EXPIRES, but I cannot find it in airflow.cfg or in other config templates. Does anybody know

Re: New committer: Jiajie Zhong

Nice one Jiajie :-) Cheers, R On Wed, 1 Apr 2020 at 07:58, Michał Słowikowski wrote: > > Congratulations! > > Best regards > M. > > wt., 31 mar 2020, 21:00 użytkownik Xinbin Huang > napisał: > > > Congratulations! > > > > On Tue, Mar 31, 2020, 11:13 AM Felix Uellendall > > wrote: > > > > >

Re: 2nd ONLINE Warsaw Airflow meetup - April 8th on Zoom

Thanks for your explanation Kaxil, I'll also keep that in mind for future events :-) Karolina Rosół Polidea | Project Manager M: +48 606 630 236 <+48606630236> E: karolina.ro...@polidea.com [image: Polidea] Check out our projects!

Re: New committer: Jiajie Zhong

Congratulations! Best regards M. wt., 31 mar 2020, 21:00 użytkownik Xinbin Huang napisał: > Congratulations! > > On Tue, Mar 31, 2020, 11:13 AM Felix Uellendall > wrote: > > > Welcome Jiajie! Congrats! Well deserved! :tada: > > > > Sent from ProtonMail Mobile > > > > On Tue, Mar 31, 2020 at