Re: Retiring Airflow Gitter?

I'm in favor of (yet another) slack. It will probably improve community growth and development, not just support searchable answers. I think nonprofits have an easy time getting permanent message retention for free but that would be an issue if that was not possible for Airflow. The default free

Re: Getting Task Killed Externally

hitting caps, but on our side, there are hardly any > concurrent tasks, rarely 1-2 at a time with parallelism set to 50. But > yeah, we'll just increase the parallelism and and see if that solves the > problem too. > > Thanks, > Vardan Gupta > > On Tue, Aug 28, 2018 at 11:

Re: Getting Task Killed Externally

Hi Vardan, We had this issue - I recommend increasing the parallelism config variable to something like 128 or 512. I have no idea what side effects this could have. So far, none. This happened to us with LocalExecutor and our monitoring showed a clear issue with hitting a cap on number of

Use 'watch' feature of Github instead of this list?

Hi All, Is it possible that people who want to see a notification for every issue can subscribe to notifications using the 'watch' feature of GitHub rather than mirroring each notification on this list through GitBox? Thanks! Best, Trent Robbins Strategic Consultant for Open Source Software

Re: Is `airflow backfill` disfunctional?

I had a similar experience but don't remember the details - it was necessary to delete all dag runs and tasks for items you wanted to backfill. We probably could have dropped those database rows but did not try. This was primarily for when there were connection issues or input files missing that

Re: Rerunning task without cleaning DB?

than dropping the database by far. Best, Trent Robbins Strategic Consultant for Open Source Software Tau Informatics LLC desk: 415-404-9452 cell: 513-233-5651 tr...@tauinformatics.com https://www.linkedin.com/in/trentrobbins On Wed, Feb 7, 2018 at 2:57 PM, Ananth Durai <vanant...@gmail.

Re: About multi user support in airflow

Hi Song, I would recommend using airflow in docker with individual databases for individual contributors. Does this make sense for your needs? There are other similar concepts that could also be used. I don't think there is another way to split DAGs by user permission. However, this feature

Re: Airflow thshirts

he link didn't work either. I'll do a second try > soon > > > and add a feather! > > > > > > Max > > > > > > On Wed, Jan 24, 2018 at 11:45 PM, Sid Anand <san...@apache.org> wrote: > > > > > >> I couldn't agree more.. > > >>

Re: Airflow thshirts

Thanks Max! Trent Best, Trent Robbins Strategic Consultant for Open Source Software Tau Informatics LLC desk: 415-404-9452 cell: 513-233-5651 tr...@tauinformatics.com https://www.linkedin.com/in/trentrobbins On Wed, Jan 24, 2018 at 1:59 PM, Maxime Beauchemin < maximebeauche...@gmail.