On Fri, Oct 23, 2026 at 6:52 PM Andrew Lamb <[email protected]> wrote:
> (also adding dev@datafusion as they are affected as well) > > The reason I am nudging is that for the last several days, contributors in > arrow-rs and datafusion are waiting 3-7 hours for CI jobs to start. I have > heard frustration from many community members. This seems to have > gotten much worse in the last week. While waiting for jobs to start, I > started investigating what projects were using the runners that our jobs > were waiting behind (the script I use is attached to issue [2]) which lead > me to Airflow. I am sorry if it seems I am singling that project out but it > seems to be using significantly more than the next largest project I can > find. > As I explained you several times. We are well aware of it, and as I told you - we are working on it. I explained and showed you the several weeks of discussions we had on it anticipating it, and all the work I have done convincing our PMC members that we need to invest in it. Continuous nudging - with automated scripts (WTF!!!) is one of many ways to get the other PMC members more touchy and angry. We were not only proactive and receptive, acknowledging the issue weeks ago, but we also provided you with all the information, including the plan we had already developed over several weeks to make it happen and confirmed we are working on it—this includes Shahar's dedication to working over his weekend to achieve it. Yes, it's Friday, yes he is in Israel, and yes, you knew all that. Yet you still decided to nudge people with automated (!) script. It's happening. It's progressing. If all you can do is write a nudgy script then my answer is "get lost." You are not helping with that; you are making things worse. I honestly now have a great urge to just stop working—it's Friday evening for me and I also work way past my hours to help. I could go to a party now. I am actually thinking about cancelling my morning running local community event to improve things. But seeing that some people think that doing an automated nudge will make their ego boosted and say "I made it happen" eventually. It's wrong. Not helping. Stop it please. Many projects are running their own workflows - and each of the project should impleement optimizations to make things happen. I spent my time, skills (literally) in Magpie and experience on workflow optimization to propose a 30% - 40% improvement (see above) - that will help everyone, and we can share that experience with others so they can use a similar approach. So my question is - which you did not answer - what YOU are doing to help projects like Arrow that use a lot of resources (for a good reason of course; Arrow is a friendly project and many of my friends are here). You are part of Arrow as well Andrew? Can you help develop those optimizations maybe for Airflow? I gave an easy recipe to follow. I know writing nudging scripts is easier and you can take credit for "fixing things" because you nudged people who absolutely do not need it. But my proposal is that we all roll up our sleeves and, rather than pointing at others (who are already working night and day and complicating their workflows enormously to get the 80% savings), we fix things in our own garden first. I would really love that, Andrew. Love and peace - I mean no harm, it's just pretty annoying behaviour. J.
