o-nikolas commented on PR #53396: URL: https://github.com/apache/airflow/pull/53396#issuecomment-3079593003
> > If we see any further scaling issues in the future we can revisit this with a more complex solution. > > Since this is experimental feature I suggest to share this known/possible limitation at the end of the lambda executor doc - we should encourage users to be aware of the limitations and report back to us their findings so it would be easier to decide when/what needs to be changed to announce the executor as stable. Ideally, this is something we should have for any experimental feature I think I'd like to push back on this a little bit. After this fix I am not sure there really is a scaling issue present still. So I'm 1) not sure exactly what I would document and 2) whatever I put on the documentation will absolutely be taken as truth and gospel and quoted until the end of time. I really would like to not start a "rumor" of sorts. If we start getting some users on board and we get tickets complaining of a persistent issue I will then either fix it or for sure document that in the future, once we know something concretely. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
