shahar1 commented on issue #61521: URL: https://github.com/apache/airflow/issues/61521#issuecomment-3866263523
> Hi @shahar1 , > I’m trying to contribute a fix for the Celery worker OOM issue (#61521), but I’m running into some difficulties. > > I cloned the apache/airflow repo, but some files referenced in the issue, like celery_executor_utils.py and supervisor.py, are missing in the main repo. I understand these are part of the Celery provider package, which seems to be separate. > > Could you please advise the best way to contribute? Should I: > > Clone the provider source separately from PyPI? > > Or is there a preferred workflow for making changes to provider code in Airflow? > > I’d like to make a proper PR but want to follow the correct procedure. Thanks for your guidance! Hey there! The file `celery_executor_utils.py` exists in the celery provider https://github.com/apache/airflow/blob/7dbe533a73428cd2ee5f8d09d2b1e1a0cce78759/providers/celery/src/airflow/providers/celery/executors/celery_executor_utils.py The file `supervisor.py` exists in the Task SDK package: https://github.com/apache/airflow/blob/7dbe533a73428cd2ee5f8d09d2b1e1a0cce78759/task-sdk/src/airflow/sdk/execution_time/supervisor.py#L4 Both files are available out of the box when you develop locally with breeze framework (please refer to the docs, they're in dev/breeze/docs), so you don't have install them specifically. I hope that it helps, good luck! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
