wjddn279 commented on issue #56641: URL: https://github.com/apache/airflow/issues/56641#issuecomment-3496068097
@alkismavridis I modified the Airflow code to insert the Memray API for memory analysis tracing. Please refer to the [PR](https://github.com/apache/airflow/pull/56821)! Although the PR implements it as a decorator, you can also use it with a with statement around the part you want to trace — it will capture memory usage for everything executed within that scope. If you’re investigating the memory growth of the executor, Memray probably won’t be very helpful. I’ve seen that the root cause of this memory increase lies in shared memory, which can’t be observed through a Memray trace. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
