Kludex commented on issue #33176: URL: https://github.com/apache/beam/issues/33176#issuecomment-2517310515
This is becoming a great exercise to profile `apache-beam` itself 😅 Now I know how things run... <img width="1482" alt="Screenshot 2024-12-04 at 14 09 02" src="https://github.com/user-attachments/assets/d0a99b9d-df38-465f-b7e7-683a11ab85f0";> I've enabled `logfire.install_auto_tracing("apache_beam", min_duration=0.00001)` to see the above. I'm now trying to find out the best places to add spans to get execution time. I know already that `run_pipeline` and `run_stages` from `PipelineRunner` are good places. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
