arr2036 commented on PR #38355:
URL: https://github.com/apache/beam/pull/38355#issuecomment-4410700890
No problem! This is just the start of the rabbit hole. The crashes only
started showing up under jemalloc... which I switched to after running into a
weird performance degradation where runners use significantly more CPU time
processing the same number of elements. I've still not got to the bottom of
that. Or why it's only hitting my Dataflow jobs... It's bad enough that
someone would've fixed it by now if it happened to every pipeline using the
Python SDK :/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
