Hi everyone, Currently we don't have a straightforward and documented way to do simple initialization steps on every Beam Python SDK worker before data processing starts. It is a rough edge that I've encountered on several occasions myself and in conversations with Beam users
I put together some thoughts on how we could provide that capability in https://s.apache.org/python_sdk_worker_initialization . Looking forward to your ideas and other feedback on this topic. Thanks, Valentyn