Hi, beam dev community, After seeing some difficulties in troubleshooting python pipelines in Dataflow, we came up with an idea to expose sdk harness status to runners through Fn API for better debuggability.
I put up a doc describing the background and proposed approach: https://docs.google.com/document/d/1W77buQtdSEIPUKd9zemAM38fb-x3CvOoaTF4P2mSxmI/edit?usp=sharing Feedbacks are very much appreciated. Thanks, Yichi