Hey everyone, I've put together a design doc for a generic remote model handler base class <https://docs.google.com/document/d/17A_oHJ7s3ol4TGCUpKeYc6iozkcTwN_e4H_J3kRlgPM/edit?usp=sharing>[1], trying to abstract away some of the rougher edges of having inference calls to a remote service in the middle of a pipeline. It's largely based on the existing Vertex AI model handler that I implemented in Beam roughly two years ago, so some of the code will look familiar if you've looked at that class before. There's also a prototype PR <https://github.com/apache/beam/pull/34379>[2] available with some small unit tests and documentation. Please take a look and let me know what you think!
Thanks, Jack McCluskey [1] https://docs.google.com/document/d/17A_oHJ7s3ol4TGCUpKeYc6iozkcTwN_e4H_J3kRlgPM/edit?usp=sharing [2] https://github.com/apache/beam/pull/34379 -- Jack McCluskey SWE - DataPLS PLAT/ Dataflow ML RDU jrmcclus...@google.com
