Thanks - left a UX suggestion, but overall I think this looks good and will be quite useful.
On Mon, Mar 24, 2025 at 10:12 AM Jack McCluskey via dev <dev@beam.apache.org> wrote: > Hey everyone, > > I've put together a design doc for a generic remote model handler base > class > <https://docs.google.com/document/d/17A_oHJ7s3ol4TGCUpKeYc6iozkcTwN_e4H_J3kRlgPM/edit?usp=sharing>[1], > trying to abstract away some of the rougher edges of having inference calls > to a remote service in the middle of a pipeline. It's largely based on the > existing Vertex AI model handler that I implemented in Beam roughly two > years ago, so some of the code will look familiar if you've looked at that > class before. There's also a prototype PR > <https://github.com/apache/beam/pull/34379>[2] available with some small > unit tests and documentation. Please take a look and let me know what you > think! > > Thanks, > > Jack McCluskey > > [1] > https://docs.google.com/document/d/17A_oHJ7s3ol4TGCUpKeYc6iozkcTwN_e4H_J3kRlgPM/edit?usp=sharing > > [2] https://github.com/apache/beam/pull/34379 > > -- > > > Jack McCluskey > SWE - DataPLS PLAT/ Dataflow ML > RDU > jrmcclus...@google.com > > >
