Yeah, this shouldn't really be particularly different than any other sort of inference. I'm curious about your use case - would you be willing to share more about what you are using this for? For context, I'm interested in seeing if we can add broader agentic support to Beam, though I'm having a hard time seeing the use cases.
Thanks, Danny On Wed, Apr 2, 2025 at 4:11 AM Sofia’s World <mmistr...@gmail.com> wrote: > Hi all > i was wondering if it is possible to run an Agent on Apache Beam? > i assume it would be same as invoking an llm, as long as > - i dont maintain state > - if i were to use external tools - like custom functions - all these > tools are available in my environment? > > Presumably i can reuse this sample that Radek posted me as part of > another query>? > > > https://github.com/apache/beam/blob/master/examples/notebooks/beam-ml/custom_remote_inference.ipynb > > > Kind regards > Marco > > > > >
