Hello Danny sure.. i currently have few 'standard' dataflows sourcing financial data from the internet and 'doing something about it'
i then got hooked on langchain, and thought about writing a simple Agent to fetching similar information, rather than me fetching the data and do somoe analysis the same data ( https://github.com/mmistroni/Magentic-AlgoTrading101/blob/main/six_step_dance.ipynb - WIP) Then i thought, why dont i have the Agent run on its own and 'do some work for me'..rather than a chat interaction or a notebook run.... so i thought why not put it on Dataflow - if it can be done - , run overnight and 'do things for me'. I can just pass a message at runtime as input to my job to invoke the Agent .. Simple usecases i can think of - status of Financial Markets - status of Transport network - grocery prices / petrol prices / supermarket prices - scan for holiday/ flights - weather forecasts or basically, any recurring task that i would do on daily/.weekly / monthly basis Mayb it's overkill...... but i am not a big fan of user interactions.... Kind regards marco On Wed, Apr 2, 2025 at 2:48 PM Danny McCormick via user < user@beam.apache.org> wrote: > Yeah, this shouldn't really be particularly different than any other sort > of inference. I'm curious about your use case - would you be willing to > share more about what you are using this for? For context, I'm interested > in seeing if we can add broader agentic support to Beam, though I'm having > a hard time seeing the use cases. > > Thanks, > Danny > > On Wed, Apr 2, 2025 at 4:11 AM Sofia’s World <mmistr...@gmail.com> wrote: > >> Hi all >> i was wondering if it is possible to run an Agent on Apache Beam? >> i assume it would be same as invoking an llm, as long as >> - i dont maintain state >> - if i were to use external tools - like custom functions - all these >> tools are available in my environment? >> >> Presumably i can reuse this sample that Radek posted me as part of >> another query>? >> >> >> https://github.com/apache/beam/blob/master/examples/notebooks/beam-ml/custom_remote_inference.ipynb >> >> >> Kind regards >> Marco >> >> >> >> >>