Ryan-Nightwish opened a new issue, #822:
URL: https://github.com/apache/flink-agents/issues/822

   ### Search before asking
   
   - [x] I searched in the 
[issues](https://github.com/apache/flink-agents/issues) and found nothing 
similar.
   
   ### Description
   
   Flink Agents already supports parallel LLM invocations via multi-action 
fan-out — an agent action
   can emit multiple `ChatRequestEvent` events, and the framework executes the 
corresponding LLM calls
   concurrently (on JDK 21+ for Java; always for Python). However, none of the 
existing quickstart
   examples or documentation covers this capability.
   
   **Proposed changes:**
   
   1. **New quickstart doc** 
(`docs/content/docs/get-started/quickstart/parallel_llm.md`) — walks
      through a "Parallel Sentiment Analysis" example end-to-end: environment 
setup, agent design,
      Flink integration, and deployment instructions. Includes both Python and 
Java tabs.
   
   2. **New Java example**
      - `examples/.../ParallelChatRequestExample.java` — entry point
      - `examples/.../agents/ParallelChatAgent.java` — agent that fans out 
three sentiment-dimension
        `ChatRequestEvent` events in parallel, collects responses, and 
aggregates with a final LLM call
   
   3. **New Python example**
      - `python/.../parallel_chat_request_example.py` — entry point
      - `python/.../agents/parallel_chat_agent.py` — Python equivalent of the 
Java agent
   
   ### Are you willing to submit a PR?
   
   - [x] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to